2024-09-12T17:48:05.242 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:48:05.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:48:05.351 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: bhubbard@redhat.com first_in_suite: false job_id: '7901157' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 46406987da2067f022005d68ecbb989daaabb837 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 46406987da2067f022005d68ecbb989daaabb837 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a owner: scheduled_bhubbard@teuthology priority: 150 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 245 sha1: 46406987da2067f022005d68ecbb989daaabb837 sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0qLj256Y9aqB0tTKvNVU3+jd65cakJk4titvP5JiLYjSJjzErDTKlI+IQ8S3k7Ck5ArTLxj1CNyIvriWfu/rE= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcbfekUAiNhtPoZugW4zDUBwE1XZfLvYpmrgZeT/ccw6aeKT0K6VhaM5QIXBq2b/7HeuvUdvTF5TvQbujg3jSo= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFSx+iIAb3XNMw2q40fzbdwquZzrCwsGnsDHIu4JgMgOwvzplNhUj+NT9i7fXxBjuXsPwBatMxzJHzeJ+gI0Sg= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQ5fI2FEdhrbPqV1fUDZ4Zf4qhz82M7btj9NEhn7yEO2lU5aj0r3R9Uzl8RYGoLcmpYPK8AaOBXEK3HgQQQUM0= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_02:37:30 tube: smithi user: bhubbard verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:48:05.352 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa; will attempt to use it 2024-09-12T17:48:05.353 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa/tasks 2024-09-12T17:48:05.353 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:48:05.354 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:48:05.376 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '46406987da2067f022005d68ecbb989daaabb837' 2024-09-12T17:48:05.376 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:48:05.376 INFO:teuthology.packaging:ref: None 2024-09-12T17:48:05.376 INFO:teuthology.packaging:tag: None 2024-09-12T17:48:05.376 INFO:teuthology.packaging:branch: main 2024-09-12T17:48:05.376 INFO:teuthology.packaging:sha1: 46406987da2067f022005d68ecbb989daaabb837 2024-09-12T17:48:05.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-12T17:48:05.580 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4881-ge5d6b434-1jammy 2024-09-12T17:48:05.582 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:48:05.588 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:48:05.588 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:48:05.643 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:48:05.662 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:48:05.670 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:48:05.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:42:00.764832', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICGEaS+at2LWh4x32S7cjHn9iB1qRlDAMzoBWb/jclOR'} 2024-09-12T17:48:05.720 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:42:00.763377', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDJ+2Zgl/wPqh5Vl4G1BG/hlQsMxuxpgZ2Lh1fL8qYTX'} 2024-09-12T17:48:05.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:42:00.766199', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIFYOIv2rshObDX2T2n6L39qBRd5hEcJSt1BsRyEmtD3'} 2024-09-12T17:48:05.767 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:42:00.761815', 'locked_by': 'scheduled_bhubbard@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIFshtNyktzICYfNgDE2uhnL++6ktldHSSCLzXF63bWf'} 2024-09-12T17:48:05.767 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:48:05.774 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-12T17:48:05.774 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['osd.0'] 2024-09-12T17:48:05.774 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['osd.1'] 2024-09-12T17:48:05.774 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['osd.2'] 2024-09-12T17:48:05.774 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:48:05.887 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7febdcecee60>, signals=[15]) 2024-09-12T17:48:05.888 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:48:05.894 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:48:05.894 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-12T17:48:05.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:48:05.981 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T17:48:05.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:48:06.061 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T17:48:06.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:48:06.144 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T17:48:06.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:48:06.225 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:48:06.231 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-12T17:48:06.237 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-12T17:48:06.237 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-12T17:48:06.285 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:48:06.285 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2024-09-12T17:48:06.285 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="22.04" 2024-09-12T17:48:06.285 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:48:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=jammy 2024-09-12T17:48:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2024-09-12T17:48:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2024-09-12T17:48:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:48:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:48:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:48:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:48:06.286 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:48:06.287 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-12T17:48:06.311 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-09-12T17:48:06.317 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-09-12T17:48:06.318 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:48:06.363 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:48:06.364 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:48:06.364 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-09-12T17:48:06.386 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-09-12T17:48:06.391 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-09-12T17:48:06.391 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-09-12T17:48:06.437 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:48:06.437 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu" 2024-09-12T17:48:06.437 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04" 2024-09-12T17:48:06.437 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:48:06.437 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy 2024-09-12T17:48:06.437 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu 2024-09-12T17:48:06.437 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian 2024-09-12T17:48:06.438 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:48:06.438 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:48:06.438 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:48:06.438 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:48:06.438 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:48:06.438 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-09-12T17:48:06.461 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-12T17:48:06.467 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-12T17:48:06.467 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-12T17:48:06.513 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:48:06.513 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2024-09-12T17:48:06.513 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2024-09-12T17:48:06.513 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:48:06.513 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2024-09-12T17:48:06.514 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2024-09-12T17:48:06.514 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2024-09-12T17:48:06.514 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:48:06.514 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:48:06.514 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:48:06.514 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:48:06.514 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:48:06.514 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-12T17:48:06.536 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:48:06.544 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:48:06.549 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:48:06.549 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:48:06.551 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:48:06.553 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:48:06.558 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:48:06.563 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:48:06.570 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:48:06.570 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:48:06.602 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:48:06.605 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:48:06.608 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:48:06.621 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:48:06.710 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:48:06.724 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:48:06.725 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:48:06.725 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:48:06.725 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:48:06.726 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:48:06.726 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:48:06.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:48:06.731 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-12T17:48:06.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:48:06.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:48:06.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:48:06.734 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-12T17:48:06.734 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-12T17:48:06.735 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-12T17:48:06.777 INFO:teuthology.orchestra.run.smithi121.stdout:5.15.0-56-generic 2024-09-12T17:48:06.778 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.15.0-56-generic 2024-09-12T17:48:06.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get clean 2024-09-12T17:48:06.783 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-56-generic 2024-09-12T17:48:06.783 INFO:teuthology.orchestra.run.smithi052.stdout:5.15.0-56-generic 2024-09-12T17:48:06.783 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.15.0-56-generic 2024-09-12T17:48:06.783 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-12T17:48:06.784 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.15.0-56-generic 2024-09-12T17:48:06.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2024-09-12T17:48:06.785 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-56-generic 2024-09-12T17:48:06.786 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.15.0-56-generic 2024-09-12T17:48:06.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-09-12T17:48:06.896 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-09-12T17:48:06.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-12T17:48:06.925 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-09-12T17:48:06.928 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-12T17:48:07.040 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:48:07.067 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:48:07.073 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:48:07.075 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:48:07.082 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:48:07.146 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:48:07.148 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:48:07.172 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:48:07.178 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:48:07.184 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:48:07.211 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:48:07.211 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:48:07.260 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:48:07.276 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:48:07.288 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:48:07.309 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:48:07.329 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:48:07.363 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:48:07.397 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:48:07.402 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:48:07.405 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:48:07.408 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:48:07.411 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:48:07.411 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:48:07.411 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:48:07.412 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:48:07.412 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:48:07.429 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:48:07.433 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:48:07.433 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:48:07.433 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:48:07.435 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:48:07.436 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:48:07.436 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:48:07.438 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:48:07.444 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:48:07.444 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:48:07.447 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:48:07.449 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:48:07.449 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:48:07.449 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:48:07.449 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:48:07.450 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:48:07.453 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:48:07.456 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:48:07.456 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:48:07.457 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:48:07.461 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:48:07.462 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:48:07.463 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:48:07.463 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:48:07.463 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:48:07.469 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:48:07.471 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:48:07.471 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:48:07.472 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:48:07.478 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:48:07.478 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:48:07.479 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:48:07.479 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:48:07.480 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:48:07.480 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:48:07.480 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:48:07.480 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:48:07.496 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:48:07.497 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:48:07.515 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:48:07.516 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:48:07.516 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:48:07.516 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:48:07.518 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:48:07.518 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:48:07.518 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:48:07.518 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:48:07.532 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:48:07.534 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:48:07.534 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:48:07.550 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:48:07.615 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:48:07.629 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:48:07.630 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:48:07.653 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:48:07.670 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:48:07.754 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:48:07.768 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:48:07.912 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:48:07.954 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:48:08.068 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:48:08.083 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:48:08.083 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:48:08.086 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:48:08.095 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:48:08.096 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:48:08.102 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:48:08.104 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:48:08.111 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:48:08.111 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:48:08.119 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:48:08.119 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:48:08.119 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:48:08.126 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:48:08.134 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:48:08.134 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:48:08.139 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:48:08.140 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:48:08.141 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:48:08.181 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:48:08.182 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:48:08.189 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:48:08.189 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:48:08.190 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:48:08.190 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:48:08.203 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:48:08.204 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:48:08.204 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:48:08.208 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:48:08.209 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:48:08.220 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:48:08.226 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:48:08.226 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:48:08.234 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:48:08.234 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:48:08.242 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:48:08.244 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:48:08.244 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:48:08.245 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:48:08.247 INFO:teuthology.orchestra.run.smithi121.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:48:08.247 INFO:teuthology.orchestra.run.smithi121.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:48:08.255 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:48:08.256 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:48:08.261 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:48:08.262 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:48:08.262 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:48:08.264 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:48:08.270 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:48:08.273 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:48:08.273 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:48:08.274 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:48:08.280 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:48:08.286 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:48:08.289 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:48:08.291 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:48:08.292 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:48:08.292 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:48:08.313 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:48:08.314 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:48:08.314 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:48:08.315 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:48:08.317 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:48:08.328 INFO:teuthology.orchestra.run.smithi121.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:48:08.328 INFO:teuthology.orchestra.run.smithi121.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:48:08.349 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:48:08.350 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:48:08.363 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:48:08.372 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:48:08.381 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:48:08.394 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:48:08.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:48:08.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:48:08.396 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:48:08.397 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:48:08.424 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:48:08.461 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:48:08.483 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:48:08.501 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:48:08.518 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:48:08.537 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:48:08.554 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:48:08.572 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:48:08.590 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:48:08.609 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:48:08.627 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:48:08.708 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:48:08.726 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:48:08.744 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:48:08.761 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:48:13.670 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 15.8 MB in 2s (7,502 kB/s) 2024-09-12T17:48:13.680 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 15.8 MB in 2s (7,285 kB/s) 2024-09-12T17:48:14.107 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 15.8 MB in 2s (7,040 kB/s) 2024-09-12T17:48:14.271 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 15.8 MB in 3s (5,775 kB/s) 2024-09-12T17:48:15.033 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T17:48:15.051 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:48:15.113 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T17:48:15.142 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T17:48:15.160 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:48:15.212 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T17:48:15.323 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-09-12T17:48:15.323 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-09-12T17:48:15.396 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T17:48:15.397 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T17:48:15.497 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:48:15.497 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:48:15.497 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:48:15.498 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:48:15.498 INFO:teuthology.orchestra.run.smithi121.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:48:15.498 INFO:teuthology.orchestra.run.smithi121.stdout: python2.7-minimal 2024-09-12T17:48:15.498 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:48:15.499 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-09-12T17:48:15.499 INFO:teuthology.orchestra.run.smithi121.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:48:15.499 INFO:teuthology.orchestra.run.smithi121.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:48:15.500 INFO:teuthology.orchestra.run.smithi121.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:48:15.501 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-09-12T17:48:15.501 INFO:teuthology.orchestra.run.smithi121.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:48:15.501 INFO:teuthology.orchestra.run.smithi121.stdout:Recommended packages: 2024-09-12T17:48:15.501 INFO:teuthology.orchestra.run.smithi121.stdout: thermald 2024-09-12T17:48:15.520 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-12T17:48:15.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:48:15.545 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-09-12T17:48:15.545 INFO:teuthology.orchestra.run.smithi121.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:48:15.545 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:48:15.545 INFO:teuthology.orchestra.run.smithi121.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:48:15.545 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages will be upgraded: 2024-09-12T17:48:15.545 INFO:teuthology.orchestra.run.smithi121.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:48:15.562 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:48:15.562 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:48:15.563 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:48:15.563 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:48:15.563 INFO:teuthology.orchestra.run.smithi111.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:48:15.563 INFO:teuthology.orchestra.run.smithi111.stdout: python2.7-minimal 2024-09-12T17:48:15.563 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:48:15.564 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-09-12T17:48:15.565 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:48:15.565 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:48:15.565 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:48:15.566 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-09-12T17:48:15.566 INFO:teuthology.orchestra.run.smithi111.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:48:15.566 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-09-12T17:48:15.566 INFO:teuthology.orchestra.run.smithi111.stdout: thermald 2024-09-12T17:48:15.604 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-12T17:48:15.612 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-09-12T17:48:15.612 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:48:15.612 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:48:15.613 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:48:15.613 INFO:teuthology.orchestra.run.smithi121.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:48:15.613 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 113 MB of archives. 2024-09-12T17:48:15.614 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:48:15.614 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:48:15.614 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-09-12T17:48:15.614 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:48:15.620 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T17:48:15.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:48:15.701 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T17:48:15.793 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:48:15.794 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 113 MB of archives. 2024-09-12T17:48:15.794 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:48:15.794 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:48:15.817 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-12T17:48:15.817 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-12T17:48:15.909 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-12T17:48:15.909 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-12T17:48:16.012 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:48:16.012 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:48:16.012 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:48:16.012 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:48:16.012 INFO:teuthology.orchestra.run.smithi052.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:48:16.013 INFO:teuthology.orchestra.run.smithi052.stdout: python2.7-minimal 2024-09-12T17:48:16.013 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:48:16.014 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-09-12T17:48:16.014 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:48:16.014 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:48:16.015 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:48:16.016 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-09-12T17:48:16.017 INFO:teuthology.orchestra.run.smithi052.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:48:16.017 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2024-09-12T17:48:16.017 INFO:teuthology.orchestra.run.smithi052.stdout: thermald 2024-09-12T17:48:16.046 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:48:16.062 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-09-12T17:48:16.062 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:48:16.062 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:48:16.062 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:48:16.064 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2024-09-12T17:48:16.065 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:48:16.085 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:48:16.086 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:48:16.086 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:48:16.086 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:48:16.086 INFO:teuthology.orchestra.run.smithi153.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:48:16.086 INFO:teuthology.orchestra.run.smithi153.stdout: python2.7-minimal 2024-09-12T17:48:16.087 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:48:16.088 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-12T17:48:16.088 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:48:16.088 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:48:16.088 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:48:16.089 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-12T17:48:16.089 INFO:teuthology.orchestra.run.smithi153.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:48:16.090 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-12T17:48:16.090 INFO:teuthology.orchestra.run.smithi153.stdout: thermald 2024-09-12T17:48:16.130 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-12T17:48:16.131 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:48:16.131 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:48:16.131 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:48:16.132 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-12T17:48:16.133 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:48:16.161 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:48:16.184 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:48:16.184 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 113 MB of archives. 2024-09-12T17:48:16.185 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:48:16.185 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:48:16.245 INFO:teuthology.orchestra.run.smithi052.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:48:16.245 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 113 MB of archives. 2024-09-12T17:48:16.245 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:48:16.245 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:48:16.935 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:48:16.935 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:48:16.935 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:48:16.952 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:48:17.052 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:48:17.071 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:48:17.154 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:48:17.185 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:48:17.535 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 113 MB in 2s (70.7 MB/s) 2024-09-12T17:48:17.595 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:48:17.659 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:48:17.716 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:48:17.891 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:48:17.891 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:48:17.891 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:48:18.017 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:48:18.029 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:48:18.050 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:48:18.487 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 113 MB in 2s (57.0 MB/s) 2024-09-12T17:48:18.652 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:48:19.706 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:48:19.706 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:48:19.707 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:48:19.728 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:48:19.732 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:19.821 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:20.050 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:48:20.133 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:48:20.252 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:48:20.252 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:48:20.253 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:48:20.531 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 113 MB in 5s (25.1 MB/s) 2024-09-12T17:48:20.593 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:48:20.623 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:48:20.627 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:20.673 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:48:20.700 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:48:20.716 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:21.112 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2024-09-12T17:48:21.292 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:48:21.930 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:48:21.951 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:22.030 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:22.517 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:48:22.537 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:22.575 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:22.833 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:48:22.837 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:22.917 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:48:22.938 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:23.023 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:23.173 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:23.227 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:48:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:23.298 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:23.462 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:48:23.482 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:23.520 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:25.374 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:48:25.382 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:48:25.387 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:25.403 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:25.475 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:25.489 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:25.953 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:48:25.969 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:48:25.973 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:25.989 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:26.010 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:26.044 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:29.400 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:29.511 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:29.851 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:29.972 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:30.320 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:48:30.339 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:48:30.383 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:48:30.437 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:30.566 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:30.881 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:30.978 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:31.264 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:48:31.287 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:48:31.330 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:48:32.855 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:32.956 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:33.337 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:33.343 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:33.464 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:33.477 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:33.789 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:33.796 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:48:33.819 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:48:33.855 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:48:33.885 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:34.188 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:48:34.210 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:48:34.254 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:48:36.289 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:48:36.326 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:36.364 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:37.205 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:48:37.242 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:37.280 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:39.102 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:39.216 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:39.552 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:48:39.670 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:39.816 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:48:39.914 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:48:39.922 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:39.936 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:39.952 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:39.989 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:40.065 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:40.104 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:48:40.140 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:48:40.178 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:40.398 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:48:40.519 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:40.645 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:48:40.799 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:41.257 INFO:teuthology.orchestra.run.smithi121.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:48:41.257 INFO:teuthology.orchestra.run.smithi121.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:48:41.258 INFO:teuthology.orchestra.run.smithi121.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:48:41.258 INFO:teuthology.orchestra.run.smithi121.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:48:41.421 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:42.116 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:48:42.117 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:48:42.117 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:48:42.117 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:48:42.285 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:43.481 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:43.580 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:43.701 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:43.912 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:43.926 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:48:44.043 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:48:44.057 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:48:44.139 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:44.257 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:48:44.394 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:44.415 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:48:44.537 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:44.663 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:48:44.818 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:44.874 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:48:44.983 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:48:45.093 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:45.163 INFO:teuthology.orchestra.run.smithi121.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:48:45.163 INFO:teuthology.orchestra.run.smithi121.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:48:45.321 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:48:45.447 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:48:45.573 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:45.631 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:48:45.632 INFO:teuthology.orchestra.run.smithi153.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:48:45.763 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:48:45.763 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:48:45.763 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:48:45.764 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:48:45.931 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:46.107 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:48:46.107 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:48:46.107 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:48:46.107 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:48:46.303 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:47.332 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:47.687 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:49.509 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:48:49.634 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:48:49.761 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:49.825 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:48:49.825 INFO:teuthology.orchestra.run.smithi052.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:48:49.872 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:48:49.990 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:48:50.100 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:48:50.161 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:48:50.161 INFO:teuthology.orchestra.run.smithi111.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:48:59.751 INFO:teuthology.orchestra.run.smithi121.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:48:59.751 INFO:teuthology.orchestra.run.smithi121.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:48:59.770 INFO:teuthology.orchestra.run.smithi121.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:48:59.793 INFO:teuthology.orchestra.run.smithi121.stdout:Generating grub configuration file ... 2024-09-12T17:49:00.037 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:49:00.068 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:49:00.230 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:49:00.231 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:49:00.258 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:49:00.283 INFO:teuthology.orchestra.run.smithi153.stdout:Generating grub configuration file ... 2024-09-12T17:49:00.410 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:49:00.415 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:49:00.492 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:49:00.498 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:49:00.556 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:49:00.578 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:49:00.656 INFO:teuthology.orchestra.run.smithi121.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:49:00.656 INFO:teuthology.orchestra.run.smithi121.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:49:00.657 INFO:teuthology.orchestra.run.smithi121.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:49:00.701 INFO:teuthology.orchestra.run.smithi121.stdout:done 2024-09-12T17:49:00.878 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:49:00.884 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:49:00.963 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:49:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:49:01.152 INFO:teuthology.orchestra.run.smithi153.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:49:01.152 INFO:teuthology.orchestra.run.smithi153.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:49:01.152 INFO:teuthology.orchestra.run.smithi153.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:49:01.186 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-09-12T17:49:01.204 DEBUG:teuthology.orchestra.run.smithi121:> dpkg -s linux-image-generic 2024-09-12T17:49:01.220 INFO:teuthology.orchestra.run.smithi121.stdout:Package: linux-image-generic 2024-09-12T17:49:01.220 INFO:teuthology.orchestra.run.smithi121.stdout:Status: install ok installed 2024-09-12T17:49:01.220 INFO:teuthology.orchestra.run.smithi121.stdout:Priority: optional 2024-09-12T17:49:01.220 INFO:teuthology.orchestra.run.smithi121.stdout:Section: kernel 2024-09-12T17:49:01.220 INFO:teuthology.orchestra.run.smithi121.stdout:Installed-Size: 21 2024-09-12T17:49:01.220 INFO:teuthology.orchestra.run.smithi121.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:49:01.220 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: amd64 2024-09-12T17:49:01.220 INFO:teuthology.orchestra.run.smithi121.stdout:Source: linux-meta 2024-09-12T17:49:01.221 INFO:teuthology.orchestra.run.smithi121.stdout:Version: 5.15.0.119.119 2024-09-12T17:49:01.221 INFO:teuthology.orchestra.run.smithi121.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:49:01.221 INFO:teuthology.orchestra.run.smithi121.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:49:01.221 INFO:teuthology.orchestra.run.smithi121.stdout:Recommends: thermald 2024-09-12T17:49:01.221 INFO:teuthology.orchestra.run.smithi121.stdout:Description: Generic Linux kernel image 2024-09-12T17:49:01.221 INFO:teuthology.orchestra.run.smithi121.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:49:01.221 INFO:teuthology.orchestra.run.smithi121.stdout: available. 2024-09-12T17:49:01.221 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:49:01.221 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:49:01.221 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:49:01.222 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-12T17:49:01.222 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:49:01.222 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get clean 2024-09-12T17:49:01.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-09-12T17:49:01.550 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:49:01.550 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:49:01.560 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:49:01.578 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:49:01.681 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.119.119 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:49:01.697 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:49:01.698 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-12T17:49:01.698 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-12T17:49:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:49:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-12T17:49:01.698 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:49:01.698 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:49:01.698 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:49:01.698 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-12T17:49:01.698 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:49:01.699 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-12T17:49:01.841 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-12T17:49:01.947 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:49:02.071 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:49:02.154 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:49:02.234 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:49:02.896 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T17:49:02.915 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:49:02.977 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T17:49:03.186 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-09-12T17:49:03.187 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-09-12T17:49:03.363 INFO:teuthology.orchestra.run.smithi121.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:49:03.363 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:49:03.363 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:49:03.363 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:49:03.363 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:49:03.364 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:49:03.364 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:49:03.364 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:49:03.403 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T17:49:03.404 INFO:teuthology.orchestra.run.smithi121.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:49:03.406 DEBUG:teuthology.orchestra.run.smithi121:> dpkg -s linux-image-generic 2024-09-12T17:49:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:Package: linux-image-generic 2024-09-12T17:49:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:Status: install ok installed 2024-09-12T17:49:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:Priority: optional 2024-09-12T17:49:03.418 INFO:teuthology.orchestra.run.smithi121.stdout:Section: kernel 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Installed-Size: 21 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: amd64 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Source: linux-meta 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Version: 5.15.0.119.119 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Recommends: thermald 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout:Description: Generic Linux kernel image 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:49:03.419 INFO:teuthology.orchestra.run.smithi121.stdout: available. 2024-09-12T17:49:03.420 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-12T17:49:03.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:49:03.468 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.Qi8n65jvCm 2024-09-12T17:49:03.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Qi8n65jvCm 2024-09-12T17:49:03.484 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T17:49:03.524 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.Qi8n65jvCm 2024-09-12T17:49:03.639 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.Qi8n65jvCm is 10KB 2024-09-12T17:49:03.651 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.Qi8n65jvCm 2024-09-12T17:49:03.656 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:49:03.700 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-12T17:49:03.700 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-12T17:49:03.712 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T17:49:03.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:49:03.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:49:03.780 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:49:03.780 DEBUG:teuthology.orchestra.run.smithi121:> sudo update-grub 2024-09-12T17:49:03.875 INFO:teuthology.orchestra.run.smithi153.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:49:03.876 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:49:03.876 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:49:03.876 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:49:03.876 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:49:03.876 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:49:03.877 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:49:03.877 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:49:03.916 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:49:03.918 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-12T17:49:03.933 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.119.119 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-12T17:49:03.934 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-12T17:49:03.935 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:49:03.935 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-12T17:49:03.935 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-12T17:49:03.979 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.ttIXtEUJ65 2024-09-12T17:49:03.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ttIXtEUJ65 2024-09-12T17:49:04.035 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.ttIXtEUJ65 2024-09-12T17:49:04.157 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.ttIXtEUJ65 is 10KB 2024-09-12T17:49:04.169 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.ttIXtEUJ65 2024-09-12T17:49:04.174 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:49:04.227 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T17:49:04.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:49:04.228 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:49:04.294 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:49:04.294 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:49:04.304 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:49:04.304 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-grub 2024-09-12T17:49:04.331 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:49:04.353 INFO:teuthology.orchestra.run.smithi111.stdout:Generating grub configuration file ... 2024-09-12T17:49:04.522 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:49:04.522 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:49:04.533 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:49:04.563 INFO:teuthology.orchestra.run.smithi052.stdout:Generating grub configuration file ... 2024-09-12T17:49:04.646 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:49:04.660 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:49:04.902 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:49:04.925 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:49:04.985 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:49:04.992 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:49:04.997 INFO:teuthology.orchestra.run.smithi121.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:49:04.999 INFO:teuthology.orchestra.run.smithi121.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:49:05.001 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2024-09-12T17:49:05.066 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:49:05.071 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:49:05.190 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:49:05.196 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:49:05.254 INFO:teuthology.orchestra.run.smithi111.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:49:05.254 INFO:teuthology.orchestra.run.smithi111.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:49:05.254 INFO:teuthology.orchestra.run.smithi111.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:49:05.301 INFO:teuthology.orchestra.run.smithi111.stdout:done 2024-09-12T17:49:05.301 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:49:05.308 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:49:05.385 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:49:05.390 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:49:05.455 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:49:05.460 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:49:05.502 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:49:05.507 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:49:05.549 INFO:teuthology.orchestra.run.smithi052.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:49:05.549 INFO:teuthology.orchestra.run.smithi052.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:49:05.549 INFO:teuthology.orchestra.run.smithi052.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:49:05.582 INFO:teuthology.orchestra.run.smithi052.stdout:done 2024-09-12T17:49:05.651 INFO:teuthology.orchestra.run.smithi121.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:49:05.652 INFO:teuthology.orchestra.run.smithi121.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:49:05.652 INFO:teuthology.orchestra.run.smithi121.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:49:05.656 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:49:05.658 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:49:05.662 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-12T17:49:05.666 INFO:teuthology.orchestra.run.smithi121.stderr:done 2024-09-12T17:49:05.683 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2024-09-12T17:49:05.785 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-09-12T17:49:05.806 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-09-12T17:49:05.806 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.119.119 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:49:05.807 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-09-12T17:49:05.808 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:49:05.808 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:49:05.809 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:49:05.809 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-12T17:49:05.809 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:49:05.809 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-09-12T17:49:05.829 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:49:05.836 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:49:05.951 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-09-12T17:49:06.059 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:49:06.062 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:49:06.065 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:49:06.071 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:49:06.089 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2024-09-12T17:49:06.090 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 21 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2024-09-12T17:49:06.110 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.15.0.119.119 2024-09-12T17:49:06.111 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:49:06.111 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:49:06.111 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2024-09-12T17:49:06.111 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2024-09-12T17:49:06.111 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:49:06.111 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2024-09-12T17:49:06.111 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:49:06.111 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:49:06.111 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:49:06.111 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:49:06.111 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:49:06.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2024-09-12T17:49:06.112 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:49:06.115 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:49:06.184 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:49:06.250 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:49:06.250 INFO:teuthology.orchestra.run.smithi153.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:49:06.250 INFO:teuthology.orchestra.run.smithi153.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:49:06.261 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-12T17:49:06.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-12T17:49:06.280 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-12T17:49:06.416 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:49:06.518 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:49:06.604 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:49:06.681 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:49:07.407 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T17:49:07.425 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:49:07.491 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T17:49:07.699 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T17:49:07.700 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T17:49:07.890 INFO:teuthology.orchestra.run.smithi111.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:49:07.890 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:49:07.890 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:49:07.890 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:49:07.890 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:49:07.890 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:49:07.891 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:49:07.891 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:49:07.892 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-12T17:49:07.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:49:07.931 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:49:07.933 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-09-12T17:49:07.948 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-09-12T17:49:07.948 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.119.119 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:49:07.949 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-09-12T17:49:07.950 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-09-12T17:49:07.967 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-12T17:49:07.993 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.W3oY5G6YIq 2024-09-12T17:49:07.993 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub/grub.cfg /tmp/tmp.W3oY5G6YIq 2024-09-12T17:49:08.051 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.W3oY5G6YIq 2024-09-12T17:49:08.157 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-12T17:49:08.160 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.W3oY5G6YIq is 10KB 2024-09-12T17:49:08.160 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-12T17:49:08.172 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.W3oY5G6YIq 2024-09-12T17:49:08.178 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:49:08.234 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T17:49:08.234 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:49:08.234 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:49:08.301 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:49:08.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-grub 2024-09-12T17:49:08.335 INFO:teuthology.orchestra.run.smithi052.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:49:08.335 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:49:08.335 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:49:08.335 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:49:08.335 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:49:08.336 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:49:08.336 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:49:08.336 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:49:08.375 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:49:08.378 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2024-09-12T17:49:08.393 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2024-09-12T17:49:08.393 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2024-09-12T17:49:08.393 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2024-09-12T17:49:08.393 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 21 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.15.0.119.119 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:49:08.394 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2024-09-12T17:49:08.395 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-12T17:49:08.440 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.lX1keTKYhS 2024-09-12T17:49:08.440 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lX1keTKYhS 2024-09-12T17:49:08.500 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.lX1keTKYhS 2024-09-12T17:49:08.617 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.lX1keTKYhS is 10KB 2024-09-12T17:49:08.629 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.lX1keTKYhS 2024-09-12T17:49:08.634 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:49:08.687 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T17:49:08.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:49:08.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:49:08.750 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:49:08.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo update-grub 2024-09-12T17:49:09.598 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:49:09.599 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:49:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-09-12T17:49:09.824 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:49:09.831 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:49:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:49:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:49:10.058 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-09-12T17:49:10.125 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:49:10.131 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:49:10.172 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:49:10.178 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:49:10.299 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:49:10.305 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:49:10.322 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:49:10.322 INFO:teuthology.orchestra.run.smithi111.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:49:10.322 INFO:teuthology.orchestra.run.smithi111.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:49:10.332 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-09-12T17:49:10.334 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-09-12T17:49:10.604 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:49:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:49:10.652 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:49:10.657 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:49:10.789 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:49:10.789 INFO:teuthology.orchestra.run.smithi052.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:49:10.789 INFO:teuthology.orchestra.run.smithi052.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:49:10.811 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-09-12T17:49:10.821 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-09-12T17:49:35.710 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-12T17:49:35.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-12T17:49:35.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:49:36.283 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-12T17:49:36.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T17:49:36.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:49:40.341 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-12T17:49:40.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T17:49:40.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:49:40.825 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:49:40.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-12T17:49:40.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:50:35.766 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:50:36.286 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:50:40.345 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:50:40.828 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:50:44.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-12T17:50:44.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:50:45.276 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-12T17:50:45.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T17:50:45.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:50:46.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-12T17:50:46.353 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-119-generic"... 2024-09-12T17:50:46.354 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-12T17:50:46.403 INFO:teuthology.orchestra.run.smithi121.stdout:5.15.0-119-generic 2024-09-12T17:50:46.403 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:50:46.404 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:50:46.404 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:50:47.404 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-12T17:50:47.404 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:50:47.590 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2024-09-12T17:50:47.612 DEBUG:teuthology.parallel:result is None 2024-09-12T17:50:49.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T17:50:49.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:50:49.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-12T17:50:49.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:50:50.446 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-12T17:50:51.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-12T17:50:51.170 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T17:50:51.170 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-12T17:50:51.218 INFO:teuthology.orchestra.run.smithi052.stdout:5.15.0-119-generic 2024-09-12T17:50:51.218 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:50:51.218 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:50:51.218 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:50:52.220 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:50:52.220 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:50:52.419 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-09-12T17:50:52.460 DEBUG:teuthology.parallel:result is None 2024-09-12T17:50:52.477 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T17:51:04.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T17:51:04.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:51:04.673 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-12T17:51:05.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T17:51:05.241 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-119-generic"... 2024-09-12T17:51:05.242 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-12T17:51:05.289 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-119-generic 2024-09-12T17:51:05.290 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:51:05.290 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:51:05.290 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:51:06.291 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-12T17:51:06.291 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:51:06.365 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-09-12T17:51:06.395 DEBUG:teuthology.parallel:result is None 2024-09-12T17:51:07.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-12T17:51:19.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T17:51:19.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:51:20.059 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-12T17:51:20.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T17:51:20.575 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-119-generic"... 2024-09-12T17:51:20.575 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-12T17:51:20.623 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-119-generic 2024-09-12T17:51:20.623 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:51:20.623 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:51:20.623 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:51:21.624 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-12T17:51:21.625 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:51:21.960 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-09-12T17:51:21.986 DEBUG:teuthology.parallel:result is None 2024-09-12T17:51:21.986 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:51:21.995 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:51:21.996 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:51:21.999 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:51:22.001 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:51:22.004 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:51:22.010 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:51:22.021 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:51:22.034 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:51:22.034 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:51:22.047 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:51:22.049 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:51:22.052 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:51:22.075 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:51:22.085 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:51:22.086 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:51:22.107 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:51:22.109 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:51:22.116 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:51:22.131 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:51:22.134 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:51:22.137 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:51:22.140 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:51:22.142 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:51:22.145 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:51:22.146 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:51:22.157 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:51:22.158 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:51:22.169 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:51:22.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:51:22.187 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:51:22.200 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:51:22.203 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:51:22.228 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:51:22.238 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:51:22.238 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:51:22.255 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:51:22.257 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:51:22.272 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:51:22.277 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:51:22.306 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:51:22.354 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T17:51:22.355 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:51:22.435 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:51:22.440 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:51:22.488 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T17:51:22.488 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:51:22.561 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:51:22.567 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:51:22.616 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T17:51:22.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:51:22.684 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:51:22.690 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:51:22.738 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T17:51:22.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:51:22.807 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-12T17:51:22.810 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-09-12T17:51:22.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-09-12T17:51:22.815 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-12T17:51:22.889 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:51:22.897 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:51:22.897 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:51:22.913 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:51:22.927 DEBUG:teuthology.task.selinux:Excluding smithi052: OS 'ubuntu' does not support SELinux 2024-09-12T17:51:22.927 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2024-09-12T17:51:22.927 DEBUG:teuthology.task.selinux:Excluding smithi121: OS 'ubuntu' does not support SELinux 2024-09-12T17:51:22.927 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2024-09-12T17:51:22.927 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:51:22.927 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T17:51:22.927 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:51:22.928 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:51:22.942 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T17:51:22.946 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T17:51:23.059 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:51:23.071 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:51:23.072 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi111.front.sepia.ceph.com,smithi121.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:59:00.708 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-09-12T17:59:00.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-12T17:59:00.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:59:00.800 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-12T17:59:00.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-12T17:59:00.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T17:59:00.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:59:00.957 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-12T17:59:01.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T17:59:01.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-12T17:59:01.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:59:01.120 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-12T17:59:01.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-12T17:59:01.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T17:59:01.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:59:01.281 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-12T17:59:01.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T17:59:01.362 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:59:01.373 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:59:01.373 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:59:01.373 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:59:01.376 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:59:01.376 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:59:01.378 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:59:01.378 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:59:01.381 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:59:01.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:59:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:59:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Command line: ntpd -gq 2024-09-12T17:59:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: ---------------------------------------------------- 2024-09-12T17:59:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:59:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:59:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: corporation. Support and training for ntp-4 are 2024-09-12T17:59:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: available at https://www.nwtime.org/support 2024-09-12T17:59:01.405 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: ---------------------------------------------------- 2024-09-12T17:59:01.405 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: proto: precision = 0.045 usec (-24) 2024-09-12T17:59:01.406 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: basedate set to 2022-02-04 2024-09-12T17:59:01.406 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:59:01.406 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:59:01.406 INFO:teuthology.orchestra.run.smithi052.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:59:01.406 INFO:teuthology.orchestra.run.smithi052.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:59:01.407 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:59:01.407 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:59:01.408 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:59:01.408 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:59:01.408 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Listen normally on 3 ens1f0 172.21.15.52:123 2024-09-12T17:59:01.408 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Listen normally on 4 lo [::1]:123 2024-09-12T17:59:01.408 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15de%4]:123 2024-09-12T17:59:01.408 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:01 ntpd[18390]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:59:01.410 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Command line: ntpd -gq 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: ---------------------------------------------------- 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: corporation. Support and training for ntp-4 are 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: available at https://www.nwtime.org/support 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: ---------------------------------------------------- 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: proto: precision = 0.044 usec (-24) 2024-09-12T17:59:01.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: basedate set to 2022-02-04 2024-09-12T17:59:01.412 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:59:01.412 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:59:01.412 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:59:01.412 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Command line: ntpd -gq 2024-09-12T17:59:01.412 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: ---------------------------------------------------- 2024-09-12T17:59:01.412 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:59:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:59:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: corporation. Support and training for ntp-4 are 2024-09-12T17:59:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: available at https://www.nwtime.org/support 2024-09-12T17:59:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: ---------------------------------------------------- 2024-09-12T17:59:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: proto: precision = 0.045 usec (-24) 2024-09-12T17:59:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: basedate set to 2022-02-04 2024-09-12T17:59:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:59:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:59:01.414 INFO:teuthology.orchestra.run.smithi121.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:59:01.414 INFO:teuthology.orchestra.run.smithi121.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:59:01.414 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:59:01.414 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:59:01.417 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:59:01.417 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:59:01.417 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:59:01.417 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:59:01.417 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Listen normally on 3 enp3s0f1 172.21.15.121:123 2024-09-12T17:59:01.417 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Listen normally on 4 lo [::1]:123 2024-09-12T17:59:01.417 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba3%5]:123 2024-09-12T17:59:01.417 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:01 ntpd[18500]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:59:01.418 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:59:01.418 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:59:01.418 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:59:01.418 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:59:01.418 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2024-09-12T17:59:01.418 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Listen normally on 4 lo [::1]:123 2024-09-12T17:59:01.419 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2024-09-12T17:59:01.419 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:01 ntpd[18521]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:59:01.434 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:59:01.434 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Command line: ntpd -gq 2024-09-12T17:59:01.434 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: ---------------------------------------------------- 2024-09-12T17:59:01.435 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:59:01.435 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:59:01.435 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: corporation. Support and training for ntp-4 are 2024-09-12T17:59:01.435 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: available at https://www.nwtime.org/support 2024-09-12T17:59:01.435 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: ---------------------------------------------------- 2024-09-12T17:59:01.436 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: proto: precision = 0.045 usec (-24) 2024-09-12T17:59:01.436 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: basedate set to 2022-02-04 2024-09-12T17:59:01.436 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:59:01.436 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:59:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:59:01.437 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:59:01.437 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:59:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:59:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:59:01.438 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:59:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2024-09-12T17:59:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Listen normally on 4 lo [::1]:123 2024-09-12T17:59:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2024-09-12T17:59:01.439 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:01 ntpd[18460]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:59:02.404 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:02 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:02 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:02 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:02 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:02 ntpd[18390]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:02.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:02 ntpd[18390]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:02.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:02.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:02 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:02.409 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:02 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:02.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:02 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:02 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:02 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:02 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:02 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:02.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:02 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:02.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:02 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:02.438 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:02 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:03.404 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:03 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:03.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:03 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:03.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:03 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:03.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:03 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:03.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:03 ntpd[18390]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:03.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:03 ntpd[18390]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:03.408 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:03 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:03.408 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:03 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:04 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:04 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:04 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:04 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:04 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:04 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:04 ntpd[18390]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:04 ntpd[18390]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:04 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:04 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:04.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:04 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:05 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:05 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:05 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:05 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:05 ntpd[18390]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:05 ntpd[18390]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:06 ntpd[18390]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.407 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.409 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.409 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.409 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:06 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:06 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:06.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:06.438 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:06.438 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:06 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:07.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:07 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:07.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:07 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:07.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:07 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:07.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:07 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:07.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:07 ntpd[18390]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:07.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:07 ntpd[18390]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:08.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.405 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:08.406 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:08.406 INFO:teuthology.orchestra.run.smithi052.stdout:12 Sep 17:59:08 ntpd[18390]: ntpd: time slew -0.000031 s 2024-09-12T17:59:08.406 INFO:teuthology.orchestra.run.smithi052.stdout:ntpd: time slew -0.000031s 2024-09-12T17:59:08.407 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:59:08.407 INFO:teuthology.orchestra.run.smithi052.stderr:12 Sep 17:59:08 ntpd[18390]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.408 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:08.409 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:08.409 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 17:59:08 ntpd[18521]: ntpd: time slew +0.000774 s 2024-09-12T17:59:08.409 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew +0.000774s 2024-09-12T17:59:08.409 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:59:08.409 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 17:59:08 ntpd[18521]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:59:08.410 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 17:59:08 ntpd[18500]: ntpd: time slew +0.001497 s 2024-09-12T17:59:08.411 INFO:teuthology.orchestra.run.smithi121.stdout:ntpd: time slew +0.001497s 2024-09-12T17:59:08.412 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:59:08.412 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 17:59:08 ntpd[18500]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:59:08.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:59:08.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:59:08.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:59:08.437 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 17:59:08 ntpd[18460]: ntpd: time slew -0.001372 s 2024-09-12T17:59:08.437 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew -0.001372s 2024-09-12T17:59:08.437 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:59:08.438 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 17:59:08 ntpd[18460]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:59:08.458 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:59:08.458 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2024-09-12T17:59:08.458 INFO:teuthology.orchestra.run.smithi052.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.458 INFO:teuthology.orchestra.run.smithi052.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.458 INFO:teuthology.orchestra.run.smithi052.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.458 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.459 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:59:08.460 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-09-12T17:59:08.460 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.460 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.460 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.460 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.465 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:59:08.465 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2024-09-12T17:59:08.465 INFO:teuthology.orchestra.run.smithi121.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.465 INFO:teuthology.orchestra.run.smithi121.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.465 INFO:teuthology.orchestra.run.smithi121.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.465 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.493 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:59:08.493 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-12T17:59:08.493 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.493 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.494 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.494 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:59:08.494 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:59:08.505 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:59:08.505 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}} 2024-09-12T17:59:08.505 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'} 2024-09-12T17:59:08.505 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:59:08.511 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:59:08.511 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:59:08.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-key list | grep Ceph 2024-09-12T17:59:08.513 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-key list | grep Ceph 2024-09-12T17:59:08.513 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-key list | grep Ceph 2024-09-12T17:59:08.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2024-09-12T17:59:08.570 INFO:teuthology.orchestra.run.smithi121.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:59:08.572 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:59:08.573 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:59:08.596 INFO:teuthology.orchestra.run.smithi121.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:59:08.596 INFO:teuthology.orchestra.run.smithi121.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:59:08.596 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:59:08.597 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T17:59:08.597 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T17:59:08.603 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:59:08.603 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:59:08.604 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:59:08.604 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:59:08.604 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T17:59:08.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T17:59:08.613 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:59:08.613 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:59:08.614 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:59:08.614 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T17:59:08.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T17:59:08.643 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:59:08.643 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:59:08.643 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:59:08.643 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-09-12T17:59:08.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T17:59:08.748 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T17:59:08.748 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T17:59:08.752 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T17:59:08.752 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T17:59:08.772 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T17:59:08.773 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T17:59:08.796 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default/ 2024-09-12T17:59:08.796 INFO:teuthology.task.install.deb:Package version is 19.3.0-4870-g46406987-1jammy 2024-09-12T17:59:08.872 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T17:59:08.872 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:59:08.874 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T17:59:08.874 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:59:08.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-09-12T17:59:08.889 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-09-12T17:59:08.893 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T17:59:08.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:59:08.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-12T17:59:08.913 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T17:59:08.913 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:59:08.930 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-12T17:59:09.042 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:59:09.053 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:59:09.057 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:59:09.057 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:59:09.068 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:59:09.070 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:59:09.085 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:59:09.097 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:59:09.112 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:59:09.112 INFO:teuthology.orchestra.run.smithi121.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:59:09.118 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T17:59:09.133 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T17:59:09.134 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T17:59:09.140 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:59:09.149 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:59:09.155 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:59:09.157 INFO:teuthology.orchestra.run.smithi121.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:59:09.161 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T17:59:09.171 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T17:59:09.176 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:59:09.178 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:59:09.182 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:59:09.189 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:59:09.198 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:59:09.198 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:59:09.199 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:59:09.204 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T17:59:09.219 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T17:59:09.227 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:59:09.232 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:59:09.233 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:59:09.254 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,429 B] 2024-09-12T17:59:09.261 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:59:09.298 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:59:09.343 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:59:09.380 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:59:09.414 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 29.3 kB in 0s (81.9 kB/s) 2024-09-12T17:59:09.414 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 29.3 kB in 0s (84.2 kB/s) 2024-09-12T17:59:09.572 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 29.3 kB in 0s (59.1 kB/s) 2024-09-12T17:59:09.586 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 29.3 kB in 0s (61.3 kB/s) 2024-09-12T17:59:10.435 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T17:59:10.448 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-12T17:59:10.451 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T17:59:10.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T17:59:10.515 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T17:59:10.528 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-12T17:59:10.543 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T17:59:10.560 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T17:59:10.590 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T17:59:10.607 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4870-g46406987-1jammy cephadm=19.3.0-4870-g46406987-1jammy ceph-mds=19.3.0-4870-g46406987-1jammy ceph-mgr=19.3.0-4870-g46406987-1jammy ceph-common=19.3.0-4870-g46406987-1jammy ceph-fuse=19.3.0-4870-g46406987-1jammy ceph-test=19.3.0-4870-g46406987-1jammy ceph-volume=19.3.0-4870-g46406987-1jammy radosgw=19.3.0-4870-g46406987-1jammy python3-rados=19.3.0-4870-g46406987-1jammy python3-rgw=19.3.0-4870-g46406987-1jammy python3-cephfs=19.3.0-4870-g46406987-1jammy python3-rbd=19.3.0-4870-g46406987-1jammy libcephfs2=19.3.0-4870-g46406987-1jammy libcephfs-dev=19.3.0-4870-g46406987-1jammy librados2=19.3.0-4870-g46406987-1jammy librbd1=19.3.0-4870-g46406987-1jammy rbd-fuse=19.3.0-4870-g46406987-1jammy 2024-09-12T17:59:10.613 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T17:59:10.671 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T17:59:10.723 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T17:59:10.724 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T17:59:10.741 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-12T17:59:10.742 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-12T17:59:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-09-12T17:59:10.803 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-09-12T17:59:10.881 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-12T17:59:10.881 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-12T17:59:10.930 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:59:10.930 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:59:10.930 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:59:10.931 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:59:10.931 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:59:10.931 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:59:10.931 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:59:10.932 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-09-12T17:59:10.932 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:59:10.932 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:59:10.933 INFO:teuthology.orchestra.run.smithi111.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T17:59:10.933 INFO:teuthology.orchestra.run.smithi111.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T17:59:10.933 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T17:59:10.934 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T17:59:10.935 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T17:59:10.935 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:59:10.935 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:59:10.935 INFO:teuthology.orchestra.run.smithi111.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:59:10.935 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:59:10.935 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:59:10.935 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet zip 2024-09-12T17:59:10.935 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-09-12T17:59:10.936 INFO:teuthology.orchestra.run.smithi111.stdout: btrfs-tools 2024-09-12T17:59:10.959 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:59:10.959 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:59:10.959 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:59:10.960 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:59:10.960 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:59:10.960 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:59:10.960 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:59:10.961 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-09-12T17:59:10.961 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:59:10.961 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:59:10.961 INFO:teuthology.orchestra.run.smithi052.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T17:59:10.961 INFO:teuthology.orchestra.run.smithi052.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T17:59:10.962 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T17:59:10.962 INFO:teuthology.orchestra.run.smithi052.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T17:59:10.962 INFO:teuthology.orchestra.run.smithi052.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:59:10.963 INFO:teuthology.orchestra.run.smithi052.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet zip 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:59:10.964 INFO:teuthology.orchestra.run.smithi052.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:59:10.965 INFO:teuthology.orchestra.run.smithi052.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:59:10.965 INFO:teuthology.orchestra.run.smithi052.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:59:10.965 INFO:teuthology.orchestra.run.smithi052.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:59:10.965 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2024-09-12T17:59:10.965 INFO:teuthology.orchestra.run.smithi052.stdout: btrfs-tools 2024-09-12T17:59:10.984 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:59:10.985 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:59:10.985 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:59:10.985 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:59:10.985 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:59:10.985 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:59:10.985 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:59:10.986 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-09-12T17:59:10.986 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:59:10.986 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:59:10.987 INFO:teuthology.orchestra.run.smithi121.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T17:59:10.987 INFO:teuthology.orchestra.run.smithi121.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T17:59:10.987 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T17:59:10.987 INFO:teuthology.orchestra.run.smithi121.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T17:59:10.988 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet zip 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:59:10.989 INFO:teuthology.orchestra.run.smithi121.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:59:10.990 INFO:teuthology.orchestra.run.smithi121.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:59:10.990 INFO:teuthology.orchestra.run.smithi121.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:59:10.990 INFO:teuthology.orchestra.run.smithi121.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:59:10.990 INFO:teuthology.orchestra.run.smithi121.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:59:10.990 INFO:teuthology.orchestra.run.smithi121.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:59:10.990 INFO:teuthology.orchestra.run.smithi121.stdout:Recommended packages: 2024-09-12T17:59:10.990 INFO:teuthology.orchestra.run.smithi121.stdout: btrfs-tools 2024-09-12T17:59:11.037 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-09-12T17:59:11.037 INFO:teuthology.orchestra.run.smithi111.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:59:11.037 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:59:11.038 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:59:11.038 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:59:11.038 INFO:teuthology.orchestra.run.smithi111.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T17:59:11.038 INFO:teuthology.orchestra.run.smithi111.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:59:11.039 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:59:11.040 INFO:teuthology.orchestra.run.smithi111.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:59:11.072 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-09-12T17:59:11.072 INFO:teuthology.orchestra.run.smithi052.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:59:11.072 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:59:11.072 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:59:11.072 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:59:11.072 INFO:teuthology.orchestra.run.smithi052.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T17:59:11.073 INFO:teuthology.orchestra.run.smithi052.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:59:11.074 INFO:teuthology.orchestra.run.smithi052.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:59:11.075 INFO:teuthology.orchestra.run.smithi052.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:59:11.086 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:59:11.086 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:59:11.086 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:59:11.087 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:59:11.087 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:59:11.087 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:59:11.087 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:59:11.088 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-12T17:59:11.088 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:59:11.088 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:59:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-12T17:59:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-12T17:59:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-12T17:59:11.089 INFO:teuthology.orchestra.run.smithi153.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-12T17:59:11.090 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:59:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:59:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:59:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:59:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:59:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet zip 2024-09-12T17:59:11.091 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-12T17:59:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:59:11.091 INFO:teuthology.orchestra.run.smithi153.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:59:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:59:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:59:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:59:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:59:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:59:11.092 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-12T17:59:11.092 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2024-09-12T17:59:11.093 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-09-12T17:59:11.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:59:11.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:59:11.093 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:59:11.094 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:59:11.094 INFO:teuthology.orchestra.run.smithi121.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T17:59:11.094 INFO:teuthology.orchestra.run.smithi121.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:59:11.094 INFO:teuthology.orchestra.run.smithi121.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:59:11.094 INFO:teuthology.orchestra.run.smithi121.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:59:11.095 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:59:11.096 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:59:11.096 INFO:teuthology.orchestra.run.smithi121.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:59:11.096 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:59:11.096 INFO:teuthology.orchestra.run.smithi121.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:59:11.096 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:59:11.096 INFO:teuthology.orchestra.run.smithi121.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:59:11.099 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:59:11.099 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 251 MB of archives. 2024-09-12T17:59:11.099 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T17:59:11.099 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:59:11.153 INFO:teuthology.orchestra.run.smithi121.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:59:11.154 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 251 MB of archives. 2024-09-12T17:59:11.154 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T17:59:11.154 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:59:11.181 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T17:59:11.188 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:59:11.190 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:59:11.194 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-12T17:59:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:59:11.194 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:59:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:59:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:59:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-12T17:59:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:59:11.196 INFO:teuthology.orchestra.run.smithi153.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:59:11.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:59:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:59:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:59:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:59:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:59:11.198 INFO:teuthology.orchestra.run.smithi153.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:59:11.208 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:59:11.216 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:59:11.216 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 251 MB of archives. 2024-09-12T17:59:11.216 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T17:59:11.216 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T17:59:11.235 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T17:59:11.243 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:59:11.246 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:59:11.255 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:59:11.255 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 251 MB of archives. 2024-09-12T17:59:11.255 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-12T17:59:11.255 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:59:11.261 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:59:11.263 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:59:11.269 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:59:11.275 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:59:11.287 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:59:11.291 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T17:59:11.292 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:59:11.293 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:59:11.293 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:59:11.301 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:59:11.304 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:59:11.306 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:59:11.309 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:59:11.309 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:59:11.323 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:59:11.326 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:59:11.327 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:59:11.328 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:59:11.330 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:59:11.331 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:59:11.331 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:59:11.332 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:59:11.333 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:59:11.333 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:59:11.340 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:59:11.342 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4870-g46406987-1jammy [3,623 kB] 2024-09-12T17:59:11.342 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:59:11.343 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:59:11.343 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:59:11.344 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T17:59:11.345 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:59:11.345 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:59:11.346 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:59:11.346 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:59:11.355 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:59:11.357 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:59:11.359 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:59:11.361 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:59:11.361 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:59:11.362 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:59:11.362 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:59:11.362 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:59:11.364 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:59:11.364 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:59:11.364 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:59:11.365 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:59:11.366 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:59:11.366 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:59:11.377 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:59:11.379 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:59:11.379 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:59:11.381 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:59:11.383 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:59:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:59:11.384 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:59:11.385 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:59:11.386 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:59:11.386 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:59:11.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:59:11.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:59:11.396 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:59:11.397 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:59:11.401 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:59:11.401 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:59:11.401 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:59:11.402 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:59:11.403 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:59:11.405 INFO:teuthology.orchestra.run.smithi111.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:59:11.405 INFO:teuthology.orchestra.run.smithi111.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T17:59:11.412 INFO:teuthology.orchestra.run.smithi111.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:59:11.414 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:59:11.414 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:59:11.417 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:59:11.417 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:59:11.418 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:59:11.418 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:59:11.419 INFO:teuthology.orchestra.run.smithi111.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:59:11.419 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:59:11.419 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:59:11.420 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:59:11.423 INFO:teuthology.orchestra.run.smithi111.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:59:11.425 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:59:11.428 INFO:teuthology.orchestra.run.smithi111.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:59:11.428 INFO:teuthology.orchestra.run.smithi111.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:59:11.431 INFO:teuthology.orchestra.run.smithi111.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:59:11.431 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:59:11.433 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:59:11.436 INFO:teuthology.orchestra.run.smithi111.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:59:11.437 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:59:11.441 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T17:59:11.442 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:59:11.443 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:59:11.444 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:59:11.449 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:59:11.450 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:59:11.452 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:59:11.454 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:59:11.455 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:59:11.455 INFO:teuthology.orchestra.run.smithi121.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:59:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:59:11.457 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:59:11.458 INFO:teuthology.orchestra.run.smithi121.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:59:11.459 INFO:teuthology.orchestra.run.smithi121.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:59:11.459 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:59:11.459 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:59:11.460 INFO:teuthology.orchestra.run.smithi121.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:59:11.466 INFO:teuthology.orchestra.run.smithi121.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:59:11.467 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T17:59:11.468 INFO:teuthology.orchestra.run.smithi121.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:59:11.476 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:59:11.477 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:59:11.478 INFO:teuthology.orchestra.run.smithi121.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:59:11.479 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:59:11.480 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:59:11.480 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:59:11.480 INFO:teuthology.orchestra.run.smithi121.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:59:11.481 INFO:teuthology.orchestra.run.smithi121.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:59:11.481 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:59:11.482 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:59:11.482 INFO:teuthology.orchestra.run.smithi121.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:59:11.482 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:59:11.485 INFO:teuthology.orchestra.run.smithi121.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:59:11.493 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:59:11.494 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:59:11.498 INFO:teuthology.orchestra.run.smithi111.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:59:11.499 INFO:teuthology.orchestra.run.smithi111.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:59:11.501 INFO:teuthology.orchestra.run.smithi111.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:59:11.501 INFO:teuthology.orchestra.run.smithi111.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:59:11.502 INFO:teuthology.orchestra.run.smithi111.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:59:11.503 INFO:teuthology.orchestra.run.smithi121.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T17:59:11.511 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:59:11.511 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:59:11.514 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:59:11.514 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:59:11.514 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:59:11.515 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:59:11.516 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:59:11.516 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:59:11.519 INFO:teuthology.orchestra.run.smithi111.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:59:11.521 INFO:teuthology.orchestra.run.smithi111.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:59:11.521 INFO:teuthology.orchestra.run.smithi111.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:59:11.528 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:59:11.529 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:59:11.536 INFO:teuthology.orchestra.run.smithi121.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:59:11.536 INFO:teuthology.orchestra.run.smithi111.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:59:11.536 INFO:teuthology.orchestra.run.smithi111.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:59:11.537 INFO:teuthology.orchestra.run.smithi121.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:59:11.537 INFO:teuthology.orchestra.run.smithi111.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:59:11.538 INFO:teuthology.orchestra.run.smithi111.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:59:11.538 INFO:teuthology.orchestra.run.smithi111.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:59:11.538 INFO:teuthology.orchestra.run.smithi111.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:59:11.539 INFO:teuthology.orchestra.run.smithi121.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:59:11.539 INFO:teuthology.orchestra.run.smithi121.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:59:11.539 INFO:teuthology.orchestra.run.smithi121.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:59:11.541 INFO:teuthology.orchestra.run.smithi111.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T17:59:11.544 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:59:11.545 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:59:11.550 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:59:11.550 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:59:11.551 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:59:11.551 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:59:11.553 INFO:teuthology.orchestra.run.smithi111.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:59:11.553 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:59:11.553 INFO:teuthology.orchestra.run.smithi111.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:59:11.555 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:59:11.556 INFO:teuthology.orchestra.run.smithi121.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:59:11.557 INFO:teuthology.orchestra.run.smithi111.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:59:11.557 INFO:teuthology.orchestra.run.smithi121.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:59:11.558 INFO:teuthology.orchestra.run.smithi121.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:59:11.561 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:59:11.563 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:59:11.570 INFO:teuthology.orchestra.run.smithi111.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:59:11.572 INFO:teuthology.orchestra.run.smithi111.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:59:11.572 INFO:teuthology.orchestra.run.smithi111.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:59:11.572 INFO:teuthology.orchestra.run.smithi121.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:59:11.573 INFO:teuthology.orchestra.run.smithi121.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:59:11.573 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:59:11.574 INFO:teuthology.orchestra.run.smithi121.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:59:11.574 INFO:teuthology.orchestra.run.smithi121.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:59:11.574 INFO:teuthology.orchestra.run.smithi121.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:59:11.574 INFO:teuthology.orchestra.run.smithi121.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:59:11.575 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:59:11.576 INFO:teuthology.orchestra.run.smithi111.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:59:11.576 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:59:11.576 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:59:11.578 INFO:teuthology.orchestra.run.smithi111.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:59:11.578 INFO:teuthology.orchestra.run.smithi111.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:59:11.579 INFO:teuthology.orchestra.run.smithi111.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:59:11.579 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:59:11.585 INFO:teuthology.orchestra.run.smithi111.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T17:59:11.587 INFO:teuthology.orchestra.run.smithi111.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:59:11.588 INFO:teuthology.orchestra.run.smithi111.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:59:11.589 INFO:teuthology.orchestra.run.smithi121.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:59:11.590 INFO:teuthology.orchestra.run.smithi121.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:59:11.590 INFO:teuthology.orchestra.run.smithi111.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:59:11.593 INFO:teuthology.orchestra.run.smithi111.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T17:59:11.593 INFO:teuthology.orchestra.run.smithi121.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:59:11.594 INFO:teuthology.orchestra.run.smithi111.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T17:59:11.597 INFO:teuthology.orchestra.run.smithi111.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T17:59:11.599 INFO:teuthology.orchestra.run.smithi111.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T17:59:11.606 INFO:teuthology.orchestra.run.smithi111.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:59:11.607 INFO:teuthology.orchestra.run.smithi111.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:59:11.607 INFO:teuthology.orchestra.run.smithi111.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T17:59:11.607 INFO:teuthology.orchestra.run.smithi111.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:59:11.607 INFO:teuthology.orchestra.run.smithi121.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:59:11.608 INFO:teuthology.orchestra.run.smithi111.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:59:11.609 INFO:teuthology.orchestra.run.smithi121.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:59:11.609 INFO:teuthology.orchestra.run.smithi111.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:59:11.609 INFO:teuthology.orchestra.run.smithi121.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:59:11.612 INFO:teuthology.orchestra.run.smithi121.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:59:11.615 INFO:teuthology.orchestra.run.smithi121.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:59:11.616 INFO:teuthology.orchestra.run.smithi121.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:59:11.616 INFO:teuthology.orchestra.run.smithi111.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:59:11.616 INFO:teuthology.orchestra.run.smithi111.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:59:11.616 INFO:teuthology.orchestra.run.smithi121.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:59:11.624 INFO:teuthology.orchestra.run.smithi111.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:59:11.626 INFO:teuthology.orchestra.run.smithi111.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:59:11.626 INFO:teuthology.orchestra.run.smithi111.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:59:11.627 INFO:teuthology.orchestra.run.smithi121.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:59:11.627 INFO:teuthology.orchestra.run.smithi121.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:59:11.629 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T17:59:11.630 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:59:11.630 INFO:teuthology.orchestra.run.smithi121.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:59:11.631 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:59:11.632 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:59:11.632 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:59:11.633 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:59:11.644 INFO:teuthology.orchestra.run.smithi121.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:59:11.645 INFO:teuthology.orchestra.run.smithi121.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:59:11.645 INFO:teuthology.orchestra.run.smithi121.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:59:11.646 INFO:teuthology.orchestra.run.smithi121.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:59:11.647 INFO:teuthology.orchestra.run.smithi121.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:59:11.650 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:59:11.652 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:59:11.652 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:59:11.653 INFO:teuthology.orchestra.run.smithi121.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:59:11.653 INFO:teuthology.orchestra.run.smithi121.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:59:11.660 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T17:59:11.661 INFO:teuthology.orchestra.run.smithi121.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:59:11.663 INFO:teuthology.orchestra.run.smithi121.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:59:11.664 INFO:teuthology.orchestra.run.smithi121.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:59:11.666 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:59:11.667 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:59:11.667 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:59:11.667 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:59:11.668 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:59:11.668 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:59:11.670 INFO:teuthology.orchestra.run.smithi121.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T17:59:11.680 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:59:11.683 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T17:59:11.684 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:59:11.684 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T17:59:11.685 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:59:11.687 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:59:11.688 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T17:59:11.690 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T17:59:11.693 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:59:11.697 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T17:59:11.701 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:59:11.702 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:59:11.703 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:59:11.705 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:59:11.708 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:59:11.708 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:59:11.709 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:59:11.718 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:59:11.718 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:59:11.721 INFO:teuthology.orchestra.run.smithi121.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T17:59:11.721 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:59:11.728 INFO:teuthology.orchestra.run.smithi121.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T17:59:11.729 INFO:teuthology.orchestra.run.smithi121.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T17:59:11.733 INFO:teuthology.orchestra.run.smithi121.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T17:59:11.735 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:59:11.735 INFO:teuthology.orchestra.run.smithi121.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T17:59:11.735 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:59:11.736 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:59:11.737 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:59:11.738 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:59:11.744 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:59:11.744 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:59:11.752 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:59:11.753 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:59:11.754 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:59:11.774 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:59:11.779 INFO:teuthology.orchestra.run.smithi121.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T17:59:12.003 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:59:12.005 INFO:teuthology.orchestra.run.smithi111.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T17:59:12.014 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:59:12.019 INFO:teuthology.orchestra.run.smithi111.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T17:59:12.032 INFO:teuthology.orchestra.run.smithi111.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T17:59:12.043 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:59:12.052 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-12T17:59:12.054 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:59:12.055 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:59:12.057 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:59:12.074 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:59:12.079 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:59:12.085 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:59:12.124 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T17:59:12.127 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T17:59:12.160 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T17:59:12.164 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:59:12.165 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:59:12.169 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:59:12.173 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:59:12.177 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:59:12.178 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:59:12.178 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:59:12.181 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:59:12.181 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:59:12.213 INFO:teuthology.orchestra.run.smithi121.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T17:59:12.216 INFO:teuthology.orchestra.run.smithi121.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T17:59:12.226 INFO:teuthology.orchestra.run.smithi121.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T17:59:12.247 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:59:12.264 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:59:12.265 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:59:12.265 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:59:12.266 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:59:12.271 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:59:12.272 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:59:12.329 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:59:12.330 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:59:12.332 INFO:teuthology.orchestra.run.smithi052.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:59:12.410 INFO:teuthology.orchestra.run.smithi052.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:59:12.411 INFO:teuthology.orchestra.run.smithi052.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:59:12.413 INFO:teuthology.orchestra.run.smithi052.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:59:12.414 INFO:teuthology.orchestra.run.smithi052.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:59:12.415 INFO:teuthology.orchestra.run.smithi052.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:59:12.425 INFO:teuthology.orchestra.run.smithi052.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:59:12.491 INFO:teuthology.orchestra.run.smithi052.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:59:12.492 INFO:teuthology.orchestra.run.smithi052.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:59:12.493 INFO:teuthology.orchestra.run.smithi052.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:59:12.496 INFO:teuthology.orchestra.run.smithi052.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:59:12.573 INFO:teuthology.orchestra.run.smithi052.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:59:12.574 INFO:teuthology.orchestra.run.smithi052.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:59:12.577 INFO:teuthology.orchestra.run.smithi052.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:59:12.579 INFO:teuthology.orchestra.run.smithi052.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:59:12.583 INFO:teuthology.orchestra.run.smithi052.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:59:12.584 INFO:teuthology.orchestra.run.smithi052.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:59:12.654 INFO:teuthology.orchestra.run.smithi052.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:59:12.658 INFO:teuthology.orchestra.run.smithi052.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:59:12.770 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4870-g46406987-1jammy [3,334 kB] 2024-09-12T17:59:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:59:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:59:12.825 INFO:teuthology.orchestra.run.smithi052.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:59:12.825 INFO:teuthology.orchestra.run.smithi052.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:59:12.827 INFO:teuthology.orchestra.run.smithi052.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:59:12.864 INFO:teuthology.orchestra.run.smithi052.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:59:12.865 INFO:teuthology.orchestra.run.smithi052.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:59:12.865 INFO:teuthology.orchestra.run.smithi052.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:59:12.926 INFO:teuthology.orchestra.run.smithi052.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:59:12.926 INFO:teuthology.orchestra.run.smithi052.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:59:12.987 INFO:teuthology.orchestra.run.smithi052.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:59:12.988 INFO:teuthology.orchestra.run.smithi052.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:59:12.989 INFO:teuthology.orchestra.run.smithi052.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:59:12.990 INFO:teuthology.orchestra.run.smithi052.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:59:12.991 INFO:teuthology.orchestra.run.smithi052.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:59:12.992 INFO:teuthology.orchestra.run.smithi052.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:59:12.999 INFO:teuthology.orchestra.run.smithi052.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:59:13.068 INFO:teuthology.orchestra.run.smithi052.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:59:13.072 INFO:teuthology.orchestra.run.smithi052.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:59:13.073 INFO:teuthology.orchestra.run.smithi052.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:59:13.150 INFO:teuthology.orchestra.run.smithi052.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:59:13.156 INFO:teuthology.orchestra.run.smithi052.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:59:13.158 INFO:teuthology.orchestra.run.smithi052.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:59:13.159 INFO:teuthology.orchestra.run.smithi052.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:59:13.171 INFO:teuthology.orchestra.run.smithi052.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:59:13.173 INFO:teuthology.orchestra.run.smithi052.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:59:13.180 INFO:teuthology.orchestra.run.smithi052.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:59:13.231 INFO:teuthology.orchestra.run.smithi052.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:59:13.232 INFO:teuthology.orchestra.run.smithi052.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:59:13.233 INFO:teuthology.orchestra.run.smithi052.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:59:13.312 INFO:teuthology.orchestra.run.smithi052.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:59:13.314 INFO:teuthology.orchestra.run.smithi052.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:59:13.333 INFO:teuthology.orchestra.run.smithi052.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:59:13.333 INFO:teuthology.orchestra.run.smithi052.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:59:13.333 INFO:teuthology.orchestra.run.smithi052.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:59:13.338 INFO:teuthology.orchestra.run.smithi052.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:59:13.339 INFO:teuthology.orchestra.run.smithi052.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:59:13.379 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4870-g46406987-1jammy [722 kB] 2024-09-12T17:59:13.449 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4870-g46406987-1jammy [356 kB] 2024-09-12T17:59:13.513 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4870-g46406987-1jammy [32.8 kB] 2024-09-12T17:59:13.514 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4870-g46406987-1jammy [180 kB] 2024-09-12T17:59:13.572 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4870-g46406987-1jammy [71.2 kB] 2024-09-12T17:59:13.574 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4870-g46406987-1jammy [338 kB] 2024-09-12T17:59:13.581 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4870-g46406987-1jammy [7,987 kB] 2024-09-12T17:59:13.632 INFO:teuthology.orchestra.run.smithi052.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T17:59:13.748 INFO:teuthology.orchestra.run.smithi121.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T17:59:13.783 INFO:teuthology.orchestra.run.smithi052.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T17:59:13.795 INFO:teuthology.orchestra.run.smithi052.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T17:59:13.798 INFO:teuthology.orchestra.run.smithi052.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T17:59:13.889 INFO:teuthology.orchestra.run.smithi052.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T17:59:13.904 INFO:teuthology.orchestra.run.smithi121.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T17:59:13.939 INFO:teuthology.orchestra.run.smithi121.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T17:59:13.940 INFO:teuthology.orchestra.run.smithi111.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T17:59:13.941 INFO:teuthology.orchestra.run.smithi121.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T17:59:14.018 INFO:teuthology.orchestra.run.smithi121.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T17:59:14.184 INFO:teuthology.orchestra.run.smithi111.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T17:59:14.190 INFO:teuthology.orchestra.run.smithi111.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T17:59:14.213 INFO:teuthology.orchestra.run.smithi052.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T17:59:14.224 INFO:teuthology.orchestra.run.smithi111.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T17:59:14.310 INFO:teuthology.orchestra.run.smithi111.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T17:59:14.378 INFO:teuthology.orchestra.run.smithi121.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T17:59:14.444 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4870-g46406987-1jammy [112 kB] 2024-09-12T17:59:14.446 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4870-g46406987-1jammy [473 kB] 2024-09-12T17:59:14.515 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4870-g46406987-1jammy [28.3 MB] 2024-09-12T17:59:14.727 INFO:teuthology.orchestra.run.smithi111.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T17:59:15.695 INFO:teuthology.orchestra.run.smithi121.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T17:59:15.695 INFO:teuthology.orchestra.run.smithi121.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T17:59:15.712 INFO:teuthology.orchestra.run.smithi121.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T17:59:15.774 INFO:teuthology.orchestra.run.smithi121.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T17:59:15.821 INFO:teuthology.orchestra.run.smithi121.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T17:59:15.836 INFO:teuthology.orchestra.run.smithi121.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T17:59:15.854 INFO:teuthology.orchestra.run.smithi052.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T17:59:15.855 INFO:teuthology.orchestra.run.smithi052.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T17:59:15.873 INFO:teuthology.orchestra.run.smithi052.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T17:59:16.014 INFO:teuthology.orchestra.run.smithi052.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T17:59:16.087 INFO:teuthology.orchestra.run.smithi052.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T17:59:16.090 INFO:teuthology.orchestra.run.smithi052.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T17:59:16.130 INFO:teuthology.orchestra.run.smithi111.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T17:59:16.130 INFO:teuthology.orchestra.run.smithi111.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T17:59:16.148 INFO:teuthology.orchestra.run.smithi111.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T17:59:16.216 INFO:teuthology.orchestra.run.smithi111.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T17:59:16.284 INFO:teuthology.orchestra.run.smithi111.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T17:59:16.287 INFO:teuthology.orchestra.run.smithi111.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T17:59:17.492 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4870-g46406987-1jammy [5,206 kB] 2024-09-12T17:59:17.991 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4870-g46406987-1jammy [251 kB] 2024-09-12T17:59:18.018 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4870-g46406987-1jammy [124 kB] 2024-09-12T17:59:18.058 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4870-g46406987-1jammy [1,561 kB] 2024-09-12T17:59:18.213 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4870-g46406987-1jammy [6,309 kB] 2024-09-12T17:59:18.907 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4870-g46406987-1jammy [23.1 MB] 2024-09-12T17:59:19.099 INFO:teuthology.orchestra.run.smithi121.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T17:59:19.366 INFO:teuthology.orchestra.run.smithi121.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T17:59:19.366 INFO:teuthology.orchestra.run.smithi121.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T17:59:20.222 INFO:teuthology.orchestra.run.smithi052.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T17:59:20.513 INFO:teuthology.orchestra.run.smithi111.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T17:59:20.531 INFO:teuthology.orchestra.run.smithi052.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T17:59:20.531 INFO:teuthology.orchestra.run.smithi052.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T17:59:20.861 INFO:teuthology.orchestra.run.smithi111.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T17:59:20.862 INFO:teuthology.orchestra.run.smithi111.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T17:59:21.367 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4870-g46406987-1jammy [14.0 kB] 2024-09-12T17:59:21.368 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4870-g46406987-1jammy [880 kB] 2024-09-12T17:59:21.385 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4870-g46406987-1jammy [2,454 kB] 2024-09-12T17:59:21.664 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4870-g46406987-1jammy [813 kB] 2024-09-12T17:59:21.743 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4870-g46406987-1jammy [160 kB] 2024-09-12T17:59:21.768 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4870-g46406987-1jammy [61.5 MB] 2024-09-12T17:59:22.255 INFO:teuthology.orchestra.run.smithi121.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T17:59:22.257 INFO:teuthology.orchestra.run.smithi121.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T17:59:22.258 INFO:teuthology.orchestra.run.smithi121.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T17:59:22.975 INFO:teuthology.orchestra.run.smithi121.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T17:59:23.545 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 251 MB in 12s (21.1 MB/s) 2024-09-12T17:59:23.676 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:59:23.762 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:59:23.768 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:59:23.852 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:59:23.923 INFO:teuthology.orchestra.run.smithi052.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T17:59:23.925 INFO:teuthology.orchestra.run.smithi052.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T17:59:23.926 INFO:teuthology.orchestra.run.smithi052.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T17:59:24.110 INFO:teuthology.orchestra.run.smithi111.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T17:59:24.112 INFO:teuthology.orchestra.run.smithi111.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T17:59:24.114 INFO:teuthology.orchestra.run.smithi111.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T17:59:24.444 INFO:teuthology.orchestra.run.smithi052.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T17:59:24.464 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:59:24.491 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:59:24.531 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:59:24.625 INFO:teuthology.orchestra.run.smithi111.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T17:59:24.867 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:59:24.893 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:59:24.933 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:59:25.047 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 251 MB in 13s (18.8 MB/s) 2024-09-12T17:59:25.192 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 251 MB in 14s (18.5 MB/s) 2024-09-12T17:59:25.208 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:59:25.313 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:59:25.316 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:59:25.353 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:59:25.379 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:59:25.398 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:59:25.405 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:25.453 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:59:25.453 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:25.458 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:59:25.543 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:59:25.605 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4870-g46406987-1jammy [8,625 kB] 2024-09-12T17:59:25.743 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:59:25.761 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4870-g46406987-1jammy [14.2 kB] 2024-09-12T17:59:25.762 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4870-g46406987-1jammy [55.8 MB] 2024-09-12T17:59:25.769 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:59:25.809 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:59:25.857 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:59:25.883 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:25.888 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:59:25.914 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:59:25.915 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:25.954 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:59:26.090 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:59:26.116 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:59:26.148 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:59:26.243 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:59:26.266 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:59:26.269 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:26.292 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:59:26.309 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:26.332 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:59:26.593 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:59:26.620 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:26.663 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:59:26.667 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:26.689 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:59:26.729 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:59:26.761 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:59:26.788 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:26.836 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:27.032 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librados2. 2024-09-12T17:59:27.058 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:27.088 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:59:27.098 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:27.114 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:27.154 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:27.231 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:59:27.257 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:27.314 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:27.466 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:59:27.492 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:27.532 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:27.543 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libnbd0. 2024-09-12T17:59:27.569 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T17:59:27.609 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T17:59:27.633 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:59:27.660 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:27.673 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4870-g46406987-1jammy [130 kB] 2024-09-12T17:59:27.676 INFO:teuthology.orchestra.run.smithi153.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4870-g46406987-1jammy [39.0 kB] 2024-09-12T17:59:27.677 INFO:teuthology.orchestra.run.smithi153.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4870-g46406987-1jammy [15.9 MB] 2024-09-12T17:59:27.691 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:27.844 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:59:27.870 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:59:27.921 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:59:27.947 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:27.952 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:59:27.987 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:28.020 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:59:28.047 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:59:28.087 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:59:28.101 INFO:teuthology.orchestra.run.smithi153.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/46406987da2067f022005d68ecbb989daaabb837/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4870-g46406987-1jammy [91.2 kB] 2024-09-12T17:59:28.289 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librados2. 2024-09-12T17:59:28.315 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:28.355 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:28.389 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librados2. 2024-09-12T17:59:28.404 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:28.447 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:28.457 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:59:28.483 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:28.523 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:28.678 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 251 MB in 17s (14.9 MB/s) 2024-09-12T17:59:28.793 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:59:28.807 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:28.834 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:59:28.841 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libnbd0. 2024-09-12T17:59:28.842 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:28.868 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T17:59:28.907 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T17:59:28.931 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:59:28.936 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:59:29.016 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:59:29.175 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libnbd0. 2024-09-12T17:59:29.200 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:59:29.202 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T17:59:29.208 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:59:29.226 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:29.232 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:29.251 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T17:59:29.260 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:29.345 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:29.378 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:59:29.404 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:59:29.444 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:59:29.503 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:59:29.530 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:29.561 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:29.598 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:59:29.624 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:29.664 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:29.722 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:59:29.749 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:29.780 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:59:29.788 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:29.807 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:59:29.847 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:59:29.984 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:59:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:59:30.010 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:30.032 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:30.050 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:30.072 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:30.209 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:59:30.236 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:30.266 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:59:30.282 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:30.286 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:30.324 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:30.366 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:59:30.382 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:30.403 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:59:30.425 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:30.433 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:59:30.470 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:59:30.627 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:59:30.643 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:30.677 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:30.681 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:59:30.707 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:30.736 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:59:30.747 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:30.762 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:30.764 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:59:30.790 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:59:30.802 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:30.822 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:59:30.896 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:59:30.912 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:30.954 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:31.055 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:59:31.070 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:31.083 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:59:31.084 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:59:31.105 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:31.109 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:59:31.110 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:31.150 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:31.150 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:59:31.291 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:59:31.317 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:31.357 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:31.399 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:59:31.425 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:31.466 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:31.478 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:59:31.503 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:59:31.504 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:59:31.529 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:59:31.536 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:59:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:59:31.685 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:59:31.712 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:59:31.753 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:59:31.794 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:59:31.820 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:59:31.847 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:59:31.856 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librados2. 2024-09-12T17:59:31.860 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:59:31.863 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:59:31.882 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-librados2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:31.905 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:59:31.922 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:32.080 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:59:32.107 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:59:32.146 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:59:32.180 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:59:32.206 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:59:32.208 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:59:32.223 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:59:32.246 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:59:32.258 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:59:32.392 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libnbd0. 2024-09-12T17:59:32.407 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:59:32.418 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-12T17:59:32.423 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:32.450 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-12T17:59:32.465 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:32.482 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:59:32.497 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:32.532 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:32.578 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:59:32.605 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:59:32.645 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:59:32.852 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:59:32.881 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:59:32.893 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:59:32.920 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:59:32.926 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:59:32.960 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:59:32.964 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:59:32.977 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:59:32.980 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:59:33.004 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-librbd1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:33.022 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:59:33.053 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:33.229 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:59:33.244 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:59:33.254 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:59:33.266 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package zip. 2024-09-12T17:59:33.281 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:59:33.283 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:59:33.288 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:59:33.321 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:59:33.325 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:59:33.505 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:59:33.532 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:33.572 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:33.598 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:59:33.611 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package unzip. 2024-09-12T17:59:33.613 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:59:33.624 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:59:33.638 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:59:33.640 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:59:33.656 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:59:33.678 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:59:33.682 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:59:33.858 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:59:33.884 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:33.924 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:33.985 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:59:34.010 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:59:34.011 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:59:34.037 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:59:34.051 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:59:34.077 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:59:34.098 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:59:34.125 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:59:34.165 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:59:34.193 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:59:34.219 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:34.251 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:34.371 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:59:34.386 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:59:34.454 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:59:34.455 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:59:34.482 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:59:34.496 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:59:34.522 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:34.530 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:59:34.539 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:59:34.562 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:34.566 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:34.606 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:34.682 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package zip. 2024-09-12T17:59:34.697 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:59:34.732 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:59:34.949 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:59:34.950 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:34.950 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:34.950 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package zip. 2024-09-12T17:59:34.950 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:59:34.950 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:59:35.053 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package unzip. 2024-09-12T17:59:35.078 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:59:35.119 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:59:35.203 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package unzip. 2024-09-12T17:59:35.225 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:59:35.229 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:59:35.241 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:35.242 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:59:35.269 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:59:35.269 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:59:35.283 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:35.309 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:59:35.497 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:59:35.523 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:59:35.563 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:59:35.595 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:59:35.620 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:59:35.628 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:59:35.644 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:59:35.652 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:59:35.678 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:59:35.815 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:59:35.841 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:59:35.881 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:59:35.906 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:59:35.921 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:35.939 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:59:35.946 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:59:35.964 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:35.965 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:35.972 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:36.005 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:36.012 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:36.231 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:59:36.258 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:36.297 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:36.325 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:59:36.352 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:59:36.392 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:59:36.425 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:59:36.452 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:36.492 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:36.598 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:59:36.613 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:36.636 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:59:36.651 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:59:36.656 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:36.702 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:59:36.874 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:59:36.890 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:36.933 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:36.989 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:59:36.992 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:59:37.015 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:59:37.019 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:59:37.055 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:59:37.059 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:59:37.269 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:59:37.296 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:59:37.335 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:59:37.347 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:59:37.375 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:37.383 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:59:37.410 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:59:37.414 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:37.450 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:59:37.672 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:59:37.699 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:37.738 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:37.744 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:59:37.760 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:59:37.809 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:59:37.819 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:59:37.835 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:37.875 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:37.997 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:59:38.023 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:38.073 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:38.117 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:59:38.144 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:38.155 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package zip. 2024-09-12T17:59:38.175 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:38.182 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:59:38.222 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:59:38.517 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package unzip. 2024-09-12T17:59:38.543 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:59:38.583 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:59:38.642 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:59:38.669 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:59:38.709 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:59:38.970 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:59:38.997 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:59:39.037 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:59:39.062 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:59:39.089 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:59:39.137 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:59:39.411 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:59:39.426 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-librgw2_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:39.460 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:39.656 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:59:39.682 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:39.705 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:59:39.723 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:59:39.732 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:39.732 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:39.750 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:59:39.783 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:39.790 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:59:40.047 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:59:40.062 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:40.093 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:59:40.096 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:40.119 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:59:40.159 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:59:40.269 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:59:40.295 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:59:40.327 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:59:40.351 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:59:40.374 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:59:40.378 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:59:40.389 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:59:40.418 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:59:40.424 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:59:40.470 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:59:40.497 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:59:40.537 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:59:40.621 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:59:40.648 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:59:40.688 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:59:40.727 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:59:40.754 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:40.794 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:40.871 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:59:40.873 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:59:40.897 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:59:40.900 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:59:40.929 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:59:40.948 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:59:41.008 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:59:41.034 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:59:41.074 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:59:41.197 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:59:41.198 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:59:41.214 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:59:41.223 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:41.263 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:41.265 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:59:41.267 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:59:41.294 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:59:41.334 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:59:41.360 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:59:41.387 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:59:41.427 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:59:41.568 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:59:41.595 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:59:41.634 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:59:41.637 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:59:41.664 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:59:41.704 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:59:41.747 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:59:41.773 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:59:41.813 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:59:41.921 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:59:41.947 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:59:41.987 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:59:42.006 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:59:42.033 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:59:42.073 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:59:42.116 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:59:42.143 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:59:42.183 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:59:42.249 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:59:42.276 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:59:42.307 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:59:42.460 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:59:42.486 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:59:42.502 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:59:42.526 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:59:42.529 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:59:42.568 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:59:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:59:42.595 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:59:42.634 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:59:42.776 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:59:42.803 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:42.822 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:59:42.838 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:59:42.845 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:59:42.853 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:42.864 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:59:42.881 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:59:42.904 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:59:42.946 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:59:42.973 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:59:43.012 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:59:43.182 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:59:43.183 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:59:43.208 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:59:43.210 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:59:43.249 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:59:43.250 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:59:43.299 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:59:43.326 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:59:43.365 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:59:43.422 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:59:43.449 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:59:43.480 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:59:43.501 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:59:43.528 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:59:43.568 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:59:43.587 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:59:43.614 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:59:43.654 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:59:43.712 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:59:43.737 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:59:43.766 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:59:43.777 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:59:43.793 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:59:43.833 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:59:43.905 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:59:43.931 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:59:43.965 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:59:43.971 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:59:43.991 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:59:44.031 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:59:44.088 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:59:44.115 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:59:44.153 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:59:44.154 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:59:44.179 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:59:44.219 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:59:44.318 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:59:44.344 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:59:44.384 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:59:44.449 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:59:44.475 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:59:44.999 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:59:45.125 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:59:45.152 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:59:45.183 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:59:45.206 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:59:45.232 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:59:45.272 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:59:45.318 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:59:45.345 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:59:45.377 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:59:45.454 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:59:45.481 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:59:45.486 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:59:45.512 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:59:45.513 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:59:45.533 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:59:45.549 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:59:45.552 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:59:45.583 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:59:45.680 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:59:45.707 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:59:45.750 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:59:45.849 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:59:45.861 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:59:45.875 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:59:45.888 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:59:45.915 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:59:45.927 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:59:45.989 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:59:46.016 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:59:46.055 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:59:46.058 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:59:46.084 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:59:46.124 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:59:46.177 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:59:46.203 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:59:46.230 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:59:46.243 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:59:46.257 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:59:46.297 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:59:46.358 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:59:46.385 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:59:46.425 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:59:46.427 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:59:46.454 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:59:46.502 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:59:46.513 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:59:46.539 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:59:46.575 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:59:46.579 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:59:46.601 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:59:46.641 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:59:46.669 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:59:46.685 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:59:46.720 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:59:46.822 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:59:46.837 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:59:46.880 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:59:46.885 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:59:46.912 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:59:46.924 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:59:46.950 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:59:46.994 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:59:47.002 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:59:47.047 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:59:47.074 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:59:47.107 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:59:47.117 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:59:47.123 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:59:47.157 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:59:47.268 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:59:47.283 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:59:47.318 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:59:47.364 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:59:47.391 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:59:47.425 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:59:47.430 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:59:47.443 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:59:47.452 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:59:47.470 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:59:47.492 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:59:47.535 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:59:47.613 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:59:47.640 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:59:47.680 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:59:47.742 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:59:47.768 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:59:47.795 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:59:47.808 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:59:47.822 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:59:47.861 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:59:47.865 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:59:47.891 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:59:47.938 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:59:47.983 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:59:47.998 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:59:48.041 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:59:48.086 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:59:48.112 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:59:48.152 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:59:48.231 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:59:48.247 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:59:48.276 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:59:48.289 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:59:48.302 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:59:48.327 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:59:48.342 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:59:48.354 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:59:48.394 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:59:48.592 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:59:48.614 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:59:48.619 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:59:48.640 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:59:48.659 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:59:48.679 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:59:48.680 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:59:48.689 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:59:48.704 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:59:48.705 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:59:48.738 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:59:48.745 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:59:48.962 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:59:48.989 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:59:49.000 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:59:49.006 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:59:49.021 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:59:49.026 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:59:49.028 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:59:49.056 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:59:49.067 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:59:49.067 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:59:49.093 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:59:49.133 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:59:49.326 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:59:49.353 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:59:49.353 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:59:49.379 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:59:49.381 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:59:49.384 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:59:49.409 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:59:49.419 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:59:49.456 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:59:49.505 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:59:49.531 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:59:49.687 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:59:49.714 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:59:49.714 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:59:49.740 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:59:49.746 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:59:49.754 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:59:49.780 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:59:49.919 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:59:49.946 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:59:49.994 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:59:50.015 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:59:50.030 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:50.065 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:50.066 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:59:50.081 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:59:50.091 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:59:50.106 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:59:50.116 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:59:50.144 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:59:50.347 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:59:50.374 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:59:50.395 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:59:50.413 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:59:50.421 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:50.427 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:59:50.444 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:59:50.453 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:50.454 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:59:50.471 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:59:50.494 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:59:50.511 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:59:50.725 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:59:50.752 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:59:50.772 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:59:50.791 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:59:50.799 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:59:50.814 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:59:50.839 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:59:50.839 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:59:50.841 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:59:50.865 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:59:50.880 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:59:50.905 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:59:51.120 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:59:51.142 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:59:51.147 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:59:51.166 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:59:51.168 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:59:51.191 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:59:51.193 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:59:51.208 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:59:51.233 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:59:51.241 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:59:51.268 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:59:51.308 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:59:51.486 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:59:51.501 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:51.536 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:51.561 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:59:51.586 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:59:51.588 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:51.612 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:59:51.614 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:59:51.628 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:51.641 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:59:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:59:51.681 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:59:51.916 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:59:51.922 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:59:51.934 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:59:51.943 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:51.949 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:59:51.950 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:51.980 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:59:51.981 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:59:51.982 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:51.992 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:52.008 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:52.047 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:52.244 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:59:52.270 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:59:52.283 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:59:52.302 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:59:52.310 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:59:52.349 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:59:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:59:52.399 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:52.438 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:52.630 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:59:52.657 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:59:52.659 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:59:52.686 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:52.697 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:59:52.700 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:59:52.712 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:59:52.725 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:52.727 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:59:52.739 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:59:52.766 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:59:52.779 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:59:53.042 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:59:53.068 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:53.069 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:59:53.096 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:59:53.098 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:59:53.108 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:53.125 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:59:53.135 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:59:53.165 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:59:53.468 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:59:53.478 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:59:53.480 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:59:53.494 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:59:53.504 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:53.507 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:53.534 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:59:53.544 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:53.546 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:53.796 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph. 2024-09-12T17:59:53.811 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:53.845 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:53.862 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:59:53.889 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:59:53.900 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:59:53.927 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:53.929 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:59:53.958 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:54.139 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:59:54.140 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:59:54.166 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:54.167 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:54.206 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:54.206 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:54.223 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:59:54.250 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:59:54.281 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:59:54.576 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:59:54.584 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:59:54.592 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:54.603 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:59:54.611 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:54.626 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:54.630 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:54.650 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:54.670 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:55.031 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:59:55.058 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:55.097 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:55.237 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:59:55.251 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph. 2024-09-12T17:59:55.263 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:55.267 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:55.309 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:55.328 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:55.408 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:59:55.435 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:59:55.476 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:59:55.589 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:59:55.617 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:59:55.653 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:59:55.655 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:59:55.681 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:55.720 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:55.728 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:59:55.755 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:59:55.765 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph. 2024-09-12T17:59:55.785 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:59:55.792 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:55.831 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:55.950 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:59:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:59:56.000 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:59:56.090 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:59:56.117 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:56.122 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:59:56.149 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:56.150 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:59:56.156 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:56.178 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:56.188 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:56.217 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:56.518 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:59:56.545 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:56.562 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:59:56.576 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:56.589 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:56.591 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:59:56.619 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:56.620 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:56.658 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:56.879 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:59:56.906 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:59:56.945 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:59:57.014 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:59:57.042 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:57.071 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:59:57.089 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:57.098 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:59:57.138 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:59:57.281 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:59:57.286 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:59:57.298 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:59:57.313 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:57.340 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:59:57.353 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:57.384 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:59:57.411 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:59:57.450 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:59:57.474 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:59:57.501 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:59:57.541 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:59:57.786 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:59:57.814 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:59:57.871 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:59:57.885 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:59:57.912 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:57.960 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:58.297 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:59:58.324 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:59:58.345 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:59:58.363 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:59:58.364 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2024-09-12T17:59:58.372 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:59:58.391 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-ceph_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:58.403 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:59:58.431 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:58.666 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:59:58.693 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:59:58.731 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:59:58.732 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:59:58.758 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:59:58.797 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:59:58.869 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:59:58.896 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:58.933 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:58.992 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:59:59.019 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:59:59.058 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:59:59.094 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:59:59.121 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:59.169 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:59.175 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:59:59.202 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:59.242 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:59.328 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:59:59.354 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:59.386 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:59:59.394 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:59.413 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:59:59.452 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:59:59.596 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:59:59.622 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:59:59.662 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:59:59.780 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:59:59.797 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:59:59.807 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-cephadm_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T17:59:59.824 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T17:59:59.847 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:59.864 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T17:59:59.948 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:59:59.975 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:00:00.015 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:00:00.108 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:00:00.135 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:00:00.174 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:00:00.201 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:00:00.229 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:00:00.259 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:00:00.343 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:00:00.371 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:00.410 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:00.460 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:00:00.476 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:00:00.510 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:00.528 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:00:00.556 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:00:00.595 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:00:00.890 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:00:00.917 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:00.956 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:01.524 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:00:01.551 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:00:01.590 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:01.885 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:00:01.911 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:00:01.951 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:00:02.057 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:00:02.075 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:00:02.115 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:00:02.304 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:00:02.331 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:02.370 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:02.593 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:00:02.621 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:00:02.662 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:00:02.707 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:00:02.734 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:00:02.773 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:00:02.973 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:00:02.990 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:00:03.023 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:00:03.026 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:00:03.031 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:00:03.051 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:00:03.053 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:00:03.090 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:00:03.092 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:00:03.388 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:00:03.393 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:00:03.414 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:03.420 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:00:03.445 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:03.535 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:00:03.544 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:00:03.562 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:00:03.593 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:00:03.928 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:00:03.960 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:00:03.980 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:00:03.994 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:00:04.008 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:00:04.047 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:00:04.203 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:00:04.233 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:04.278 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:04.333 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:00:04.348 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:00:04.468 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:00:04.490 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:00:04.517 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:00:04.564 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:00:04.910 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:00:04.938 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:00:04.976 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:00:05.128 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:00:05.157 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:05.240 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:00:05.256 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:00:05.360 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:00:05.377 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:05.388 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:00:05.590 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:00:06.241 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:00:06.241 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:00:06.241 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:00:06.242 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:00:06.242 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:00:06.242 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:00:06.242 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:00:06.242 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:00:06.242 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:00:06.326 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:00:06.355 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:06.392 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:06.457 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:00:06.464 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:00:06.485 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:00:06.493 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:00:06.523 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:00:06.523 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:00:06.595 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:00:06.622 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:00:06.661 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:00:06.800 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:00:06.829 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:00:06.852 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:00:06.867 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:00:06.880 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:00:06.910 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:00:07.025 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:00:07.051 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:00:07.089 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:00:07.179 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:00:07.205 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:00:07.207 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:00:07.233 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:00:07.245 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:00:07.271 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:00:07.337 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:00:07.366 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:00:07.392 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:00:07.404 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:00:07.419 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:00:07.536 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:00:07.557 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:00:07.585 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:00:07.608 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:00:07.623 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:00:07.636 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:00:07.674 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:00:07.681 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:00:07.699 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:00:07.740 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:00:07.944 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:00:07.972 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:00:07.986 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:00:08.012 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:00:08.014 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:00:08.052 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:00:08.052 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:00:08.080 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:00:08.118 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:00:08.188 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:00:08.216 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:08.254 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:08.331 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:00:08.359 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:00:08.388 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:00:08.397 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:00:08.416 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:00:08.456 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:00:08.675 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:00:08.691 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:00:08.724 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:00:08.725 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:00:08.752 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:08.775 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:00:08.791 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:08.803 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:00:08.841 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:00:09.062 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:00:09.090 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:00:09.118 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:00:09.128 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:00:09.146 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:00:09.161 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:00:09.179 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:00:09.185 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:00:09.219 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:00:09.399 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:00:09.427 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:00:09.466 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:00:09.488 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:00:09.516 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:00:09.554 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:00:09.556 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:00:09.584 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:00:09.622 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:00:09.734 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:00:09.750 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:09.768 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:00:09.792 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:09.796 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:00:09.816 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package jq. 2024-09-12T18:00:09.835 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:00:09.843 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:00:09.882 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:00:09.942 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:00:09.970 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:00:10.008 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:00:10.078 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:00:10.103 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:00:10.135 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package socat. 2024-09-12T18:00:10.144 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:00:10.162 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:00:10.171 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:00:10.199 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:00:10.201 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:00:10.238 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:00:10.473 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:00:10.501 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:00:10.521 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:00:10.531 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:00:10.538 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:00:10.579 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:00:10.648 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:00:10.677 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:10.698 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:00:10.714 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:10.725 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:00:10.774 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:00:10.783 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package jq. 2024-09-12T18:00:10.800 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:00:10.842 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:00:10.933 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:00:10.950 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:10.991 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:11.025 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:00:11.052 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:00:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:00:11.069 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:00:11.091 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:00:11.095 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package socat. 2024-09-12T18:00:11.102 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:00:11.111 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:00:11.153 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:00:11.339 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:00:11.355 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:00:11.397 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:00:11.464 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:00:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:00:11.481 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:00:11.499 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:00:11.523 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:00:11.536 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:00:11.700 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:00:11.727 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:00:11.766 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:00:11.781 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package jq. 2024-09-12T18:00:11.797 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:00:11.830 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:00:11.860 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:00:11.877 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:11.918 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:12.058 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package socat. 2024-09-12T18:00:12.087 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:00:12.094 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:00:12.122 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:00:12.124 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:00:12.161 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:00:12.428 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:00:12.457 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:00:12.495 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:00:12.866 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:00:12.875 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:00:12.891 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:12.894 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:12.932 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:12.933 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:13.252 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:00:13.280 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:00:13.319 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:00:13.529 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:00:13.545 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:13.581 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:13.680 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:00:13.708 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:00:13.746 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:00:13.858 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:00:13.886 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:13.924 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:14.016 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2024-09-12T18:00:14.032 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:00:14.074 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:00:14.210 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:00:14.239 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:00:14.277 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:00:14.310 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2024-09-12T18:00:14.338 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:00:14.377 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:00:14.407 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:00:14.435 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:14.473 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:14.615 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:00:14.638 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:00:14.642 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:00:14.654 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:00:14.681 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:00:14.687 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:00:14.777 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:00:14.793 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:14.835 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:15.017 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:00:15.033 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:15.052 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:00:15.067 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:15.080 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:00:15.118 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:00:15.155 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:00:15.183 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:00:15.222 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:00:15.540 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:00:15.569 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:00:15.585 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:00:15.586 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:00:15.606 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:00:15.613 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:00:15.615 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:15.653 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:15.659 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:00:15.837 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:00:15.858 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:00:15.901 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:00:15.965 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:00:15.994 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:16.031 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:16.047 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:00:16.075 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:00:16.122 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:00:16.337 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:00:16.366 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:00:16.368 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:00:16.395 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:00:16.397 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:00:16.435 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:00:16.494 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:00:16.522 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:00:16.552 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:00:16.690 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:00:16.718 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:00:16.730 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:00:16.748 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:00:16.756 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:00:16.789 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:00:16.805 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:00:16.821 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:00:16.863 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:00:17.061 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:00:17.088 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:00:17.126 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:00:17.134 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:00:17.162 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:00:17.201 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:00:17.268 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:00:17.297 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:00:17.335 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:00:17.429 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:00:17.437 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:00:17.457 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4870-g46406987-1jammy_all.deb ... 2024-09-12T18:00:17.465 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:00:17.496 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:17.503 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:00:17.631 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:00:17.660 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:00:17.663 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:00:17.691 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:00:17.697 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:00:17.746 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:00:17.766 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:00:17.782 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:17.816 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:17.840 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:00:17.868 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:00:17.915 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:00:17.975 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:00:17.992 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:00:18.033 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:00:18.049 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:00:18.066 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:00:18.099 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:00:18.127 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:00:18.155 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:00:18.194 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:00:18.235 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:00:18.263 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:00:18.301 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:00:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:00:18.397 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:00:18.435 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:00:18.470 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:00:18.499 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:00:18.515 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:00:18.537 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:00:18.543 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:00:18.581 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:00:18.747 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:00:18.763 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:00:18.775 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:00:18.792 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:00:18.814 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:00:18.830 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:00:18.839 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:00:18.868 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:00:18.906 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:00:18.927 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:00:18.955 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:00:18.993 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:00:19.124 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:00:19.134 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:00:19.152 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:00:19.162 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:00:19.191 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:00:19.193 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:00:19.201 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:00:19.222 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:00:19.251 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:00:19.440 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:00:19.468 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:00:19.494 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:00:19.506 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:00:19.522 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:00:19.554 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:00:19.560 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:00:19.583 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:00:19.637 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:00:19.671 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:00:19.699 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:00:19.737 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:00:19.759 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:00:19.775 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:00:19.817 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:00:19.889 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:00:19.917 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:00:19.955 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:00:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:00:20.002 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:00:20.039 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:00:20.048 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:00:20.077 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:00:20.114 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:00:20.216 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:00:20.228 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:00:20.244 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:00:20.256 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:00:20.282 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:00:20.295 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:00:20.326 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:00:20.355 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:00:20.392 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:00:20.401 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:00:20.430 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:00:20.467 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:00:20.581 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:00:20.609 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:00:20.647 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:00:20.813 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:00:20.841 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:00:20.872 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:00:20.879 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:00:20.901 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:00:20.938 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:00:20.953 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:00:20.959 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:00:20.975 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:00:20.981 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:21.009 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:00:21.011 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:21.148 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:00:21.177 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:00:21.215 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:00:21.250 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:00:21.253 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:00:21.278 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:00:21.281 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:00:21.316 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:00:21.320 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:00:21.594 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:00:21.611 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:00:21.614 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:00:21.627 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:00:21.652 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:00:21.664 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:00:21.961 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:00:21.976 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:00:21.990 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:21.997 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:00:21.998 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:00:22.004 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:00:22.026 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:22.026 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:00:22.027 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:22.034 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:00:22.064 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:00:22.064 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:22.333 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:00:22.350 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:00:22.377 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:00:22.391 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:00:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:00:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:00:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:00:22.636 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:00:22.753 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:00:22.874 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:00:22.897 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:00:22.902 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:00:22.913 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:22.932 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:00:22.947 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:23.017 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:00:23.070 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:00:23.099 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:23.136 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:23.201 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:00:23.230 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:00:23.261 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:00:23.267 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:00:23.385 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:00:23.511 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:00:23.613 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:00:23.637 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:00:23.641 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:00:23.679 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:00:23.844 INFO:teuthology.orchestra.run.smithi121.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:00:23.900 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:00:23.905 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:23.957 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:00:23.985 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:00:24.023 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:00:24.065 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:00:24.082 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:24.123 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:24.234 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:00:24.420 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:00:24.429 INFO:teuthology.orchestra.run.smithi121.stdout:Adding system user cephadm....done 2024-09-12T18:00:24.602 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:00:24.669 INFO:teuthology.orchestra.run.smithi111.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:00:24.694 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:00:24.694 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:00:24.723 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../117-radosgw_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:24.760 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:24.789 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:24.821 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:00:24.879 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:00:25.091 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:00:25.130 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:00:25.256 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:00:25.427 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:00:25.515 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:00:25.621 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:00:25.630 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user cephadm....done 2024-09-12T18:00:25.638 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4870-g46406987-1jammy_amd64.deb ... 2024-09-12T18:00:25.681 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:25.775 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:00:25.787 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:00:25.884 INFO:teuthology.orchestra.run.smithi052.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:00:25.917 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:00:25.973 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:25.976 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:00:26.214 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:00:26.218 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:00:26.260 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:00:26.411 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:00:26.473 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:00:26.551 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user cephadm....done 2024-09-12T18:00:26.554 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:00:26.600 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:00:26.666 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:00:26.739 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:00:26.813 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:00:26.842 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:00:26.968 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:00:27.081 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:00:27.119 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:00:27.134 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:00:27.245 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:00:27.367 INFO:teuthology.orchestra.run.smithi153.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:00:27.374 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:00:27.462 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:27.503 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:00:27.546 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:00:27.634 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:00:27.723 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:00:27.885 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:00:27.915 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:00:27.997 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2024-09-12T18:00:28.128 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:00:28.175 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:00:28.178 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:00:28.194 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:28.386 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:00:28.459 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:00:28.462 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:00:28.487 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:00:28.580 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:00:28.621 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:00:28.678 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:00:28.706 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:00:28.814 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:00:28.832 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:00:28.881 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:00:28.928 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:00:28.957 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:00:28.990 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:00:29.166 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:00:29.217 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:00:29.233 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:00:29.388 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:00:29.425 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:00:29.492 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:00:29.601 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:00:29.618 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:00:29.631 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:00:29.639 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:29.695 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:00:29.710 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:00:29.821 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:00:29.890 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:00:29.945 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:00:30.000 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:00:30.070 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:00:30.126 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:00:30.181 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:30.252 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:00:30.263 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:00:30.307 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:00:30.381 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:00:30.446 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:00:30.522 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:00:30.574 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:00:30.637 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:00:30.698 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:00:30.756 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:30.876 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:00:30.974 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:00:30.999 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:00:31.013 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:00:31.059 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:00:31.124 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:00:31.125 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:00:31.168 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:00:31.209 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:00:31.250 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:00:31.276 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:00:31.286 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:00:31.406 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:00:31.451 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:00:31.503 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:00:31.593 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:31.702 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:00:31.718 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:00:31.754 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:00:31.929 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:00:32.003 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:00:32.011 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:32.126 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:00:32.160 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:00:32.180 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:00:32.224 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:00:32.262 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:00:32.263 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:00:32.306 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:00:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:00:32.388 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-12T18:00:32.432 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:00:32.515 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:00:32.564 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:00:32.641 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:00:32.690 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:00:32.725 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:00:32.743 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:32.767 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:00:32.861 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:00:33.017 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:00:33.084 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:00:33.103 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:00:33.319 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:00:33.350 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:00:33.363 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:00:33.396 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:00:33.423 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:00:33.496 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:00:33.593 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:00:33.663 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:00:33.670 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:00:33.672 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:00:33.711 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:00:33.798 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:00:33.837 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:00:33.955 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:00:34.023 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:34.138 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:00:34.149 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:00:34.298 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:00:34.417 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:00:34.522 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:00:34.549 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:00:34.550 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:00:34.675 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:34.692 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:00:34.765 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:00:34.809 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:00:34.911 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:00:34.967 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:00:34.985 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:00:35.013 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:00:35.103 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:00:35.142 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:00:35.269 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:00:35.304 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:00:35.426 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:00:35.697 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:00:35.769 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:00:35.788 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:00:35.948 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:00:36.021 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:00:36.048 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:00:36.174 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:00:36.300 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:00:36.339 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:36.341 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:00:36.466 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:00:36.592 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:00:36.634 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:00:36.681 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:00:36.902 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:36.902 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:00:36.952 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:00:36.986 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:00:36.999 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:00:37.095 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:00:37.186 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:00:37.220 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:00:37.221 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:00:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:37.347 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:00:37.579 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:00:37.648 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:00:37.648 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:00:37.864 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:00:37.916 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:00:37.982 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:00:38.105 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:00:38.167 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:38.207 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:00:38.292 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:00:38.340 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:38.449 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:00:38.466 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:00:38.592 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:38.594 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:00:38.709 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:00:38.810 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:00:38.845 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:00:38.868 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:00:38.954 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:00:39.096 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:00:39.172 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:00:39.204 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:00:39.245 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:00:39.347 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:00:39.456 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:39.497 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:00:39.606 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:00:39.607 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:00:39.748 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:39.857 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:00:39.874 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:00:39.875 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:00:39.983 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:00:40.001 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:00:40.118 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:00:40.142 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:00:40.284 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:00:40.376 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:00:40.395 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:00:40.402 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:00:40.433 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:00:40.629 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:00:40.636 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:00:40.643 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:40.703 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:00:40.794 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:00:40.880 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:40.895 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:00:41.004 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:00:41.006 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:00:41.053 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:00:41.146 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:00:41.179 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:00:41.255 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:00:41.305 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:00:41.316 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:00:41.398 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:00:41.414 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:00:41.524 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:41.540 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:00:41.575 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:00:41.598 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:00:41.612 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:00:41.833 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:00:41.835 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:00:41.843 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:00:41.858 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:00:41.959 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:00:41.968 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:00:42.094 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:00:42.100 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:42.210 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:00:42.243 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:00:42.329 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:00:42.353 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:00:42.495 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:00:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:00:42.588 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:00:42.604 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:00:42.714 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:00:42.737 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:00:42.829 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:00:42.955 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:00:43.005 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:00:43.007 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:00:43.088 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:00:43.089 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:43.133 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:00:43.170 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:00:43.273 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:00:43.339 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:43.408 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:00:43.434 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:00:43.465 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:00:43.517 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:00:43.523 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:00:43.760 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:00:43.782 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:00:43.783 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:00:43.884 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:00:43.885 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:00:44.011 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:00:44.084 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:00:44.129 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:00:44.145 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:00:44.151 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:00:44.255 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:44.271 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:00:44.278 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:00:44.335 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:00:44.343 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:00:44.436 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:00:44.530 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:44.604 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:00:44.615 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:00:44.639 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:00:44.678 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:00:44.757 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:00:44.888 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:00:44.958 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:00:45.031 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:00:45.139 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:00:45.159 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:00:45.234 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:00:45.265 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:00:45.291 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:00:45.391 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:00:45.426 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:00:45.464 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:00:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:00:45.536 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:00:45.627 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:00:45.651 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:00:45.701 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:00:45.787 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:45.811 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:00:45.895 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:00:45.896 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:00:45.944 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:00:46.195 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:00:46.239 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:00:46.257 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:00:46.288 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:00:46.389 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:46.454 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:00:46.508 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:00:46.515 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:46.548 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:00:46.581 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:00:46.624 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:00:46.825 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:00:46.840 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:00:46.877 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:00:46.936 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:46.951 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:00:46.966 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:00:47.087 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:47.162 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:00:47.213 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:00:47.226 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:00:47.275 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:00:47.489 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:47.497 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:00:47.551 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:00:47.588 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:00:47.607 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:47.615 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:47.716 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:47.741 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:47.819 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:00:47.834 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:00:47.856 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:00:47.963 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:00:47.964 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:00:47.987 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:00:48.170 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:48.250 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:00:48.262 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:00:48.296 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:48.422 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:00:48.500 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:48.543 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:00:48.621 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:48.624 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:00:48.707 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:48.746 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:48.833 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:48.872 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:00:48.883 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:00:48.895 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:00:48.960 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:49.013 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:49.156 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:49.170 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:00:49.170 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:00:49.227 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:00:49.282 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:00:49.503 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:00:49.669 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:49.839 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:00:49.946 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.072 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:00:50.099 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.109 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.143 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.210 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.217 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:00:50.271 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.311 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.380 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:00:50.437 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.563 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.637 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.665 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.763 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:00:50.791 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:50.917 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.072 INFO:teuthology.orchestra.run.smithi121.stdout:Adding group ceph....done 2024-09-12T18:00:51.136 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:00:51.136 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:00:51.183 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.201 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.292 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.327 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.415 INFO:teuthology.orchestra.run.smithi121.stdout:Adding system user ceph....done 2024-09-12T18:00:51.453 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:00:51.489 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:00:51.579 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.584 INFO:teuthology.orchestra.run.smithi121.stdout:Setting system user ceph properties....done 2024-09-12T18:00:51.596 INFO:teuthology.orchestra.run.smithi121.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:00:51.660 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.705 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.729 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:00:51.786 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.903 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:51.985 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:52.005 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:00:52.056 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:00:52.102 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:52.198 INFO:teuthology.orchestra.run.smithi111.stdout:Adding group ceph....done 2024-09-12T18:00:52.228 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:52.354 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:00:52.564 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:52.591 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user ceph....done 2024-09-12T18:00:52.706 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:52.759 INFO:teuthology.orchestra.run.smithi111.stdout:Setting system user ceph properties....done 2024-09-12T18:00:52.774 INFO:teuthology.orchestra.run.smithi111.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:00:52.914 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:00:53.171 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:00:53.172 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:00:53.214 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:00:53.242 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.359 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.468 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.569 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.650 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.695 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.723 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.769 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.833 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:53.895 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:54.004 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:00:54.021 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:54.147 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:54.230 INFO:teuthology.orchestra.run.smithi052.stdout:Adding group ceph....done 2024-09-12T18:00:54.304 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:00:54.304 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:00:54.485 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:54.599 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user ceph....done 2024-09-12T18:00:54.657 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2024-09-12T18:00:54.715 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:00:54.715 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:00:54.767 INFO:teuthology.orchestra.run.smithi052.stdout:Setting system user ceph properties....done 2024-09-12T18:00:54.786 INFO:teuthology.orchestra.run.smithi052.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:00:54.792 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:54.927 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:00:54.941 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2024-09-12T18:00:55.135 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2024-09-12T18:00:55.142 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:00:55.153 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:00:55.212 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:55.276 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:00:55.290 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:00:55.421 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:00:55.421 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:00:55.593 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:00:55.636 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:55.755 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:55.862 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:00:55.862 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:00:55.890 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:55.896 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:56.057 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:56.160 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:00:56.161 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:00:56.166 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:56.357 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:00:56.357 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:00:56.388 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:56.605 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:00:56.605 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:00:56.606 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:00:56.606 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:00:56.647 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:56.748 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:56.874 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.060 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.081 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:00:57.082 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:00:57.084 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-base (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.156 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.409 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:00:57.414 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:00:57.418 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:00:57.418 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:00:57.584 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.726 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.854 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.861 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.894 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mds (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:57.941 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:58.012 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:58.077 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:00:58.077 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:00:58.084 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:58.117 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:00:58.117 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:00:58.235 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:58.373 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:00:58.449 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:00:58.449 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:00:58.473 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:00:58.547 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:58.630 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:58.644 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:00:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:00:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:00:58.857 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:00:58.858 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:00:58.953 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:59.104 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:59.230 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:59.273 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:59.364 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-osd (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:59.381 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:00:59.544 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:00:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:00:59.649 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:00:59.649 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:00:59.726 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:00:59.818 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:00:59.854 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:00:59.970 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:00:59.992 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:00.101 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:00.124 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:00.244 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:00.250 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:00.418 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mon (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:00.458 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:01:00.459 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:01:00.529 INFO:teuthology.orchestra.run.smithi121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:01:00.533 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:01:00.630 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T18:01:00.632 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:01:00.632 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:01:00.843 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-09-12T18:01:00.844 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-09-12T18:01:00.962 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:01.048 INFO:teuthology.orchestra.run.smithi121.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:01:01.048 INFO:teuthology.orchestra.run.smithi121.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:01:01.048 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:01:01.049 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:01:01.049 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:01:01.049 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:01:01.049 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:01:01.049 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:01:01.049 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:01:01.050 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-09-12T18:01:01.051 INFO:teuthology.orchestra.run.smithi121.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:01:01.053 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-09-12T18:01:01.053 INFO:teuthology.orchestra.run.smithi121.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:01:01.084 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-09-12T18:01:01.085 INFO:teuthology.orchestra.run.smithi121.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:01:01.087 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages will be upgraded: 2024-09-12T18:01:01.088 INFO:teuthology.orchestra.run.smithi121.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:01:01.113 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:01.130 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:01:01.153 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-cephadm (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:01.239 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:01.268 INFO:teuthology.orchestra.run.smithi121.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:01:01.269 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:01:01.269 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:01:01.269 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:01:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:01.391 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:01.597 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-dashboard (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:01.735 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:01:01.745 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:01:01.748 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-volume (19.3.0-4870-g46406987-1jammy) ... 2024-09-12T18:01:01.780 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:01:01.783 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:01:01.844 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:01:01.845 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:01:01.996 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:01:01.998 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:01:01.999 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:01:02.001 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:01:02.034 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:01:02.035 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:01:02.037 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:01:02.038 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:01:02.038 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:01:02.055 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T18:01:02.055 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T18:01:02.101 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:01:02.210 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:01:02.246 INFO:teuthology.orchestra.run.smithi111.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:01:02.246 INFO:teuthology.orchestra.run.smithi111.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:01:02.246 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:01:02.246 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:01:02.246 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:01:02.246 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:01:02.247 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:01:02.247 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:01:02.247 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:01:02.247 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-09-12T18:01:02.248 INFO:teuthology.orchestra.run.smithi111.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:01:02.250 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-09-12T18:01:02.250 INFO:teuthology.orchestra.run.smithi111.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:01:02.278 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-09-12T18:01:02.279 INFO:teuthology.orchestra.run.smithi111.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:01:02.281 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-09-12T18:01:02.281 INFO:teuthology.orchestra.run.smithi111.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:01:02.332 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:01:02.332 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:01:02.332 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:01:02.332 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:01:02.354 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:01:02.432 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:01:02.456 INFO:teuthology.orchestra.run.smithi121.stdout:Preconfiguring packages ... 2024-09-12T18:01:02.492 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:01:02.493 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:01:02.493 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:01:02.502 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:01:02.502 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:01:02.503 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:01:02.504 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:01:02.504 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:01:02.556 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 5,494 kB in 1s (5,377 kB/s) 2024-09-12T18:01:02.692 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package flex. 2024-09-12T18:01:02.786 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:01:02.792 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:02.840 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:01:02.866 INFO:teuthology.orchestra.run.smithi111.stdout:Preconfiguring packages ... 2024-09-12T18:01:02.968 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 5,494 kB in 0s (22.7 MB/s) 2024-09-12T18:01:03.089 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:01:03.095 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package flex. 2024-09-12T18:01:03.193 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:01:03.198 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:03.243 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:01:03.346 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:01:03.373 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:01:03.529 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:01:03.740 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:01:03.743 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:01:03.798 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T18:01:03.894 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:01:03.995 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-12T18:01:03.996 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-12T18:01:04.022 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:01:04.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-09-12T18:01:04.066 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:04.083 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-12T18:01:04.108 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:01:04.178 INFO:teuthology.orchestra.run.smithi153.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:01:04.178 INFO:teuthology.orchestra.run.smithi153.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:01:04.178 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:01:04.178 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:01:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:01:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:01:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:01:04.179 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:01:04.179 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:01:04.180 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-12T18:01:04.181 INFO:teuthology.orchestra.run.smithi153.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:01:04.182 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-12T18:01:04.182 INFO:teuthology.orchestra.run.smithi153.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:01:04.211 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-12T18:01:04.212 INFO:teuthology.orchestra.run.smithi153.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:01:04.213 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-12T18:01:04.213 INFO:teuthology.orchestra.run.smithi153.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:01:04.265 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:01:04.265 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:01:04.265 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:01:04.265 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:01:04.297 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-12T18:01:04.298 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-12T18:01:04.367 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:01:04.427 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:01:04.428 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:01:04.442 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:01:04.443 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:01:04.444 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:01:04.445 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:01:04.445 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:01:04.510 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:01:04.511 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:01:04.511 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:01:04.511 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:01:04.512 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-09-12T18:01:04.513 INFO:teuthology.orchestra.run.smithi052.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-09-12T18:01:04.514 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-09-12T18:01:04.514 INFO:teuthology.orchestra.run.smithi052.stdout: bison-doc flex-doc libssl-doc 2024-09-12T18:01:04.546 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-09-12T18:01:04.548 INFO:teuthology.orchestra.run.smithi052.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-09-12T18:01:04.549 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2024-09-12T18:01:04.550 INFO:teuthology.orchestra.run.smithi052.stdout: libssl3 libuuid1 uuid-dev 2024-09-12T18:01:04.577 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:01:04.583 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:01:04.713 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:01:04.731 INFO:teuthology.orchestra.run.smithi052.stdout:3 upgraded, 7 newly installed, 0 to remove and 328 not upgraded. 2024-09-12T18:01:04.731 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 5,494 kB of archives. 2024-09-12T18:01:04.731 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-09-12T18:01:04.731 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T18:01:04.770 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:04.809 INFO:teuthology.orchestra.run.smithi153.stdout:Preconfiguring packages ... 2024-09-12T18:01:04.915 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 5,494 kB in 0s (21.7 MB/s) 2024-09-12T18:01:05.044 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package flex. 2024-09-12T18:01:05.135 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:01:05.141 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:05.177 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:01:05.197 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:01:05.210 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T18:01:05.331 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:01:05.336 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:01:05.344 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:01:05.468 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T18:01:05.470 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T18:01:05.470 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T18:01:05.483 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:01:05.507 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T18:01:05.513 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T18:01:05.515 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T18:01:05.516 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T18:01:05.516 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T18:01:05.711 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:01:05.830 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:01:05.893 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:01:05.946 INFO:teuthology.orchestra.run.smithi052.stdout:Preconfiguring packages ... 2024-09-12T18:01:05.975 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:01:06.039 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:01:06.062 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 5,494 kB in 1s (5,335 kB/s) 2024-09-12T18:01:06.202 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package flex. 2024-09-12T18:01:06.245 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package bison. 2024-09-12T18:01:06.300 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176253 files and directories currently installed.) 2024-09-12T18:01:06.306 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:06.350 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:01:06.350 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T18:01:06.355 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:01:06.405 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:01:06.417 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:01:06.419 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:06.764 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:01:06.773 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package bison. 2024-09-12T18:01:06.792 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:01:06.830 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:01:06.877 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:01:06.883 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:01:06.916 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:01:06.922 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:01:06.934 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:01:07.018 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:01:07.041 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:01:07.084 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:01:07.112 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:01:07.159 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:01:07.190 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T18:01:07.327 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:01:07.343 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:01:07.377 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:01:07.450 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:01:07.513 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:01:07.540 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:07.579 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:07.580 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:01:07.593 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:07.656 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:01:07.684 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:01:07.723 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:01:07.848 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:01:07.876 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:07.900 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:01:07.914 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:08.037 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:01:08.064 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:08.103 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:08.122 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:01:08.127 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:01:08.167 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:01:08.195 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:01:08.236 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:08.264 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package bison. 2024-09-12T18:01:08.272 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:01:08.305 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:01:08.322 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:08.364 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:08.367 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:01:08.373 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:01:08.416 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:01:08.616 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:01:08.633 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:01:08.675 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:08.682 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T18:01:08.711 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:01:08.751 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:01:08.779 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:01:08.817 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:01:08.821 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T18:01:08.948 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:01:09.046 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:01:09.062 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:01:09.074 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:01:09.104 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:01:09.149 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:01:09.153 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:01:09.200 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:09.280 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:01:09.342 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:01:09.431 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:01:09.474 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:01:09.477 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:09.503 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:09.541 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:09.563 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package bison. 2024-09-12T18:01:09.582 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:09.628 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:01:09.672 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176326 files and directories currently installed.) 2024-09-12T18:01:09.678 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T18:01:09.718 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:01:09.724 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:01:09.733 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:01:09.779 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:09.793 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:01:09.810 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:09.851 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:09.875 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:09.890 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:01:10.002 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:01:10.024 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:01:10.049 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T18:01:10.078 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T18:01:10.087 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:01:10.090 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:01:10.104 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:01:10.124 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:01:10.137 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:10.153 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:10.280 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:01:10.403 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T18:01:10.431 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T18:01:10.440 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:01:10.469 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:01:10.598 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:01:10.725 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:01:10.851 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:01:11.000 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T18:01:11.029 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:11.092 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:11.158 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:01:11.304 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:11.386 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T18:01:11.414 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T18:01:11.461 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:11.605 INFO:teuthology.orchestra.run.smithi121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:01:11.610 DEBUG:teuthology.parallel:result is None 2024-09-12T18:01:11.616 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:01:11.655 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:01:11.696 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T18:01:11.714 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T18:01:11.755 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:11.772 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:11.873 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:01:11.972 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:01:12.067 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:12.152 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:01:12.161 DEBUG:teuthology.parallel:result is None 2024-09-12T18:01:12.194 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:01:12.234 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T18:01:12.345 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:01:12.351 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T18:01:12.477 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T18:01:12.578 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T18:01:12.679 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T18:01:12.797 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:12.923 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T18:01:13.012 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T18:01:13.074 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T18:01:13.201 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:01:13.353 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:01:13.554 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:01:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:01:14.006 DEBUG:teuthology.parallel:result is None 2024-09-12T18:01:14.554 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:01:15.064 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:01:15.069 DEBUG:teuthology.parallel:result is None 2024-09-12T18:01:15.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:01:15.214 DEBUG:teuthology.orchestra.run.smithi052:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:01:15.233 INFO:teuthology.orchestra.run.smithi052.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:01:15.233 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:01:15.234 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:01:15.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:01:15.381 DEBUG:teuthology.orchestra.run.smithi111:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:01:15.400 INFO:teuthology.orchestra.run.smithi111.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:01:15.401 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:01:15.401 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:01:15.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:01:15.547 DEBUG:teuthology.orchestra.run.smithi121:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:01:15.566 INFO:teuthology.orchestra.run.smithi121.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:01:15.566 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:01:15.566 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:01:15.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=46406987da2067f022005d68ecbb989daaabb837 2024-09-12T18:01:15.704 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:01:15.724 INFO:teuthology.orchestra.run.smithi153.stdout:19.3.0-4870-g46406987-1jammy 2024-09-12T18:01:15.724 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4870-g46406987-1jammy 2024-09-12T18:01:15.724 INFO:teuthology.task.install:The correct ceph version 19.3.0-4870-g46406987-1jammy is installed. 2024-09-12T18:01:15.726 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T18:01:15.726 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:15.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:01:15.742 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:15.742 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:01:15.756 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:15.756 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:01:15.771 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:15.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:01:15.788 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T18:01:15.788 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:15.788 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:01:15.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:01:15.858 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:15.858 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:01:15.871 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:01:15.924 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:15.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:01:15.937 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:01:15.993 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:15.993 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:01:16.006 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:01:16.061 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T18:01:16.061 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:16.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:01:16.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:01:16.134 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:16.135 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:01:16.148 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:01:16.204 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:16.204 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:01:16.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:01:16.272 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:16.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:01:16.286 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:01:16.341 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T18:01:16.341 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:16.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:01:16.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:01:16.410 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:16.410 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:01:16.423 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:01:16.476 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:16.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:01:16.489 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:01:16.544 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:16.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:01:16.558 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:01:16.616 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T18:01:16.696 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T18:01:16.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-09-12T18:01:16.699 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2024-09-12T18:01:16.701 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-09-12T18:01:16.703 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-09-12T18:01:16.715 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T18:01:16.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:01:16.755 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:01:16.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:01:16.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:01:16.772 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T18:01:16.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:01:16.811 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:01:16.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:01:16.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:01:16.838 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T18:01:16.838 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T18:01:16.839 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'bhubbard@redhat.com', 'first_in_suite': False, 'job_id': '7901157', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'owner': 'scheduled_bhubbard@teuthology', 'priority': 150, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 245, 'sha1': '46406987da2067f022005d68ecbb989daaabb837', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0qLj256Y9aqB0tTKvNVU3+jd65cakJk4titvP5JiLYjSJjzErDTKlI+IQ8S3k7Ck5ArTLxj1CNyIvriWfu/rE=', 'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcbfekUAiNhtPoZugW4zDUBwE1XZfLvYpmrgZeT/ccw6aeKT0K6VhaM5QIXBq2b/7HeuvUdvTF5TvQbujg3jSo=', 'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFSx+iIAb3XNMw2q40fzbdwquZzrCwsGnsDHIu4JgMgOwvzplNhUj+NT9i7fXxBjuXsPwBatMxzJHzeJ+gI0Sg=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQ5fI2FEdhrbPqV1fUDZ4Zf4qhz82M7btj9NEhn7yEO2lU5aj0r3R9Uzl8RYGoLcmpYPK8AaOBXEK3HgQQQUM0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_02:37:30', 'tube': 'smithi', 'user': 'bhubbard', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T18:01:16.839 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:01:16.867 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:01:16.869 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:01:16.872 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:01:16.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:01:16.915 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:01:16.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:01:16.920 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:01:16.933 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:16.933 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:01:16.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:01:16.977 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-09-12T18:01:17.025 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:01:17.025 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:17.025 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-12T18:01:17.025 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:17.025 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-12 17:55:22.544750482 +0000 2024-09-12T18:01:17.025 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-12 17:55:22.296752697 +0000 2024-09-12T18:01:17.026 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-12 17:55:22.296752697 +0000 2024-09-12T18:01:17.026 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-12T18:01:17.026 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:01:17.079 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-12T18:01:17.079 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-12T18:01:17.079 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000353159 s, 1.4 MB/s 2024-09-12T18:01:17.080 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:01:17.130 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-09-12T18:01:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:01:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:17.177 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-12T18:01:17.177 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:17.177 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-12 17:55:23.028746159 +0000 2024-09-12T18:01:17.177 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-12 17:55:22.772748446 +0000 2024-09-12T18:01:17.177 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-12 17:55:22.772748446 +0000 2024-09-12T18:01:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-12T18:01:17.178 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:01:17.231 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-12T18:01:17.231 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-12T18:01:17.231 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.00040156 s, 1.3 MB/s 2024-09-12T18:01:17.232 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:01:17.282 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-09-12T18:01:17.328 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:01:17.329 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:17.329 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T18:01:17.329 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:17.329 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-12 17:55:23.276743944 +0000 2024-09-12T18:01:17.329 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-12 17:55:23.272743980 +0000 2024-09-12T18:01:17.329 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-12 17:55:23.272743980 +0000 2024-09-12T18:01:17.329 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-12T18:01:17.329 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:01:17.383 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-12T18:01:17.383 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-12T18:01:17.383 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000413811 s, 1.2 MB/s 2024-09-12T18:01:17.384 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:01:17.434 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-09-12T18:01:17.481 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:01:17.481 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:17.481 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-12T18:01:17.481 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:17.481 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-12 17:55:24.012737369 +0000 2024-09-12T18:01:17.481 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-12 17:55:23.756739657 +0000 2024-09-12T18:01:17.481 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-12 17:55:23.756739657 +0000 2024-09-12T18:01:17.481 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-12T18:01:17.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:01:17.535 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-12T18:01:17.535 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-12T18:01:17.535 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000298513 s, 1.7 MB/s 2024-09-12T18:01:17.537 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:01:17.586 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T18:01:17.586 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:17.586 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:01:17.592 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:01:17.592 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-09-12T18:01:17.638 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:01:17.638 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:17.638 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-12T18:01:17.638 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:17.638 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-12 17:55:25.037151018 +0000 2024-09-12T18:01:17.638 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-12 17:55:24.753153554 +0000 2024-09-12T18:01:17.639 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-12 17:55:24.753153554 +0000 2024-09-12T18:01:17.639 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-09-12T18:01:17.639 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:01:17.692 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-12T18:01:17.692 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-12T18:01:17.692 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000457853 s, 1.1 MB/s 2024-09-12T18:01:17.693 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:01:17.743 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-09-12T18:01:17.789 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:01:17.790 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:17.790 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-12T18:01:17.790 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:17.790 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-12 17:55:25.505146838 +0000 2024-09-12T18:01:17.790 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-12 17:55:25.269148946 +0000 2024-09-12T18:01:17.790 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-12 17:55:25.269148946 +0000 2024-09-12T18:01:17.790 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-09-12T18:01:17.790 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:01:17.844 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-12T18:01:17.844 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-12T18:01:17.844 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000397927 s, 1.3 MB/s 2024-09-12T18:01:17.845 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:01:17.895 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-09-12T18:01:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:01:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:17.942 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-12T18:01:17.942 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:17.942 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-12 17:55:25.961142765 +0000 2024-09-12T18:01:17.943 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-12 17:55:25.713144980 +0000 2024-09-12T18:01:17.943 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-12 17:55:25.713144980 +0000 2024-09-12T18:01:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-09-12T18:01:17.943 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:01:17.996 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-12T18:01:17.996 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-12T18:01:17.996 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000389627 s, 1.3 MB/s 2024-09-12T18:01:17.997 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:01:18.047 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-09-12T18:01:18.094 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:01:18.094 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:18.094 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-09-12T18:01:18.094 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:18.094 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-12 17:55:26.473138191 +0000 2024-09-12T18:01:18.094 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-12 17:55:26.217140477 +0000 2024-09-12T18:01:18.094 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-12 17:55:26.217140477 +0000 2024-09-12T18:01:18.094 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-09-12T18:01:18.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:01:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-12T18:01:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-12T18:01:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000436191 s, 1.2 MB/s 2024-09-12T18:01:18.149 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:01:18.199 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T18:01:18.199 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:18.199 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:01:18.205 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:01:18.205 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-12T18:01:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:01:18.250 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:18.251 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-09-12T18:01:18.251 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:18.251 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 17:55:23.515083593 +0000 2024-09-12T18:01:18.251 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 17:55:23.263085844 +0000 2024-09-12T18:01:18.251 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 17:55:23.263085844 +0000 2024-09-12T18:01:18.251 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-12T18:01:18.251 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:01:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T18:01:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T18:01:18.305 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000462762 s, 1.1 MB/s 2024-09-12T18:01:18.306 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:01:18.355 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-12T18:01:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:01:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:18.402 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-12T18:01:18.402 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:18.402 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 17:55:23.723081735 +0000 2024-09-12T18:01:18.402 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 17:55:23.719081771 +0000 2024-09-12T18:01:18.402 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 17:55:23.719081771 +0000 2024-09-12T18:01:18.402 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-12T18:01:18.403 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:01:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T18:01:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T18:01:18.456 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000379769 s, 1.3 MB/s 2024-09-12T18:01:18.457 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:01:18.507 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-12T18:01:18.554 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:01:18.554 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:18.554 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-12T18:01:18.554 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:18.555 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 17:55:24.459075165 +0000 2024-09-12T18:01:18.555 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 17:55:24.191077555 +0000 2024-09-12T18:01:18.555 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 17:55:24.191077555 +0000 2024-09-12T18:01:18.555 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-12T18:01:18.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:01:18.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T18:01:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T18:01:18.609 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000419833 s, 1.2 MB/s 2024-09-12T18:01:18.610 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:01:18.659 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-12T18:01:18.706 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:01:18.706 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:01:18.706 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-09-12T18:01:18.706 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:01:18.706 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 17:55:24.935070916 +0000 2024-09-12T18:01:18.706 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 17:55:24.699073024 +0000 2024-09-12T18:01:18.706 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 17:55:24.699073024 +0000 2024-09-12T18:01:18.706 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-12T18:01:18.707 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:01:18.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T18:01:18.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T18:01:18.761 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000408143 s, 1.3 MB/s 2024-09-12T18:01:18.762 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:01:18.811 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T18:01:18.811 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T18:01:18.811 INFO:tasks.ceph:Generating config... 2024-09-12T18:01:18.813 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T18:01:18.813 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T18:01:18.813 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T18:01:18.813 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T18:01:18.813 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T18:01:18.813 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T18:01:18.813 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-12T18:01:18.813 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-12T18:01:18.813 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T18:01:18.813 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T18:01:18.813 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T18:01:18.813 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T18:01:18.814 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T18:01:18.814 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T18:01:18.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T18:01:18.851 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T18:01:18.864 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T18:01:18.942 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:01:19.001 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]'), ('mon.c', '[v2:172.21.15.52:3302,v1:172.21.15.52:6791]')] 2024-09-12T18:01:19.002 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-09-12T18:01:19.003 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:19.003 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T18:01:19.050 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --addv b '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]' --addv c '[v2:172.21.15.52:3302,v1:172.21.15.52:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:19.138 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:19.138 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid da5a949a-216b-4267-953a-8d92e3d25b1d 2024-09-12T18:01:19.138 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-09-12T18:01:19.138 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-09-12T18:01:19.138 INFO:teuthology.orchestra.run.smithi052.stdout:fsid da5a949a-216b-4267-953a-8d92e3d25b1d 2024-09-12T18:01:19.138 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-09-12T18:01:19.138988+0000 2024-09-12T18:01:19.139 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-12T18:01:19.138988+0000 2024-09-12T18:01:19.139 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-09-12T18:01:19.139 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-09-12T18:01:19.139 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-12T18:01:19.139 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.b 2024-09-12T18:01:19.139 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.52:3302/0,v1:172.21.15.52:6791/0] mon.c 2024-09-12T18:01:19.139 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T18:01:19.140 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T18:01:19.145 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID da5a949a-216b-4267-953a-8d92e3d25b1d... 2024-09-12T18:01:19.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:01:19.191 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:01:19.193 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:01:19.196 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:01:19.219 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-12T18:01:19.219 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-09-12T18:01:19.220 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-09-12T18:01:19.221 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:01:19.222 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = da5a949a-216b-4267-953a-8d92e3d25b1d 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-09-12T18:01:19.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.224 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-09-12T18:01:19.225 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore compression algorithm = snappy 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore compression mode = aggressive 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:01:19.226 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: osd max markdown count = 1000 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-09-12T18:01:19.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.228 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-09-12T18:01:19.229 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-09-12T18:01:19.230 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-09-12T18:01:19.230 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-09-12T18:01:19.230 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:01:19.230 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:01:19.230 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-09-12T18:01:19.230 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-09-12T18:01:19.230 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-09-12T18:01:19.230 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-09-12T18:01:19.231 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-12T18:01:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-12T18:01:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:01:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-12T18:01:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-12T18:01:19.231 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:01:19.232 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-12T18:01:19.233 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = da5a949a-216b-4267-953a-8d92e3d25b1d 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-12T18:01:19.234 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.235 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-12T18:01:19.236 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore compression algorithm = snappy 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore compression mode = aggressive 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:01:19.237 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: osd max markdown count = 1000 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.238 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:01:19.239 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-12T18:01:19.240 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-09-12T18:01:19.241 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:01:19.242 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.243 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = da5a949a-216b-4267-953a-8d92e3d25b1d 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-09-12T18:01:19.244 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.245 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-09-12T18:01:19.246 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore compression algorithm = snappy 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore compression mode = aggressive 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:01:19.247 INFO:teuthology.orchestra.run.smithi121.stdout: osd max markdown count = 1000 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-12T18:01:19.248 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.249 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:01:19.250 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2024-09-12T18:01:19.251 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.252 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:01:19.253 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = da5a949a-216b-4267-953a-8d92e3d25b1d 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.254 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug trim objects = true 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2024-09-12T18:01:19.255 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore block size = 96636764160 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore compression algorithm = snappy 2024-09-12T18:01:19.256 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore compression mode = aggressive 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore fsck on mount = True 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluefs = 1/20 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluestore = 1/20 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: debug rocksdb = 4/10 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd full ratio = 0.9 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: osd blocked scrub grace period = 3600 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: osd max markdown count = 1000 2024-09-12T18:01:19.257 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = bluestore 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-09-12T18:01:19.258 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:01:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:01:19.260 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2024-09-12T18:01:19.261 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.b] 2024-09-12T18:01:19.261 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.c] 2024-09-12T18:01:19.261 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.a] 2024-09-12T18:01:19.263 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T18:01:19.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T18:01:19.358 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T18:01:19.358 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:19.359 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T18:01:19.364 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:19.364 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T18:01:19.410 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-09-12T18:01:19.410 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:19.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:01:19.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:01:19.476 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:19.476 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:19.522 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:01:19.522 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:19.522 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:01:19.523 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:01:19.545 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:19.545 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:19.593 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T18:01:19.593 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:19.593 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:01:19.593 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:01:19.616 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:19.617 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:19.662 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:01:19.662 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:19.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:01:19.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:01:19.685 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:19.685 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:19.734 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T18:01:19.734 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T18:01:19.735 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T18:01:19.781 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T18:01:19.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T18:01:19.866 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T18:01:19.869 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T18:01:19.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T18:01:19.954 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T18:01:19.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T18:01:20.010 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T18:01:20.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T18:01:20.089 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T18:01:20.099 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T18:01:20.100 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T18:01:20.100 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T18:01:20.114 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T18:01:20.114 INFO:tasks.ceph:role: osd.0 2024-09-12T18:01:20.114 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:01:20.114 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:01:20.179 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:01:20.654 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-12T18:01:20.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-12T18:01:20.656 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T18:01:20.804 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T18:01:20.816 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:01:20.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:01:20.817 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:20.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:01:20.923+0000 7f58250f77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T18:01:20.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:01:20.931+0000 7f58250f77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T18:01:20.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:01:20.931+0000 7f58250f77c0 -1 bdev(0x55e83985d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T18:01:20.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:01:20.931+0000 7f58250f77c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T18:01:24.072 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T18:01:24.086 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T18:01:24.101 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T18:01:24.101 INFO:tasks.ceph:role: osd.1 2024-09-12T18:01:24.102 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T18:01:24.102 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:01:24.165 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:01:24.166 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:01:24.623 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-12T18:01:24.625 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-12T18:01:24.625 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T18:01:24.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T18:01:24.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:01:24.735 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:01:24.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:24.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T18:01:24.896+0000 7f67942bf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T18:01:24.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T18:01:24.900+0000 7f67942bf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T18:01:24.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T18:01:24.900+0000 7f67942bf7c0 -1 bdev(0x558c6068f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T18:01:24.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T18:01:24.900+0000 7f67942bf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T18:01:28.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T18:01:28.042 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T18:01:28.057 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T18:01:28.058 INFO:tasks.ceph:role: osd.2 2024-09-12T18:01:28.058 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:01:28.058 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:01:28.122 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:01:28.123 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:01:28.584 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T18:01:28.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T18:01:28.586 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T18:01:28.684 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T18:01:28.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:01:28.696 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:01:28.696 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:28.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:01:28.814+0000 7f4e4b7bd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T18:01:28.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:01:28.814+0000 7f4e4b7bd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T18:01:28.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:01:28.818+0000 7f4e4b7bd7c0 -1 bdev(0x560a00fa9800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T18:01:28.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:01:28.818+0000 7f4e4b7bd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T18:01:31.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T18:01:31.966 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T18:01:31.966 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:31.966 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T18:01:31.982 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:31.982 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T18:01:32.038 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:32.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T18:01:32.094 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:32.094 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T18:01:32.109 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:32.109 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T18:01:32.123 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:32.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T18:01:32.137 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:01:32.137 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T18:01:32.142 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T18:01:32.142 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBvLONmx2aYLhAAxV9NWXgF/63vfg0gRLZ7AQ== 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBvLONm54SwMxAASiWkSXtAzzVgxRizzz91Wg== 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBvLONm+LHmOBAADASmnGxlSf7y4b2UJ34/xQ== 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBwLONmw1lqNxAAlTUXAur5ByPt+dMZ2/PnHw== 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-09-12T18:01:32.197 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQB0LONmb3DQNRAA3x68gl7kKwAm/FZabkbGfg== 2024-09-12T18:01:32.198 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-09-12T18:01:32.198 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQB4LONmIniYMBAAVp3S4XLib4v4XIIuXECAag== 2024-09-12T18:01:32.198 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-12T18:01:32.198 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQBwLONmf65dBRAAgO5IUdf/qphh+AzVEhuGoQ== 2024-09-12T18:01:32.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:01:32.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:01:32.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T18:01:32.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:01:32.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:01:32.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:01:32.635 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T18:01:32.685 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T18:01:32.685 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T18:01:32.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:01:32.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T18:01:32.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T18:01:32.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:01:32.961 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T18:01:32.972 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T18:01:33.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:01:33.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T18:01:33.129 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:01:33.173 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T18:01:33.173 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T18:01:33.173 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T18:01:33.215 INFO:tasks.ceph.mon.a:Started 2024-09-12T18:01:33.215 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T18:01:33.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T18:01:33.218 INFO:tasks.ceph.mon.b:Started 2024-09-12T18:01:33.218 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T18:01:33.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T18:01:33.220 INFO:tasks.ceph.mon.c:Started 2024-09-12T18:01:33.221 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T18:01:33.221 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T18:01:33.221 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T18:01:33.223 INFO:tasks.ceph.mgr.x:Started 2024-09-12T18:01:33.224 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T18:01:33.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T18:01:33.226 INFO:tasks.ceph.mgr.y:Started 2024-09-12T18:01:33.226 DEBUG:tasks.ceph:set 0 configs 2024-09-12T18:01:33.226 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T18:01:33.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T18:01:33.673 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-09-12T18:01:33.693 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T18:01:33.693 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T18:01:33.694 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:01:33.694 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T18:01:33.708 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T18:01:33.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T18:01:33.721 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:01:33.721 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T18:01:33.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new f692452d-28b8-4aad-928e-fe1805e23b68 0 2024-09-12T18:01:33.990 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-09-12T18:01:34.008 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new b5b3807e-e3b5-4530-adc6-af19dd31e340 1 2024-09-12T18:01:34.215 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-12T18:01:34.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 926e4870-279e-45c7-9d6c-5841397a5e6c 2 2024-09-12T18:01:34.443 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-09-12T18:01:34.461 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T18:01:34.462 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T18:01:34.464 INFO:tasks.ceph.osd.0:Started 2024-09-12T18:01:34.464 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T18:01:34.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T18:01:34.467 INFO:tasks.ceph.osd.1:Started 2024-09-12T18:01:34.467 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T18:01:34.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T18:01:34.470 INFO:tasks.ceph.osd.2:Started 2024-09-12T18:01:34.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:34.674 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:34.442067+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:34.691 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T18:01:34.691 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T18:01:34.994 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:35.183 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-12T18:01:35.183 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":5,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:34.442067+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:35.199 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T18:01:35.527 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:01:35.526+0000 7ff252a457c0 -1 Falling back to public interface 2024-09-12T18:01:35.530 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:01:35.530+0000 7f7a8d0ca7c0 -1 Falling back to public interface 2024-09-12T18:01:35.539 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:01:35.536+0000 7f67372747c0 -1 Falling back to public interface 2024-09-12T18:01:36.572 INFO:tasks.ceph.mgr.x.smithi052.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T18:01:36.573 INFO:tasks.ceph.mgr.x.smithi052.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T18:01:36.573 INFO:tasks.ceph.mgr.x.smithi052.stderr: from numpy import show_config as show_numpy_config 2024-09-12T18:01:36.573 INFO:tasks.ceph.mgr.y.smithi052.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T18:01:36.573 INFO:tasks.ceph.mgr.y.smithi052.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T18:01:36.573 INFO:tasks.ceph.mgr.y.smithi052.stderr: from numpy import show_config as show_numpy_config 2024-09-12T18:01:39.348 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:01:39.346+0000 7f7a8d0ca7c0 -1 osd.0 0 log_to_monitors true 2024-09-12T18:01:39.355 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:01:39.354+0000 7ff252a457c0 -1 osd.2 0 log_to_monitors true 2024-09-12T18:01:39.383 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:01:39.380+0000 7f67372747c0 -1 osd.1 0 log_to_monitors true 2024-09-12T18:01:39.577 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-09-12T18:01:39.576+0000 7fbeeb9d0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T18:01:39.578 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-09-12T18:01:39.576+0000 7fbeeb9d0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T18:01:41.433 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:01:41.430+0000 7ff24e9ee640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T18:01:41.454 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:01:41.454+0000 7ff246820640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:01:41.462 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:01:41.460+0000 7f673321d640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T18:01:41.482 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:01:41.480+0000 7f672b04f640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:01:41.503 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:41.515 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:01:41.514+0000 7f7a89885640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T18:01:41.529 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:01:41.530+0000 7f7a80ea5640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:01:41.817 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-12T18:01:41.817 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":7,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:40.611540+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:41.835 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T18:01:48.137 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:48.452 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-12T18:01:48.452 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":11,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:45.481191+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:48.469 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-12T18:01:48.469 INFO:tasks.ceph:Creating RBD pool 2024-09-12T18:01:48.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T18:01:49.518 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2024-09-12T18:01:49.541 DEBUG:teuthology.orchestra.run.smithi052:> rbd --cluster ceph pool init rbd 2024-09-12T18:01:52.565 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T18:01:52.565 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T18:01:52.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T18:01:52.568 INFO:tasks.ceph.mds.a:Started 2024-09-12T18:01:52.568 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T18:01:52.568 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:01:52.650 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-12T18:01:52.916 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:52.917 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"btime":"2024-09-12T18:01:52:671025+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6803/2379477754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2379477754},{"type":"v1","addr":"172.21.15.52:6803","nonce":2379477754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T18:01:52.917 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-09-12T18:01:52.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T18:01:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:53.225 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-12T18:01:53.225 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:01:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-12T18:01:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-12T18:01:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:01:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:01:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2024-09-12T18:01:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2024-09-12T18:01:53.226 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:01:53.226 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-12T18:01:53.242 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T18:01:53.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T18:01:53.681 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-12T18:01:53.700 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T18:01:54.686 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-12T18:01:54.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T18:01:55.680 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 3 and data pool 4 2024-09-12T18:01:55.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:56.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:56.011 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:55.052016+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:56.030 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:56.346 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:56.347 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":18,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:55.052016+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:56.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T18:01:57.706 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T18:01:57.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T18:01:58.679 INFO:tasks.ceph.mds.a.smithi052.stderr:2024-09-12T18:01:58.676+0000 7ff50919a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T18:01:58.716 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T18:01:58.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:01:59.066 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:59.066 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:01:55.051940+0000","modified":"2024-09-12T18:01:58.061122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6803/2379477754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2379477754},{"type":"v1","addr":"172.21.15.52:6803","nonce":2379477754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-09-12T18:01:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-09-12T18:01:59.085 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:01:59.380 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:59.380 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:58.296887+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:01:59.397 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:01:59.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:01:59.703 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:01:59.705 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:01:59.719 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T18:01:58.559722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90100,"kb_used_data":680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025420,"statfs":{"total":289910292480,"available":289818030080,"internally_reserved":0,"allocated":696320,"data_stored":1362612,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001011"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267064+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:01:57.267064+0000","last_peered":"2024-09-12T18:01:57.267064+0000","last_clean":"2024-09-12T18:01:57.267064+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:01:57.267064+0000","last_undegraded":"2024-09-12T18:01:57.267064+0000","last_fullsized":"2024-09-12T18:01:57.267064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267415+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:01:57.267415+0000","last_peered":"2024-09-12T18:01:57.267415+0000","last_clean":"2024-09-12T18:01:57.267415+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:01:57.267415+0000","last_undegraded":"2024-09-12T18:01:57.267415+0000","last_fullsized":"2024-09-12T18:01:57.267415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578608+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:01:56.578608+0000","last_peered":"2024-09-12T18:01:56.578608+0000","last_clean":"2024-09-12T18:01:56.578608+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:01:56.578608+0000","last_undegraded":"2024-09-12T18:01:56.578608+0000","last_fullsized":"2024-09-12T18:01:56.578608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576895+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:01:56.576895+0000","last_peered":"2024-09-12T18:01:56.576895+0000","last_clean":"2024-09-12T18:01:56.576895+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:01:56.576895+0000","last_undegraded":"2024-09-12T18:01:56.576895+0000","last_fullsized":"2024-09-12T18:01:56.576895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268244+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:01:57.268244+0000","last_peered":"2024-09-12T18:01:57.268244+0000","last_clean":"2024-09-12T18:01:57.268244+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:01:57.268244+0000","last_undegraded":"2024-09-12T18:01:57.268244+0000","last_fullsized":"2024-09-12T18:01:57.268244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575500+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:01:56.575500+0000","last_peered":"2024-09-12T18:01:56.575500+0000","last_clean":"2024-09-12T18:01:56.575500+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:01:56.575500+0000","last_undegraded":"2024-09-12T18:01:56.575500+0000","last_fullsized":"2024-09-12T18:01:56.575500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575128+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:01:56.575128+0000","last_peered":"2024-09-12T18:01:56.575128+0000","last_clean":"2024-09-12T18:01:56.575128+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:01:56.575128+0000","last_undegraded":"2024-09-12T18:01:56.575128+0000","last_fullsized":"2024-09-12T18:01:56.575128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576005+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:01:56.576005+0000","last_peered":"2024-09-12T18:01:56.576005+0000","last_clean":"2024-09-12T18:01:56.576005+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:01:56.576005+0000","last_undegraded":"2024-09-12T18:01:56.576005+0000","last_fullsized":"2024-09-12T18:01:56.576005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574479+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:01:56.574479+0000","last_peered":"2024-09-12T18:01:56.574479+0000","last_clean":"2024-09-12T18:01:56.574479+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:01:56.574479+0000","last_undegraded":"2024-09-12T18:01:56.574479+0000","last_fullsized":"2024-09-12T18:01:56.574479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268019+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:01:57.268019+0000","last_peered":"2024-09-12T18:01:57.268019+0000","last_clean":"2024-09-12T18:01:57.268019+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:01:57.268019+0000","last_undegraded":"2024-09-12T18:01:57.268019+0000","last_fullsized":"2024-09-12T18:01:57.268019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576135+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:01:56.576135+0000","last_peered":"2024-09-12T18:01:56.576135+0000","last_clean":"2024-09-12T18:01:56.576135+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:01:56.576135+0000","last_undegraded":"2024-09-12T18:01:56.576135+0000","last_fullsized":"2024-09-12T18:01:56.576135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266135+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:01:57.266135+0000","last_peered":"2024-09-12T18:01:57.266135+0000","last_clean":"2024-09-12T18:01:57.266135+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:01:57.266135+0000","last_undegraded":"2024-09-12T18:01:57.266135+0000","last_fullsized":"2024-09-12T18:01:57.266135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266324+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:01:57.266324+0000","last_peered":"2024-09-12T18:01:57.266324+0000","last_clean":"2024-09-12T18:01:57.266324+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:01:57.266324+0000","last_undegraded":"2024-09-12T18:01:57.266324+0000","last_fullsized":"2024-09-12T18:01:57.266324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575408+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:01:56.575408+0000","last_peered":"2024-09-12T18:01:56.575408+0000","last_clean":"2024-09-12T18:01:56.575408+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:01:56.575408+0000","last_undegraded":"2024-09-12T18:01:56.575408+0000","last_fullsized":"2024-09-12T18:01:56.575408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575392+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:01:56.575392+0000","last_peered":"2024-09-12T18:01:56.575392+0000","last_clean":"2024-09-12T18:01:56.575392+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:01:56.575392+0000","last_undegraded":"2024-09-12T18:01:56.575392+0000","last_fullsized":"2024-09-12T18:01:56.575392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575470+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:01:56.575470+0000","last_peered":"2024-09-12T18:01:56.575470+0000","last_clean":"2024-09-12T18:01:56.575470+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:01:56.575470+0000","last_undegraded":"2024-09-12T18:01:56.575470+0000","last_fullsized":"2024-09-12T18:01:56.575470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576555+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:01:56.576555+0000","last_peered":"2024-09-12T18:01:56.576555+0000","last_clean":"2024-09-12T18:01:56.576555+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:01:56.576555+0000","last_undegraded":"2024-09-12T18:01:56.576555+0000","last_fullsized":"2024-09-12T18:01:56.576555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268601+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:01:57.268601+0000","last_peered":"2024-09-12T18:01:57.268601+0000","last_clean":"2024-09-12T18:01:57.268601+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:01:57.268601+0000","last_undegraded":"2024-09-12T18:01:57.268601+0000","last_fullsized":"2024-09-12T18:01:57.268601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574257+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:01:56.574257+0000","last_peered":"2024-09-12T18:01:56.574257+0000","last_clean":"2024-09-12T18:01:56.574257+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:01:56.574257+0000","last_undegraded":"2024-09-12T18:01:56.574257+0000","last_fullsized":"2024-09-12T18:01:56.574257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576999+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:01:56.576999+0000","last_peered":"2024-09-12T18:01:56.576999+0000","last_clean":"2024-09-12T18:01:56.576999+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:01:56.576999+0000","last_undegraded":"2024-09-12T18:01:56.576999+0000","last_fullsized":"2024-09-12T18:01:56.576999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576526+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:01:56.576526+0000","last_peered":"2024-09-12T18:01:56.576526+0000","last_clean":"2024-09-12T18:01:56.576526+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:01:56.576526+0000","last_undegraded":"2024-09-12T18:01:56.576526+0000","last_fullsized":"2024-09-12T18:01:56.576526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265951+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:01:57.265951+0000","last_peered":"2024-09-12T18:01:57.265951+0000","last_clean":"2024-09-12T18:01:57.265951+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:01:57.265951+0000","last_undegraded":"2024-09-12T18:01:57.265951+0000","last_fullsized":"2024-09-12T18:01:57.265951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573105+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:01:56.573105+0000","last_peered":"2024-09-12T18:01:56.573105+0000","last_clean":"2024-09-12T18:01:56.573105+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:01:56.573105+0000","last_undegraded":"2024-09-12T18:01:56.573105+0000","last_fullsized":"2024-09-12T18:01:56.573105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265162+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:01:57.265162+0000","last_peered":"2024-09-12T18:01:57.265162+0000","last_clean":"2024-09-12T18:01:57.265162+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:01:57.265162+0000","last_undegraded":"2024-09-12T18:01:57.265162+0000","last_fullsized":"2024-09-12T18:01:57.265162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267551+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:01:57.267551+0000","last_peered":"2024-09-12T18:01:57.267551+0000","last_clean":"2024-09-12T18:01:57.267551+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:01:57.267551+0000","last_undegraded":"2024-09-12T18:01:57.267551+0000","last_fullsized":"2024-09-12T18:01:57.267551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576220+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:01:56.576220+0000","last_peered":"2024-09-12T18:01:56.576220+0000","last_clean":"2024-09-12T18:01:56.576220+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:01:56.576220+0000","last_undegraded":"2024-09-12T18:01:56.576220+0000","last_fullsized":"2024-09-12T18:01:56.576220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576775+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:01:56.576775+0000","last_peered":"2024-09-12T18:01:56.576775+0000","last_clean":"2024-09-12T18:01:56.576775+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:01:56.576775+0000","last_undegraded":"2024-09-12T18:01:56.576775+0000","last_fullsized":"2024-09-12T18:01:56.576775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267826+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:01:57.267826+0000","last_peered":"2024-09-12T18:01:57.267826+0000","last_clean":"2024-09-12T18:01:57.267826+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:01:57.267826+0000","last_undegraded":"2024-09-12T18:01:57.267826+0000","last_fullsized":"2024-09-12T18:01:57.267826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575294+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:01:56.575294+0000","last_peered":"2024-09-12T18:01:56.575294+0000","last_clean":"2024-09-12T18:01:56.575294+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:01:56.575294+0000","last_undegraded":"2024-09-12T18:01:56.575294+0000","last_fullsized":"2024-09-12T18:01:56.575294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266672+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:01:57.266672+0000","last_peered":"2024-09-12T18:01:57.266672+0000","last_clean":"2024-09-12T18:01:57.266672+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:01:57.266672+0000","last_undegraded":"2024-09-12T18:01:57.266672+0000","last_fullsized":"2024-09-12T18:01:57.266672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573286+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:01:56.573286+0000","last_peered":"2024-09-12T18:01:56.573286+0000","last_clean":"2024-09-12T18:01:56.573286+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:01:56.573286+0000","last_undegraded":"2024-09-12T18:01:56.573286+0000","last_fullsized":"2024-09-12T18:01:56.573286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576069+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:01:56.576069+0000","last_peered":"2024-09-12T18:01:56.576069+0000","last_clean":"2024-09-12T18:01:56.576069+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:01:56.576069+0000","last_undegraded":"2024-09-12T18:01:56.576069+0000","last_fullsized":"2024-09-12T18:01:56.576069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268063+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:01:57.268063+0000","last_peered":"2024-09-12T18:01:57.268063+0000","last_clean":"2024-09-12T18:01:57.268063+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:01:57.268063+0000","last_undegraded":"2024-09-12T18:01:57.268063+0000","last_fullsized":"2024-09-12T18:01:57.268063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577142+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:01:56.577142+0000","last_peered":"2024-09-12T18:01:56.577142+0000","last_clean":"2024-09-12T18:01:56.577142+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:01:56.577142+0000","last_undegraded":"2024-09-12T18:01:56.577142+0000","last_fullsized":"2024-09-12T18:01:56.577142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267484+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:01:57.267484+0000","last_peered":"2024-09-12T18:01:57.267484+0000","last_clean":"2024-09-12T18:01:57.267484+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:01:57.267484+0000","last_undegraded":"2024-09-12T18:01:57.267484+0000","last_fullsized":"2024-09-12T18:01:57.267484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574144+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:01:56.574144+0000","last_peered":"2024-09-12T18:01:56.574144+0000","last_clean":"2024-09-12T18:01:56.574144+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:01:56.574144+0000","last_undegraded":"2024-09-12T18:01:56.574144+0000","last_fullsized":"2024-09-12T18:01:56.574144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576341+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:01:56.576341+0000","last_peered":"2024-09-12T18:01:56.576341+0000","last_clean":"2024-09-12T18:01:56.576341+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:01:56.576341+0000","last_undegraded":"2024-09-12T18:01:56.576341+0000","last_fullsized":"2024-09-12T18:01:56.576341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266742+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:01:57.266742+0000","last_peered":"2024-09-12T18:01:57.266742+0000","last_clean":"2024-09-12T18:01:57.266742+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:01:57.266742+0000","last_undegraded":"2024-09-12T18:01:57.266742+0000","last_fullsized":"2024-09-12T18:01:57.266742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575355+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:01:56.575355+0000","last_peered":"2024-09-12T18:01:56.575355+0000","last_clean":"2024-09-12T18:01:56.575355+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:01:56.575355+0000","last_undegraded":"2024-09-12T18:01:56.575355+0000","last_fullsized":"2024-09-12T18:01:56.575355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576297+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:01:56.576297+0000","last_peered":"2024-09-12T18:01:56.576297+0000","last_clean":"2024-09-12T18:01:56.576297+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:01:56.576297+0000","last_undegraded":"2024-09-12T18:01:56.576297+0000","last_fullsized":"2024-09-12T18:01:56.576297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577635+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:01:56.577635+0000","last_peered":"2024-09-12T18:01:56.577635+0000","last_clean":"2024-09-12T18:01:56.577635+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:01:56.577635+0000","last_undegraded":"2024-09-12T18:01:56.577635+0000","last_fullsized":"2024-09-12T18:01:56.577635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265205+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:01:57.265205+0000","last_peered":"2024-09-12T18:01:57.265205+0000","last_clean":"2024-09-12T18:01:57.265205+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:01:57.265205+0000","last_undegraded":"2024-09-12T18:01:57.265205+0000","last_fullsized":"2024-09-12T18:01:57.265205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268598+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:01:57.268598+0000","last_peered":"2024-09-12T18:01:57.268598+0000","last_clean":"2024-09-12T18:01:57.268598+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:01:57.268598+0000","last_undegraded":"2024-09-12T18:01:57.268598+0000","last_fullsized":"2024-09-12T18:01:57.268598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265581+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:01:57.265581+0000","last_peered":"2024-09-12T18:01:57.265581+0000","last_clean":"2024-09-12T18:01:57.265581+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:01:57.265581+0000","last_undegraded":"2024-09-12T18:01:57.265581+0000","last_fullsized":"2024-09-12T18:01:57.265581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578832+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:01:56.578832+0000","last_peered":"2024-09-12T18:01:56.578832+0000","last_clean":"2024-09-12T18:01:56.578832+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:01:56.578832+0000","last_undegraded":"2024-09-12T18:01:56.578832+0000","last_fullsized":"2024-09-12T18:01:56.578832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576305+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:01:56.576305+0000","last_peered":"2024-09-12T18:01:56.576305+0000","last_clean":"2024-09-12T18:01:56.576305+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:01:56.576305+0000","last_undegraded":"2024-09-12T18:01:56.576305+0000","last_fullsized":"2024-09-12T18:01:56.576305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578699+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:01:56.578699+0000","last_peered":"2024-09-12T18:01:56.578699+0000","last_clean":"2024-09-12T18:01:56.578699+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:01:56.578699+0000","last_undegraded":"2024-09-12T18:01:56.578699+0000","last_fullsized":"2024-09-12T18:01:56.578699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574492+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:01:56.574492+0000","last_peered":"2024-09-12T18:01:56.574492+0000","last_clean":"2024-09-12T18:01:56.574492+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:01:56.574492+0000","last_undegraded":"2024-09-12T18:01:56.574492+0000","last_fullsized":"2024-09-12T18:01:56.574492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575560+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:01:56.575560+0000","last_peered":"2024-09-12T18:01:56.575560+0000","last_clean":"2024-09-12T18:01:56.575560+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:01:56.575560+0000","last_undegraded":"2024-09-12T18:01:56.575560+0000","last_fullsized":"2024-09-12T18:01:56.575560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577566+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:01:56.577566+0000","last_peered":"2024-09-12T18:01:56.577566+0000","last_clean":"2024-09-12T18:01:56.577566+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:01:56.577566+0000","last_undegraded":"2024-09-12T18:01:56.577566+0000","last_fullsized":"2024-09-12T18:01:56.577566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576897+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:01:56.576897+0000","last_peered":"2024-09-12T18:01:56.576897+0000","last_clean":"2024-09-12T18:01:56.576897+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:01:56.576897+0000","last_undegraded":"2024-09-12T18:01:56.576897+0000","last_fullsized":"2024-09-12T18:01:56.576897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577643+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:01:56.577643+0000","last_peered":"2024-09-12T18:01:56.577643+0000","last_clean":"2024-09-12T18:01:56.577643+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:01:56.577643+0000","last_undegraded":"2024-09-12T18:01:56.577643+0000","last_fullsized":"2024-09-12T18:01:56.577643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266566+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:01:57.266566+0000","last_peered":"2024-09-12T18:01:57.266566+0000","last_clean":"2024-09-12T18:01:57.266566+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:01:57.266566+0000","last_undegraded":"2024-09-12T18:01:57.266566+0000","last_fullsized":"2024-09-12T18:01:57.266566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576707+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:01:56.576707+0000","last_peered":"2024-09-12T18:01:56.576707+0000","last_clean":"2024-09-12T18:01:56.576707+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:01:56.576707+0000","last_undegraded":"2024-09-12T18:01:56.576707+0000","last_fullsized":"2024-09-12T18:01:56.576707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266004+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:01:57.266004+0000","last_peered":"2024-09-12T18:01:57.266004+0000","last_clean":"2024-09-12T18:01:57.266004+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:01:57.266004+0000","last_undegraded":"2024-09-12T18:01:57.266004+0000","last_fullsized":"2024-09-12T18:01:57.266004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575722+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:01:56.575722+0000","last_peered":"2024-09-12T18:01:56.575722+0000","last_clean":"2024-09-12T18:01:56.575722+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:01:56.575722+0000","last_undegraded":"2024-09-12T18:01:56.575722+0000","last_fullsized":"2024-09-12T18:01:56.575722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576719+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:01:56.576719+0000","last_peered":"2024-09-12T18:01:56.576719+0000","last_clean":"2024-09-12T18:01:56.576719+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:01:56.576719+0000","last_undegraded":"2024-09-12T18:01:56.576719+0000","last_fullsized":"2024-09-12T18:01:56.576719+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576931+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:01:56.576931+0000","last_peered":"2024-09-12T18:01:56.576931+0000","last_clean":"2024-09-12T18:01:56.576931+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:01:56.576931+0000","last_undegraded":"2024-09-12T18:01:56.576931+0000","last_fullsized":"2024-09-12T18:01:56.576931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574698+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:01:56.574698+0000","last_peered":"2024-09-12T18:01:56.574698+0000","last_clean":"2024-09-12T18:01:56.574698+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:01:56.574698+0000","last_undegraded":"2024-09-12T18:01:56.574698+0000","last_fullsized":"2024-09-12T18:01:56.574698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578890+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:01:56.578890+0000","last_peered":"2024-09-12T18:01:56.578890+0000","last_clean":"2024-09-12T18:01:56.578890+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:01:56.578890+0000","last_undegraded":"2024-09-12T18:01:56.578890+0000","last_fullsized":"2024-09-12T18:01:56.578890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576442+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:01:56.576442+0000","last_peered":"2024-09-12T18:01:56.576442+0000","last_clean":"2024-09-12T18:01:56.576442+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:01:56.576442+0000","last_undegraded":"2024-09-12T18:01:56.576442+0000","last_fullsized":"2024-09-12T18:01:56.576442+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574496+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:01:56.574496+0000","last_peered":"2024-09-12T18:01:56.574496+0000","last_clean":"2024-09-12T18:01:56.574496+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:01:56.574496+0000","last_undegraded":"2024-09-12T18:01:56.574496+0000","last_fullsized":"2024-09-12T18:01:56.574496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268409+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:01:57.268409+0000","last_peered":"2024-09-12T18:01:57.268409+0000","last_clean":"2024-09-12T18:01:57.268409+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:01:57.268409+0000","last_undegraded":"2024-09-12T18:01:57.268409+0000","last_fullsized":"2024-09-12T18:01:57.268409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574721+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:01:56.574721+0000","last_peered":"2024-09-12T18:01:56.574721+0000","last_clean":"2024-09-12T18:01:56.574721+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:01:56.574721+0000","last_undegraded":"2024-09-12T18:01:56.574721+0000","last_fullsized":"2024-09-12T18:01:56.574721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266265+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:01:57.266265+0000","last_peered":"2024-09-12T18:01:57.266265+0000","last_clean":"2024-09-12T18:01:57.266265+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:01:57.266265+0000","last_undegraded":"2024-09-12T18:01:57.266265+0000","last_fullsized":"2024-09-12T18:01:57.266265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575840+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:01:56.575840+0000","last_peered":"2024-09-12T18:01:56.575840+0000","last_clean":"2024-09-12T18:01:56.575840+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:01:56.575840+0000","last_undegraded":"2024-09-12T18:01:56.575840+0000","last_fullsized":"2024-09-12T18:01:56.575840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577338+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:01:56.577338+0000","last_peered":"2024-09-12T18:01:56.577338+0000","last_clean":"2024-09-12T18:01:56.577338+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:01:56.577338+0000","last_undegraded":"2024-09-12T18:01:56.577338+0000","last_fullsized":"2024-09-12T18:01:56.577338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576802+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:01:56.576802+0000","last_peered":"2024-09-12T18:01:56.576802+0000","last_clean":"2024-09-12T18:01:56.576802+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:01:56.576802+0000","last_undegraded":"2024-09-12T18:01:56.576802+0000","last_fullsized":"2024-09-12T18:01:56.576802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575629+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:01:56.575629+0000","last_peered":"2024-09-12T18:01:56.575629+0000","last_clean":"2024-09-12T18:01:56.575629+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:01:56.575629+0000","last_undegraded":"2024-09-12T18:01:56.575629+0000","last_fullsized":"2024-09-12T18:01:56.575629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578985+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:01:56.578985+0000","last_peered":"2024-09-12T18:01:56.578985+0000","last_clean":"2024-09-12T18:01:56.578985+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:01:56.578985+0000","last_undegraded":"2024-09-12T18:01:56.578985+0000","last_fullsized":"2024-09-12T18:01:56.578985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575582+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:01:56.575582+0000","last_peered":"2024-09-12T18:01:56.575582+0000","last_clean":"2024-09-12T18:01:56.575582+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:01:56.575582+0000","last_undegraded":"2024-09-12T18:01:56.575582+0000","last_fullsized":"2024-09-12T18:01:56.575582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267523+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:01:57.267523+0000","last_peered":"2024-09-12T18:01:57.267523+0000","last_clean":"2024-09-12T18:01:57.267523+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:01:57.267523+0000","last_undegraded":"2024-09-12T18:01:57.267523+0000","last_fullsized":"2024-09-12T18:01:57.267523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575443+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:01:56.575443+0000","last_peered":"2024-09-12T18:01:56.575443+0000","last_clean":"2024-09-12T18:01:56.575443+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:01:56.575443+0000","last_undegraded":"2024-09-12T18:01:56.575443+0000","last_fullsized":"2024-09-12T18:01:56.575443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268382+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:01:57.268382+0000","last_peered":"2024-09-12T18:01:57.268382+0000","last_clean":"2024-09-12T18:01:57.268382+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:01:57.268382+0000","last_undegraded":"2024-09-12T18:01:57.268382+0000","last_fullsized":"2024-09-12T18:01:57.268382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266465+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:01:57.266465+0000","last_peered":"2024-09-12T18:01:57.266465+0000","last_clean":"2024-09-12T18:01:57.266465+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:01:57.266465+0000","last_undegraded":"2024-09-12T18:01:57.266465+0000","last_fullsized":"2024-09-12T18:01:57.266465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576279+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:01:56.576279+0000","last_peered":"2024-09-12T18:01:56.576279+0000","last_clean":"2024-09-12T18:01:56.576279+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:01:56.576279+0000","last_undegraded":"2024-09-12T18:01:56.576279+0000","last_fullsized":"2024-09-12T18:01:56.576279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576427+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:01:56.576427+0000","last_peered":"2024-09-12T18:01:56.576427+0000","last_clean":"2024-09-12T18:01:56.576427+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:01:56.576427+0000","last_undegraded":"2024-09-12T18:01:56.576427+0000","last_fullsized":"2024-09-12T18:01:56.576427+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573480+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:01:56.573480+0000","last_peered":"2024-09-12T18:01:56.573480+0000","last_clean":"2024-09-12T18:01:56.573480+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:01:56.573480+0000","last_undegraded":"2024-09-12T18:01:56.573480+0000","last_fullsized":"2024-09-12T18:01:56.573480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.688234+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:01:56.688234+0000","last_peered":"2024-09-12T18:01:56.688234+0000","last_clean":"2024-09-12T18:01:56.688234+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:01:56.688234+0000","last_undegraded":"2024-09-12T18:01:56.688234+0000","last_fullsized":"2024-09-12T18:01:56.688234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577659+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:01:56.577659+0000","last_peered":"2024-09-12T18:01:56.577659+0000","last_clean":"2024-09-12T18:01:56.577659+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:01:56.577659+0000","last_undegraded":"2024-09-12T18:01:56.577659+0000","last_fullsized":"2024-09-12T18:01:56.577659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265632+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:01:57.265632+0000","last_peered":"2024-09-12T18:01:57.265632+0000","last_clean":"2024-09-12T18:01:57.265632+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:01:57.265632+0000","last_undegraded":"2024-09-12T18:01:57.265632+0000","last_fullsized":"2024-09-12T18:01:57.265632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575585+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:01:56.575585+0000","last_peered":"2024-09-12T18:01:56.575585+0000","last_clean":"2024-09-12T18:01:56.575585+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:01:56.575585+0000","last_undegraded":"2024-09-12T18:01:56.575585+0000","last_fullsized":"2024-09-12T18:01:56.575585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578680+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:01:56.578680+0000","last_peered":"2024-09-12T18:01:56.578680+0000","last_clean":"2024-09-12T18:01:56.578680+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:01:56.578680+0000","last_undegraded":"2024-09-12T18:01:56.578680+0000","last_fullsized":"2024-09-12T18:01:56.578680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573583+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:01:56.573583+0000","last_peered":"2024-09-12T18:01:56.573583+0000","last_clean":"2024-09-12T18:01:56.573583+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:01:56.573583+0000","last_undegraded":"2024-09-12T18:01:56.573583+0000","last_fullsized":"2024-09-12T18:01:56.573583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268300+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:01:57.268300+0000","last_peered":"2024-09-12T18:01:57.268300+0000","last_clean":"2024-09-12T18:01:57.268300+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:01:57.268300+0000","last_undegraded":"2024-09-12T18:01:57.268300+0000","last_fullsized":"2024-09-12T18:01:57.268300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576727+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:01:56.576727+0000","last_peered":"2024-09-12T18:01:56.576727+0000","last_clean":"2024-09-12T18:01:56.576727+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:01:56.576727+0000","last_undegraded":"2024-09-12T18:01:56.576727+0000","last_fullsized":"2024-09-12T18:01:56.576727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573721+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:01:56.573721+0000","last_peered":"2024-09-12T18:01:56.573721+0000","last_clean":"2024-09-12T18:01:56.573721+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:01:56.573721+0000","last_undegraded":"2024-09-12T18:01:56.573721+0000","last_fullsized":"2024-09-12T18:01:56.573721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576116+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:01:56.576116+0000","last_peered":"2024-09-12T18:01:56.576116+0000","last_clean":"2024-09-12T18:01:56.576116+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:01:56.576116+0000","last_undegraded":"2024-09-12T18:01:56.576116+0000","last_fullsized":"2024-09-12T18:01:56.576116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573789+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:01:56.573789+0000","last_peered":"2024-09-12T18:01:56.573789+0000","last_clean":"2024-09-12T18:01:56.573789+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:01:56.573789+0000","last_undegraded":"2024-09-12T18:01:56.573789+0000","last_fullsized":"2024-09-12T18:01:56.573789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267698+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:01:57.267698+0000","last_peered":"2024-09-12T18:01:57.267698+0000","last_clean":"2024-09-12T18:01:57.267698+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:01:57.267698+0000","last_undegraded":"2024-09-12T18:01:57.267698+0000","last_fullsized":"2024-09-12T18:01:57.267698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573786+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:01:56.573786+0000","last_peered":"2024-09-12T18:01:56.573786+0000","last_clean":"2024-09-12T18:01:56.573786+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:01:56.573786+0000","last_undegraded":"2024-09-12T18:01:56.573786+0000","last_fullsized":"2024-09-12T18:01:56.573786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575625+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:01:56.575625+0000","last_peered":"2024-09-12T18:01:56.575625+0000","last_clean":"2024-09-12T18:01:56.575625+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:01:56.575625+0000","last_undegraded":"2024-09-12T18:01:56.575625+0000","last_fullsized":"2024-09-12T18:01:56.575625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574228+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:01:56.574228+0000","last_peered":"2024-09-12T18:01:56.574228+0000","last_clean":"2024-09-12T18:01:56.574228+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:01:56.574228+0000","last_undegraded":"2024-09-12T18:01:56.574228+0000","last_fullsized":"2024-09-12T18:01:56.574228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266417+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:01:57.266417+0000","last_peered":"2024-09-12T18:01:57.266417+0000","last_clean":"2024-09-12T18:01:57.266417+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:01:57.266417+0000","last_undegraded":"2024-09-12T18:01:57.266417+0000","last_fullsized":"2024-09-12T18:01:57.266417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266984+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:01:57.266984+0000","last_peered":"2024-09-12T18:01:57.266984+0000","last_clean":"2024-09-12T18:01:57.266984+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:01:57.266984+0000","last_undegraded":"2024-09-12T18:01:57.266984+0000","last_fullsized":"2024-09-12T18:01:57.266984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266713+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:01:57.266713+0000","last_peered":"2024-09-12T18:01:57.266713+0000","last_clean":"2024-09-12T18:01:57.266713+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:01:57.266713+0000","last_undegraded":"2024-09-12T18:01:57.266713+0000","last_fullsized":"2024-09-12T18:01:57.266713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266817+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:01:57.266817+0000","last_peered":"2024-09-12T18:01:57.266817+0000","last_clean":"2024-09-12T18:01:57.266817+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:01:57.266817+0000","last_undegraded":"2024-09-12T18:01:57.266817+0000","last_fullsized":"2024-09-12T18:01:57.266817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575894+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:01:56.575894+0000","last_peered":"2024-09-12T18:01:56.575894+0000","last_clean":"2024-09-12T18:01:56.575894+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:01:56.575894+0000","last_undegraded":"2024-09-12T18:01:56.575894+0000","last_fullsized":"2024-09-12T18:01:56.575894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577653+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:01:56.577653+0000","last_peered":"2024-09-12T18:01:56.577653+0000","last_clean":"2024-09-12T18:01:56.577653+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:01:56.577653+0000","last_undegraded":"2024-09-12T18:01:56.577653+0000","last_fullsized":"2024-09-12T18:01:56.577653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576337+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:01:56.576337+0000","last_peered":"2024-09-12T18:01:56.576337+0000","last_clean":"2024-09-12T18:01:56.576337+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:01:56.576337+0000","last_undegraded":"2024-09-12T18:01:56.576337+0000","last_fullsized":"2024-09-12T18:01:56.576337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267789+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:01:57.267789+0000","last_peered":"2024-09-12T18:01:57.267789+0000","last_clean":"2024-09-12T18:01:57.267789+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:01:57.267789+0000","last_undegraded":"2024-09-12T18:01:57.267789+0000","last_fullsized":"2024-09-12T18:01:57.267789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267139+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:01:57.267139+0000","last_peered":"2024-09-12T18:01:57.267139+0000","last_clean":"2024-09-12T18:01:57.267139+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:01:57.267139+0000","last_undegraded":"2024-09-12T18:01:57.267139+0000","last_fullsized":"2024-09-12T18:01:57.267139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576011+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:01:56.576011+0000","last_peered":"2024-09-12T18:01:56.576011+0000","last_clean":"2024-09-12T18:01:56.576011+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:01:56.576011+0000","last_undegraded":"2024-09-12T18:01:56.576011+0000","last_fullsized":"2024-09-12T18:01:56.576011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577465+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:01:56.577465+0000","last_peered":"2024-09-12T18:01:56.577465+0000","last_clean":"2024-09-12T18:01:56.577465+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:01:56.577465+0000","last_undegraded":"2024-09-12T18:01:56.577465+0000","last_fullsized":"2024-09-12T18:01:56.577465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576006+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:01:56.576006+0000","last_peered":"2024-09-12T18:01:56.576006+0000","last_clean":"2024-09-12T18:01:56.576006+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:01:56.576006+0000","last_undegraded":"2024-09-12T18:01:56.576006+0000","last_fullsized":"2024-09-12T18:01:56.576006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":253952,"data_stored":651168,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":651803,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:01:59.723 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:00.046 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:00.050 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:00.067 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T18:01:58.559722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90100,"kb_used_data":680,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025420,"statfs":{"total":289910292480,"available":289818030080,"internally_reserved":0,"allocated":696320,"data_stored":1362612,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001011"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267064+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:01:57.267064+0000","last_peered":"2024-09-12T18:01:57.267064+0000","last_clean":"2024-09-12T18:01:57.267064+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:01:57.267064+0000","last_undegraded":"2024-09-12T18:01:57.267064+0000","last_fullsized":"2024-09-12T18:01:57.267064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267415+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:01:57.267415+0000","last_peered":"2024-09-12T18:01:57.267415+0000","last_clean":"2024-09-12T18:01:57.267415+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:01:57.267415+0000","last_undegraded":"2024-09-12T18:01:57.267415+0000","last_fullsized":"2024-09-12T18:01:57.267415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578608+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:01:56.578608+0000","last_peered":"2024-09-12T18:01:56.578608+0000","last_clean":"2024-09-12T18:01:56.578608+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:01:56.578608+0000","last_undegraded":"2024-09-12T18:01:56.578608+0000","last_fullsized":"2024-09-12T18:01:56.578608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576895+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:01:56.576895+0000","last_peered":"2024-09-12T18:01:56.576895+0000","last_clean":"2024-09-12T18:01:56.576895+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:01:56.576895+0000","last_undegraded":"2024-09-12T18:01:56.576895+0000","last_fullsized":"2024-09-12T18:01:56.576895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268244+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:01:57.268244+0000","last_peered":"2024-09-12T18:01:57.268244+0000","last_clean":"2024-09-12T18:01:57.268244+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:01:57.268244+0000","last_undegraded":"2024-09-12T18:01:57.268244+0000","last_fullsized":"2024-09-12T18:01:57.268244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575500+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:01:56.575500+0000","last_peered":"2024-09-12T18:01:56.575500+0000","last_clean":"2024-09-12T18:01:56.575500+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:01:56.575500+0000","last_undegraded":"2024-09-12T18:01:56.575500+0000","last_fullsized":"2024-09-12T18:01:56.575500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575128+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:01:56.575128+0000","last_peered":"2024-09-12T18:01:56.575128+0000","last_clean":"2024-09-12T18:01:56.575128+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:01:56.575128+0000","last_undegraded":"2024-09-12T18:01:56.575128+0000","last_fullsized":"2024-09-12T18:01:56.575128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576005+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:01:56.576005+0000","last_peered":"2024-09-12T18:01:56.576005+0000","last_clean":"2024-09-12T18:01:56.576005+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:01:56.576005+0000","last_undegraded":"2024-09-12T18:01:56.576005+0000","last_fullsized":"2024-09-12T18:01:56.576005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574479+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:01:56.574479+0000","last_peered":"2024-09-12T18:01:56.574479+0000","last_clean":"2024-09-12T18:01:56.574479+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:01:56.574479+0000","last_undegraded":"2024-09-12T18:01:56.574479+0000","last_fullsized":"2024-09-12T18:01:56.574479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268019+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:01:57.268019+0000","last_peered":"2024-09-12T18:01:57.268019+0000","last_clean":"2024-09-12T18:01:57.268019+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:01:57.268019+0000","last_undegraded":"2024-09-12T18:01:57.268019+0000","last_fullsized":"2024-09-12T18:01:57.268019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576135+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:01:56.576135+0000","last_peered":"2024-09-12T18:01:56.576135+0000","last_clean":"2024-09-12T18:01:56.576135+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:01:56.576135+0000","last_undegraded":"2024-09-12T18:01:56.576135+0000","last_fullsized":"2024-09-12T18:01:56.576135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266135+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:01:57.266135+0000","last_peered":"2024-09-12T18:01:57.266135+0000","last_clean":"2024-09-12T18:01:57.266135+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:01:57.266135+0000","last_undegraded":"2024-09-12T18:01:57.266135+0000","last_fullsized":"2024-09-12T18:01:57.266135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266324+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:01:57.266324+0000","last_peered":"2024-09-12T18:01:57.266324+0000","last_clean":"2024-09-12T18:01:57.266324+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:01:57.266324+0000","last_undegraded":"2024-09-12T18:01:57.266324+0000","last_fullsized":"2024-09-12T18:01:57.266324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575408+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:01:56.575408+0000","last_peered":"2024-09-12T18:01:56.575408+0000","last_clean":"2024-09-12T18:01:56.575408+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:01:56.575408+0000","last_undegraded":"2024-09-12T18:01:56.575408+0000","last_fullsized":"2024-09-12T18:01:56.575408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575392+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:01:56.575392+0000","last_peered":"2024-09-12T18:01:56.575392+0000","last_clean":"2024-09-12T18:01:56.575392+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:01:56.575392+0000","last_undegraded":"2024-09-12T18:01:56.575392+0000","last_fullsized":"2024-09-12T18:01:56.575392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575470+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:01:56.575470+0000","last_peered":"2024-09-12T18:01:56.575470+0000","last_clean":"2024-09-12T18:01:56.575470+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:01:56.575470+0000","last_undegraded":"2024-09-12T18:01:56.575470+0000","last_fullsized":"2024-09-12T18:01:56.575470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576555+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:01:56.576555+0000","last_peered":"2024-09-12T18:01:56.576555+0000","last_clean":"2024-09-12T18:01:56.576555+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:01:56.576555+0000","last_undegraded":"2024-09-12T18:01:56.576555+0000","last_fullsized":"2024-09-12T18:01:56.576555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268601+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:01:57.268601+0000","last_peered":"2024-09-12T18:01:57.268601+0000","last_clean":"2024-09-12T18:01:57.268601+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:01:57.268601+0000","last_undegraded":"2024-09-12T18:01:57.268601+0000","last_fullsized":"2024-09-12T18:01:57.268601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574257+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:01:56.574257+0000","last_peered":"2024-09-12T18:01:56.574257+0000","last_clean":"2024-09-12T18:01:56.574257+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:01:56.574257+0000","last_undegraded":"2024-09-12T18:01:56.574257+0000","last_fullsized":"2024-09-12T18:01:56.574257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576999+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:01:56.576999+0000","last_peered":"2024-09-12T18:01:56.576999+0000","last_clean":"2024-09-12T18:01:56.576999+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:01:56.576999+0000","last_undegraded":"2024-09-12T18:01:56.576999+0000","last_fullsized":"2024-09-12T18:01:56.576999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576526+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:01:56.576526+0000","last_peered":"2024-09-12T18:01:56.576526+0000","last_clean":"2024-09-12T18:01:56.576526+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:01:56.576526+0000","last_undegraded":"2024-09-12T18:01:56.576526+0000","last_fullsized":"2024-09-12T18:01:56.576526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265951+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:01:57.265951+0000","last_peered":"2024-09-12T18:01:57.265951+0000","last_clean":"2024-09-12T18:01:57.265951+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:01:57.265951+0000","last_undegraded":"2024-09-12T18:01:57.265951+0000","last_fullsized":"2024-09-12T18:01:57.265951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573105+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:01:56.573105+0000","last_peered":"2024-09-12T18:01:56.573105+0000","last_clean":"2024-09-12T18:01:56.573105+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:01:56.573105+0000","last_undegraded":"2024-09-12T18:01:56.573105+0000","last_fullsized":"2024-09-12T18:01:56.573105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265162+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:01:57.265162+0000","last_peered":"2024-09-12T18:01:57.265162+0000","last_clean":"2024-09-12T18:01:57.265162+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:01:57.265162+0000","last_undegraded":"2024-09-12T18:01:57.265162+0000","last_fullsized":"2024-09-12T18:01:57.265162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267551+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:01:57.267551+0000","last_peered":"2024-09-12T18:01:57.267551+0000","last_clean":"2024-09-12T18:01:57.267551+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:01:57.267551+0000","last_undegraded":"2024-09-12T18:01:57.267551+0000","last_fullsized":"2024-09-12T18:01:57.267551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576220+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:01:56.576220+0000","last_peered":"2024-09-12T18:01:56.576220+0000","last_clean":"2024-09-12T18:01:56.576220+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:01:56.576220+0000","last_undegraded":"2024-09-12T18:01:56.576220+0000","last_fullsized":"2024-09-12T18:01:56.576220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576775+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:01:56.576775+0000","last_peered":"2024-09-12T18:01:56.576775+0000","last_clean":"2024-09-12T18:01:56.576775+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:01:56.576775+0000","last_undegraded":"2024-09-12T18:01:56.576775+0000","last_fullsized":"2024-09-12T18:01:56.576775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267826+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:01:57.267826+0000","last_peered":"2024-09-12T18:01:57.267826+0000","last_clean":"2024-09-12T18:01:57.267826+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:01:57.267826+0000","last_undegraded":"2024-09-12T18:01:57.267826+0000","last_fullsized":"2024-09-12T18:01:57.267826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575294+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:01:56.575294+0000","last_peered":"2024-09-12T18:01:56.575294+0000","last_clean":"2024-09-12T18:01:56.575294+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:01:56.575294+0000","last_undegraded":"2024-09-12T18:01:56.575294+0000","last_fullsized":"2024-09-12T18:01:56.575294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266672+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:01:57.266672+0000","last_peered":"2024-09-12T18:01:57.266672+0000","last_clean":"2024-09-12T18:01:57.266672+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:01:57.266672+0000","last_undegraded":"2024-09-12T18:01:57.266672+0000","last_fullsized":"2024-09-12T18:01:57.266672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573286+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:01:56.573286+0000","last_peered":"2024-09-12T18:01:56.573286+0000","last_clean":"2024-09-12T18:01:56.573286+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:01:56.573286+0000","last_undegraded":"2024-09-12T18:01:56.573286+0000","last_fullsized":"2024-09-12T18:01:56.573286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576069+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:01:56.576069+0000","last_peered":"2024-09-12T18:01:56.576069+0000","last_clean":"2024-09-12T18:01:56.576069+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:01:56.576069+0000","last_undegraded":"2024-09-12T18:01:56.576069+0000","last_fullsized":"2024-09-12T18:01:56.576069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268063+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:01:57.268063+0000","last_peered":"2024-09-12T18:01:57.268063+0000","last_clean":"2024-09-12T18:01:57.268063+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:01:57.268063+0000","last_undegraded":"2024-09-12T18:01:57.268063+0000","last_fullsized":"2024-09-12T18:01:57.268063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577142+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:01:56.577142+0000","last_peered":"2024-09-12T18:01:56.577142+0000","last_clean":"2024-09-12T18:01:56.577142+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:01:56.577142+0000","last_undegraded":"2024-09-12T18:01:56.577142+0000","last_fullsized":"2024-09-12T18:01:56.577142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267484+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:01:57.267484+0000","last_peered":"2024-09-12T18:01:57.267484+0000","last_clean":"2024-09-12T18:01:57.267484+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:01:57.267484+0000","last_undegraded":"2024-09-12T18:01:57.267484+0000","last_fullsized":"2024-09-12T18:01:57.267484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574144+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:01:56.574144+0000","last_peered":"2024-09-12T18:01:56.574144+0000","last_clean":"2024-09-12T18:01:56.574144+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:01:56.574144+0000","last_undegraded":"2024-09-12T18:01:56.574144+0000","last_fullsized":"2024-09-12T18:01:56.574144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576341+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:01:56.576341+0000","last_peered":"2024-09-12T18:01:56.576341+0000","last_clean":"2024-09-12T18:01:56.576341+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:01:56.576341+0000","last_undegraded":"2024-09-12T18:01:56.576341+0000","last_fullsized":"2024-09-12T18:01:56.576341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266742+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:01:57.266742+0000","last_peered":"2024-09-12T18:01:57.266742+0000","last_clean":"2024-09-12T18:01:57.266742+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:01:57.266742+0000","last_undegraded":"2024-09-12T18:01:57.266742+0000","last_fullsized":"2024-09-12T18:01:57.266742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575355+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:01:56.575355+0000","last_peered":"2024-09-12T18:01:56.575355+0000","last_clean":"2024-09-12T18:01:56.575355+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:01:56.575355+0000","last_undegraded":"2024-09-12T18:01:56.575355+0000","last_fullsized":"2024-09-12T18:01:56.575355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576297+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:01:56.576297+0000","last_peered":"2024-09-12T18:01:56.576297+0000","last_clean":"2024-09-12T18:01:56.576297+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:01:56.576297+0000","last_undegraded":"2024-09-12T18:01:56.576297+0000","last_fullsized":"2024-09-12T18:01:56.576297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577635+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:01:56.577635+0000","last_peered":"2024-09-12T18:01:56.577635+0000","last_clean":"2024-09-12T18:01:56.577635+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:01:56.577635+0000","last_undegraded":"2024-09-12T18:01:56.577635+0000","last_fullsized":"2024-09-12T18:01:56.577635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265205+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:01:57.265205+0000","last_peered":"2024-09-12T18:01:57.265205+0000","last_clean":"2024-09-12T18:01:57.265205+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:01:57.265205+0000","last_undegraded":"2024-09-12T18:01:57.265205+0000","last_fullsized":"2024-09-12T18:01:57.265205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268598+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:01:57.268598+0000","last_peered":"2024-09-12T18:01:57.268598+0000","last_clean":"2024-09-12T18:01:57.268598+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:01:57.268598+0000","last_undegraded":"2024-09-12T18:01:57.268598+0000","last_fullsized":"2024-09-12T18:01:57.268598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265581+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:01:57.265581+0000","last_peered":"2024-09-12T18:01:57.265581+0000","last_clean":"2024-09-12T18:01:57.265581+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:01:57.265581+0000","last_undegraded":"2024-09-12T18:01:57.265581+0000","last_fullsized":"2024-09-12T18:01:57.265581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578832+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:01:56.578832+0000","last_peered":"2024-09-12T18:01:56.578832+0000","last_clean":"2024-09-12T18:01:56.578832+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:01:56.578832+0000","last_undegraded":"2024-09-12T18:01:56.578832+0000","last_fullsized":"2024-09-12T18:01:56.578832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576305+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:01:56.576305+0000","last_peered":"2024-09-12T18:01:56.576305+0000","last_clean":"2024-09-12T18:01:56.576305+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:01:56.576305+0000","last_undegraded":"2024-09-12T18:01:56.576305+0000","last_fullsized":"2024-09-12T18:01:56.576305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578699+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:01:56.578699+0000","last_peered":"2024-09-12T18:01:56.578699+0000","last_clean":"2024-09-12T18:01:56.578699+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:01:56.578699+0000","last_undegraded":"2024-09-12T18:01:56.578699+0000","last_fullsized":"2024-09-12T18:01:56.578699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574492+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:01:56.574492+0000","last_peered":"2024-09-12T18:01:56.574492+0000","last_clean":"2024-09-12T18:01:56.574492+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:01:56.574492+0000","last_undegraded":"2024-09-12T18:01:56.574492+0000","last_fullsized":"2024-09-12T18:01:56.574492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575560+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:01:56.575560+0000","last_peered":"2024-09-12T18:01:56.575560+0000","last_clean":"2024-09-12T18:01:56.575560+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:01:56.575560+0000","last_undegraded":"2024-09-12T18:01:56.575560+0000","last_fullsized":"2024-09-12T18:01:56.575560+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577566+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:01:56.577566+0000","last_peered":"2024-09-12T18:01:56.577566+0000","last_clean":"2024-09-12T18:01:56.577566+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:01:56.577566+0000","last_undegraded":"2024-09-12T18:01:56.577566+0000","last_fullsized":"2024-09-12T18:01:56.577566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576897+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:01:56.576897+0000","last_peered":"2024-09-12T18:01:56.576897+0000","last_clean":"2024-09-12T18:01:56.576897+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:01:56.576897+0000","last_undegraded":"2024-09-12T18:01:56.576897+0000","last_fullsized":"2024-09-12T18:01:56.576897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577643+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:01:56.577643+0000","last_peered":"2024-09-12T18:01:56.577643+0000","last_clean":"2024-09-12T18:01:56.577643+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:01:56.577643+0000","last_undegraded":"2024-09-12T18:01:56.577643+0000","last_fullsized":"2024-09-12T18:01:56.577643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266566+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:01:57.266566+0000","last_peered":"2024-09-12T18:01:57.266566+0000","last_clean":"2024-09-12T18:01:57.266566+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:01:57.266566+0000","last_undegraded":"2024-09-12T18:01:57.266566+0000","last_fullsized":"2024-09-12T18:01:57.266566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576707+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:01:56.576707+0000","last_peered":"2024-09-12T18:01:56.576707+0000","last_clean":"2024-09-12T18:01:56.576707+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:01:56.576707+0000","last_undegraded":"2024-09-12T18:01:56.576707+0000","last_fullsized":"2024-09-12T18:01:56.576707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266004+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:01:57.266004+0000","last_peered":"2024-09-12T18:01:57.266004+0000","last_clean":"2024-09-12T18:01:57.266004+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:01:57.266004+0000","last_undegraded":"2024-09-12T18:01:57.266004+0000","last_fullsized":"2024-09-12T18:01:57.266004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575722+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:01:56.575722+0000","last_peered":"2024-09-12T18:01:56.575722+0000","last_clean":"2024-09-12T18:01:56.575722+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:01:56.575722+0000","last_undegraded":"2024-09-12T18:01:56.575722+0000","last_fullsized":"2024-09-12T18:01:56.575722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576719+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:01:56.576719+0000","last_peered":"2024-09-12T18:01:56.576719+0000","last_clean":"2024-09-12T18:01:56.576719+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:01:56.576719+0000","last_undegraded":"2024-09-12T18:01:56.576719+0000","last_fullsized":"2024-09-12T18:01:56.576719+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576931+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:01:56.576931+0000","last_peered":"2024-09-12T18:01:56.576931+0000","last_clean":"2024-09-12T18:01:56.576931+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:01:56.576931+0000","last_undegraded":"2024-09-12T18:01:56.576931+0000","last_fullsized":"2024-09-12T18:01:56.576931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574698+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:01:56.574698+0000","last_peered":"2024-09-12T18:01:56.574698+0000","last_clean":"2024-09-12T18:01:56.574698+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:01:56.574698+0000","last_undegraded":"2024-09-12T18:01:56.574698+0000","last_fullsized":"2024-09-12T18:01:56.574698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578890+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:01:56.578890+0000","last_peered":"2024-09-12T18:01:56.578890+0000","last_clean":"2024-09-12T18:01:56.578890+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:01:56.578890+0000","last_undegraded":"2024-09-12T18:01:56.578890+0000","last_fullsized":"2024-09-12T18:01:56.578890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576442+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:01:56.576442+0000","last_peered":"2024-09-12T18:01:56.576442+0000","last_clean":"2024-09-12T18:01:56.576442+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:01:56.576442+0000","last_undegraded":"2024-09-12T18:01:56.576442+0000","last_fullsized":"2024-09-12T18:01:56.576442+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574496+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:01:56.574496+0000","last_peered":"2024-09-12T18:01:56.574496+0000","last_clean":"2024-09-12T18:01:56.574496+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:01:56.574496+0000","last_undegraded":"2024-09-12T18:01:56.574496+0000","last_fullsized":"2024-09-12T18:01:56.574496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268409+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:01:57.268409+0000","last_peered":"2024-09-12T18:01:57.268409+0000","last_clean":"2024-09-12T18:01:57.268409+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:01:57.268409+0000","last_undegraded":"2024-09-12T18:01:57.268409+0000","last_fullsized":"2024-09-12T18:01:57.268409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574721+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:01:56.574721+0000","last_peered":"2024-09-12T18:01:56.574721+0000","last_clean":"2024-09-12T18:01:56.574721+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:01:56.574721+0000","last_undegraded":"2024-09-12T18:01:56.574721+0000","last_fullsized":"2024-09-12T18:01:56.574721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266265+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:01:57.266265+0000","last_peered":"2024-09-12T18:01:57.266265+0000","last_clean":"2024-09-12T18:01:57.266265+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:01:57.266265+0000","last_undegraded":"2024-09-12T18:01:57.266265+0000","last_fullsized":"2024-09-12T18:01:57.266265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575840+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:01:56.575840+0000","last_peered":"2024-09-12T18:01:56.575840+0000","last_clean":"2024-09-12T18:01:56.575840+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:01:56.575840+0000","last_undegraded":"2024-09-12T18:01:56.575840+0000","last_fullsized":"2024-09-12T18:01:56.575840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":30,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577338+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:01:56.577338+0000","last_peered":"2024-09-12T18:01:56.577338+0000","last_clean":"2024-09-12T18:01:56.577338+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:01:56.577338+0000","last_undegraded":"2024-09-12T18:01:56.577338+0000","last_fullsized":"2024-09-12T18:01:56.577338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576802+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:01:56.576802+0000","last_peered":"2024-09-12T18:01:56.576802+0000","last_clean":"2024-09-12T18:01:56.576802+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:01:56.576802+0000","last_undegraded":"2024-09-12T18:01:56.576802+0000","last_fullsized":"2024-09-12T18:01:56.576802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575629+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:01:56.575629+0000","last_peered":"2024-09-12T18:01:56.575629+0000","last_clean":"2024-09-12T18:01:56.575629+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:01:56.575629+0000","last_undegraded":"2024-09-12T18:01:56.575629+0000","last_fullsized":"2024-09-12T18:01:56.575629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578985+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:01:56.578985+0000","last_peered":"2024-09-12T18:01:56.578985+0000","last_clean":"2024-09-12T18:01:56.578985+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:01:56.578985+0000","last_undegraded":"2024-09-12T18:01:56.578985+0000","last_fullsized":"2024-09-12T18:01:56.578985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575582+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:01:56.575582+0000","last_peered":"2024-09-12T18:01:56.575582+0000","last_clean":"2024-09-12T18:01:56.575582+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:01:56.575582+0000","last_undegraded":"2024-09-12T18:01:56.575582+0000","last_fullsized":"2024-09-12T18:01:56.575582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267523+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:01:57.267523+0000","last_peered":"2024-09-12T18:01:57.267523+0000","last_clean":"2024-09-12T18:01:57.267523+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:01:57.267523+0000","last_undegraded":"2024-09-12T18:01:57.267523+0000","last_fullsized":"2024-09-12T18:01:57.267523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575443+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:01:56.575443+0000","last_peered":"2024-09-12T18:01:56.575443+0000","last_clean":"2024-09-12T18:01:56.575443+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:01:56.575443+0000","last_undegraded":"2024-09-12T18:01:56.575443+0000","last_fullsized":"2024-09-12T18:01:56.575443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268382+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:01:57.268382+0000","last_peered":"2024-09-12T18:01:57.268382+0000","last_clean":"2024-09-12T18:01:57.268382+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:01:57.268382+0000","last_undegraded":"2024-09-12T18:01:57.268382+0000","last_fullsized":"2024-09-12T18:01:57.268382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266465+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:01:57.266465+0000","last_peered":"2024-09-12T18:01:57.266465+0000","last_clean":"2024-09-12T18:01:57.266465+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:01:57.266465+0000","last_undegraded":"2024-09-12T18:01:57.266465+0000","last_fullsized":"2024-09-12T18:01:57.266465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576279+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:01:56.576279+0000","last_peered":"2024-09-12T18:01:56.576279+0000","last_clean":"2024-09-12T18:01:56.576279+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:01:56.576279+0000","last_undegraded":"2024-09-12T18:01:56.576279+0000","last_fullsized":"2024-09-12T18:01:56.576279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576427+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:01:56.576427+0000","last_peered":"2024-09-12T18:01:56.576427+0000","last_clean":"2024-09-12T18:01:56.576427+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:01:56.576427+0000","last_undegraded":"2024-09-12T18:01:56.576427+0000","last_fullsized":"2024-09-12T18:01:56.576427+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573480+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:01:56.573480+0000","last_peered":"2024-09-12T18:01:56.573480+0000","last_clean":"2024-09-12T18:01:56.573480+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:01:56.573480+0000","last_undegraded":"2024-09-12T18:01:56.573480+0000","last_fullsized":"2024-09-12T18:01:56.573480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.688234+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:01:56.688234+0000","last_peered":"2024-09-12T18:01:56.688234+0000","last_clean":"2024-09-12T18:01:56.688234+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:01:56.688234+0000","last_undegraded":"2024-09-12T18:01:56.688234+0000","last_fullsized":"2024-09-12T18:01:56.688234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577659+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:01:56.577659+0000","last_peered":"2024-09-12T18:01:56.577659+0000","last_clean":"2024-09-12T18:01:56.577659+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:01:56.577659+0000","last_undegraded":"2024-09-12T18:01:56.577659+0000","last_fullsized":"2024-09-12T18:01:56.577659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.265632+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:01:57.265632+0000","last_peered":"2024-09-12T18:01:57.265632+0000","last_clean":"2024-09-12T18:01:57.265632+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:01:57.265632+0000","last_undegraded":"2024-09-12T18:01:57.265632+0000","last_fullsized":"2024-09-12T18:01:57.265632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575585+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:01:56.575585+0000","last_peered":"2024-09-12T18:01:56.575585+0000","last_clean":"2024-09-12T18:01:56.575585+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:01:56.575585+0000","last_undegraded":"2024-09-12T18:01:56.575585+0000","last_fullsized":"2024-09-12T18:01:56.575585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.578680+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:01:56.578680+0000","last_peered":"2024-09-12T18:01:56.578680+0000","last_clean":"2024-09-12T18:01:56.578680+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:01:56.578680+0000","last_undegraded":"2024-09-12T18:01:56.578680+0000","last_fullsized":"2024-09-12T18:01:56.578680+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573583+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:01:56.573583+0000","last_peered":"2024-09-12T18:01:56.573583+0000","last_clean":"2024-09-12T18:01:56.573583+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:01:56.573583+0000","last_undegraded":"2024-09-12T18:01:56.573583+0000","last_fullsized":"2024-09-12T18:01:56.573583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.268300+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:01:57.268300+0000","last_peered":"2024-09-12T18:01:57.268300+0000","last_clean":"2024-09-12T18:01:57.268300+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:01:57.268300+0000","last_undegraded":"2024-09-12T18:01:57.268300+0000","last_fullsized":"2024-09-12T18:01:57.268300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576727+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:01:56.576727+0000","last_peered":"2024-09-12T18:01:56.576727+0000","last_clean":"2024-09-12T18:01:56.576727+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:01:56.576727+0000","last_undegraded":"2024-09-12T18:01:56.576727+0000","last_fullsized":"2024-09-12T18:01:56.576727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573721+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:01:56.573721+0000","last_peered":"2024-09-12T18:01:56.573721+0000","last_clean":"2024-09-12T18:01:56.573721+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:01:56.573721+0000","last_undegraded":"2024-09-12T18:01:56.573721+0000","last_fullsized":"2024-09-12T18:01:56.573721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576116+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:01:56.576116+0000","last_peered":"2024-09-12T18:01:56.576116+0000","last_clean":"2024-09-12T18:01:56.576116+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:01:56.576116+0000","last_undegraded":"2024-09-12T18:01:56.576116+0000","last_fullsized":"2024-09-12T18:01:56.576116+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573789+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:01:56.573789+0000","last_peered":"2024-09-12T18:01:56.573789+0000","last_clean":"2024-09-12T18:01:56.573789+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:01:56.573789+0000","last_undegraded":"2024-09-12T18:01:56.573789+0000","last_fullsized":"2024-09-12T18:01:56.573789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267698+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:01:57.267698+0000","last_peered":"2024-09-12T18:01:57.267698+0000","last_clean":"2024-09-12T18:01:57.267698+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:01:57.267698+0000","last_undegraded":"2024-09-12T18:01:57.267698+0000","last_fullsized":"2024-09-12T18:01:57.267698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.573786+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:01:56.573786+0000","last_peered":"2024-09-12T18:01:56.573786+0000","last_clean":"2024-09-12T18:01:56.573786+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:01:56.573786+0000","last_undegraded":"2024-09-12T18:01:56.573786+0000","last_fullsized":"2024-09-12T18:01:56.573786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575625+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:01:56.575625+0000","last_peered":"2024-09-12T18:01:56.575625+0000","last_clean":"2024-09-12T18:01:56.575625+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:01:56.575625+0000","last_undegraded":"2024-09-12T18:01:56.575625+0000","last_fullsized":"2024-09-12T18:01:56.575625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.574228+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:01:56.574228+0000","last_peered":"2024-09-12T18:01:56.574228+0000","last_clean":"2024-09-12T18:01:56.574228+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:01:56.574228+0000","last_undegraded":"2024-09-12T18:01:56.574228+0000","last_fullsized":"2024-09-12T18:01:56.574228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266417+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:01:57.266417+0000","last_peered":"2024-09-12T18:01:57.266417+0000","last_clean":"2024-09-12T18:01:57.266417+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:01:57.266417+0000","last_undegraded":"2024-09-12T18:01:57.266417+0000","last_fullsized":"2024-09-12T18:01:57.266417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266984+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:01:57.266984+0000","last_peered":"2024-09-12T18:01:57.266984+0000","last_clean":"2024-09-12T18:01:57.266984+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:01:57.266984+0000","last_undegraded":"2024-09-12T18:01:57.266984+0000","last_fullsized":"2024-09-12T18:01:57.266984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266713+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:01:57.266713+0000","last_peered":"2024-09-12T18:01:57.266713+0000","last_clean":"2024-09-12T18:01:57.266713+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:01:57.266713+0000","last_undegraded":"2024-09-12T18:01:57.266713+0000","last_fullsized":"2024-09-12T18:01:57.266713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.266817+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:01:57.266817+0000","last_peered":"2024-09-12T18:01:57.266817+0000","last_clean":"2024-09-12T18:01:57.266817+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:01:57.266817+0000","last_undegraded":"2024-09-12T18:01:57.266817+0000","last_fullsized":"2024-09-12T18:01:57.266817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.575894+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:01:56.575894+0000","last_peered":"2024-09-12T18:01:56.575894+0000","last_clean":"2024-09-12T18:01:56.575894+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:01:56.575894+0000","last_undegraded":"2024-09-12T18:01:56.575894+0000","last_fullsized":"2024-09-12T18:01:56.575894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577653+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:01:56.577653+0000","last_peered":"2024-09-12T18:01:56.577653+0000","last_clean":"2024-09-12T18:01:56.577653+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:01:56.577653+0000","last_undegraded":"2024-09-12T18:01:56.577653+0000","last_fullsized":"2024-09-12T18:01:56.577653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576337+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:01:56.576337+0000","last_peered":"2024-09-12T18:01:56.576337+0000","last_clean":"2024-09-12T18:01:56.576337+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:01:56.576337+0000","last_undegraded":"2024-09-12T18:01:56.576337+0000","last_fullsized":"2024-09-12T18:01:56.576337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267789+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:01:57.267789+0000","last_peered":"2024-09-12T18:01:57.267789+0000","last_clean":"2024-09-12T18:01:57.267789+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:01:57.267789+0000","last_undegraded":"2024-09-12T18:01:57.267789+0000","last_fullsized":"2024-09-12T18:01:57.267789+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:57.267139+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:01:57.267139+0000","last_peered":"2024-09-12T18:01:57.267139+0000","last_clean":"2024-09-12T18:01:57.267139+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:01:57.267139+0000","last_undegraded":"2024-09-12T18:01:57.267139+0000","last_fullsized":"2024-09-12T18:01:57.267139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576011+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:01:56.576011+0000","last_peered":"2024-09-12T18:01:56.576011+0000","last_clean":"2024-09-12T18:01:56.576011+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:01:56.576011+0000","last_undegraded":"2024-09-12T18:01:56.576011+0000","last_fullsized":"2024-09-12T18:01:56.576011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.577465+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:01:56.577465+0000","last_peered":"2024-09-12T18:01:56.577465+0000","last_clean":"2024-09-12T18:01:56.577465+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:01:56.577465+0000","last_undegraded":"2024-09-12T18:01:56.577465+0000","last_fullsized":"2024-09-12T18:01:56.577465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-12T18:01:56.576006+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:01:56.576006+0000","last_peered":"2024-09-12T18:01:56.576006+0000","last_clean":"2024-09-12T18:01:56.576006+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:01:56.576006+0000","last_undegraded":"2024-09-12T18:01:56.576006+0000","last_fullsized":"2024-09-12T18:01:56.576006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":253952,"data_stored":651168,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":266240,"data_stored":651803,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:00.071 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:02:00.071 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T18:02:00.072 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T18:02:00.405 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:00.424 INFO:teuthology.orchestra.run.smithi052.stdout:[{"version":4,"timestamp":"2024-09-12T18:01:41.517465+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"5872.079657"}]}] 2024-09-12T18:02:00.424 INFO:tasks.ceph_manager:config epoch is 4 2024-09-12T18:02:00.424 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T18:02:00.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T18:02:00.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T18:02:00.778 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:00.795 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1830932141},{"type":"v1","addr":"172.21.15.52:6801","nonce":1830932141}]},"active_addr":"172.21.15.52:6801/1830932141","active_change":"2024-09-12T18:01:38.546972+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":1867458600}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":810438904}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2744031853}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":3211935079}]}]} 2024-09-12T18:02:00.799 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T18:02:00.799 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T18:02:00.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:02:01.088 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:01.088 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:58.296887+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:02:01.106 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T18:02:01.106 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:02:01.397 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:01.398 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:58.296887+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:02:01.415 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T18:02:01.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T18:02:01.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T18:02:01.573 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-09-12T18:02:01.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:02:01.588 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-09-12T18:02:01.588 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:02:01.593 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-09-12T18:02:01.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:02:01.863 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-09-12T18:02:01.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.2 2024-09-12T18:02:01.923 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-09-12T18:02:01.929 INFO:teuthology.orchestra.run.smithi052.stdout:34359738374 2024-09-12T18:02:01.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-09-12T18:02:01.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.0 2024-09-12T18:02:02.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:02:02.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:02:02.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:02:03.212 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-09-12T18:02:03.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-09-12T18:02:03.229 DEBUG:teuthology.parallel:result is None 2024-09-12T18:02:03.273 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-09-12T18:02:03.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-09-12T18:02:03.290 DEBUG:teuthology.parallel:result is None 2024-09-12T18:02:03.301 INFO:teuthology.orchestra.run.smithi052.stdout:34359738375 2024-09-12T18:02:03.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-09-12T18:02:03.318 DEBUG:teuthology.parallel:result is None 2024-09-12T18:02:03.318 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:02:03.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:03.670 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:03.671 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:03.687 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-12T18:02:02.560553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.001848"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308558+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:01:58.308558+0000","last_peered":"2024-09-12T18:01:58.308558+0000","last_clean":"2024-09-12T18:01:58.308558+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:01:58.308558+0000","last_undegraded":"2024-09-12T18:01:58.308558+0000","last_fullsized":"2024-09-12T18:01:58.308558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308285+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:01:58.308285+0000","last_peered":"2024-09-12T18:01:58.308285+0000","last_clean":"2024-09-12T18:01:58.308285+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:01:58.308285+0000","last_undegraded":"2024-09-12T18:01:58.308285+0000","last_fullsized":"2024-09-12T18:01:58.308285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307148+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:01:58.307148+0000","last_peered":"2024-09-12T18:01:58.307148+0000","last_clean":"2024-09-12T18:01:58.307148+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:01:58.307148+0000","last_undegraded":"2024-09-12T18:01:58.307148+0000","last_fullsized":"2024-09-12T18:01:58.307148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307863+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:01:58.307863+0000","last_peered":"2024-09-12T18:01:58.307863+0000","last_clean":"2024-09-12T18:01:58.307863+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:01:58.307863+0000","last_undegraded":"2024-09-12T18:01:58.307863+0000","last_fullsized":"2024-09-12T18:01:58.307863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307179+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:01:58.307179+0000","last_peered":"2024-09-12T18:01:58.307179+0000","last_clean":"2024-09-12T18:01:58.307179+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:01:58.307179+0000","last_undegraded":"2024-09-12T18:01:58.307179+0000","last_fullsized":"2024-09-12T18:01:58.307179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306280+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:01:58.306280+0000","last_peered":"2024-09-12T18:01:58.306280+0000","last_clean":"2024-09-12T18:01:58.306280+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:01:58.306280+0000","last_undegraded":"2024-09-12T18:01:58.306280+0000","last_fullsized":"2024-09-12T18:01:58.306280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306438+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:01:58.306438+0000","last_peered":"2024-09-12T18:01:58.306438+0000","last_clean":"2024-09-12T18:01:58.306438+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:01:58.306438+0000","last_undegraded":"2024-09-12T18:01:58.306438+0000","last_fullsized":"2024-09-12T18:01:58.306438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305795+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:01:58.305795+0000","last_peered":"2024-09-12T18:01:58.305795+0000","last_clean":"2024-09-12T18:01:58.305795+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:01:58.305795+0000","last_undegraded":"2024-09-12T18:01:58.305795+0000","last_fullsized":"2024-09-12T18:01:58.305795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522943+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:01:58.522943+0000","last_peered":"2024-09-12T18:01:58.522943+0000","last_clean":"2024-09-12T18:01:58.522943+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:01:58.522943+0000","last_undegraded":"2024-09-12T18:01:58.522943+0000","last_fullsized":"2024-09-12T18:01:58.522943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308196+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:01:58.308196+0000","last_peered":"2024-09-12T18:01:58.308196+0000","last_clean":"2024-09-12T18:01:58.308196+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:01:58.308196+0000","last_undegraded":"2024-09-12T18:01:58.308196+0000","last_fullsized":"2024-09-12T18:01:58.308196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307608+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:01:58.307608+0000","last_peered":"2024-09-12T18:01:58.307608+0000","last_clean":"2024-09-12T18:01:58.307608+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:01:58.307608+0000","last_undegraded":"2024-09-12T18:01:58.307608+0000","last_fullsized":"2024-09-12T18:01:58.307608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307084+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:01:58.307084+0000","last_peered":"2024-09-12T18:01:58.307084+0000","last_clean":"2024-09-12T18:01:58.307084+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:01:58.307084+0000","last_undegraded":"2024-09-12T18:01:58.307084+0000","last_fullsized":"2024-09-12T18:01:58.307084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306901+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:01:58.306901+0000","last_peered":"2024-09-12T18:01:58.306901+0000","last_clean":"2024-09-12T18:01:58.306901+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:01:58.306901+0000","last_undegraded":"2024-09-12T18:01:58.306901+0000","last_fullsized":"2024-09-12T18:01:58.306901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306334+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:01:58.306334+0000","last_peered":"2024-09-12T18:01:58.306334+0000","last_clean":"2024-09-12T18:01:58.306334+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:01:58.306334+0000","last_undegraded":"2024-09-12T18:01:58.306334+0000","last_fullsized":"2024-09-12T18:01:58.306334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306757+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:01:58.306757+0000","last_peered":"2024-09-12T18:01:58.306757+0000","last_clean":"2024-09-12T18:01:58.306757+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:01:58.306757+0000","last_undegraded":"2024-09-12T18:01:58.306757+0000","last_fullsized":"2024-09-12T18:01:58.306757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305977+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:01:58.305977+0000","last_peered":"2024-09-12T18:01:58.305977+0000","last_clean":"2024-09-12T18:01:58.305977+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:01:58.305977+0000","last_undegraded":"2024-09-12T18:01:58.305977+0000","last_fullsized":"2024-09-12T18:01:58.305977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523801+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:01:58.523801+0000","last_peered":"2024-09-12T18:01:58.523801+0000","last_clean":"2024-09-12T18:01:58.523801+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:01:58.523801+0000","last_undegraded":"2024-09-12T18:01:58.523801+0000","last_fullsized":"2024-09-12T18:01:58.523801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308722+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:01:58.308722+0000","last_peered":"2024-09-12T18:01:58.308722+0000","last_clean":"2024-09-12T18:01:58.308722+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:01:58.308722+0000","last_undegraded":"2024-09-12T18:01:58.308722+0000","last_fullsized":"2024-09-12T18:01:58.308722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522685+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:01:58.522685+0000","last_peered":"2024-09-12T18:01:58.522685+0000","last_clean":"2024-09-12T18:01:58.522685+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:01:58.522685+0000","last_undegraded":"2024-09-12T18:01:58.522685+0000","last_fullsized":"2024-09-12T18:01:58.522685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308165+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:01:58.308165+0000","last_peered":"2024-09-12T18:01:58.308165+0000","last_clean":"2024-09-12T18:01:58.308165+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:01:58.308165+0000","last_undegraded":"2024-09-12T18:01:58.308165+0000","last_fullsized":"2024-09-12T18:01:58.308165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306938+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:01:58.306938+0000","last_peered":"2024-09-12T18:01:58.306938+0000","last_clean":"2024-09-12T18:01:58.306938+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:01:58.306938+0000","last_undegraded":"2024-09-12T18:01:58.306938+0000","last_fullsized":"2024-09-12T18:01:58.306938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307068+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:01:58.307068+0000","last_peered":"2024-09-12T18:01:58.307068+0000","last_clean":"2024-09-12T18:01:58.307068+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:01:58.307068+0000","last_undegraded":"2024-09-12T18:01:58.307068+0000","last_fullsized":"2024-09-12T18:01:58.307068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520263+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:01:58.520263+0000","last_peered":"2024-09-12T18:01:58.520263+0000","last_clean":"2024-09-12T18:01:58.520263+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:01:58.520263+0000","last_undegraded":"2024-09-12T18:01:58.520263+0000","last_fullsized":"2024-09-12T18:01:58.520263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306530+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:01:58.306530+0000","last_peered":"2024-09-12T18:01:58.306530+0000","last_clean":"2024-09-12T18:01:58.306530+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:01:58.306530+0000","last_undegraded":"2024-09-12T18:01:58.306530+0000","last_fullsized":"2024-09-12T18:01:58.306530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308760+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:01:58.308760+0000","last_peered":"2024-09-12T18:01:58.308760+0000","last_clean":"2024-09-12T18:01:58.308760+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:01:58.308760+0000","last_undegraded":"2024-09-12T18:01:58.308760+0000","last_fullsized":"2024-09-12T18:01:58.308760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523307+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:01:58.523307+0000","last_peered":"2024-09-12T18:01:58.523307+0000","last_clean":"2024-09-12T18:01:58.523307+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:01:58.523307+0000","last_undegraded":"2024-09-12T18:01:58.523307+0000","last_fullsized":"2024-09-12T18:01:58.523307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307840+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:01:58.307840+0000","last_peered":"2024-09-12T18:01:58.307840+0000","last_clean":"2024-09-12T18:01:58.307840+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:01:58.307840+0000","last_undegraded":"2024-09-12T18:01:58.307840+0000","last_fullsized":"2024-09-12T18:01:58.307840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308048+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:01:58.308048+0000","last_peered":"2024-09-12T18:01:58.308048+0000","last_clean":"2024-09-12T18:01:58.308048+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:01:58.308048+0000","last_undegraded":"2024-09-12T18:01:58.308048+0000","last_fullsized":"2024-09-12T18:01:58.308048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522201+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:01:58.522201+0000","last_peered":"2024-09-12T18:01:58.522201+0000","last_clean":"2024-09-12T18:01:58.522201+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:01:58.522201+0000","last_undegraded":"2024-09-12T18:01:58.522201+0000","last_fullsized":"2024-09-12T18:01:58.522201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307453+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:01:58.307453+0000","last_peered":"2024-09-12T18:01:58.307453+0000","last_clean":"2024-09-12T18:01:58.307453+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:01:58.307453+0000","last_undegraded":"2024-09-12T18:01:58.307453+0000","last_fullsized":"2024-09-12T18:01:58.307453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520383+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:01:58.520383+0000","last_peered":"2024-09-12T18:01:58.520383+0000","last_clean":"2024-09-12T18:01:58.520383+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:01:58.520383+0000","last_undegraded":"2024-09-12T18:01:58.520383+0000","last_fullsized":"2024-09-12T18:01:58.520383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306046+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:01:58.306046+0000","last_peered":"2024-09-12T18:01:58.306046+0000","last_clean":"2024-09-12T18:01:58.306046+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:01:58.306046+0000","last_undegraded":"2024-09-12T18:01:58.306046+0000","last_fullsized":"2024-09-12T18:01:58.306046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307713+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:01:58.307713+0000","last_peered":"2024-09-12T18:01:58.307713+0000","last_clean":"2024-09-12T18:01:58.307713+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:01:58.307713+0000","last_undegraded":"2024-09-12T18:01:58.307713+0000","last_fullsized":"2024-09-12T18:01:58.307713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307021+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:01:58.307021+0000","last_peered":"2024-09-12T18:01:58.307021+0000","last_clean":"2024-09-12T18:01:58.307021+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:01:58.307021+0000","last_undegraded":"2024-09-12T18:01:58.307021+0000","last_fullsized":"2024-09-12T18:01:58.307021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308169+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:01:58.308169+0000","last_peered":"2024-09-12T18:01:58.308169+0000","last_clean":"2024-09-12T18:01:58.308169+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:01:58.308169+0000","last_undegraded":"2024-09-12T18:01:58.308169+0000","last_fullsized":"2024-09-12T18:01:58.308169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521151+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:01:58.521151+0000","last_peered":"2024-09-12T18:01:58.521151+0000","last_clean":"2024-09-12T18:01:58.521151+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:01:58.521151+0000","last_undegraded":"2024-09-12T18:01:58.521151+0000","last_fullsized":"2024-09-12T18:01:58.521151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523536+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:01:58.523536+0000","last_peered":"2024-09-12T18:01:58.523536+0000","last_clean":"2024-09-12T18:01:58.523536+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:01:58.523536+0000","last_undegraded":"2024-09-12T18:01:58.523536+0000","last_fullsized":"2024-09-12T18:01:58.523536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306809+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:01:58.306809+0000","last_peered":"2024-09-12T18:01:58.306809+0000","last_clean":"2024-09-12T18:01:58.306809+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:01:58.306809+0000","last_undegraded":"2024-09-12T18:01:58.306809+0000","last_fullsized":"2024-09-12T18:01:58.306809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523210+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:01:58.523210+0000","last_peered":"2024-09-12T18:01:58.523210+0000","last_clean":"2024-09-12T18:01:58.523210+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:01:58.523210+0000","last_undegraded":"2024-09-12T18:01:58.523210+0000","last_fullsized":"2024-09-12T18:01:58.523210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306263+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:01:58.306263+0000","last_peered":"2024-09-12T18:01:58.306263+0000","last_clean":"2024-09-12T18:01:58.306263+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:01:58.306263+0000","last_undegraded":"2024-09-12T18:01:58.306263+0000","last_fullsized":"2024-09-12T18:01:58.306263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308667+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:01:58.308667+0000","last_peered":"2024-09-12T18:01:58.308667+0000","last_clean":"2024-09-12T18:01:58.308667+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:01:58.308667+0000","last_undegraded":"2024-09-12T18:01:58.308667+0000","last_fullsized":"2024-09-12T18:01:58.308667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306836+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:01:58.306836+0000","last_peered":"2024-09-12T18:01:58.306836+0000","last_clean":"2024-09-12T18:01:58.306836+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:01:58.306836+0000","last_undegraded":"2024-09-12T18:01:58.306836+0000","last_fullsized":"2024-09-12T18:01:58.306836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308728+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:01:58.308728+0000","last_peered":"2024-09-12T18:01:58.308728+0000","last_clean":"2024-09-12T18:01:58.308728+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:01:58.308728+0000","last_undegraded":"2024-09-12T18:01:58.308728+0000","last_fullsized":"2024-09-12T18:01:58.308728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306551+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:01:58.306551+0000","last_peered":"2024-09-12T18:01:58.306551+0000","last_clean":"2024-09-12T18:01:58.306551+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:01:58.306551+0000","last_undegraded":"2024-09-12T18:01:58.306551+0000","last_fullsized":"2024-09-12T18:01:58.306551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308374+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:01:58.308374+0000","last_peered":"2024-09-12T18:01:58.308374+0000","last_clean":"2024-09-12T18:01:58.308374+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:01:58.308374+0000","last_undegraded":"2024-09-12T18:01:58.308374+0000","last_fullsized":"2024-09-12T18:01:58.308374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306564+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:01:58.306564+0000","last_peered":"2024-09-12T18:01:58.306564+0000","last_clean":"2024-09-12T18:01:58.306564+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:01:58.306564+0000","last_undegraded":"2024-09-12T18:01:58.306564+0000","last_fullsized":"2024-09-12T18:01:58.306564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308773+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:01:58.308773+0000","last_peered":"2024-09-12T18:01:58.308773+0000","last_clean":"2024-09-12T18:01:58.308773+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:01:58.308773+0000","last_undegraded":"2024-09-12T18:01:58.308773+0000","last_fullsized":"2024-09-12T18:01:58.308773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521950+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:01:58.521950+0000","last_peered":"2024-09-12T18:01:58.521950+0000","last_clean":"2024-09-12T18:01:58.521950+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:01:58.521950+0000","last_undegraded":"2024-09-12T18:01:58.521950+0000","last_fullsized":"2024-09-12T18:01:58.521950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522420+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:01:58.522420+0000","last_peered":"2024-09-12T18:01:58.522420+0000","last_clean":"2024-09-12T18:01:58.522420+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:01:58.522420+0000","last_undegraded":"2024-09-12T18:01:58.522420+0000","last_fullsized":"2024-09-12T18:01:58.522420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308436+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:01:58.308436+0000","last_peered":"2024-09-12T18:01:58.308436+0000","last_clean":"2024-09-12T18:01:58.308436+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:01:58.308436+0000","last_undegraded":"2024-09-12T18:01:58.308436+0000","last_fullsized":"2024-09-12T18:01:58.308436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307114+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:01:58.307114+0000","last_peered":"2024-09-12T18:01:58.307114+0000","last_clean":"2024-09-12T18:01:58.307114+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:01:58.307114+0000","last_undegraded":"2024-09-12T18:01:58.307114+0000","last_fullsized":"2024-09-12T18:01:58.307114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308096+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:01:58.308096+0000","last_peered":"2024-09-12T18:01:58.308096+0000","last_clean":"2024-09-12T18:01:58.308096+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:01:58.308096+0000","last_undegraded":"2024-09-12T18:01:58.308096+0000","last_fullsized":"2024-09-12T18:01:58.308096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307081+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:01:58.307081+0000","last_peered":"2024-09-12T18:01:58.307081+0000","last_clean":"2024-09-12T18:01:58.307081+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:01:58.307081+0000","last_undegraded":"2024-09-12T18:01:58.307081+0000","last_fullsized":"2024-09-12T18:01:58.307081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307801+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:01:58.307801+0000","last_peered":"2024-09-12T18:01:58.307801+0000","last_clean":"2024-09-12T18:01:58.307801+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:01:58.307801+0000","last_undegraded":"2024-09-12T18:01:58.307801+0000","last_fullsized":"2024-09-12T18:01:58.307801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306861+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:01:58.306861+0000","last_peered":"2024-09-12T18:01:58.306861+0000","last_clean":"2024-09-12T18:01:58.306861+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:01:58.306861+0000","last_undegraded":"2024-09-12T18:01:58.306861+0000","last_fullsized":"2024-09-12T18:01:58.306861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523209+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:01:58.523209+0000","last_peered":"2024-09-12T18:01:58.523209+0000","last_clean":"2024-09-12T18:01:58.523209+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:01:58.523209+0000","last_undegraded":"2024-09-12T18:01:58.523209+0000","last_fullsized":"2024-09-12T18:01:58.523209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307284+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:01:58.307284+0000","last_peered":"2024-09-12T18:01:58.307284+0000","last_clean":"2024-09-12T18:01:58.307284+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:01:58.307284+0000","last_undegraded":"2024-09-12T18:01:58.307284+0000","last_fullsized":"2024-09-12T18:01:58.307284+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307391+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:01:58.307391+0000","last_peered":"2024-09-12T18:01:58.307391+0000","last_clean":"2024-09-12T18:01:58.307391+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:01:58.307391+0000","last_undegraded":"2024-09-12T18:01:58.307391+0000","last_fullsized":"2024-09-12T18:01:58.307391+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521347+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:01:58.521347+0000","last_peered":"2024-09-12T18:01:58.521347+0000","last_clean":"2024-09-12T18:01:58.521347+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:01:58.521347+0000","last_undegraded":"2024-09-12T18:01:58.521347+0000","last_fullsized":"2024-09-12T18:01:58.521347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308303+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:01:58.308303+0000","last_peered":"2024-09-12T18:01:58.308303+0000","last_clean":"2024-09-12T18:01:58.308303+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:01:58.308303+0000","last_undegraded":"2024-09-12T18:01:58.308303+0000","last_fullsized":"2024-09-12T18:01:58.308303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306710+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:01:58.306710+0000","last_peered":"2024-09-12T18:01:58.306710+0000","last_clean":"2024-09-12T18:01:58.306710+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:01:58.306710+0000","last_undegraded":"2024-09-12T18:01:58.306710+0000","last_fullsized":"2024-09-12T18:01:58.306710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520927+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:01:58.520927+0000","last_peered":"2024-09-12T18:01:58.520927+0000","last_clean":"2024-09-12T18:01:58.520927+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:01:58.520927+0000","last_undegraded":"2024-09-12T18:01:58.520927+0000","last_fullsized":"2024-09-12T18:01:58.520927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308440+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:01:58.308440+0000","last_peered":"2024-09-12T18:01:58.308440+0000","last_clean":"2024-09-12T18:01:58.308440+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:01:58.308440+0000","last_undegraded":"2024-09-12T18:01:58.308440+0000","last_fullsized":"2024-09-12T18:01:58.308440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521264+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:01:58.521264+0000","last_peered":"2024-09-12T18:01:58.521264+0000","last_clean":"2024-09-12T18:01:58.521264+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:01:58.521264+0000","last_undegraded":"2024-09-12T18:01:58.521264+0000","last_fullsized":"2024-09-12T18:01:58.521264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307103+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:01:58.307103+0000","last_peered":"2024-09-12T18:01:58.307103+0000","last_clean":"2024-09-12T18:01:58.307103+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:01:58.307103+0000","last_undegraded":"2024-09-12T18:01:58.307103+0000","last_fullsized":"2024-09-12T18:01:58.307103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523358+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:01:58.523358+0000","last_peered":"2024-09-12T18:01:58.523358+0000","last_clean":"2024-09-12T18:01:58.523358+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:01:58.523358+0000","last_undegraded":"2024-09-12T18:01:58.523358+0000","last_fullsized":"2024-09-12T18:01:58.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307334+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:01:58.307334+0000","last_peered":"2024-09-12T18:01:58.307334+0000","last_clean":"2024-09-12T18:01:58.307334+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:01:58.307334+0000","last_undegraded":"2024-09-12T18:01:58.307334+0000","last_fullsized":"2024-09-12T18:01:58.307334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307283+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:01:58.307283+0000","last_peered":"2024-09-12T18:01:58.307283+0000","last_clean":"2024-09-12T18:01:58.307283+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:01:58.307283+0000","last_undegraded":"2024-09-12T18:01:58.307283+0000","last_fullsized":"2024-09-12T18:01:58.307283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522497+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:01:58.522497+0000","last_peered":"2024-09-12T18:01:58.522497+0000","last_clean":"2024-09-12T18:01:58.522497+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:01:58.522497+0000","last_undegraded":"2024-09-12T18:01:58.522497+0000","last_fullsized":"2024-09-12T18:01:58.522497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308613+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:01:58.308613+0000","last_peered":"2024-09-12T18:01:58.308613+0000","last_clean":"2024-09-12T18:01:58.308613+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:01:58.308613+0000","last_undegraded":"2024-09-12T18:01:58.308613+0000","last_fullsized":"2024-09-12T18:01:58.308613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522819+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:01:58.522819+0000","last_peered":"2024-09-12T18:01:58.522819+0000","last_clean":"2024-09-12T18:01:58.522819+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:01:58.522819+0000","last_undegraded":"2024-09-12T18:01:58.522819+0000","last_fullsized":"2024-09-12T18:01:58.522819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307143+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:01:58.307143+0000","last_peered":"2024-09-12T18:01:58.307143+0000","last_clean":"2024-09-12T18:01:58.307143+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:01:58.307143+0000","last_undegraded":"2024-09-12T18:01:58.307143+0000","last_fullsized":"2024-09-12T18:01:58.307143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522522+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:01:58.522522+0000","last_peered":"2024-09-12T18:01:58.522522+0000","last_clean":"2024-09-12T18:01:58.522522+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:01:58.522522+0000","last_undegraded":"2024-09-12T18:01:58.522522+0000","last_fullsized":"2024-09-12T18:01:58.522522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308821+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:01:58.308821+0000","last_peered":"2024-09-12T18:01:58.308821+0000","last_clean":"2024-09-12T18:01:58.308821+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:01:58.308821+0000","last_undegraded":"2024-09-12T18:01:58.308821+0000","last_fullsized":"2024-09-12T18:01:58.308821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307004+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:01:58.307004+0000","last_peered":"2024-09-12T18:01:58.307004+0000","last_clean":"2024-09-12T18:01:58.307004+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:01:58.307004+0000","last_undegraded":"2024-09-12T18:01:58.307004+0000","last_fullsized":"2024-09-12T18:01:58.307004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523799+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:01:58.523799+0000","last_peered":"2024-09-12T18:01:58.523799+0000","last_clean":"2024-09-12T18:01:58.523799+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:01:58.523799+0000","last_undegraded":"2024-09-12T18:01:58.523799+0000","last_fullsized":"2024-09-12T18:01:58.523799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523895+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:01:58.523895+0000","last_peered":"2024-09-12T18:01:58.523895+0000","last_clean":"2024-09-12T18:01:58.523895+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:01:58.523895+0000","last_undegraded":"2024-09-12T18:01:58.523895+0000","last_fullsized":"2024-09-12T18:01:58.523895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520611+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:01:58.520611+0000","last_peered":"2024-09-12T18:01:58.520611+0000","last_clean":"2024-09-12T18:01:58.520611+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:01:58.520611+0000","last_undegraded":"2024-09-12T18:01:58.520611+0000","last_fullsized":"2024-09-12T18:01:58.520611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523802+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:01:58.523802+0000","last_peered":"2024-09-12T18:01:58.523802+0000","last_clean":"2024-09-12T18:01:58.523802+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:01:58.523802+0000","last_undegraded":"2024-09-12T18:01:58.523802+0000","last_fullsized":"2024-09-12T18:01:58.523802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308763+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:01:58.308763+0000","last_peered":"2024-09-12T18:01:58.308763+0000","last_clean":"2024-09-12T18:01:58.308763+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:01:58.308763+0000","last_undegraded":"2024-09-12T18:01:58.308763+0000","last_fullsized":"2024-09-12T18:01:58.308763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306540+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:01:58.306540+0000","last_peered":"2024-09-12T18:01:58.306540+0000","last_clean":"2024-09-12T18:01:58.306540+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:01:58.306540+0000","last_undegraded":"2024-09-12T18:01:58.306540+0000","last_fullsized":"2024-09-12T18:01:58.306540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306657+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:01:58.306657+0000","last_peered":"2024-09-12T18:01:58.306657+0000","last_clean":"2024-09-12T18:01:58.306657+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:01:58.306657+0000","last_undegraded":"2024-09-12T18:01:58.306657+0000","last_fullsized":"2024-09-12T18:01:58.306657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308692+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:01:58.308692+0000","last_peered":"2024-09-12T18:01:58.308692+0000","last_clean":"2024-09-12T18:01:58.308692+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:01:58.308692+0000","last_undegraded":"2024-09-12T18:01:58.308692+0000","last_fullsized":"2024-09-12T18:01:58.308692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520948+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:01:58.520948+0000","last_peered":"2024-09-12T18:01:58.520948+0000","last_clean":"2024-09-12T18:01:58.520948+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:01:58.520948+0000","last_undegraded":"2024-09-12T18:01:58.520948+0000","last_fullsized":"2024-09-12T18:01:58.520948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308438+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:01:58.308438+0000","last_peered":"2024-09-12T18:01:58.308438+0000","last_clean":"2024-09-12T18:01:58.308438+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:01:58.308438+0000","last_undegraded":"2024-09-12T18:01:58.308438+0000","last_fullsized":"2024-09-12T18:01:58.308438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307996+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:01:58.307996+0000","last_peered":"2024-09-12T18:01:58.307996+0000","last_clean":"2024-09-12T18:01:58.307996+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:01:58.307996+0000","last_undegraded":"2024-09-12T18:01:58.307996+0000","last_fullsized":"2024-09-12T18:01:58.307996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520540+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:01:58.520540+0000","last_peered":"2024-09-12T18:01:58.520540+0000","last_clean":"2024-09-12T18:01:58.520540+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:01:58.520540+0000","last_undegraded":"2024-09-12T18:01:58.520540+0000","last_fullsized":"2024-09-12T18:01:58.520540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523593+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:01:58.523593+0000","last_peered":"2024-09-12T18:01:58.523593+0000","last_clean":"2024-09-12T18:01:58.523593+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:01:58.523593+0000","last_undegraded":"2024-09-12T18:01:58.523593+0000","last_fullsized":"2024-09-12T18:01:58.523593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520359+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:01:58.520359+0000","last_peered":"2024-09-12T18:01:58.520359+0000","last_clean":"2024-09-12T18:01:58.520359+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:01:58.520359+0000","last_undegraded":"2024-09-12T18:01:58.520359+0000","last_fullsized":"2024-09-12T18:01:58.520359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308770+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:01:58.308770+0000","last_peered":"2024-09-12T18:01:58.308770+0000","last_clean":"2024-09-12T18:01:58.308770+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:01:58.308770+0000","last_undegraded":"2024-09-12T18:01:58.308770+0000","last_fullsized":"2024-09-12T18:01:58.308770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520712+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:01:58.520712+0000","last_peered":"2024-09-12T18:01:58.520712+0000","last_clean":"2024-09-12T18:01:58.520712+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:01:58.520712+0000","last_undegraded":"2024-09-12T18:01:58.520712+0000","last_fullsized":"2024-09-12T18:01:58.520712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523105+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:01:58.523105+0000","last_peered":"2024-09-12T18:01:58.523105+0000","last_clean":"2024-09-12T18:01:58.523105+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:01:58.523105+0000","last_undegraded":"2024-09-12T18:01:58.523105+0000","last_fullsized":"2024-09-12T18:01:58.523105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520913+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:01:58.520913+0000","last_peered":"2024-09-12T18:01:58.520913+0000","last_clean":"2024-09-12T18:01:58.520913+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:01:58.520913+0000","last_undegraded":"2024-09-12T18:01:58.520913+0000","last_fullsized":"2024-09-12T18:01:58.520913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307918+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:01:58.307918+0000","last_peered":"2024-09-12T18:01:58.307918+0000","last_clean":"2024-09-12T18:01:58.307918+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:01:58.307918+0000","last_undegraded":"2024-09-12T18:01:58.307918+0000","last_fullsized":"2024-09-12T18:01:58.307918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307691+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:01:58.307691+0000","last_peered":"2024-09-12T18:01:58.307691+0000","last_clean":"2024-09-12T18:01:58.307691+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:01:58.307691+0000","last_undegraded":"2024-09-12T18:01:58.307691+0000","last_fullsized":"2024-09-12T18:01:58.307691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307440+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:01:58.307440+0000","last_peered":"2024-09-12T18:01:58.307440+0000","last_clean":"2024-09-12T18:01:58.307440+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:01:58.307440+0000","last_undegraded":"2024-09-12T18:01:58.307440+0000","last_fullsized":"2024-09-12T18:01:58.307440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307331+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:01:58.307331+0000","last_peered":"2024-09-12T18:01:58.307331+0000","last_clean":"2024-09-12T18:01:58.307331+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:01:58.307331+0000","last_undegraded":"2024-09-12T18:01:58.307331+0000","last_fullsized":"2024-09-12T18:01:58.307331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306520+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:01:58.306520+0000","last_peered":"2024-09-12T18:01:58.306520+0000","last_clean":"2024-09-12T18:01:58.306520+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:01:58.306520+0000","last_undegraded":"2024-09-12T18:01:58.306520+0000","last_fullsized":"2024-09-12T18:01:58.306520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308501+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:01:58.308501+0000","last_peered":"2024-09-12T18:01:58.308501+0000","last_clean":"2024-09-12T18:01:58.308501+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:01:58.308501+0000","last_undegraded":"2024-09-12T18:01:58.308501+0000","last_fullsized":"2024-09-12T18:01:58.308501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306832+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:01:58.306832+0000","last_peered":"2024-09-12T18:01:58.306832+0000","last_clean":"2024-09-12T18:01:58.306832+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:01:58.306832+0000","last_undegraded":"2024-09-12T18:01:58.306832+0000","last_fullsized":"2024-09-12T18:01:58.306832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308276+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:01:58.308276+0000","last_peered":"2024-09-12T18:01:58.308276+0000","last_clean":"2024-09-12T18:01:58.308276+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:01:58.308276+0000","last_undegraded":"2024-09-12T18:01:58.308276+0000","last_fullsized":"2024-09-12T18:01:58.308276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307335+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:01:58.307335+0000","last_peered":"2024-09-12T18:01:58.307335+0000","last_clean":"2024-09-12T18:01:58.307335+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:01:58.307335+0000","last_undegraded":"2024-09-12T18:01:58.307335+0000","last_fullsized":"2024-09-12T18:01:58.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523494+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:01:58.523494+0000","last_peered":"2024-09-12T18:01:58.523494+0000","last_clean":"2024-09-12T18:01:58.523494+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:01:58.523494+0000","last_undegraded":"2024-09-12T18:01:58.523494+0000","last_fullsized":"2024-09-12T18:01:58.523494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307856+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:01:58.307856+0000","last_peered":"2024-09-12T18:01:58.307856+0000","last_clean":"2024-09-12T18:01:58.307856+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:01:58.307856+0000","last_undegraded":"2024-09-12T18:01:58.307856+0000","last_fullsized":"2024-09-12T18:01:58.307856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523461+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:01:58.523461+0000","last_peered":"2024-09-12T18:01:58.523461+0000","last_clean":"2024-09-12T18:01:58.523461+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:01:58.523461+0000","last_undegraded":"2024-09-12T18:01:58.523461+0000","last_fullsized":"2024-09-12T18:01:58.523461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:03.692 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:04.037 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:04.039 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:04.055 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-12T18:02:02.560553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.001848"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308558+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:01:58.308558+0000","last_peered":"2024-09-12T18:01:58.308558+0000","last_clean":"2024-09-12T18:01:58.308558+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:01:58.308558+0000","last_undegraded":"2024-09-12T18:01:58.308558+0000","last_fullsized":"2024-09-12T18:01:58.308558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308285+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:01:58.308285+0000","last_peered":"2024-09-12T18:01:58.308285+0000","last_clean":"2024-09-12T18:01:58.308285+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:01:58.308285+0000","last_undegraded":"2024-09-12T18:01:58.308285+0000","last_fullsized":"2024-09-12T18:01:58.308285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307148+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:01:58.307148+0000","last_peered":"2024-09-12T18:01:58.307148+0000","last_clean":"2024-09-12T18:01:58.307148+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:01:58.307148+0000","last_undegraded":"2024-09-12T18:01:58.307148+0000","last_fullsized":"2024-09-12T18:01:58.307148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307863+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:01:58.307863+0000","last_peered":"2024-09-12T18:01:58.307863+0000","last_clean":"2024-09-12T18:01:58.307863+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:01:58.307863+0000","last_undegraded":"2024-09-12T18:01:58.307863+0000","last_fullsized":"2024-09-12T18:01:58.307863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307179+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:01:58.307179+0000","last_peered":"2024-09-12T18:01:58.307179+0000","last_clean":"2024-09-12T18:01:58.307179+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:01:58.307179+0000","last_undegraded":"2024-09-12T18:01:58.307179+0000","last_fullsized":"2024-09-12T18:01:58.307179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306280+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:01:58.306280+0000","last_peered":"2024-09-12T18:01:58.306280+0000","last_clean":"2024-09-12T18:01:58.306280+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:01:58.306280+0000","last_undegraded":"2024-09-12T18:01:58.306280+0000","last_fullsized":"2024-09-12T18:01:58.306280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306438+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:01:58.306438+0000","last_peered":"2024-09-12T18:01:58.306438+0000","last_clean":"2024-09-12T18:01:58.306438+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:01:58.306438+0000","last_undegraded":"2024-09-12T18:01:58.306438+0000","last_fullsized":"2024-09-12T18:01:58.306438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305795+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:01:58.305795+0000","last_peered":"2024-09-12T18:01:58.305795+0000","last_clean":"2024-09-12T18:01:58.305795+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:01:58.305795+0000","last_undegraded":"2024-09-12T18:01:58.305795+0000","last_fullsized":"2024-09-12T18:01:58.305795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522943+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:01:58.522943+0000","last_peered":"2024-09-12T18:01:58.522943+0000","last_clean":"2024-09-12T18:01:58.522943+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:01:58.522943+0000","last_undegraded":"2024-09-12T18:01:58.522943+0000","last_fullsized":"2024-09-12T18:01:58.522943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308196+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:01:58.308196+0000","last_peered":"2024-09-12T18:01:58.308196+0000","last_clean":"2024-09-12T18:01:58.308196+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:01:58.308196+0000","last_undegraded":"2024-09-12T18:01:58.308196+0000","last_fullsized":"2024-09-12T18:01:58.308196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307608+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:01:58.307608+0000","last_peered":"2024-09-12T18:01:58.307608+0000","last_clean":"2024-09-12T18:01:58.307608+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:01:58.307608+0000","last_undegraded":"2024-09-12T18:01:58.307608+0000","last_fullsized":"2024-09-12T18:01:58.307608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307084+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:01:58.307084+0000","last_peered":"2024-09-12T18:01:58.307084+0000","last_clean":"2024-09-12T18:01:58.307084+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:01:58.307084+0000","last_undegraded":"2024-09-12T18:01:58.307084+0000","last_fullsized":"2024-09-12T18:01:58.307084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306901+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:01:58.306901+0000","last_peered":"2024-09-12T18:01:58.306901+0000","last_clean":"2024-09-12T18:01:58.306901+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:01:58.306901+0000","last_undegraded":"2024-09-12T18:01:58.306901+0000","last_fullsized":"2024-09-12T18:01:58.306901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306334+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:01:58.306334+0000","last_peered":"2024-09-12T18:01:58.306334+0000","last_clean":"2024-09-12T18:01:58.306334+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:01:58.306334+0000","last_undegraded":"2024-09-12T18:01:58.306334+0000","last_fullsized":"2024-09-12T18:01:58.306334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306757+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:01:58.306757+0000","last_peered":"2024-09-12T18:01:58.306757+0000","last_clean":"2024-09-12T18:01:58.306757+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:01:58.306757+0000","last_undegraded":"2024-09-12T18:01:58.306757+0000","last_fullsized":"2024-09-12T18:01:58.306757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305977+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:01:58.305977+0000","last_peered":"2024-09-12T18:01:58.305977+0000","last_clean":"2024-09-12T18:01:58.305977+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:01:58.305977+0000","last_undegraded":"2024-09-12T18:01:58.305977+0000","last_fullsized":"2024-09-12T18:01:58.305977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523801+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:01:58.523801+0000","last_peered":"2024-09-12T18:01:58.523801+0000","last_clean":"2024-09-12T18:01:58.523801+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:01:58.523801+0000","last_undegraded":"2024-09-12T18:01:58.523801+0000","last_fullsized":"2024-09-12T18:01:58.523801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308722+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:01:58.308722+0000","last_peered":"2024-09-12T18:01:58.308722+0000","last_clean":"2024-09-12T18:01:58.308722+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:01:58.308722+0000","last_undegraded":"2024-09-12T18:01:58.308722+0000","last_fullsized":"2024-09-12T18:01:58.308722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522685+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:01:58.522685+0000","last_peered":"2024-09-12T18:01:58.522685+0000","last_clean":"2024-09-12T18:01:58.522685+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:01:58.522685+0000","last_undegraded":"2024-09-12T18:01:58.522685+0000","last_fullsized":"2024-09-12T18:01:58.522685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308165+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:01:58.308165+0000","last_peered":"2024-09-12T18:01:58.308165+0000","last_clean":"2024-09-12T18:01:58.308165+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:01:58.308165+0000","last_undegraded":"2024-09-12T18:01:58.308165+0000","last_fullsized":"2024-09-12T18:01:58.308165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306938+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:01:58.306938+0000","last_peered":"2024-09-12T18:01:58.306938+0000","last_clean":"2024-09-12T18:01:58.306938+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:01:58.306938+0000","last_undegraded":"2024-09-12T18:01:58.306938+0000","last_fullsized":"2024-09-12T18:01:58.306938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307068+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:01:58.307068+0000","last_peered":"2024-09-12T18:01:58.307068+0000","last_clean":"2024-09-12T18:01:58.307068+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:01:58.307068+0000","last_undegraded":"2024-09-12T18:01:58.307068+0000","last_fullsized":"2024-09-12T18:01:58.307068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520263+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:01:58.520263+0000","last_peered":"2024-09-12T18:01:58.520263+0000","last_clean":"2024-09-12T18:01:58.520263+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:01:58.520263+0000","last_undegraded":"2024-09-12T18:01:58.520263+0000","last_fullsized":"2024-09-12T18:01:58.520263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306530+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:01:58.306530+0000","last_peered":"2024-09-12T18:01:58.306530+0000","last_clean":"2024-09-12T18:01:58.306530+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:01:58.306530+0000","last_undegraded":"2024-09-12T18:01:58.306530+0000","last_fullsized":"2024-09-12T18:01:58.306530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308760+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:01:58.308760+0000","last_peered":"2024-09-12T18:01:58.308760+0000","last_clean":"2024-09-12T18:01:58.308760+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:01:58.308760+0000","last_undegraded":"2024-09-12T18:01:58.308760+0000","last_fullsized":"2024-09-12T18:01:58.308760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523307+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:01:58.523307+0000","last_peered":"2024-09-12T18:01:58.523307+0000","last_clean":"2024-09-12T18:01:58.523307+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:01:58.523307+0000","last_undegraded":"2024-09-12T18:01:58.523307+0000","last_fullsized":"2024-09-12T18:01:58.523307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307840+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:01:58.307840+0000","last_peered":"2024-09-12T18:01:58.307840+0000","last_clean":"2024-09-12T18:01:58.307840+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:01:58.307840+0000","last_undegraded":"2024-09-12T18:01:58.307840+0000","last_fullsized":"2024-09-12T18:01:58.307840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308048+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:01:58.308048+0000","last_peered":"2024-09-12T18:01:58.308048+0000","last_clean":"2024-09-12T18:01:58.308048+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:01:58.308048+0000","last_undegraded":"2024-09-12T18:01:58.308048+0000","last_fullsized":"2024-09-12T18:01:58.308048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522201+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:01:58.522201+0000","last_peered":"2024-09-12T18:01:58.522201+0000","last_clean":"2024-09-12T18:01:58.522201+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:01:58.522201+0000","last_undegraded":"2024-09-12T18:01:58.522201+0000","last_fullsized":"2024-09-12T18:01:58.522201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307453+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:01:58.307453+0000","last_peered":"2024-09-12T18:01:58.307453+0000","last_clean":"2024-09-12T18:01:58.307453+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:01:58.307453+0000","last_undegraded":"2024-09-12T18:01:58.307453+0000","last_fullsized":"2024-09-12T18:01:58.307453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520383+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:01:58.520383+0000","last_peered":"2024-09-12T18:01:58.520383+0000","last_clean":"2024-09-12T18:01:58.520383+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:01:58.520383+0000","last_undegraded":"2024-09-12T18:01:58.520383+0000","last_fullsized":"2024-09-12T18:01:58.520383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306046+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:01:58.306046+0000","last_peered":"2024-09-12T18:01:58.306046+0000","last_clean":"2024-09-12T18:01:58.306046+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:01:58.306046+0000","last_undegraded":"2024-09-12T18:01:58.306046+0000","last_fullsized":"2024-09-12T18:01:58.306046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307713+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:01:58.307713+0000","last_peered":"2024-09-12T18:01:58.307713+0000","last_clean":"2024-09-12T18:01:58.307713+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:01:58.307713+0000","last_undegraded":"2024-09-12T18:01:58.307713+0000","last_fullsized":"2024-09-12T18:01:58.307713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307021+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:01:58.307021+0000","last_peered":"2024-09-12T18:01:58.307021+0000","last_clean":"2024-09-12T18:01:58.307021+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:01:58.307021+0000","last_undegraded":"2024-09-12T18:01:58.307021+0000","last_fullsized":"2024-09-12T18:01:58.307021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308169+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:01:58.308169+0000","last_peered":"2024-09-12T18:01:58.308169+0000","last_clean":"2024-09-12T18:01:58.308169+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:01:58.308169+0000","last_undegraded":"2024-09-12T18:01:58.308169+0000","last_fullsized":"2024-09-12T18:01:58.308169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521151+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:01:58.521151+0000","last_peered":"2024-09-12T18:01:58.521151+0000","last_clean":"2024-09-12T18:01:58.521151+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:01:58.521151+0000","last_undegraded":"2024-09-12T18:01:58.521151+0000","last_fullsized":"2024-09-12T18:01:58.521151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523536+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:01:58.523536+0000","last_peered":"2024-09-12T18:01:58.523536+0000","last_clean":"2024-09-12T18:01:58.523536+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:01:58.523536+0000","last_undegraded":"2024-09-12T18:01:58.523536+0000","last_fullsized":"2024-09-12T18:01:58.523536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306809+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:01:58.306809+0000","last_peered":"2024-09-12T18:01:58.306809+0000","last_clean":"2024-09-12T18:01:58.306809+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:01:58.306809+0000","last_undegraded":"2024-09-12T18:01:58.306809+0000","last_fullsized":"2024-09-12T18:01:58.306809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523210+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:01:58.523210+0000","last_peered":"2024-09-12T18:01:58.523210+0000","last_clean":"2024-09-12T18:01:58.523210+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:01:58.523210+0000","last_undegraded":"2024-09-12T18:01:58.523210+0000","last_fullsized":"2024-09-12T18:01:58.523210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306263+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:01:58.306263+0000","last_peered":"2024-09-12T18:01:58.306263+0000","last_clean":"2024-09-12T18:01:58.306263+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:01:58.306263+0000","last_undegraded":"2024-09-12T18:01:58.306263+0000","last_fullsized":"2024-09-12T18:01:58.306263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308667+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:01:58.308667+0000","last_peered":"2024-09-12T18:01:58.308667+0000","last_clean":"2024-09-12T18:01:58.308667+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:01:58.308667+0000","last_undegraded":"2024-09-12T18:01:58.308667+0000","last_fullsized":"2024-09-12T18:01:58.308667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306836+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:01:58.306836+0000","last_peered":"2024-09-12T18:01:58.306836+0000","last_clean":"2024-09-12T18:01:58.306836+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:01:58.306836+0000","last_undegraded":"2024-09-12T18:01:58.306836+0000","last_fullsized":"2024-09-12T18:01:58.306836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308728+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:01:58.308728+0000","last_peered":"2024-09-12T18:01:58.308728+0000","last_clean":"2024-09-12T18:01:58.308728+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:01:58.308728+0000","last_undegraded":"2024-09-12T18:01:58.308728+0000","last_fullsized":"2024-09-12T18:01:58.308728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306551+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:01:58.306551+0000","last_peered":"2024-09-12T18:01:58.306551+0000","last_clean":"2024-09-12T18:01:58.306551+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:01:58.306551+0000","last_undegraded":"2024-09-12T18:01:58.306551+0000","last_fullsized":"2024-09-12T18:01:58.306551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308374+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:01:58.308374+0000","last_peered":"2024-09-12T18:01:58.308374+0000","last_clean":"2024-09-12T18:01:58.308374+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:01:58.308374+0000","last_undegraded":"2024-09-12T18:01:58.308374+0000","last_fullsized":"2024-09-12T18:01:58.308374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306564+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:01:58.306564+0000","last_peered":"2024-09-12T18:01:58.306564+0000","last_clean":"2024-09-12T18:01:58.306564+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:01:58.306564+0000","last_undegraded":"2024-09-12T18:01:58.306564+0000","last_fullsized":"2024-09-12T18:01:58.306564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308773+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:01:58.308773+0000","last_peered":"2024-09-12T18:01:58.308773+0000","last_clean":"2024-09-12T18:01:58.308773+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:01:58.308773+0000","last_undegraded":"2024-09-12T18:01:58.308773+0000","last_fullsized":"2024-09-12T18:01:58.308773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521950+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:01:58.521950+0000","last_peered":"2024-09-12T18:01:58.521950+0000","last_clean":"2024-09-12T18:01:58.521950+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:01:58.521950+0000","last_undegraded":"2024-09-12T18:01:58.521950+0000","last_fullsized":"2024-09-12T18:01:58.521950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522420+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:01:58.522420+0000","last_peered":"2024-09-12T18:01:58.522420+0000","last_clean":"2024-09-12T18:01:58.522420+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:01:58.522420+0000","last_undegraded":"2024-09-12T18:01:58.522420+0000","last_fullsized":"2024-09-12T18:01:58.522420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308436+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:01:58.308436+0000","last_peered":"2024-09-12T18:01:58.308436+0000","last_clean":"2024-09-12T18:01:58.308436+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:01:58.308436+0000","last_undegraded":"2024-09-12T18:01:58.308436+0000","last_fullsized":"2024-09-12T18:01:58.308436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307114+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:01:58.307114+0000","last_peered":"2024-09-12T18:01:58.307114+0000","last_clean":"2024-09-12T18:01:58.307114+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:01:58.307114+0000","last_undegraded":"2024-09-12T18:01:58.307114+0000","last_fullsized":"2024-09-12T18:01:58.307114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308096+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:01:58.308096+0000","last_peered":"2024-09-12T18:01:58.308096+0000","last_clean":"2024-09-12T18:01:58.308096+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:01:58.308096+0000","last_undegraded":"2024-09-12T18:01:58.308096+0000","last_fullsized":"2024-09-12T18:01:58.308096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307081+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:01:58.307081+0000","last_peered":"2024-09-12T18:01:58.307081+0000","last_clean":"2024-09-12T18:01:58.307081+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:01:58.307081+0000","last_undegraded":"2024-09-12T18:01:58.307081+0000","last_fullsized":"2024-09-12T18:01:58.307081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307801+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:01:58.307801+0000","last_peered":"2024-09-12T18:01:58.307801+0000","last_clean":"2024-09-12T18:01:58.307801+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:01:58.307801+0000","last_undegraded":"2024-09-12T18:01:58.307801+0000","last_fullsized":"2024-09-12T18:01:58.307801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306861+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:01:58.306861+0000","last_peered":"2024-09-12T18:01:58.306861+0000","last_clean":"2024-09-12T18:01:58.306861+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:01:58.306861+0000","last_undegraded":"2024-09-12T18:01:58.306861+0000","last_fullsized":"2024-09-12T18:01:58.306861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523209+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:01:58.523209+0000","last_peered":"2024-09-12T18:01:58.523209+0000","last_clean":"2024-09-12T18:01:58.523209+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:01:58.523209+0000","last_undegraded":"2024-09-12T18:01:58.523209+0000","last_fullsized":"2024-09-12T18:01:58.523209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307284+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:01:58.307284+0000","last_peered":"2024-09-12T18:01:58.307284+0000","last_clean":"2024-09-12T18:01:58.307284+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:01:58.307284+0000","last_undegraded":"2024-09-12T18:01:58.307284+0000","last_fullsized":"2024-09-12T18:01:58.307284+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307391+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:01:58.307391+0000","last_peered":"2024-09-12T18:01:58.307391+0000","last_clean":"2024-09-12T18:01:58.307391+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:01:58.307391+0000","last_undegraded":"2024-09-12T18:01:58.307391+0000","last_fullsized":"2024-09-12T18:01:58.307391+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521347+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:01:58.521347+0000","last_peered":"2024-09-12T18:01:58.521347+0000","last_clean":"2024-09-12T18:01:58.521347+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:01:58.521347+0000","last_undegraded":"2024-09-12T18:01:58.521347+0000","last_fullsized":"2024-09-12T18:01:58.521347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308303+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:01:58.308303+0000","last_peered":"2024-09-12T18:01:58.308303+0000","last_clean":"2024-09-12T18:01:58.308303+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:01:58.308303+0000","last_undegraded":"2024-09-12T18:01:58.308303+0000","last_fullsized":"2024-09-12T18:01:58.308303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306710+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:01:58.306710+0000","last_peered":"2024-09-12T18:01:58.306710+0000","last_clean":"2024-09-12T18:01:58.306710+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:01:58.306710+0000","last_undegraded":"2024-09-12T18:01:58.306710+0000","last_fullsized":"2024-09-12T18:01:58.306710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520927+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:01:58.520927+0000","last_peered":"2024-09-12T18:01:58.520927+0000","last_clean":"2024-09-12T18:01:58.520927+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:01:58.520927+0000","last_undegraded":"2024-09-12T18:01:58.520927+0000","last_fullsized":"2024-09-12T18:01:58.520927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308440+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:01:58.308440+0000","last_peered":"2024-09-12T18:01:58.308440+0000","last_clean":"2024-09-12T18:01:58.308440+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:01:58.308440+0000","last_undegraded":"2024-09-12T18:01:58.308440+0000","last_fullsized":"2024-09-12T18:01:58.308440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521264+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:01:58.521264+0000","last_peered":"2024-09-12T18:01:58.521264+0000","last_clean":"2024-09-12T18:01:58.521264+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:01:58.521264+0000","last_undegraded":"2024-09-12T18:01:58.521264+0000","last_fullsized":"2024-09-12T18:01:58.521264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307103+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:01:58.307103+0000","last_peered":"2024-09-12T18:01:58.307103+0000","last_clean":"2024-09-12T18:01:58.307103+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:01:58.307103+0000","last_undegraded":"2024-09-12T18:01:58.307103+0000","last_fullsized":"2024-09-12T18:01:58.307103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523358+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:01:58.523358+0000","last_peered":"2024-09-12T18:01:58.523358+0000","last_clean":"2024-09-12T18:01:58.523358+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:01:58.523358+0000","last_undegraded":"2024-09-12T18:01:58.523358+0000","last_fullsized":"2024-09-12T18:01:58.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307334+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:01:58.307334+0000","last_peered":"2024-09-12T18:01:58.307334+0000","last_clean":"2024-09-12T18:01:58.307334+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:01:58.307334+0000","last_undegraded":"2024-09-12T18:01:58.307334+0000","last_fullsized":"2024-09-12T18:01:58.307334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307283+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:01:58.307283+0000","last_peered":"2024-09-12T18:01:58.307283+0000","last_clean":"2024-09-12T18:01:58.307283+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:01:58.307283+0000","last_undegraded":"2024-09-12T18:01:58.307283+0000","last_fullsized":"2024-09-12T18:01:58.307283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522497+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:01:58.522497+0000","last_peered":"2024-09-12T18:01:58.522497+0000","last_clean":"2024-09-12T18:01:58.522497+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:01:58.522497+0000","last_undegraded":"2024-09-12T18:01:58.522497+0000","last_fullsized":"2024-09-12T18:01:58.522497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308613+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:01:58.308613+0000","last_peered":"2024-09-12T18:01:58.308613+0000","last_clean":"2024-09-12T18:01:58.308613+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:01:58.308613+0000","last_undegraded":"2024-09-12T18:01:58.308613+0000","last_fullsized":"2024-09-12T18:01:58.308613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522819+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:01:58.522819+0000","last_peered":"2024-09-12T18:01:58.522819+0000","last_clean":"2024-09-12T18:01:58.522819+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:01:58.522819+0000","last_undegraded":"2024-09-12T18:01:58.522819+0000","last_fullsized":"2024-09-12T18:01:58.522819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307143+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:01:58.307143+0000","last_peered":"2024-09-12T18:01:58.307143+0000","last_clean":"2024-09-12T18:01:58.307143+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:01:58.307143+0000","last_undegraded":"2024-09-12T18:01:58.307143+0000","last_fullsized":"2024-09-12T18:01:58.307143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522522+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:01:58.522522+0000","last_peered":"2024-09-12T18:01:58.522522+0000","last_clean":"2024-09-12T18:01:58.522522+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:01:58.522522+0000","last_undegraded":"2024-09-12T18:01:58.522522+0000","last_fullsized":"2024-09-12T18:01:58.522522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308821+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:01:58.308821+0000","last_peered":"2024-09-12T18:01:58.308821+0000","last_clean":"2024-09-12T18:01:58.308821+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:01:58.308821+0000","last_undegraded":"2024-09-12T18:01:58.308821+0000","last_fullsized":"2024-09-12T18:01:58.308821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307004+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:01:58.307004+0000","last_peered":"2024-09-12T18:01:58.307004+0000","last_clean":"2024-09-12T18:01:58.307004+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:01:58.307004+0000","last_undegraded":"2024-09-12T18:01:58.307004+0000","last_fullsized":"2024-09-12T18:01:58.307004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523799+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:01:58.523799+0000","last_peered":"2024-09-12T18:01:58.523799+0000","last_clean":"2024-09-12T18:01:58.523799+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:01:58.523799+0000","last_undegraded":"2024-09-12T18:01:58.523799+0000","last_fullsized":"2024-09-12T18:01:58.523799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523895+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:01:58.523895+0000","last_peered":"2024-09-12T18:01:58.523895+0000","last_clean":"2024-09-12T18:01:58.523895+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:01:58.523895+0000","last_undegraded":"2024-09-12T18:01:58.523895+0000","last_fullsized":"2024-09-12T18:01:58.523895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520611+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:01:58.520611+0000","last_peered":"2024-09-12T18:01:58.520611+0000","last_clean":"2024-09-12T18:01:58.520611+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:01:58.520611+0000","last_undegraded":"2024-09-12T18:01:58.520611+0000","last_fullsized":"2024-09-12T18:01:58.520611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523802+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:01:58.523802+0000","last_peered":"2024-09-12T18:01:58.523802+0000","last_clean":"2024-09-12T18:01:58.523802+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:01:58.523802+0000","last_undegraded":"2024-09-12T18:01:58.523802+0000","last_fullsized":"2024-09-12T18:01:58.523802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308763+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:01:58.308763+0000","last_peered":"2024-09-12T18:01:58.308763+0000","last_clean":"2024-09-12T18:01:58.308763+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:01:58.308763+0000","last_undegraded":"2024-09-12T18:01:58.308763+0000","last_fullsized":"2024-09-12T18:01:58.308763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306540+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:01:58.306540+0000","last_peered":"2024-09-12T18:01:58.306540+0000","last_clean":"2024-09-12T18:01:58.306540+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:01:58.306540+0000","last_undegraded":"2024-09-12T18:01:58.306540+0000","last_fullsized":"2024-09-12T18:01:58.306540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306657+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:01:58.306657+0000","last_peered":"2024-09-12T18:01:58.306657+0000","last_clean":"2024-09-12T18:01:58.306657+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:01:58.306657+0000","last_undegraded":"2024-09-12T18:01:58.306657+0000","last_fullsized":"2024-09-12T18:01:58.306657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308692+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:01:58.308692+0000","last_peered":"2024-09-12T18:01:58.308692+0000","last_clean":"2024-09-12T18:01:58.308692+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:01:58.308692+0000","last_undegraded":"2024-09-12T18:01:58.308692+0000","last_fullsized":"2024-09-12T18:01:58.308692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520948+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:01:58.520948+0000","last_peered":"2024-09-12T18:01:58.520948+0000","last_clean":"2024-09-12T18:01:58.520948+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:01:58.520948+0000","last_undegraded":"2024-09-12T18:01:58.520948+0000","last_fullsized":"2024-09-12T18:01:58.520948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308438+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:01:58.308438+0000","last_peered":"2024-09-12T18:01:58.308438+0000","last_clean":"2024-09-12T18:01:58.308438+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:01:58.308438+0000","last_undegraded":"2024-09-12T18:01:58.308438+0000","last_fullsized":"2024-09-12T18:01:58.308438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307996+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:01:58.307996+0000","last_peered":"2024-09-12T18:01:58.307996+0000","last_clean":"2024-09-12T18:01:58.307996+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:01:58.307996+0000","last_undegraded":"2024-09-12T18:01:58.307996+0000","last_fullsized":"2024-09-12T18:01:58.307996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520540+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:01:58.520540+0000","last_peered":"2024-09-12T18:01:58.520540+0000","last_clean":"2024-09-12T18:01:58.520540+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:01:58.520540+0000","last_undegraded":"2024-09-12T18:01:58.520540+0000","last_fullsized":"2024-09-12T18:01:58.520540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523593+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:01:58.523593+0000","last_peered":"2024-09-12T18:01:58.523593+0000","last_clean":"2024-09-12T18:01:58.523593+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:01:58.523593+0000","last_undegraded":"2024-09-12T18:01:58.523593+0000","last_fullsized":"2024-09-12T18:01:58.523593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520359+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:01:58.520359+0000","last_peered":"2024-09-12T18:01:58.520359+0000","last_clean":"2024-09-12T18:01:58.520359+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:01:58.520359+0000","last_undegraded":"2024-09-12T18:01:58.520359+0000","last_fullsized":"2024-09-12T18:01:58.520359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308770+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:01:58.308770+0000","last_peered":"2024-09-12T18:01:58.308770+0000","last_clean":"2024-09-12T18:01:58.308770+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:01:58.308770+0000","last_undegraded":"2024-09-12T18:01:58.308770+0000","last_fullsized":"2024-09-12T18:01:58.308770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520712+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:01:58.520712+0000","last_peered":"2024-09-12T18:01:58.520712+0000","last_clean":"2024-09-12T18:01:58.520712+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:01:58.520712+0000","last_undegraded":"2024-09-12T18:01:58.520712+0000","last_fullsized":"2024-09-12T18:01:58.520712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523105+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:01:58.523105+0000","last_peered":"2024-09-12T18:01:58.523105+0000","last_clean":"2024-09-12T18:01:58.523105+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:01:58.523105+0000","last_undegraded":"2024-09-12T18:01:58.523105+0000","last_fullsized":"2024-09-12T18:01:58.523105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520913+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:01:58.520913+0000","last_peered":"2024-09-12T18:01:58.520913+0000","last_clean":"2024-09-12T18:01:58.520913+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:01:58.520913+0000","last_undegraded":"2024-09-12T18:01:58.520913+0000","last_fullsized":"2024-09-12T18:01:58.520913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307918+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:01:58.307918+0000","last_peered":"2024-09-12T18:01:58.307918+0000","last_clean":"2024-09-12T18:01:58.307918+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:01:58.307918+0000","last_undegraded":"2024-09-12T18:01:58.307918+0000","last_fullsized":"2024-09-12T18:01:58.307918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307691+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:01:58.307691+0000","last_peered":"2024-09-12T18:01:58.307691+0000","last_clean":"2024-09-12T18:01:58.307691+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:01:58.307691+0000","last_undegraded":"2024-09-12T18:01:58.307691+0000","last_fullsized":"2024-09-12T18:01:58.307691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307440+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:01:58.307440+0000","last_peered":"2024-09-12T18:01:58.307440+0000","last_clean":"2024-09-12T18:01:58.307440+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:01:58.307440+0000","last_undegraded":"2024-09-12T18:01:58.307440+0000","last_fullsized":"2024-09-12T18:01:58.307440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307331+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:01:58.307331+0000","last_peered":"2024-09-12T18:01:58.307331+0000","last_clean":"2024-09-12T18:01:58.307331+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:01:58.307331+0000","last_undegraded":"2024-09-12T18:01:58.307331+0000","last_fullsized":"2024-09-12T18:01:58.307331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306520+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:01:58.306520+0000","last_peered":"2024-09-12T18:01:58.306520+0000","last_clean":"2024-09-12T18:01:58.306520+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:01:58.306520+0000","last_undegraded":"2024-09-12T18:01:58.306520+0000","last_fullsized":"2024-09-12T18:01:58.306520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308501+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:01:58.308501+0000","last_peered":"2024-09-12T18:01:58.308501+0000","last_clean":"2024-09-12T18:01:58.308501+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:01:58.308501+0000","last_undegraded":"2024-09-12T18:01:58.308501+0000","last_fullsized":"2024-09-12T18:01:58.308501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306832+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:01:58.306832+0000","last_peered":"2024-09-12T18:01:58.306832+0000","last_clean":"2024-09-12T18:01:58.306832+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:01:58.306832+0000","last_undegraded":"2024-09-12T18:01:58.306832+0000","last_fullsized":"2024-09-12T18:01:58.306832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308276+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:01:58.308276+0000","last_peered":"2024-09-12T18:01:58.308276+0000","last_clean":"2024-09-12T18:01:58.308276+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:01:58.308276+0000","last_undegraded":"2024-09-12T18:01:58.308276+0000","last_fullsized":"2024-09-12T18:01:58.308276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307335+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:01:58.307335+0000","last_peered":"2024-09-12T18:01:58.307335+0000","last_clean":"2024-09-12T18:01:58.307335+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:01:58.307335+0000","last_undegraded":"2024-09-12T18:01:58.307335+0000","last_fullsized":"2024-09-12T18:01:58.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523494+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:01:58.523494+0000","last_peered":"2024-09-12T18:01:58.523494+0000","last_clean":"2024-09-12T18:01:58.523494+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:01:58.523494+0000","last_undegraded":"2024-09-12T18:01:58.523494+0000","last_fullsized":"2024-09-12T18:01:58.523494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307856+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:01:58.307856+0000","last_peered":"2024-09-12T18:01:58.307856+0000","last_clean":"2024-09-12T18:01:58.307856+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:01:58.307856+0000","last_undegraded":"2024-09-12T18:01:58.307856+0000","last_fullsized":"2024-09-12T18:01:58.307856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523461+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:01:58.523461+0000","last_peered":"2024-09-12T18:01:58.523461+0000","last_clean":"2024-09-12T18:01:58.523461+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:01:58.523461+0000","last_undegraded":"2024-09-12T18:01:58.523461+0000","last_fullsized":"2024-09-12T18:01:58.523461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:04.060 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:02:04.060 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T18:02:04.060 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T18:02:04.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T18:02:04.441 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:04.441 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T18:02:04.460 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T18:02:04.461 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:02:04.793 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:04.793 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:01:55.051940+0000","modified":"2024-09-12T18:01:58.061122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6803/2379477754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2379477754},{"type":"v1","addr":"172.21.15.52:6803","nonce":2379477754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-09-12T18:02:04.793 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-09-12T18:02:04.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:02:05.148 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:05.148 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:01:55.051940+0000","modified":"2024-09-12T18:01:58.061122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6803/2379477754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2379477754},{"type":"v1","addr":"172.21.15.52:6803","nonce":2379477754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-09-12T18:02:05.149 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-09-12T18:02:05.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:02:05.467 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:05.467 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:01:58.296887+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:02:05.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:02:05.808 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:05.808 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:01:55.051940+0000","modified":"2024-09-12T18:01:58.061122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6803/2379477754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2379477754},{"type":"v1","addr":"172.21.15.52:6803","nonce":2379477754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-09-12T18:02:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-09-12T18:02:05.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T18:01:55.051940+0000', 'modified': '2024-09-12T18:01:58.061122+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.52:6803/2379477754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6802', 'nonce': 2379477754}, {'type': 'v1', 'addr': '172.21.15.52:6803', 'nonce': 2379477754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4193, 'qdb_cluster': [4193]} 2024-09-12T18:02:05.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T18:02:05.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T18:02:06.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:06.064+0000 7fb7bd7fa640 0 client.4399 ms_handle_reset on v2:172.21.15.52:6802/2379477754 2024-09-12T18:02:06.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:06.088+0000 7fb7bd7fa640 0 client.4385 ms_handle_reset on v2:172.21.15.52:6802/2379477754 2024-09-12T18:02:06.090 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:02:06.090 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "da5a949a-216b-4267-953a-8d92e3d25b1d", 2024-09-12T18:02:06.090 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-12T18:02:06.090 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4193, 2024-09-12T18:02:06.090 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-12T18:02:06.090 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-12T18:02:06.091 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-12T18:02:06.091 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 10.408853903000001, 2024-09-12T18:02:06.091 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 6, 2024-09-12T18:02:06.091 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 20, 2024-09-12T18:02:06.091 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 20, 2024-09-12T18:02:06.091 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 13.439177494999999 2024-09-12T18:02:06.091 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:02:06.106 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T18:02:06.117 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T18:02:06.117 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '46406987da2067f022005d68ecbb989daaabb837'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-12T18:02:06.117 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T18:02:06.117 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-12T18:02:06.117 DEBUG:teuthology.orchestra.run.smithi052:> sync 2024-09-12T18:02:06.376 DEBUG:teuthology.orchestra.run.smithi111:> sync 2024-09-12T18:02:06.477 DEBUG:teuthology.orchestra.run.smithi121:> sync 2024-09-12T18:02:06.588 DEBUG:teuthology.orchestra.run.smithi153:> sync 2024-09-12T18:02:06.762 DEBUG:tasks.thrashosds:checking console status of smithi052 2024-09-12T18:02:06.763 DEBUG:teuthology.orchestra.console.smithi052:Waiting for login prompt 2024-09-12T18:02:06.763 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi052 2024-09-12T18:02:06.894 DEBUG:teuthology.orchestra.console.smithi052:expect before: [Enter `^Ec?' for help] 2024-09-12T18:02:06.894 DEBUG:teuthology.orchestra.console.smithi052:expect after: smithi052 login: 2024-09-12T18:02:06.946 DEBUG:teuthology.orchestra.console.smithi052:console disconnect output: [Enter `^Ec?' for help] smithi052 login: [disconnect] 2024-09-12T18:02:07.047 DEBUG:tasks.thrashosds:checking console status of smithi111 2024-09-12T18:02:07.048 DEBUG:teuthology.orchestra.console.smithi111:Waiting for login prompt 2024-09-12T18:02:07.048 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi111 2024-09-12T18:02:07.148 DEBUG:teuthology.orchestra.console.smithi111:expect before: [Enter `^Ec?' for help] 2024-09-12T18:02:07.148 DEBUG:teuthology.orchestra.console.smithi111:expect after: smithi111 login: 2024-09-12T18:02:07.201 DEBUG:teuthology.orchestra.console.smithi111:console disconnect output: [Enter `^Ec?' for help] smithi111 login: [disconnect] 2024-09-12T18:02:07.302 DEBUG:tasks.thrashosds:checking console status of smithi121 2024-09-12T18:02:07.302 DEBUG:teuthology.orchestra.console.smithi121:Waiting for login prompt 2024-09-12T18:02:07.303 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi121 2024-09-12T18:02:07.448 DEBUG:teuthology.orchestra.console.smithi121:expect before: [Enter `^Ec?' for help] 2024-09-12T18:02:07.448 DEBUG:teuthology.orchestra.console.smithi121:expect after: smithi121 login: 2024-09-12T18:02:07.500 DEBUG:teuthology.orchestra.console.smithi121:console disconnect output: [Enter `^Ec?' for help] smithi121 login: [disconnect] 2024-09-12T18:02:07.602 DEBUG:tasks.thrashosds:checking console status of smithi153 2024-09-12T18:02:07.602 DEBUG:teuthology.orchestra.console.smithi153:Waiting for login prompt 2024-09-12T18:02:07.602 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi153 2024-09-12T18:02:07.734 DEBUG:teuthology.orchestra.console.smithi153:expect before: [Enter `^Ec?' for help] 2024-09-12T18:02:07.735 DEBUG:teuthology.orchestra.console.smithi153:expect after: smithi153 login: 2024-09-12T18:02:07.786 DEBUG:teuthology.orchestra.console.smithi153:console disconnect output: [Enter `^Ec?' for help] smithi153 login: [disconnect] 2024-09-12T18:02:07.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T18:02:08.232 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T18:02:08.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:02:08.233 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:08.547 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:08.564 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-12T18:02:06.562079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.993410"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308558+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:01:58.308558+0000","last_peered":"2024-09-12T18:01:58.308558+0000","last_clean":"2024-09-12T18:01:58.308558+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:01:58.308558+0000","last_undegraded":"2024-09-12T18:01:58.308558+0000","last_fullsized":"2024-09-12T18:01:58.308558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308285+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:01:58.308285+0000","last_peered":"2024-09-12T18:01:58.308285+0000","last_clean":"2024-09-12T18:01:58.308285+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:01:58.308285+0000","last_undegraded":"2024-09-12T18:01:58.308285+0000","last_fullsized":"2024-09-12T18:01:58.308285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307148+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:01:58.307148+0000","last_peered":"2024-09-12T18:01:58.307148+0000","last_clean":"2024-09-12T18:01:58.307148+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:01:58.307148+0000","last_undegraded":"2024-09-12T18:01:58.307148+0000","last_fullsized":"2024-09-12T18:01:58.307148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307863+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:01:58.307863+0000","last_peered":"2024-09-12T18:01:58.307863+0000","last_clean":"2024-09-12T18:01:58.307863+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:01:58.307863+0000","last_undegraded":"2024-09-12T18:01:58.307863+0000","last_fullsized":"2024-09-12T18:01:58.307863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307179+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:01:58.307179+0000","last_peered":"2024-09-12T18:01:58.307179+0000","last_clean":"2024-09-12T18:01:58.307179+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:01:58.307179+0000","last_undegraded":"2024-09-12T18:01:58.307179+0000","last_fullsized":"2024-09-12T18:01:58.307179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306280+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:01:58.306280+0000","last_peered":"2024-09-12T18:01:58.306280+0000","last_clean":"2024-09-12T18:01:58.306280+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:01:58.306280+0000","last_undegraded":"2024-09-12T18:01:58.306280+0000","last_fullsized":"2024-09-12T18:01:58.306280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306438+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:01:58.306438+0000","last_peered":"2024-09-12T18:01:58.306438+0000","last_clean":"2024-09-12T18:01:58.306438+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:01:58.306438+0000","last_undegraded":"2024-09-12T18:01:58.306438+0000","last_fullsized":"2024-09-12T18:01:58.306438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305795+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:01:58.305795+0000","last_peered":"2024-09-12T18:01:58.305795+0000","last_clean":"2024-09-12T18:01:58.305795+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:01:58.305795+0000","last_undegraded":"2024-09-12T18:01:58.305795+0000","last_fullsized":"2024-09-12T18:01:58.305795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522943+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:01:58.522943+0000","last_peered":"2024-09-12T18:01:58.522943+0000","last_clean":"2024-09-12T18:01:58.522943+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:01:58.522943+0000","last_undegraded":"2024-09-12T18:01:58.522943+0000","last_fullsized":"2024-09-12T18:01:58.522943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308196+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:01:58.308196+0000","last_peered":"2024-09-12T18:01:58.308196+0000","last_clean":"2024-09-12T18:01:58.308196+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:01:58.308196+0000","last_undegraded":"2024-09-12T18:01:58.308196+0000","last_fullsized":"2024-09-12T18:01:58.308196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307608+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:01:58.307608+0000","last_peered":"2024-09-12T18:01:58.307608+0000","last_clean":"2024-09-12T18:01:58.307608+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:01:58.307608+0000","last_undegraded":"2024-09-12T18:01:58.307608+0000","last_fullsized":"2024-09-12T18:01:58.307608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307084+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:01:58.307084+0000","last_peered":"2024-09-12T18:01:58.307084+0000","last_clean":"2024-09-12T18:01:58.307084+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:01:58.307084+0000","last_undegraded":"2024-09-12T18:01:58.307084+0000","last_fullsized":"2024-09-12T18:01:58.307084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306901+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:01:58.306901+0000","last_peered":"2024-09-12T18:01:58.306901+0000","last_clean":"2024-09-12T18:01:58.306901+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:01:58.306901+0000","last_undegraded":"2024-09-12T18:01:58.306901+0000","last_fullsized":"2024-09-12T18:01:58.306901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306334+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:01:58.306334+0000","last_peered":"2024-09-12T18:01:58.306334+0000","last_clean":"2024-09-12T18:01:58.306334+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:01:58.306334+0000","last_undegraded":"2024-09-12T18:01:58.306334+0000","last_fullsized":"2024-09-12T18:01:58.306334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306757+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:01:58.306757+0000","last_peered":"2024-09-12T18:01:58.306757+0000","last_clean":"2024-09-12T18:01:58.306757+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:01:58.306757+0000","last_undegraded":"2024-09-12T18:01:58.306757+0000","last_fullsized":"2024-09-12T18:01:58.306757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305977+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:01:58.305977+0000","last_peered":"2024-09-12T18:01:58.305977+0000","last_clean":"2024-09-12T18:01:58.305977+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:01:58.305977+0000","last_undegraded":"2024-09-12T18:01:58.305977+0000","last_fullsized":"2024-09-12T18:01:58.305977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523801+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:01:58.523801+0000","last_peered":"2024-09-12T18:01:58.523801+0000","last_clean":"2024-09-12T18:01:58.523801+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:01:58.523801+0000","last_undegraded":"2024-09-12T18:01:58.523801+0000","last_fullsized":"2024-09-12T18:01:58.523801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308722+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:01:58.308722+0000","last_peered":"2024-09-12T18:01:58.308722+0000","last_clean":"2024-09-12T18:01:58.308722+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:01:58.308722+0000","last_undegraded":"2024-09-12T18:01:58.308722+0000","last_fullsized":"2024-09-12T18:01:58.308722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522685+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:01:58.522685+0000","last_peered":"2024-09-12T18:01:58.522685+0000","last_clean":"2024-09-12T18:01:58.522685+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:01:58.522685+0000","last_undegraded":"2024-09-12T18:01:58.522685+0000","last_fullsized":"2024-09-12T18:01:58.522685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308165+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:01:58.308165+0000","last_peered":"2024-09-12T18:01:58.308165+0000","last_clean":"2024-09-12T18:01:58.308165+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:01:58.308165+0000","last_undegraded":"2024-09-12T18:01:58.308165+0000","last_fullsized":"2024-09-12T18:01:58.308165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306938+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:01:58.306938+0000","last_peered":"2024-09-12T18:01:58.306938+0000","last_clean":"2024-09-12T18:01:58.306938+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:01:58.306938+0000","last_undegraded":"2024-09-12T18:01:58.306938+0000","last_fullsized":"2024-09-12T18:01:58.306938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307068+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:01:58.307068+0000","last_peered":"2024-09-12T18:01:58.307068+0000","last_clean":"2024-09-12T18:01:58.307068+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:01:58.307068+0000","last_undegraded":"2024-09-12T18:01:58.307068+0000","last_fullsized":"2024-09-12T18:01:58.307068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520263+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:01:58.520263+0000","last_peered":"2024-09-12T18:01:58.520263+0000","last_clean":"2024-09-12T18:01:58.520263+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:01:58.520263+0000","last_undegraded":"2024-09-12T18:01:58.520263+0000","last_fullsized":"2024-09-12T18:01:58.520263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306530+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:01:58.306530+0000","last_peered":"2024-09-12T18:01:58.306530+0000","last_clean":"2024-09-12T18:01:58.306530+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:01:58.306530+0000","last_undegraded":"2024-09-12T18:01:58.306530+0000","last_fullsized":"2024-09-12T18:01:58.306530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308760+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:01:58.308760+0000","last_peered":"2024-09-12T18:01:58.308760+0000","last_clean":"2024-09-12T18:01:58.308760+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:01:58.308760+0000","last_undegraded":"2024-09-12T18:01:58.308760+0000","last_fullsized":"2024-09-12T18:01:58.308760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523307+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:01:58.523307+0000","last_peered":"2024-09-12T18:01:58.523307+0000","last_clean":"2024-09-12T18:01:58.523307+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:01:58.523307+0000","last_undegraded":"2024-09-12T18:01:58.523307+0000","last_fullsized":"2024-09-12T18:01:58.523307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307840+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:01:58.307840+0000","last_peered":"2024-09-12T18:01:58.307840+0000","last_clean":"2024-09-12T18:01:58.307840+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:01:58.307840+0000","last_undegraded":"2024-09-12T18:01:58.307840+0000","last_fullsized":"2024-09-12T18:01:58.307840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308048+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:01:58.308048+0000","last_peered":"2024-09-12T18:01:58.308048+0000","last_clean":"2024-09-12T18:01:58.308048+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:01:58.308048+0000","last_undegraded":"2024-09-12T18:01:58.308048+0000","last_fullsized":"2024-09-12T18:01:58.308048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522201+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:01:58.522201+0000","last_peered":"2024-09-12T18:01:58.522201+0000","last_clean":"2024-09-12T18:01:58.522201+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:01:58.522201+0000","last_undegraded":"2024-09-12T18:01:58.522201+0000","last_fullsized":"2024-09-12T18:01:58.522201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307453+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:01:58.307453+0000","last_peered":"2024-09-12T18:01:58.307453+0000","last_clean":"2024-09-12T18:01:58.307453+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:01:58.307453+0000","last_undegraded":"2024-09-12T18:01:58.307453+0000","last_fullsized":"2024-09-12T18:01:58.307453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520383+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:01:58.520383+0000","last_peered":"2024-09-12T18:01:58.520383+0000","last_clean":"2024-09-12T18:01:58.520383+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:01:58.520383+0000","last_undegraded":"2024-09-12T18:01:58.520383+0000","last_fullsized":"2024-09-12T18:01:58.520383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306046+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:01:58.306046+0000","last_peered":"2024-09-12T18:01:58.306046+0000","last_clean":"2024-09-12T18:01:58.306046+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:01:58.306046+0000","last_undegraded":"2024-09-12T18:01:58.306046+0000","last_fullsized":"2024-09-12T18:01:58.306046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307713+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:01:58.307713+0000","last_peered":"2024-09-12T18:01:58.307713+0000","last_clean":"2024-09-12T18:01:58.307713+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:01:58.307713+0000","last_undegraded":"2024-09-12T18:01:58.307713+0000","last_fullsized":"2024-09-12T18:01:58.307713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307021+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:01:58.307021+0000","last_peered":"2024-09-12T18:01:58.307021+0000","last_clean":"2024-09-12T18:01:58.307021+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:01:58.307021+0000","last_undegraded":"2024-09-12T18:01:58.307021+0000","last_fullsized":"2024-09-12T18:01:58.307021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308169+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:01:58.308169+0000","last_peered":"2024-09-12T18:01:58.308169+0000","last_clean":"2024-09-12T18:01:58.308169+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:01:58.308169+0000","last_undegraded":"2024-09-12T18:01:58.308169+0000","last_fullsized":"2024-09-12T18:01:58.308169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521151+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:01:58.521151+0000","last_peered":"2024-09-12T18:01:58.521151+0000","last_clean":"2024-09-12T18:01:58.521151+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:01:58.521151+0000","last_undegraded":"2024-09-12T18:01:58.521151+0000","last_fullsized":"2024-09-12T18:01:58.521151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523536+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:01:58.523536+0000","last_peered":"2024-09-12T18:01:58.523536+0000","last_clean":"2024-09-12T18:01:58.523536+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:01:58.523536+0000","last_undegraded":"2024-09-12T18:01:58.523536+0000","last_fullsized":"2024-09-12T18:01:58.523536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306809+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:01:58.306809+0000","last_peered":"2024-09-12T18:01:58.306809+0000","last_clean":"2024-09-12T18:01:58.306809+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:01:58.306809+0000","last_undegraded":"2024-09-12T18:01:58.306809+0000","last_fullsized":"2024-09-12T18:01:58.306809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523210+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:01:58.523210+0000","last_peered":"2024-09-12T18:01:58.523210+0000","last_clean":"2024-09-12T18:01:58.523210+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:01:58.523210+0000","last_undegraded":"2024-09-12T18:01:58.523210+0000","last_fullsized":"2024-09-12T18:01:58.523210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306263+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:01:58.306263+0000","last_peered":"2024-09-12T18:01:58.306263+0000","last_clean":"2024-09-12T18:01:58.306263+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:01:58.306263+0000","last_undegraded":"2024-09-12T18:01:58.306263+0000","last_fullsized":"2024-09-12T18:01:58.306263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308667+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:01:58.308667+0000","last_peered":"2024-09-12T18:01:58.308667+0000","last_clean":"2024-09-12T18:01:58.308667+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:01:58.308667+0000","last_undegraded":"2024-09-12T18:01:58.308667+0000","last_fullsized":"2024-09-12T18:01:58.308667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306836+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:01:58.306836+0000","last_peered":"2024-09-12T18:01:58.306836+0000","last_clean":"2024-09-12T18:01:58.306836+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:01:58.306836+0000","last_undegraded":"2024-09-12T18:01:58.306836+0000","last_fullsized":"2024-09-12T18:01:58.306836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308728+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:01:58.308728+0000","last_peered":"2024-09-12T18:01:58.308728+0000","last_clean":"2024-09-12T18:01:58.308728+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:01:58.308728+0000","last_undegraded":"2024-09-12T18:01:58.308728+0000","last_fullsized":"2024-09-12T18:01:58.308728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306551+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:01:58.306551+0000","last_peered":"2024-09-12T18:01:58.306551+0000","last_clean":"2024-09-12T18:01:58.306551+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:01:58.306551+0000","last_undegraded":"2024-09-12T18:01:58.306551+0000","last_fullsized":"2024-09-12T18:01:58.306551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308374+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:01:58.308374+0000","last_peered":"2024-09-12T18:01:58.308374+0000","last_clean":"2024-09-12T18:01:58.308374+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:01:58.308374+0000","last_undegraded":"2024-09-12T18:01:58.308374+0000","last_fullsized":"2024-09-12T18:01:58.308374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306564+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:01:58.306564+0000","last_peered":"2024-09-12T18:01:58.306564+0000","last_clean":"2024-09-12T18:01:58.306564+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:01:58.306564+0000","last_undegraded":"2024-09-12T18:01:58.306564+0000","last_fullsized":"2024-09-12T18:01:58.306564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308773+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:01:58.308773+0000","last_peered":"2024-09-12T18:01:58.308773+0000","last_clean":"2024-09-12T18:01:58.308773+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:01:58.308773+0000","last_undegraded":"2024-09-12T18:01:58.308773+0000","last_fullsized":"2024-09-12T18:01:58.308773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521950+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:01:58.521950+0000","last_peered":"2024-09-12T18:01:58.521950+0000","last_clean":"2024-09-12T18:01:58.521950+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:01:58.521950+0000","last_undegraded":"2024-09-12T18:01:58.521950+0000","last_fullsized":"2024-09-12T18:01:58.521950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522420+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:01:58.522420+0000","last_peered":"2024-09-12T18:01:58.522420+0000","last_clean":"2024-09-12T18:01:58.522420+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:01:58.522420+0000","last_undegraded":"2024-09-12T18:01:58.522420+0000","last_fullsized":"2024-09-12T18:01:58.522420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308436+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:01:58.308436+0000","last_peered":"2024-09-12T18:01:58.308436+0000","last_clean":"2024-09-12T18:01:58.308436+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:01:58.308436+0000","last_undegraded":"2024-09-12T18:01:58.308436+0000","last_fullsized":"2024-09-12T18:01:58.308436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307114+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:01:58.307114+0000","last_peered":"2024-09-12T18:01:58.307114+0000","last_clean":"2024-09-12T18:01:58.307114+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:01:58.307114+0000","last_undegraded":"2024-09-12T18:01:58.307114+0000","last_fullsized":"2024-09-12T18:01:58.307114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308096+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:01:58.308096+0000","last_peered":"2024-09-12T18:01:58.308096+0000","last_clean":"2024-09-12T18:01:58.308096+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:01:58.308096+0000","last_undegraded":"2024-09-12T18:01:58.308096+0000","last_fullsized":"2024-09-12T18:01:58.308096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307081+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:01:58.307081+0000","last_peered":"2024-09-12T18:01:58.307081+0000","last_clean":"2024-09-12T18:01:58.307081+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:01:58.307081+0000","last_undegraded":"2024-09-12T18:01:58.307081+0000","last_fullsized":"2024-09-12T18:01:58.307081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307801+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:01:58.307801+0000","last_peered":"2024-09-12T18:01:58.307801+0000","last_clean":"2024-09-12T18:01:58.307801+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:01:58.307801+0000","last_undegraded":"2024-09-12T18:01:58.307801+0000","last_fullsized":"2024-09-12T18:01:58.307801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306861+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:01:58.306861+0000","last_peered":"2024-09-12T18:01:58.306861+0000","last_clean":"2024-09-12T18:01:58.306861+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:01:58.306861+0000","last_undegraded":"2024-09-12T18:01:58.306861+0000","last_fullsized":"2024-09-12T18:01:58.306861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523209+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:01:58.523209+0000","last_peered":"2024-09-12T18:01:58.523209+0000","last_clean":"2024-09-12T18:01:58.523209+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:01:58.523209+0000","last_undegraded":"2024-09-12T18:01:58.523209+0000","last_fullsized":"2024-09-12T18:01:58.523209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307284+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:01:58.307284+0000","last_peered":"2024-09-12T18:01:58.307284+0000","last_clean":"2024-09-12T18:01:58.307284+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:01:58.307284+0000","last_undegraded":"2024-09-12T18:01:58.307284+0000","last_fullsized":"2024-09-12T18:01:58.307284+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307391+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:01:58.307391+0000","last_peered":"2024-09-12T18:01:58.307391+0000","last_clean":"2024-09-12T18:01:58.307391+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:01:58.307391+0000","last_undegraded":"2024-09-12T18:01:58.307391+0000","last_fullsized":"2024-09-12T18:01:58.307391+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521347+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:01:58.521347+0000","last_peered":"2024-09-12T18:01:58.521347+0000","last_clean":"2024-09-12T18:01:58.521347+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:01:58.521347+0000","last_undegraded":"2024-09-12T18:01:58.521347+0000","last_fullsized":"2024-09-12T18:01:58.521347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308303+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:01:58.308303+0000","last_peered":"2024-09-12T18:01:58.308303+0000","last_clean":"2024-09-12T18:01:58.308303+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:01:58.308303+0000","last_undegraded":"2024-09-12T18:01:58.308303+0000","last_fullsized":"2024-09-12T18:01:58.308303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306710+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:01:58.306710+0000","last_peered":"2024-09-12T18:01:58.306710+0000","last_clean":"2024-09-12T18:01:58.306710+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:01:58.306710+0000","last_undegraded":"2024-09-12T18:01:58.306710+0000","last_fullsized":"2024-09-12T18:01:58.306710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520927+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:01:58.520927+0000","last_peered":"2024-09-12T18:01:58.520927+0000","last_clean":"2024-09-12T18:01:58.520927+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:01:58.520927+0000","last_undegraded":"2024-09-12T18:01:58.520927+0000","last_fullsized":"2024-09-12T18:01:58.520927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308440+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:01:58.308440+0000","last_peered":"2024-09-12T18:01:58.308440+0000","last_clean":"2024-09-12T18:01:58.308440+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:01:58.308440+0000","last_undegraded":"2024-09-12T18:01:58.308440+0000","last_fullsized":"2024-09-12T18:01:58.308440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521264+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:01:58.521264+0000","last_peered":"2024-09-12T18:01:58.521264+0000","last_clean":"2024-09-12T18:01:58.521264+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:01:58.521264+0000","last_undegraded":"2024-09-12T18:01:58.521264+0000","last_fullsized":"2024-09-12T18:01:58.521264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307103+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:01:58.307103+0000","last_peered":"2024-09-12T18:01:58.307103+0000","last_clean":"2024-09-12T18:01:58.307103+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:01:58.307103+0000","last_undegraded":"2024-09-12T18:01:58.307103+0000","last_fullsized":"2024-09-12T18:01:58.307103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523358+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:01:58.523358+0000","last_peered":"2024-09-12T18:01:58.523358+0000","last_clean":"2024-09-12T18:01:58.523358+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:01:58.523358+0000","last_undegraded":"2024-09-12T18:01:58.523358+0000","last_fullsized":"2024-09-12T18:01:58.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307334+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:01:58.307334+0000","last_peered":"2024-09-12T18:01:58.307334+0000","last_clean":"2024-09-12T18:01:58.307334+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:01:58.307334+0000","last_undegraded":"2024-09-12T18:01:58.307334+0000","last_fullsized":"2024-09-12T18:01:58.307334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307283+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:01:58.307283+0000","last_peered":"2024-09-12T18:01:58.307283+0000","last_clean":"2024-09-12T18:01:58.307283+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:01:58.307283+0000","last_undegraded":"2024-09-12T18:01:58.307283+0000","last_fullsized":"2024-09-12T18:01:58.307283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522497+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:01:58.522497+0000","last_peered":"2024-09-12T18:01:58.522497+0000","last_clean":"2024-09-12T18:01:58.522497+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:01:58.522497+0000","last_undegraded":"2024-09-12T18:01:58.522497+0000","last_fullsized":"2024-09-12T18:01:58.522497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308613+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:01:58.308613+0000","last_peered":"2024-09-12T18:01:58.308613+0000","last_clean":"2024-09-12T18:01:58.308613+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:01:58.308613+0000","last_undegraded":"2024-09-12T18:01:58.308613+0000","last_fullsized":"2024-09-12T18:01:58.308613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522819+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:01:58.522819+0000","last_peered":"2024-09-12T18:01:58.522819+0000","last_clean":"2024-09-12T18:01:58.522819+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:01:58.522819+0000","last_undegraded":"2024-09-12T18:01:58.522819+0000","last_fullsized":"2024-09-12T18:01:58.522819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307143+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:01:58.307143+0000","last_peered":"2024-09-12T18:01:58.307143+0000","last_clean":"2024-09-12T18:01:58.307143+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:01:58.307143+0000","last_undegraded":"2024-09-12T18:01:58.307143+0000","last_fullsized":"2024-09-12T18:01:58.307143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522522+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:01:58.522522+0000","last_peered":"2024-09-12T18:01:58.522522+0000","last_clean":"2024-09-12T18:01:58.522522+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:01:58.522522+0000","last_undegraded":"2024-09-12T18:01:58.522522+0000","last_fullsized":"2024-09-12T18:01:58.522522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308821+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:01:58.308821+0000","last_peered":"2024-09-12T18:01:58.308821+0000","last_clean":"2024-09-12T18:01:58.308821+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:01:58.308821+0000","last_undegraded":"2024-09-12T18:01:58.308821+0000","last_fullsized":"2024-09-12T18:01:58.308821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307004+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:01:58.307004+0000","last_peered":"2024-09-12T18:01:58.307004+0000","last_clean":"2024-09-12T18:01:58.307004+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:01:58.307004+0000","last_undegraded":"2024-09-12T18:01:58.307004+0000","last_fullsized":"2024-09-12T18:01:58.307004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523799+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:01:58.523799+0000","last_peered":"2024-09-12T18:01:58.523799+0000","last_clean":"2024-09-12T18:01:58.523799+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:01:58.523799+0000","last_undegraded":"2024-09-12T18:01:58.523799+0000","last_fullsized":"2024-09-12T18:01:58.523799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523895+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:01:58.523895+0000","last_peered":"2024-09-12T18:01:58.523895+0000","last_clean":"2024-09-12T18:01:58.523895+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:01:58.523895+0000","last_undegraded":"2024-09-12T18:01:58.523895+0000","last_fullsized":"2024-09-12T18:01:58.523895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520611+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:01:58.520611+0000","last_peered":"2024-09-12T18:01:58.520611+0000","last_clean":"2024-09-12T18:01:58.520611+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:01:58.520611+0000","last_undegraded":"2024-09-12T18:01:58.520611+0000","last_fullsized":"2024-09-12T18:01:58.520611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523802+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:01:58.523802+0000","last_peered":"2024-09-12T18:01:58.523802+0000","last_clean":"2024-09-12T18:01:58.523802+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:01:58.523802+0000","last_undegraded":"2024-09-12T18:01:58.523802+0000","last_fullsized":"2024-09-12T18:01:58.523802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308763+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:01:58.308763+0000","last_peered":"2024-09-12T18:01:58.308763+0000","last_clean":"2024-09-12T18:01:58.308763+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:01:58.308763+0000","last_undegraded":"2024-09-12T18:01:58.308763+0000","last_fullsized":"2024-09-12T18:01:58.308763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306540+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:01:58.306540+0000","last_peered":"2024-09-12T18:01:58.306540+0000","last_clean":"2024-09-12T18:01:58.306540+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:01:58.306540+0000","last_undegraded":"2024-09-12T18:01:58.306540+0000","last_fullsized":"2024-09-12T18:01:58.306540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306657+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:01:58.306657+0000","last_peered":"2024-09-12T18:01:58.306657+0000","last_clean":"2024-09-12T18:01:58.306657+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:01:58.306657+0000","last_undegraded":"2024-09-12T18:01:58.306657+0000","last_fullsized":"2024-09-12T18:01:58.306657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308692+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:01:58.308692+0000","last_peered":"2024-09-12T18:01:58.308692+0000","last_clean":"2024-09-12T18:01:58.308692+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:01:58.308692+0000","last_undegraded":"2024-09-12T18:01:58.308692+0000","last_fullsized":"2024-09-12T18:01:58.308692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520948+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:01:58.520948+0000","last_peered":"2024-09-12T18:01:58.520948+0000","last_clean":"2024-09-12T18:01:58.520948+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:01:58.520948+0000","last_undegraded":"2024-09-12T18:01:58.520948+0000","last_fullsized":"2024-09-12T18:01:58.520948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308438+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:01:58.308438+0000","last_peered":"2024-09-12T18:01:58.308438+0000","last_clean":"2024-09-12T18:01:58.308438+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:01:58.308438+0000","last_undegraded":"2024-09-12T18:01:58.308438+0000","last_fullsized":"2024-09-12T18:01:58.308438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307996+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:01:58.307996+0000","last_peered":"2024-09-12T18:01:58.307996+0000","last_clean":"2024-09-12T18:01:58.307996+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:01:58.307996+0000","last_undegraded":"2024-09-12T18:01:58.307996+0000","last_fullsized":"2024-09-12T18:01:58.307996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520540+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:01:58.520540+0000","last_peered":"2024-09-12T18:01:58.520540+0000","last_clean":"2024-09-12T18:01:58.520540+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:01:58.520540+0000","last_undegraded":"2024-09-12T18:01:58.520540+0000","last_fullsized":"2024-09-12T18:01:58.520540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523593+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:01:58.523593+0000","last_peered":"2024-09-12T18:01:58.523593+0000","last_clean":"2024-09-12T18:01:58.523593+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:01:58.523593+0000","last_undegraded":"2024-09-12T18:01:58.523593+0000","last_fullsized":"2024-09-12T18:01:58.523593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520359+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:01:58.520359+0000","last_peered":"2024-09-12T18:01:58.520359+0000","last_clean":"2024-09-12T18:01:58.520359+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:01:58.520359+0000","last_undegraded":"2024-09-12T18:01:58.520359+0000","last_fullsized":"2024-09-12T18:01:58.520359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308770+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:01:58.308770+0000","last_peered":"2024-09-12T18:01:58.308770+0000","last_clean":"2024-09-12T18:01:58.308770+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:01:58.308770+0000","last_undegraded":"2024-09-12T18:01:58.308770+0000","last_fullsized":"2024-09-12T18:01:58.308770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520712+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:01:58.520712+0000","last_peered":"2024-09-12T18:01:58.520712+0000","last_clean":"2024-09-12T18:01:58.520712+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:01:58.520712+0000","last_undegraded":"2024-09-12T18:01:58.520712+0000","last_fullsized":"2024-09-12T18:01:58.520712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523105+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:01:58.523105+0000","last_peered":"2024-09-12T18:01:58.523105+0000","last_clean":"2024-09-12T18:01:58.523105+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:01:58.523105+0000","last_undegraded":"2024-09-12T18:01:58.523105+0000","last_fullsized":"2024-09-12T18:01:58.523105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520913+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:01:58.520913+0000","last_peered":"2024-09-12T18:01:58.520913+0000","last_clean":"2024-09-12T18:01:58.520913+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:01:58.520913+0000","last_undegraded":"2024-09-12T18:01:58.520913+0000","last_fullsized":"2024-09-12T18:01:58.520913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307918+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:01:58.307918+0000","last_peered":"2024-09-12T18:01:58.307918+0000","last_clean":"2024-09-12T18:01:58.307918+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:01:58.307918+0000","last_undegraded":"2024-09-12T18:01:58.307918+0000","last_fullsized":"2024-09-12T18:01:58.307918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307691+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:01:58.307691+0000","last_peered":"2024-09-12T18:01:58.307691+0000","last_clean":"2024-09-12T18:01:58.307691+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:01:58.307691+0000","last_undegraded":"2024-09-12T18:01:58.307691+0000","last_fullsized":"2024-09-12T18:01:58.307691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307440+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:01:58.307440+0000","last_peered":"2024-09-12T18:01:58.307440+0000","last_clean":"2024-09-12T18:01:58.307440+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:01:58.307440+0000","last_undegraded":"2024-09-12T18:01:58.307440+0000","last_fullsized":"2024-09-12T18:01:58.307440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307331+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:01:58.307331+0000","last_peered":"2024-09-12T18:01:58.307331+0000","last_clean":"2024-09-12T18:01:58.307331+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:01:58.307331+0000","last_undegraded":"2024-09-12T18:01:58.307331+0000","last_fullsized":"2024-09-12T18:01:58.307331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306520+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:01:58.306520+0000","last_peered":"2024-09-12T18:01:58.306520+0000","last_clean":"2024-09-12T18:01:58.306520+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:01:58.306520+0000","last_undegraded":"2024-09-12T18:01:58.306520+0000","last_fullsized":"2024-09-12T18:01:58.306520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308501+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:01:58.308501+0000","last_peered":"2024-09-12T18:01:58.308501+0000","last_clean":"2024-09-12T18:01:58.308501+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:01:58.308501+0000","last_undegraded":"2024-09-12T18:01:58.308501+0000","last_fullsized":"2024-09-12T18:01:58.308501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306832+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:01:58.306832+0000","last_peered":"2024-09-12T18:01:58.306832+0000","last_clean":"2024-09-12T18:01:58.306832+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:01:58.306832+0000","last_undegraded":"2024-09-12T18:01:58.306832+0000","last_fullsized":"2024-09-12T18:01:58.306832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308276+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:01:58.308276+0000","last_peered":"2024-09-12T18:01:58.308276+0000","last_clean":"2024-09-12T18:01:58.308276+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:01:58.308276+0000","last_undegraded":"2024-09-12T18:01:58.308276+0000","last_fullsized":"2024-09-12T18:01:58.308276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307335+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:01:58.307335+0000","last_peered":"2024-09-12T18:01:58.307335+0000","last_clean":"2024-09-12T18:01:58.307335+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:01:58.307335+0000","last_undegraded":"2024-09-12T18:01:58.307335+0000","last_fullsized":"2024-09-12T18:01:58.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523494+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:01:58.523494+0000","last_peered":"2024-09-12T18:01:58.523494+0000","last_clean":"2024-09-12T18:01:58.523494+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:01:58.523494+0000","last_undegraded":"2024-09-12T18:01:58.523494+0000","last_fullsized":"2024-09-12T18:01:58.523494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307856+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:01:58.307856+0000","last_peered":"2024-09-12T18:01:58.307856+0000","last_clean":"2024-09-12T18:01:58.307856+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:01:58.307856+0000","last_undegraded":"2024-09-12T18:01:58.307856+0000","last_fullsized":"2024-09-12T18:01:58.307856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523461+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:01:58.523461+0000","last_peered":"2024-09-12T18:01:58.523461+0000","last_clean":"2024-09-12T18:01:58.523461+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:01:58.523461+0000","last_undegraded":"2024-09-12T18:01:58.523461+0000","last_fullsized":"2024-09-12T18:01:58.523461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:08.569 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:08.906 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:08.908 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:08.924 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T18:02:08.562557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.261869"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308558+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:01:58.308558+0000","last_peered":"2024-09-12T18:01:58.308558+0000","last_clean":"2024-09-12T18:01:58.308558+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:01:58.308558+0000","last_undegraded":"2024-09-12T18:01:58.308558+0000","last_fullsized":"2024-09-12T18:01:58.308558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308285+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:01:58.308285+0000","last_peered":"2024-09-12T18:01:58.308285+0000","last_clean":"2024-09-12T18:01:58.308285+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:01:58.308285+0000","last_undegraded":"2024-09-12T18:01:58.308285+0000","last_fullsized":"2024-09-12T18:01:58.308285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307148+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:01:58.307148+0000","last_peered":"2024-09-12T18:01:58.307148+0000","last_clean":"2024-09-12T18:01:58.307148+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:01:58.307148+0000","last_undegraded":"2024-09-12T18:01:58.307148+0000","last_fullsized":"2024-09-12T18:01:58.307148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307863+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:01:58.307863+0000","last_peered":"2024-09-12T18:01:58.307863+0000","last_clean":"2024-09-12T18:01:58.307863+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:01:58.307863+0000","last_undegraded":"2024-09-12T18:01:58.307863+0000","last_fullsized":"2024-09-12T18:01:58.307863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307179+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:01:58.307179+0000","last_peered":"2024-09-12T18:01:58.307179+0000","last_clean":"2024-09-12T18:01:58.307179+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:01:58.307179+0000","last_undegraded":"2024-09-12T18:01:58.307179+0000","last_fullsized":"2024-09-12T18:01:58.307179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306280+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:01:58.306280+0000","last_peered":"2024-09-12T18:01:58.306280+0000","last_clean":"2024-09-12T18:01:58.306280+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:01:58.306280+0000","last_undegraded":"2024-09-12T18:01:58.306280+0000","last_fullsized":"2024-09-12T18:01:58.306280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306438+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:01:58.306438+0000","last_peered":"2024-09-12T18:01:58.306438+0000","last_clean":"2024-09-12T18:01:58.306438+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:01:58.306438+0000","last_undegraded":"2024-09-12T18:01:58.306438+0000","last_fullsized":"2024-09-12T18:01:58.306438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305795+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:01:58.305795+0000","last_peered":"2024-09-12T18:01:58.305795+0000","last_clean":"2024-09-12T18:01:58.305795+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:01:58.305795+0000","last_undegraded":"2024-09-12T18:01:58.305795+0000","last_fullsized":"2024-09-12T18:01:58.305795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522943+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:01:58.522943+0000","last_peered":"2024-09-12T18:01:58.522943+0000","last_clean":"2024-09-12T18:01:58.522943+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:01:58.522943+0000","last_undegraded":"2024-09-12T18:01:58.522943+0000","last_fullsized":"2024-09-12T18:01:58.522943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308196+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:01:58.308196+0000","last_peered":"2024-09-12T18:01:58.308196+0000","last_clean":"2024-09-12T18:01:58.308196+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:01:58.308196+0000","last_undegraded":"2024-09-12T18:01:58.308196+0000","last_fullsized":"2024-09-12T18:01:58.308196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307608+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:01:58.307608+0000","last_peered":"2024-09-12T18:01:58.307608+0000","last_clean":"2024-09-12T18:01:58.307608+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:01:58.307608+0000","last_undegraded":"2024-09-12T18:01:58.307608+0000","last_fullsized":"2024-09-12T18:01:58.307608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307084+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:01:58.307084+0000","last_peered":"2024-09-12T18:01:58.307084+0000","last_clean":"2024-09-12T18:01:58.307084+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:01:58.307084+0000","last_undegraded":"2024-09-12T18:01:58.307084+0000","last_fullsized":"2024-09-12T18:01:58.307084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306901+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:01:58.306901+0000","last_peered":"2024-09-12T18:01:58.306901+0000","last_clean":"2024-09-12T18:01:58.306901+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:01:58.306901+0000","last_undegraded":"2024-09-12T18:01:58.306901+0000","last_fullsized":"2024-09-12T18:01:58.306901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306334+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:01:58.306334+0000","last_peered":"2024-09-12T18:01:58.306334+0000","last_clean":"2024-09-12T18:01:58.306334+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:01:58.306334+0000","last_undegraded":"2024-09-12T18:01:58.306334+0000","last_fullsized":"2024-09-12T18:01:58.306334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306757+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:01:58.306757+0000","last_peered":"2024-09-12T18:01:58.306757+0000","last_clean":"2024-09-12T18:01:58.306757+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:01:58.306757+0000","last_undegraded":"2024-09-12T18:01:58.306757+0000","last_fullsized":"2024-09-12T18:01:58.306757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305977+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:01:58.305977+0000","last_peered":"2024-09-12T18:01:58.305977+0000","last_clean":"2024-09-12T18:01:58.305977+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:01:58.305977+0000","last_undegraded":"2024-09-12T18:01:58.305977+0000","last_fullsized":"2024-09-12T18:01:58.305977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523801+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:01:58.523801+0000","last_peered":"2024-09-12T18:01:58.523801+0000","last_clean":"2024-09-12T18:01:58.523801+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:01:58.523801+0000","last_undegraded":"2024-09-12T18:01:58.523801+0000","last_fullsized":"2024-09-12T18:01:58.523801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308722+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:01:58.308722+0000","last_peered":"2024-09-12T18:01:58.308722+0000","last_clean":"2024-09-12T18:01:58.308722+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:01:58.308722+0000","last_undegraded":"2024-09-12T18:01:58.308722+0000","last_fullsized":"2024-09-12T18:01:58.308722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522685+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:01:58.522685+0000","last_peered":"2024-09-12T18:01:58.522685+0000","last_clean":"2024-09-12T18:01:58.522685+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:01:58.522685+0000","last_undegraded":"2024-09-12T18:01:58.522685+0000","last_fullsized":"2024-09-12T18:01:58.522685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308165+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:01:58.308165+0000","last_peered":"2024-09-12T18:01:58.308165+0000","last_clean":"2024-09-12T18:01:58.308165+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:01:58.308165+0000","last_undegraded":"2024-09-12T18:01:58.308165+0000","last_fullsized":"2024-09-12T18:01:58.308165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306938+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:01:58.306938+0000","last_peered":"2024-09-12T18:01:58.306938+0000","last_clean":"2024-09-12T18:01:58.306938+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:01:58.306938+0000","last_undegraded":"2024-09-12T18:01:58.306938+0000","last_fullsized":"2024-09-12T18:01:58.306938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307068+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:01:58.307068+0000","last_peered":"2024-09-12T18:01:58.307068+0000","last_clean":"2024-09-12T18:01:58.307068+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:01:58.307068+0000","last_undegraded":"2024-09-12T18:01:58.307068+0000","last_fullsized":"2024-09-12T18:01:58.307068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520263+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:01:58.520263+0000","last_peered":"2024-09-12T18:01:58.520263+0000","last_clean":"2024-09-12T18:01:58.520263+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:01:58.520263+0000","last_undegraded":"2024-09-12T18:01:58.520263+0000","last_fullsized":"2024-09-12T18:01:58.520263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306530+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:01:58.306530+0000","last_peered":"2024-09-12T18:01:58.306530+0000","last_clean":"2024-09-12T18:01:58.306530+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:01:58.306530+0000","last_undegraded":"2024-09-12T18:01:58.306530+0000","last_fullsized":"2024-09-12T18:01:58.306530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308760+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:01:58.308760+0000","last_peered":"2024-09-12T18:01:58.308760+0000","last_clean":"2024-09-12T18:01:58.308760+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:01:58.308760+0000","last_undegraded":"2024-09-12T18:01:58.308760+0000","last_fullsized":"2024-09-12T18:01:58.308760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523307+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:01:58.523307+0000","last_peered":"2024-09-12T18:01:58.523307+0000","last_clean":"2024-09-12T18:01:58.523307+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:01:58.523307+0000","last_undegraded":"2024-09-12T18:01:58.523307+0000","last_fullsized":"2024-09-12T18:01:58.523307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307840+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:01:58.307840+0000","last_peered":"2024-09-12T18:01:58.307840+0000","last_clean":"2024-09-12T18:01:58.307840+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:01:58.307840+0000","last_undegraded":"2024-09-12T18:01:58.307840+0000","last_fullsized":"2024-09-12T18:01:58.307840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308048+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:01:58.308048+0000","last_peered":"2024-09-12T18:01:58.308048+0000","last_clean":"2024-09-12T18:01:58.308048+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:01:58.308048+0000","last_undegraded":"2024-09-12T18:01:58.308048+0000","last_fullsized":"2024-09-12T18:01:58.308048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522201+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:01:58.522201+0000","last_peered":"2024-09-12T18:01:58.522201+0000","last_clean":"2024-09-12T18:01:58.522201+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:01:58.522201+0000","last_undegraded":"2024-09-12T18:01:58.522201+0000","last_fullsized":"2024-09-12T18:01:58.522201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307453+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:01:58.307453+0000","last_peered":"2024-09-12T18:01:58.307453+0000","last_clean":"2024-09-12T18:01:58.307453+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:01:58.307453+0000","last_undegraded":"2024-09-12T18:01:58.307453+0000","last_fullsized":"2024-09-12T18:01:58.307453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520383+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:01:58.520383+0000","last_peered":"2024-09-12T18:01:58.520383+0000","last_clean":"2024-09-12T18:01:58.520383+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:01:58.520383+0000","last_undegraded":"2024-09-12T18:01:58.520383+0000","last_fullsized":"2024-09-12T18:01:58.520383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306046+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:01:58.306046+0000","last_peered":"2024-09-12T18:01:58.306046+0000","last_clean":"2024-09-12T18:01:58.306046+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:01:58.306046+0000","last_undegraded":"2024-09-12T18:01:58.306046+0000","last_fullsized":"2024-09-12T18:01:58.306046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307713+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:01:58.307713+0000","last_peered":"2024-09-12T18:01:58.307713+0000","last_clean":"2024-09-12T18:01:58.307713+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:01:58.307713+0000","last_undegraded":"2024-09-12T18:01:58.307713+0000","last_fullsized":"2024-09-12T18:01:58.307713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307021+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:01:58.307021+0000","last_peered":"2024-09-12T18:01:58.307021+0000","last_clean":"2024-09-12T18:01:58.307021+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:01:58.307021+0000","last_undegraded":"2024-09-12T18:01:58.307021+0000","last_fullsized":"2024-09-12T18:01:58.307021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308169+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:01:58.308169+0000","last_peered":"2024-09-12T18:01:58.308169+0000","last_clean":"2024-09-12T18:01:58.308169+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:01:58.308169+0000","last_undegraded":"2024-09-12T18:01:58.308169+0000","last_fullsized":"2024-09-12T18:01:58.308169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521151+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:01:58.521151+0000","last_peered":"2024-09-12T18:01:58.521151+0000","last_clean":"2024-09-12T18:01:58.521151+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:01:58.521151+0000","last_undegraded":"2024-09-12T18:01:58.521151+0000","last_fullsized":"2024-09-12T18:01:58.521151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523536+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:01:58.523536+0000","last_peered":"2024-09-12T18:01:58.523536+0000","last_clean":"2024-09-12T18:01:58.523536+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:01:58.523536+0000","last_undegraded":"2024-09-12T18:01:58.523536+0000","last_fullsized":"2024-09-12T18:01:58.523536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306809+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:01:58.306809+0000","last_peered":"2024-09-12T18:01:58.306809+0000","last_clean":"2024-09-12T18:01:58.306809+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:01:58.306809+0000","last_undegraded":"2024-09-12T18:01:58.306809+0000","last_fullsized":"2024-09-12T18:01:58.306809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523210+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:01:58.523210+0000","last_peered":"2024-09-12T18:01:58.523210+0000","last_clean":"2024-09-12T18:01:58.523210+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:01:58.523210+0000","last_undegraded":"2024-09-12T18:01:58.523210+0000","last_fullsized":"2024-09-12T18:01:58.523210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306263+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:01:58.306263+0000","last_peered":"2024-09-12T18:01:58.306263+0000","last_clean":"2024-09-12T18:01:58.306263+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:01:58.306263+0000","last_undegraded":"2024-09-12T18:01:58.306263+0000","last_fullsized":"2024-09-12T18:01:58.306263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308667+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:01:58.308667+0000","last_peered":"2024-09-12T18:01:58.308667+0000","last_clean":"2024-09-12T18:01:58.308667+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:01:58.308667+0000","last_undegraded":"2024-09-12T18:01:58.308667+0000","last_fullsized":"2024-09-12T18:01:58.308667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306836+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:01:58.306836+0000","last_peered":"2024-09-12T18:01:58.306836+0000","last_clean":"2024-09-12T18:01:58.306836+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:01:58.306836+0000","last_undegraded":"2024-09-12T18:01:58.306836+0000","last_fullsized":"2024-09-12T18:01:58.306836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308728+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:01:58.308728+0000","last_peered":"2024-09-12T18:01:58.308728+0000","last_clean":"2024-09-12T18:01:58.308728+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:01:58.308728+0000","last_undegraded":"2024-09-12T18:01:58.308728+0000","last_fullsized":"2024-09-12T18:01:58.308728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306551+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:01:58.306551+0000","last_peered":"2024-09-12T18:01:58.306551+0000","last_clean":"2024-09-12T18:01:58.306551+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:01:58.306551+0000","last_undegraded":"2024-09-12T18:01:58.306551+0000","last_fullsized":"2024-09-12T18:01:58.306551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308374+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:01:58.308374+0000","last_peered":"2024-09-12T18:01:58.308374+0000","last_clean":"2024-09-12T18:01:58.308374+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:01:58.308374+0000","last_undegraded":"2024-09-12T18:01:58.308374+0000","last_fullsized":"2024-09-12T18:01:58.308374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306564+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:01:58.306564+0000","last_peered":"2024-09-12T18:01:58.306564+0000","last_clean":"2024-09-12T18:01:58.306564+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:01:58.306564+0000","last_undegraded":"2024-09-12T18:01:58.306564+0000","last_fullsized":"2024-09-12T18:01:58.306564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308773+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:01:58.308773+0000","last_peered":"2024-09-12T18:01:58.308773+0000","last_clean":"2024-09-12T18:01:58.308773+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:01:58.308773+0000","last_undegraded":"2024-09-12T18:01:58.308773+0000","last_fullsized":"2024-09-12T18:01:58.308773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521950+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:01:58.521950+0000","last_peered":"2024-09-12T18:01:58.521950+0000","last_clean":"2024-09-12T18:01:58.521950+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:01:58.521950+0000","last_undegraded":"2024-09-12T18:01:58.521950+0000","last_fullsized":"2024-09-12T18:01:58.521950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522420+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:01:58.522420+0000","last_peered":"2024-09-12T18:01:58.522420+0000","last_clean":"2024-09-12T18:01:58.522420+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:01:58.522420+0000","last_undegraded":"2024-09-12T18:01:58.522420+0000","last_fullsized":"2024-09-12T18:01:58.522420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308436+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:01:58.308436+0000","last_peered":"2024-09-12T18:01:58.308436+0000","last_clean":"2024-09-12T18:01:58.308436+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:01:58.308436+0000","last_undegraded":"2024-09-12T18:01:58.308436+0000","last_fullsized":"2024-09-12T18:01:58.308436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307114+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:01:58.307114+0000","last_peered":"2024-09-12T18:01:58.307114+0000","last_clean":"2024-09-12T18:01:58.307114+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:01:58.307114+0000","last_undegraded":"2024-09-12T18:01:58.307114+0000","last_fullsized":"2024-09-12T18:01:58.307114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308096+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:01:58.308096+0000","last_peered":"2024-09-12T18:01:58.308096+0000","last_clean":"2024-09-12T18:01:58.308096+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:01:58.308096+0000","last_undegraded":"2024-09-12T18:01:58.308096+0000","last_fullsized":"2024-09-12T18:01:58.308096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307081+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:01:58.307081+0000","last_peered":"2024-09-12T18:01:58.307081+0000","last_clean":"2024-09-12T18:01:58.307081+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:01:58.307081+0000","last_undegraded":"2024-09-12T18:01:58.307081+0000","last_fullsized":"2024-09-12T18:01:58.307081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307801+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:01:58.307801+0000","last_peered":"2024-09-12T18:01:58.307801+0000","last_clean":"2024-09-12T18:01:58.307801+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:01:58.307801+0000","last_undegraded":"2024-09-12T18:01:58.307801+0000","last_fullsized":"2024-09-12T18:01:58.307801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306861+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:01:58.306861+0000","last_peered":"2024-09-12T18:01:58.306861+0000","last_clean":"2024-09-12T18:01:58.306861+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:01:58.306861+0000","last_undegraded":"2024-09-12T18:01:58.306861+0000","last_fullsized":"2024-09-12T18:01:58.306861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523209+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:01:58.523209+0000","last_peered":"2024-09-12T18:01:58.523209+0000","last_clean":"2024-09-12T18:01:58.523209+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:01:58.523209+0000","last_undegraded":"2024-09-12T18:01:58.523209+0000","last_fullsized":"2024-09-12T18:01:58.523209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307284+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:01:58.307284+0000","last_peered":"2024-09-12T18:01:58.307284+0000","last_clean":"2024-09-12T18:01:58.307284+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:01:58.307284+0000","last_undegraded":"2024-09-12T18:01:58.307284+0000","last_fullsized":"2024-09-12T18:01:58.307284+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307391+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:01:58.307391+0000","last_peered":"2024-09-12T18:01:58.307391+0000","last_clean":"2024-09-12T18:01:58.307391+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:01:58.307391+0000","last_undegraded":"2024-09-12T18:01:58.307391+0000","last_fullsized":"2024-09-12T18:01:58.307391+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521347+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:01:58.521347+0000","last_peered":"2024-09-12T18:01:58.521347+0000","last_clean":"2024-09-12T18:01:58.521347+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:01:58.521347+0000","last_undegraded":"2024-09-12T18:01:58.521347+0000","last_fullsized":"2024-09-12T18:01:58.521347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308303+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:01:58.308303+0000","last_peered":"2024-09-12T18:01:58.308303+0000","last_clean":"2024-09-12T18:01:58.308303+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:01:58.308303+0000","last_undegraded":"2024-09-12T18:01:58.308303+0000","last_fullsized":"2024-09-12T18:01:58.308303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306710+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:01:58.306710+0000","last_peered":"2024-09-12T18:01:58.306710+0000","last_clean":"2024-09-12T18:01:58.306710+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:01:58.306710+0000","last_undegraded":"2024-09-12T18:01:58.306710+0000","last_fullsized":"2024-09-12T18:01:58.306710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520927+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:01:58.520927+0000","last_peered":"2024-09-12T18:01:58.520927+0000","last_clean":"2024-09-12T18:01:58.520927+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:01:58.520927+0000","last_undegraded":"2024-09-12T18:01:58.520927+0000","last_fullsized":"2024-09-12T18:01:58.520927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308440+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:01:58.308440+0000","last_peered":"2024-09-12T18:01:58.308440+0000","last_clean":"2024-09-12T18:01:58.308440+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:01:58.308440+0000","last_undegraded":"2024-09-12T18:01:58.308440+0000","last_fullsized":"2024-09-12T18:01:58.308440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521264+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:01:58.521264+0000","last_peered":"2024-09-12T18:01:58.521264+0000","last_clean":"2024-09-12T18:01:58.521264+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:01:58.521264+0000","last_undegraded":"2024-09-12T18:01:58.521264+0000","last_fullsized":"2024-09-12T18:01:58.521264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307103+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:01:58.307103+0000","last_peered":"2024-09-12T18:01:58.307103+0000","last_clean":"2024-09-12T18:01:58.307103+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:01:58.307103+0000","last_undegraded":"2024-09-12T18:01:58.307103+0000","last_fullsized":"2024-09-12T18:01:58.307103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523358+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:01:58.523358+0000","last_peered":"2024-09-12T18:01:58.523358+0000","last_clean":"2024-09-12T18:01:58.523358+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:01:58.523358+0000","last_undegraded":"2024-09-12T18:01:58.523358+0000","last_fullsized":"2024-09-12T18:01:58.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307334+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:01:58.307334+0000","last_peered":"2024-09-12T18:01:58.307334+0000","last_clean":"2024-09-12T18:01:58.307334+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:01:58.307334+0000","last_undegraded":"2024-09-12T18:01:58.307334+0000","last_fullsized":"2024-09-12T18:01:58.307334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307283+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:01:58.307283+0000","last_peered":"2024-09-12T18:01:58.307283+0000","last_clean":"2024-09-12T18:01:58.307283+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:01:58.307283+0000","last_undegraded":"2024-09-12T18:01:58.307283+0000","last_fullsized":"2024-09-12T18:01:58.307283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522497+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:01:58.522497+0000","last_peered":"2024-09-12T18:01:58.522497+0000","last_clean":"2024-09-12T18:01:58.522497+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:01:58.522497+0000","last_undegraded":"2024-09-12T18:01:58.522497+0000","last_fullsized":"2024-09-12T18:01:58.522497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308613+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:01:58.308613+0000","last_peered":"2024-09-12T18:01:58.308613+0000","last_clean":"2024-09-12T18:01:58.308613+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:01:58.308613+0000","last_undegraded":"2024-09-12T18:01:58.308613+0000","last_fullsized":"2024-09-12T18:01:58.308613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522819+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:01:58.522819+0000","last_peered":"2024-09-12T18:01:58.522819+0000","last_clean":"2024-09-12T18:01:58.522819+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:01:58.522819+0000","last_undegraded":"2024-09-12T18:01:58.522819+0000","last_fullsized":"2024-09-12T18:01:58.522819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307143+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:01:58.307143+0000","last_peered":"2024-09-12T18:01:58.307143+0000","last_clean":"2024-09-12T18:01:58.307143+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:01:58.307143+0000","last_undegraded":"2024-09-12T18:01:58.307143+0000","last_fullsized":"2024-09-12T18:01:58.307143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522522+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:01:58.522522+0000","last_peered":"2024-09-12T18:01:58.522522+0000","last_clean":"2024-09-12T18:01:58.522522+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:01:58.522522+0000","last_undegraded":"2024-09-12T18:01:58.522522+0000","last_fullsized":"2024-09-12T18:01:58.522522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308821+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:01:58.308821+0000","last_peered":"2024-09-12T18:01:58.308821+0000","last_clean":"2024-09-12T18:01:58.308821+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:01:58.308821+0000","last_undegraded":"2024-09-12T18:01:58.308821+0000","last_fullsized":"2024-09-12T18:01:58.308821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307004+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:01:58.307004+0000","last_peered":"2024-09-12T18:01:58.307004+0000","last_clean":"2024-09-12T18:01:58.307004+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:01:58.307004+0000","last_undegraded":"2024-09-12T18:01:58.307004+0000","last_fullsized":"2024-09-12T18:01:58.307004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523799+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:01:58.523799+0000","last_peered":"2024-09-12T18:01:58.523799+0000","last_clean":"2024-09-12T18:01:58.523799+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:01:58.523799+0000","last_undegraded":"2024-09-12T18:01:58.523799+0000","last_fullsized":"2024-09-12T18:01:58.523799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523895+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:01:58.523895+0000","last_peered":"2024-09-12T18:01:58.523895+0000","last_clean":"2024-09-12T18:01:58.523895+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:01:58.523895+0000","last_undegraded":"2024-09-12T18:01:58.523895+0000","last_fullsized":"2024-09-12T18:01:58.523895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520611+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:01:58.520611+0000","last_peered":"2024-09-12T18:01:58.520611+0000","last_clean":"2024-09-12T18:01:58.520611+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:01:58.520611+0000","last_undegraded":"2024-09-12T18:01:58.520611+0000","last_fullsized":"2024-09-12T18:01:58.520611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523802+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:01:58.523802+0000","last_peered":"2024-09-12T18:01:58.523802+0000","last_clean":"2024-09-12T18:01:58.523802+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:01:58.523802+0000","last_undegraded":"2024-09-12T18:01:58.523802+0000","last_fullsized":"2024-09-12T18:01:58.523802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308763+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:01:58.308763+0000","last_peered":"2024-09-12T18:01:58.308763+0000","last_clean":"2024-09-12T18:01:58.308763+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:01:58.308763+0000","last_undegraded":"2024-09-12T18:01:58.308763+0000","last_fullsized":"2024-09-12T18:01:58.308763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306540+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:01:58.306540+0000","last_peered":"2024-09-12T18:01:58.306540+0000","last_clean":"2024-09-12T18:01:58.306540+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:01:58.306540+0000","last_undegraded":"2024-09-12T18:01:58.306540+0000","last_fullsized":"2024-09-12T18:01:58.306540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306657+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:01:58.306657+0000","last_peered":"2024-09-12T18:01:58.306657+0000","last_clean":"2024-09-12T18:01:58.306657+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:01:58.306657+0000","last_undegraded":"2024-09-12T18:01:58.306657+0000","last_fullsized":"2024-09-12T18:01:58.306657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308692+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:01:58.308692+0000","last_peered":"2024-09-12T18:01:58.308692+0000","last_clean":"2024-09-12T18:01:58.308692+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:01:58.308692+0000","last_undegraded":"2024-09-12T18:01:58.308692+0000","last_fullsized":"2024-09-12T18:01:58.308692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520948+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:01:58.520948+0000","last_peered":"2024-09-12T18:01:58.520948+0000","last_clean":"2024-09-12T18:01:58.520948+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:01:58.520948+0000","last_undegraded":"2024-09-12T18:01:58.520948+0000","last_fullsized":"2024-09-12T18:01:58.520948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308438+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:01:58.308438+0000","last_peered":"2024-09-12T18:01:58.308438+0000","last_clean":"2024-09-12T18:01:58.308438+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:01:58.308438+0000","last_undegraded":"2024-09-12T18:01:58.308438+0000","last_fullsized":"2024-09-12T18:01:58.308438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307996+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:01:58.307996+0000","last_peered":"2024-09-12T18:01:58.307996+0000","last_clean":"2024-09-12T18:01:58.307996+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:01:58.307996+0000","last_undegraded":"2024-09-12T18:01:58.307996+0000","last_fullsized":"2024-09-12T18:01:58.307996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520540+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:01:58.520540+0000","last_peered":"2024-09-12T18:01:58.520540+0000","last_clean":"2024-09-12T18:01:58.520540+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:01:58.520540+0000","last_undegraded":"2024-09-12T18:01:58.520540+0000","last_fullsized":"2024-09-12T18:01:58.520540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523593+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:01:58.523593+0000","last_peered":"2024-09-12T18:01:58.523593+0000","last_clean":"2024-09-12T18:01:58.523593+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:01:58.523593+0000","last_undegraded":"2024-09-12T18:01:58.523593+0000","last_fullsized":"2024-09-12T18:01:58.523593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520359+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:01:58.520359+0000","last_peered":"2024-09-12T18:01:58.520359+0000","last_clean":"2024-09-12T18:01:58.520359+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:01:58.520359+0000","last_undegraded":"2024-09-12T18:01:58.520359+0000","last_fullsized":"2024-09-12T18:01:58.520359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308770+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:01:58.308770+0000","last_peered":"2024-09-12T18:01:58.308770+0000","last_clean":"2024-09-12T18:01:58.308770+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:01:58.308770+0000","last_undegraded":"2024-09-12T18:01:58.308770+0000","last_fullsized":"2024-09-12T18:01:58.308770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520712+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:01:58.520712+0000","last_peered":"2024-09-12T18:01:58.520712+0000","last_clean":"2024-09-12T18:01:58.520712+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:01:58.520712+0000","last_undegraded":"2024-09-12T18:01:58.520712+0000","last_fullsized":"2024-09-12T18:01:58.520712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523105+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:01:58.523105+0000","last_peered":"2024-09-12T18:01:58.523105+0000","last_clean":"2024-09-12T18:01:58.523105+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:01:58.523105+0000","last_undegraded":"2024-09-12T18:01:58.523105+0000","last_fullsized":"2024-09-12T18:01:58.523105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520913+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:01:58.520913+0000","last_peered":"2024-09-12T18:01:58.520913+0000","last_clean":"2024-09-12T18:01:58.520913+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:01:58.520913+0000","last_undegraded":"2024-09-12T18:01:58.520913+0000","last_fullsized":"2024-09-12T18:01:58.520913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307918+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:01:58.307918+0000","last_peered":"2024-09-12T18:01:58.307918+0000","last_clean":"2024-09-12T18:01:58.307918+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:01:58.307918+0000","last_undegraded":"2024-09-12T18:01:58.307918+0000","last_fullsized":"2024-09-12T18:01:58.307918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307691+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:01:58.307691+0000","last_peered":"2024-09-12T18:01:58.307691+0000","last_clean":"2024-09-12T18:01:58.307691+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:01:58.307691+0000","last_undegraded":"2024-09-12T18:01:58.307691+0000","last_fullsized":"2024-09-12T18:01:58.307691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307440+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:01:58.307440+0000","last_peered":"2024-09-12T18:01:58.307440+0000","last_clean":"2024-09-12T18:01:58.307440+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:01:58.307440+0000","last_undegraded":"2024-09-12T18:01:58.307440+0000","last_fullsized":"2024-09-12T18:01:58.307440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307331+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:01:58.307331+0000","last_peered":"2024-09-12T18:01:58.307331+0000","last_clean":"2024-09-12T18:01:58.307331+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:01:58.307331+0000","last_undegraded":"2024-09-12T18:01:58.307331+0000","last_fullsized":"2024-09-12T18:01:58.307331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306520+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:01:58.306520+0000","last_peered":"2024-09-12T18:01:58.306520+0000","last_clean":"2024-09-12T18:01:58.306520+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:01:58.306520+0000","last_undegraded":"2024-09-12T18:01:58.306520+0000","last_fullsized":"2024-09-12T18:01:58.306520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308501+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:01:58.308501+0000","last_peered":"2024-09-12T18:01:58.308501+0000","last_clean":"2024-09-12T18:01:58.308501+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:01:58.308501+0000","last_undegraded":"2024-09-12T18:01:58.308501+0000","last_fullsized":"2024-09-12T18:01:58.308501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306832+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:01:58.306832+0000","last_peered":"2024-09-12T18:01:58.306832+0000","last_clean":"2024-09-12T18:01:58.306832+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:01:58.306832+0000","last_undegraded":"2024-09-12T18:01:58.306832+0000","last_fullsized":"2024-09-12T18:01:58.306832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308276+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:01:58.308276+0000","last_peered":"2024-09-12T18:01:58.308276+0000","last_clean":"2024-09-12T18:01:58.308276+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:01:58.308276+0000","last_undegraded":"2024-09-12T18:01:58.308276+0000","last_fullsized":"2024-09-12T18:01:58.308276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307335+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:01:58.307335+0000","last_peered":"2024-09-12T18:01:58.307335+0000","last_clean":"2024-09-12T18:01:58.307335+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:01:58.307335+0000","last_undegraded":"2024-09-12T18:01:58.307335+0000","last_fullsized":"2024-09-12T18:01:58.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523494+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:01:58.523494+0000","last_peered":"2024-09-12T18:01:58.523494+0000","last_clean":"2024-09-12T18:01:58.523494+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:01:58.523494+0000","last_undegraded":"2024-09-12T18:01:58.523494+0000","last_fullsized":"2024-09-12T18:01:58.523494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307856+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:01:58.307856+0000","last_peered":"2024-09-12T18:01:58.307856+0000","last_clean":"2024-09-12T18:01:58.307856+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:01:58.307856+0000","last_undegraded":"2024-09-12T18:01:58.307856+0000","last_fullsized":"2024-09-12T18:01:58.307856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523461+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:01:58.523461+0000","last_peered":"2024-09-12T18:01:58.523461+0000","last_clean":"2024-09-12T18:01:58.523461+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:01:58.523461+0000","last_undegraded":"2024-09-12T18:01:58.523461+0000","last_fullsized":"2024-09-12T18:01:58.523461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:08.928 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:02:08.928 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T18:02:09.288 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 20 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:fsid da5a949a-216b-4267-953a-8d92e3d25b1d 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-12T18:01:33.537080+0000 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-12T18:01:58.296887+0000 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:crush_version 4 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:full_ratio 0.95 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:backfillfull_ratio 0.9 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:nearfull_ratio 0.85 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:require_min_compat_client luminous 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:min_compat_client jewel 2024-09-12T18:02:09.289 INFO:teuthology.orchestra.run.smithi052.stdout:require_osd_release squid 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:stretch_mode_enabled false 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:max_osd 3 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/177809282,v1:172.21.15.111:6801/177809282] [v2:172.21.15.111:6802/177809282,v1:172.21.15.111:6803/177809282] exists,up f692452d-28b8-4aad-928e-fe1805e23b68 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6800/3534339867,v1:172.21.15.121:6801/3534339867] [v2:172.21.15.121:6802/3534339867,v1:172.21.15.121:6803/3534339867] exists,up b5b3807e-e3b5-4530-adc6-af19dd31e340 2024-09-12T18:02:09.290 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/284634690,v1:172.21.15.153:6801/284634690] [v2:172.21.15.153:6802/284634690,v1:172.21.15.153:6803/284634690] exists,up 926e4870-279e-45c7-9d6c-5841397a5e6c 2024-09-12T18:02:09.308 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/177809282,v1:172.21.15.111:6801/177809282] [v2:172.21.15.111:6802/177809282,v1:172.21.15.111:6803/177809282] exists,up f692452d-28b8-4aad-928e-fe1805e23b68', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6800/3534339867,v1:172.21.15.121:6801/3534339867] [v2:172.21.15.121:6802/3534339867,v1:172.21.15.121:6803/3534339867] exists,up b5b3807e-e3b5-4530-adc6-af19dd31e340', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/284634690,v1:172.21.15.153:6801/284634690] [v2:172.21.15.153:6802/284634690,v1:172.21.15.153:6803/284634690] exists,up 926e4870-279e-45c7-9d6c-5841397a5e6c'] 2024-09-12T18:02:09.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mon.a", 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster": "ceph", 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout: "admin_socket_mode": "", 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_client_required": "cephx, none", 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_cluster_required": "cephx", 2024-09-12T18:02:09.432 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_debug": "true", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_service_required": "cephx", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_supported": "cephx", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio": "true", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_reap_max": "16", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_async_discard_threads": "0", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_block_size": "4096", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio": "false", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T18:02:09.433 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_enable_discard": "false", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_flock_retry": "3", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_inject_crash": "0", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring": "false", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring_hipri": "false", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T18:02:09.434 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_type": "", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_allocator": "hybrid", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_buffered_io": "true", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T18:02:09.435 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_replay_recovery": "false", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_sync_write": "false", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_allocator": "hybrid", 2024-09-12T18:02:09.436 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_async_db_compaction": "true", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_create": "true", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_create": "false", 2024-09-12T18:02:09.437 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_path": "", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_size": "0", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_path": "", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_size": "107374182400", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_create": "false", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_path": "", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs": "true", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T18:02:09.438 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_autotune": "true", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size": "0", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T18:02:09.439 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_type": "2q", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_clone_cow": "true", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_mode": "none", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-12T18:02:09.440 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_freelist": "false", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T18:02:09.441 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fail_eio": "false", 2024-09-12T18:02:09.442 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T18:02:09.443 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size": "0", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T18:02:09.444 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T18:02:09.445 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_mem": "512", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T18:02:09.446 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_tracing": "false", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_write_v2": "false", 2024-09-12T18:02:09.447 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_write_v2_random": "false", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T18:02:09.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_cluster_require_version": "2", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_require_signatures": "false", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_require_version": "2", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_service_require_signatures": "false", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_service_require_version": "2", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_sign_messages": "true", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "chdir": "", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "client_acl_type": "", 2024-09-12T18:02:09.449 INFO:teuthology.orchestra.run.smithi052.stdout: "client_asio_thread_count": "2", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_cache_mid": "0.750000", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_cache_size": "16384", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_caps_release_delay": "5", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_check_pool_perm": "true", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_force_sync_read": "false", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_getattr_caps": "false", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_inject_features": "", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_die_on_failed_remount": "false", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_dirsize_rbytes": "true", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_force_lazyio": "false", 2024-09-12T18:02:09.450 INFO:teuthology.orchestra.run.smithi052.stdout: "client_fs": "", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_inject_release_failure": "false", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_max_inline_size": "4096", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mds_namespace": "", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_metadata": "", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_gid": "-1", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_timeout": "300", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_uid": "-1", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mountpoint": "/", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_notify_timeout": "10", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc": "true", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T18:02:09.451 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_objects": "1000", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_size": "209715200", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_permissions": "true", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_quota": "true", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_quota_df": "true", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_max_bytes": "0", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_max_periods": "4", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_min": "131072", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_reconnect_stale": "false", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_shutdown_timeout": "30", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_snapdir": ".snap", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_tick_interval": "1", 2024-09-12T18:02:09.452 INFO:teuthology.orchestra.run.smithi052.stdout: "client_trace": "", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "client_use_faked_inos": "false", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "client_use_random_mds": "false", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog": "false", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog_port": "12201", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_monitors": "default=true", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog": "false", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog_level": "info", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "-", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_network": "", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_network_interface": "", 2024-09-12T18:02:09.453 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_isal": "false", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_level": "5", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zstd_level": "1", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location": "", 2024-09-12T18:02:09.454 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location_hook": "", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location_hook_timeout": "10", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "daemonize": "false", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "daos_pool": "tank", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_alienstore": "0/5", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asok": "1/5", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asok_assert_abort": "false", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_auth": "20/20", 2024-09-12T18:02:09.455 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bdev": "1/3", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bluefs": "1/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bluestore": "1/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_buffer": "0/1", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ceph_dedup": "0/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cephsqlite": "0/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_client": "0/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_compressor": "1/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_context": "0/1", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crush": "1/1", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crypto": "1/5", 2024-09-12T18:02:09.456 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cyanstore": "0/5", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_dpdk": "1/5", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_eventtrace": "1/5", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_filer": "0/1", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_filestore": "1/3", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_finisher": "1/1", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_fuse": "1/5", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_javaclient": "1/5", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_journal": "1/3", 2024-09-12T18:02:09.457 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_journaler": "0/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_kstore": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_lockdep": "0/1", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mclock": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_balancer": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_locker": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_log": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_migrator": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_memstore": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mgr": "2/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mgrc": "1/5", 2024-09-12T18:02:09.458 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mon": "20/20", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_monc": "0/10", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ms": "1/1", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_none": "0/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objclass": "0/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objectcacher": "0/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objecter": "0/1", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_optracker": "0/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_osd": "1/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_paxos": "20/20", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_perfcounter": "1/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_prioritycache": "1/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rados": "0/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd": "0/5", 2024-09-12T18:02:09.459 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_replay": "0/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_refs": "0/0", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_reserver": "1/1", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw": "1/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_access": "1/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_flight": "1/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_notification": "1/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_sync": "1/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rocksdb": "4/5", 2024-09-12T18:02:09.460 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_backref": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_cache": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_device": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_epm": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_journal": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_lba": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_odata": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_omap": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_onode": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_t": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_tm": "0/5", 2024-09-12T18:02:09.461 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_striper": "0/1", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_test": "0/5", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_throttle": "1/1", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_timer": "0/1", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_tp": "0/5", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_trace": "1/5", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "device_failure_prediction_mode": "none", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_graylog": "false", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_journald": "false", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_stderr": "true", 2024-09-12T18:02:09.462 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_syslog": "false", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "event_tracing": "false", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_cert_file": "", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_http_port": "9926", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_key_file": "", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_prio_limit": "5", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_sort_metrics": "true", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_stats_period": "5", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "fake_statfs_for_testing": "0", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "fatal_signal_handlers": "true", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "filer_max_purge_ops": "10", 2024-09-12T18:02:09.463 INFO:teuthology.orchestra.run.smithi052.stdout: "filer_max_truncate_ops": "128", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_blackhole": "false", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_btrfs_snap": "true", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_caller_concurrency": "10", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_omap_check": "false", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_verify_split": "false", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_dump_file": "", 2024-09-12T18:02:09.464 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fadvise": "true", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fail_eio": "true", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fd_cache_size": "128", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fiemap": "false", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_inject_stall": "0", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_parallel": "false", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_trailing": "false", 2024-09-12T18:02:09.465 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_writeahead": "false", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_kill_at": "0", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T18:02:09.466 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_merge_threshold": "-10", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_odsync_write": "false", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_backend_path": "", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_threads": "2", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_punch_hole": "false", 2024-09-12T18:02:09.467 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_ops": "50", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_seek_data_hole": "false", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_sloppy_crc": "false", 2024-09-12T18:02:09.468 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_splice": "false", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_split_multiple": "2", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_split_rand_factor": "20", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_update_to": "1000", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T18:02:09.469 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_xfs_extsize": "false", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_zfs_snap": "false", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fio_dir": "/tmp/fio", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "da5a949a-216b-4267-953a-8d92e3d25b1d", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_allow_other": "true", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_big_writes": "true", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_debug": "false", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_default_permissions": "false", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_disable_pagecache": "false", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_max_write": "0", 2024-09-12T18:02:09.470 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_multithreaded": "true", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_require_active_mds": "true", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_set_user_groups": "true", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_move": "true", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_read": "true", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_write": "true", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "gss_target_name": "ceph", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_file": "", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_inject_failure": "0", 2024-09-12T18:02:09.471 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_interval": "5", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "host": "smithi052", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T18:02:09.472 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "inject_early_sigterm": "false", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "jaeger_agent_port": "6799", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "jaeger_tracing_enable": "false", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_aio": "true", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_align_min_size": "65536", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_block_align": "true", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_block_size": "4096", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_dio": "true", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_discard": "false", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_force_aio": "false", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_ignore_corruption": "false", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T18:02:09.473 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_max_write_entries": "100", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_replay_from": "0", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_write_header_frequency": "0", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_zero_on_create": "false", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_prefetch_periods": "10", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_prezero_periods": "5", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_write_head_interval": "15", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "keyfile": "", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_backend": "rocksdb", 2024-09-12T18:02:09.474 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_max_bytes": "67108864", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_max_ops": "512", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_onode_map_size": "1024", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_sync_transaction": "false", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "librados_thread_count": "2", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "lockdep": "false", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "lockdep_force_backtrace": "false", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "log_coarse_timestamps": "true", 2024-09-12T18:02:09.475 INFO:teuthology.orchestra.run.smithi052.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_flush_on_exit": "false", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_graylog_port": "12201", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_max_new": "1000", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_max_recent": "10000", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_stderr_prefix": "", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": "true", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_graylog": "false", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_journald": "false", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_stderr": "false", 2024-09-12T18:02:09.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_syslog": "false", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_action_on_write_error": "1", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_alternate_name_max": "8192", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_asio_thread_count": "2", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_export_pin": "true", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T18:02:09.477 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_interval": "10", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_max": "-1", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_max_until": "-1", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_merge_size": "50", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_mode": "0", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T18:02:09.478 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_bits": "3", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_size": "10000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T18:02:09.479 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_mid": "0.700000", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_interval": "1", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T18:02:09.480 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_auth_pins": "false", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_frag": "false", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_scatterstat": "false", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_subtrees": "false", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_default_dir_hash": "2", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_defer_session_stale": "true", 2024-09-12T18:02:09.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_max_entries": "0", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_prefetch": "true", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_early_reply": "true", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_enable_op_tracker": "true", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_enforce_unique_name": "true", 2024-09-12T18:02:09.482 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T18:02:09.483 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_health_dummy": "false", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_join_fs": "", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_journal_format": "1", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_create_at": "0", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_dirfrag_at": "0", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_export_at": "0", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_import_at": "0", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_at": "0", 2024-09-12T18:02:09.484 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_link_at": "0", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_openc_at": "0", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_rename_at": "0", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_max_events": "-1", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_max_segments": "128", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_pause": "false", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_segment_size": "0", 2024-09-12T18:02:09.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_trim_threshold": "128", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_completed_requests": "100000", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_export_size": "20971520", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_file_recover": "32", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_files": "64", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_ops": "8192", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T18:02:09.486 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_metrics_update_interval": "2", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_min_caps_per_client": "100", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_numa_node": "-1", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_duration": "600", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_size": "20", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_log_threshold": "5", 2024-09-12T18:02:09.487 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_ping_grace": "15", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_ping_interval": "5", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_caps": "30000", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_replay_interval": "1.000000", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T18:02:09.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_root_ino_gid": "0", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_root_ino_uid": "0", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_scrub_stats_review_period": "1", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T18:02:09.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_shutdown_check": "0", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_skip_ino": "0", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_min_uid": "0", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_rstat": "false", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_symlink_recovery": "true", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_thrash_exports": "0", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_thrash_fragments": "0", 2024-09-12T18:02:09.490 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_tick_interval": "5.000000", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_valgrind_exit": "false", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_verify_backtrace": "1", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_verify_scatter": "false", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_wipe_sessions": "false", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool_debug": "false", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_page_set": "false", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_page_size": "65536", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_bytes": "134217728", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_messages": "512", 2024-09-12T18:02:09.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_disabled_modules": "", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_max_pg_creating": "1024", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mds_messages": "128", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T18:02:09.492 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mon_messages": "128", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_op_history_duration": "600", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_op_history_size": "20", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_op_log_threshold": "5", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_osd_messages": "8192", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_pool": "true", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_standby_modules": "true", 2024-09-12T18:02:09.493 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_stats_period": "5", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_stats_threshold": "5", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_tick_period": "2", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_allow_pool_delete": "true", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_bytes": "104857600", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T18:02:09.494 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_target_rank": "-1", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_level": "debug", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T18:02:09.495 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_start": "false", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_trim": "true", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cpu_threads": "4", 2024-09-12T18:02:09.496 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_avail_crit": "5", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_avail_warn": "5", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_json": "false", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_extra_checks": "false", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T18:02:09.497 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_down_uptime_grace": "60", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_election_default_strategy": "1", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_election_timeout": "5.000000", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T18:02:09.498 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_enable_op_tracker": "true", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_fake_pool_delete": "false", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_force_quorum_join": "false", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_log_update_period": "5", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_max_detail": "50", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog": "true", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_host": "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_host_override": "", 2024-09-12T18:02:09.499 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_initial_members": "", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease": "5.000000", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_full_interval": "50", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_max": "10000", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_max_summary": "50", 2024-09-12T18:02:09.500 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_log_epochs": "500", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_osd": "10000", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T18:02:09.501 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_memory_autotune": "true", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_memory_target": "2147483648", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_digest_period": "5", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-12T18:02:09.502 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_complaint_time": "30", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_duration": "600", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_size": "20", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_log_threshold": "5", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_cache_size": "500", 2024-09-12T18:02:09.503 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T18:02:09.504 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_report_timeout": "900", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T18:02:09.505 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T18:02:09.506 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_max_osds": "4", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_interval": "86400", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_max_keys": "100", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_timeout": "300", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_session_timeout": "300", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_smart_report_timeout": "5", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T18:02:09.507 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_pool_size": "4", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_debug": "false", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_tick_interval": "5", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T18:02:09.508 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_older_version": "true", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T18:02:09.509 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "monmap": "", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T18:02:09.510 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_tracing_enabled": "false", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_op_threads": "3", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_cm": "false", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_device_name": "", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T18:02:09.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_sl": "3", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_type": "ib", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_reap_threshold": "5", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_before_connect": "false", 2024-09-12T18:02:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_ipv4": "true", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_ipv6": "false", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_msgr1": "true", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_msgr2": "true", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_port_max": "7568", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_port_min": "6800", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_retry_count": "3", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_retry_delay": "5", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_client": "false", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mds": "false", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mgr": "false", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mon": "false", 2024-09-12T18:02:09.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_osd": "false", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_client_mode": "crc secure", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_cluster_type": "", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_compress_secure": "false", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_crc_data": "true", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_crc_header": "true", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_bug": "true", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_old_message": "true", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T18:02:09.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hugepages": "", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_lro": "true", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T18:02:09.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_pmd": "", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_port_id": "0", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dump_on_send": "false", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_type": "", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_network_congestion": "0", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_socket_failures": "0", 2024-09-12T18:02:09.516 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_max_accept_failures": "4", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_max_backoff": "15.000000", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compress_mode": "none", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_pq_min_cost": "65536", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_public_type": "", 2024-09-12T18:02:09.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_service_mode": "crc secure", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_nodelay": "true", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_type": "async+posix", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "no_config_file": "false", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-12T18:02:09.518 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inflight_ops": "1024", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_timeout": "10.000000", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objectstore_blackhole": "false", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "openssl_engine_opts": "", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T18:02:09.519 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_max_ops": "4", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_slop": "0.020000", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_asio_thread_count": "2", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_scan_max": "512", 2024-09-12T18:02:09.520 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_scan_min": "64", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_peering": "false", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_beacon_report_interval": "300", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_duration": "30", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_blkin_trace_all": "false", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T18:02:09.521 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_update_on_start": "true", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_message_cap": "256", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_op_priority": "63", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_watch_timeout": "30", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_command_max_records": "256", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_compact_on_start": "false", 2024-09-12T18:02:09.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_update_on_start": "true", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T18:02:09.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_op_order": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_shutdown": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_trim_objects": "false", 2024-09-12T18:02:09.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_default_notify_timeout": "30", 2024-09-12T18:02:09.525 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ec_partial_reads": "true", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_enable_op_tracker": "true", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_info": "true", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown": "true", 2024-09-12T18:02:09.526 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_function_tracing": "false", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_grace": "20", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_interval": "6", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_stale": "600", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T18:02:09.527 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal_size": "5120", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_kill_backfill_at": "0", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_cache_size": "50", 2024-09-12T18:02:09.528 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_dedup": "true", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_message_max": "40", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_attr_name_len": "100", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_attr_size": "0", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_backfills": "1", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_markdown_count": "5", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_markdown_period": "600", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_name_len": "2048", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_size": "134217728", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T18:02:09.529 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pgls": "1024", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_push_cost": "8388608", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_push_objects": "10", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_scrubs": "3", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_write_size": "90", 2024-09-12T18:02:09.530 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_profile": "balanced", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T18:02:09.531 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_base": "805306368", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target": "4294967296", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target_autotune": "false", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T18:02:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_min_recovery_priority": "0", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_report_interval": "5", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_num_cache_shards": "32", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_node": "-1", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objecter_finishers": "1", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore": "bluestore", 2024-09-12T18:02:09.533 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_fuse": "false", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_tracing": "false", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_duration": "600", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_size": "20", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_log_threshold": "5", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards": "0", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T18:02:09.534 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_thread_timeout": "15", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_open_classes_on_start": "true", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_os_flags": "0", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_peering_op_priority": "255", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_delete_priority": "5", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T18:02:09.535 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T18:02:09.536 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_crimson": "false", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flags": "0", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_min_size": "0", 2024-09-12T18:02:09.537 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_size": "2", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_type": "replicated", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T18:02:09.538 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_cost": "20971520", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active": "0", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_op_priority": "3", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_priority": "5", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T18:02:09.539 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_repair_during_recovery": "false", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T18:02:09.540 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_cost": "52428800", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_end_hour": "0", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T18:02:09.541 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_priority": "5", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_retry_delay": "30", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_retry_trimming": "10", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_skip_data_digest": "false", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_smart_report_timeout": "5", 2024-09-12T18:02:09.542 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_priority": "5", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_target_transaction_size": "30", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T18:02:09.543 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tracing": "false", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_use_stale_snap": "false", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_kill_at": "0", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_max_join_drift": "10", 2024-09-12T18:02:09.544 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_min": "500", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_min_wait": "0.050000", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_max": "500", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_min": "250", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_stash_full_interval": "25", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_trim_max": "500", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_trim_min": "250", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "perf": "true", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "-", 2024-09-12T18:02:09.545 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrv": "", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "public_bind_addr": "-", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "public_network": "", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "public_network_interface": "", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_enabled": "false", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_mon_op_timeout": "0", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_osd_op_timeout": "0", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_tracing": "false", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_atime_update_interval": "60", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T18:02:09.546 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache": "true", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_policy": "writearound", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_size": "33554432", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T18:02:09.547 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_compression_hint": "none", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_clone_format": "auto", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_data_pool": "", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_features": "61", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_format": "2", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_map_options": "", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_order": "22", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_pool": "rbd", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_stripe_count": "0", 2024-09-12T18:02:09.548 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_io_scheduler": "simple", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T18:02:09.549 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_order": "24", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_pool": "", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_splay_width": "4", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T18:02:09.550 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T18:02:09.551 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T18:02:09.552 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_op_threads": "1", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_plugins": "", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T18:02:09.553 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T18:02:09.554 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_tracing": "false", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_validate_names": "true", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_validate_pool": "true", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "restapi_base_url": "", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "restapi_log_level": "", 2024-09-12T18:02:09.555 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_admin_entry": "admin", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_asio_assert_yielding": "false", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_backend_store": "rados", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_barbican_url": "", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_beast_enable_async": "true", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T18:02:09.556 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_enabled": "true", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_config_store": "rados", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_content_length_compat": "false", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T18:02:09.557 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cross_domain_policy": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T18:02:09.558 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T18:02:09.559 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T18:02:09.560 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-12T18:02:09.561 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_window": "30", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T18:02:09.562 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_disable_s3select": "false", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T18:02:09.563 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dns_name": "", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dns_s3website_name": "", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-12T18:02:09.564 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_mdsearch": "true", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_ops_log": "false", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_static_website": "false", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_usage_log": "false", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_expose_bucket": "false", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_extended_http_attrs": "", 2024-09-12T18:02:09.565 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_filter": "none", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_objs": "32", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T18:02:09.566 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_init_timeout": "300", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_password": "", 2024-09-12T18:02:09.567 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_project": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_token": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_user": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T18:02:09.568 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_url": "", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_objs": "32", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_worker": "3", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T18:02:09.569 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_uri": "", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_http_headers": "", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T18:02:09.570 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attr_size": "0", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_listing_results": "5000", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_notify_retries": "10", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T18:02:09.571 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T18:02:09.572 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_num_control_oids": "8", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_numa_node": "-1", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T18:02:09.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_tracing": "false", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_token": "", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_url": "", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_rados": "false", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T18:02:09.574 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_print_continue": "true", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T18:02:09.575 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_tracing": "false", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm": "", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm_id": "", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_region": "", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_request_uri": "", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T18:02:09.576 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_resolve_cname": "false", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_run_sync_thread": "true", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T18:02:09.577 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_script_uri": "", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_service_provider_name": "", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_client_id": "", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_client_secret": "", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_entry": "sts", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_key": "sts", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T18:02:09.578 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_auth_url": "", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_custom_header": "", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_need_stats": "true", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_tenant_name": "", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_url": "", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T18:02:09.579 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_lease_period": "120", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_thread_pool_size": "512", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T18:02:09.580 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_comment": "", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_createby": "", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_encoding": "", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_flag": "false", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_origin": "", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_tracker": "", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_max_shards": "32", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T18:02:09.581 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_use_opa_authz": "false", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_counters_cache": "false", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_unique_email": "true", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_verify_ssl": "true", 2024-09-12T18:02:09.582 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone": "", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone_id": "", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup": "", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup_id": "", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_block_size": "4096", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T18:02:09.583 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T18:02:09.584 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_partition_filters": "false", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_perf": "false", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "run_dir": "/var/run/ceph", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_block_create": "true", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_device_size": "53687091200", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T18:02:09.585 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_full_integrity_check": "false", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_main_device_type": "SSD", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_segment_size": "67108864", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "set_keepcaps": "false", 2024-09-12T18:02:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "setgroup": "", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "setuser": "", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "setuser_match_path": "", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "thp": "false", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "threadpool_default_timeout": "60", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "throttler_perf_counter": "true", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "tmp_dir": "/tmp", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "uadk_compressor_enabled": "false", 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-12T18:02:09.587 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:02:09.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T18:02:09.737 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a: {} 2024-09-12T18:02:09.737 INFO:teuthology.orchestra.run.smithi052.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:02:09.745 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b: {} 2024-09-12T18:02:09.746 INFO:teuthology.orchestra.run.smithi052.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:02:09.756 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c: {} 2024-09-12T18:02:09.756 INFO:teuthology.orchestra.run.smithi052.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:02:09.773 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-12T18:02:09.774 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-12T18:02:09.799 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-12T18:02:09.799 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-12T18:02:09.799 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-12T18:02:09.799 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T18:02:09.800 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:09.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:09.800 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-12T18:02:09.800 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T18:02:09.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:02:09.801 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:02:09.801 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T18:02:09.804 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T18:02:09.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:09.805 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T18:02:09.805 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:09.805 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T18:02:09.805 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:02:09.807 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:09.804+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:09.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:09.811 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-12T18:02:09.865 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-09-12T18:02:09.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:02:09.867 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-12T18:02:09.867 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T18:02:09.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T18:02:09.906 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:09.906+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:09.937 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:09.937 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:09.937 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:09.937 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:09.951 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:09.951 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:09.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:09.972 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:09.972 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:09.994 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:09.994 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:10.009 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:10.009+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:10.110 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:10.109+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:10.110 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:10.111 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:10.125 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:10.213 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:10.213+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:02:10.228 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:02:10.245 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:10.245 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:10.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:02:10.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:10.277 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T18:02:10.294 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T18:02:10.294 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T18:02:10.295 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-12T18:02:10.295 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T18:02:10.295 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:10.295 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T18:02:10.295 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T18:02:10.295 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T18:02:10.295 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T18:02:10.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:10.295 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-12T18:02:10.314 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:10.313+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-12T18:02:10.342 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42517sec preferred_lft 42517sec 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-12T18:02:10.343 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-12T18:02:10.344 INFO:teuthology.orchestra.run.smithi052.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T18:02:10.344 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 02:42:ea:30:b4:ab brd ff:ff:ff:ff:ff:ff 2024-09-12T18:02:10.344 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T18:02:10.344 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-12T18:02:10.344 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T18:02:10.344 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T18:02:10.344 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-12T18:02:10.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-09-12T18:02:10.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-09-12T18:02:10.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-09-12T18:02:10.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T18:02:10.345 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-12T18:02:10.389 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:10.390 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:10.404 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:10.416 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:10.414+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T18:02:10.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T18:02:10.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:10.453 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T18:02:10.504 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-12T18:02:10.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:10.506 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-12T18:02:10.515 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:10.513+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:10.529 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:10.530 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:10.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:10.573 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-12T18:02:10.573 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T18:02:10.573 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-12T18:02:10.573 INFO:teuthology.orchestra.run.smithi052.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T18:02:10.573 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-12T18:02:10.573 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T18:02:10.574 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T18:02:10.574 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-12T18:02:10.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T18:02:10.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T18:02:10.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T18:02:10.574 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-12T18:02:10.616 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:10.612+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:10.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T18:02:10.661 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:10.661 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:10.676 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:10.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T18:02:10.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:10.685 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-12T18:02:10.717 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:10.718+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:10.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:10.730 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-09-12T18:02:10.777 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T18:02:10.777 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-12T18:02:10.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T18:02:10.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T18:02:10.778 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-12T18:02:10.808 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:10.808 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:10.818 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:10.818+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:10.825 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:10.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T18:02:10.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T18:02:10.885 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T18:02:10.886 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T18:02:10.886 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-12T18:02:10.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T18:02:10.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T18:02:10.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T18:02:10.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T18:02:10.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T18:02:10.886 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-12T18:02:10.918 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:10.917+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:10.940 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:10.940 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:10.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:10.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T18:02:11.019 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:11.018+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T18:02:11.042 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T18:02:11.042 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-12T18:02:11.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-12T18:02:11.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T18:02:11.043 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-12T18:02:11.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T18:02:11.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T18:02:11.099 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T18:02:11.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T18:02:11.099 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:11.119 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:11.119 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:11.120 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:11.120+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:11.133 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:11.145 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T18:02:11.145 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T18:02:11.145 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:11.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-09-12T18:02:11.221 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:11.217+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:11.232 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:02:11.244 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T18:02:11.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:02:11.267 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:11.268 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:11.282 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:11.309 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-09-12T18:02:11.309 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-09-12T18:02:11.310 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T18:02:11.311 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T18:02:11.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:11.312 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-09-12T18:02:11.328 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:11.330+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:11.362 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T18:02:11.362 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T18:02:11.403 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:11.403 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:11.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-09-12T18:02:11.417 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:11.422 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:11.421+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:11.424 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T18:02:11.469 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2024-09-12T18:02:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T18:02:11.471 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2024-09-12T18:02:11.472 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-09-12T18:02:11.472 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-09-12T18:02:11.472 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-09-12T18:02:11.472 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T18:02:11.472 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T18:02:11.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:11.472 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-09-12T18:02:11.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:2024-09-12T18:02:11.492+0000 7fd83c34f580 -1 init, newargv = 0x55ba76a8aee0 newargc=15 2024-09-12T18:02:11.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[23648]: starting ceph client 2024-09-12T18:02:11.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[23648]: starting fuse 2024-09-12T18:02:11.522 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:11.522+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:11.577 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:11.578 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:11.592 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:11.636 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:11.638+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:11.724 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:11.724 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:11.724 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:11.721+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:11.738 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:11.825 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:11.821+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:11.859 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:11.859 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:11.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:11.925 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:11.924+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:11.995 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:11.995 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:12.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:12.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:12.027 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:12.026+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:12.128 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:12.128+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:12.142 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:12.142 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:12.156 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:12.173 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:12.173 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:12.194 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:12.194 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:12.212 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:12.212 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:12.228 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:12.225+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:12.239 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:02:12.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:02:12.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:02:12.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:12.278 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:12.278 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:12.278 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:12.278 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:12.278 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:12.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:12.330 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:12.330+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:12.430 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:12.429+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:12.466 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:12.466 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:12.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:12.466 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:12.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.466 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:12.466 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.927766512000002, 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:12.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.925462315000001, 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.471 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:12.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.922155267000001, 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:12.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.774767113999999, 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:12.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:12.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:12.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:12.486 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.774674051000002, 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:12.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:12.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.774631578000001, 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.492 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:12.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:12.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.774527352, 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:12.498 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:12.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.774491519000001, 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:12.504 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:12.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.7744605, 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:12.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:12.515 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.774409559999999, 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:12.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.774354487, 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:12.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.774320671000002, 2024-09-12T18:02:12.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:12.529 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.772977094000002, 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:12.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.772707676, 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:12.533 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:12.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:12.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.770947199999998, 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.538 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:12.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.770791545000002, 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:12.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.547 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.769035724999998, 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00051837900000000002, 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695531+0000", 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5460000000000001e-06 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695538+0000", 2024-09-12T18:02:12.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0700000000000001e-06 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695559+0000", 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1203999999999999e-05 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695577+0000", 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7785999999999999e-05 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695716+0000", 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013935299999999999 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695738+0000", 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1290000000000001e-05 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696048+0000", 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031012999999999999 2024-09-12T18:02:12.551 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.768631044999999, 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.552 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.556 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(mds.0.3:19 3.b e18/16 ondisk, result = 0)", 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.696645+0000", 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.767920140000001, 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00050144299999999996, 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696645+0000", 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696645+0000", 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696646+0000", 2024-09-12T18:02:12.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4100000000000001e-06 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696652+0000", 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9529999999999996e-06 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696669+0000", 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.649e-05 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696678+0000", 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2429999999999994e-06 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696859+0000", 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018141199999999999 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696879+0000", 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9530000000000001e-05 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697146+0000", 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026740500000000002 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.779416450999999, 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:12.561 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:12.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:12.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:12.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.566 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.567 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.567 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:12.567 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:12.567 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:12.568 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:12.569 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:12.570+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:12.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-09-12T18:02:12.614 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T18:02:12.621 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:12.623 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:12.625 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-09-12T18:02:12.625 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-09-12T18:02:12.625 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-09-12T18:02:12.625 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-09-12T18:02:12.625 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-09-12T18:02:12.625 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/run/lock 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/fs/nfsd 2024-09-12T18:02:12.626 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/run/rpc_pipefs 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T18:02:12.627 INFO:teuthology.orchestra.run.smithi052.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:12.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:12.628 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-09-12T18:02:12.640 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T18:02:12.563279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001199"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308558+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:01:58.308558+0000","last_peered":"2024-09-12T18:01:58.308558+0000","last_clean":"2024-09-12T18:01:58.308558+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:01:58.308558+0000","last_undegraded":"2024-09-12T18:01:58.308558+0000","last_fullsized":"2024-09-12T18:01:58.308558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308285+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:01:58.308285+0000","last_peered":"2024-09-12T18:01:58.308285+0000","last_clean":"2024-09-12T18:01:58.308285+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:01:58.308285+0000","last_undegraded":"2024-09-12T18:01:58.308285+0000","last_fullsized":"2024-09-12T18:01:58.308285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307148+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:01:58.307148+0000","last_peered":"2024-09-12T18:01:58.307148+0000","last_clean":"2024-09-12T18:01:58.307148+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:01:58.307148+0000","last_undegraded":"2024-09-12T18:01:58.307148+0000","last_fullsized":"2024-09-12T18:01:58.307148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307863+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:01:58.307863+0000","last_peered":"2024-09-12T18:01:58.307863+0000","last_clean":"2024-09-12T18:01:58.307863+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:01:58.307863+0000","last_undegraded":"2024-09-12T18:01:58.307863+0000","last_fullsized":"2024-09-12T18:01:58.307863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307179+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:01:58.307179+0000","last_peered":"2024-09-12T18:01:58.307179+0000","last_clean":"2024-09-12T18:01:58.307179+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:01:58.307179+0000","last_undegraded":"2024-09-12T18:01:58.307179+0000","last_fullsized":"2024-09-12T18:01:58.307179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306280+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:01:58.306280+0000","last_peered":"2024-09-12T18:01:58.306280+0000","last_clean":"2024-09-12T18:01:58.306280+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:01:58.306280+0000","last_undegraded":"2024-09-12T18:01:58.306280+0000","last_fullsized":"2024-09-12T18:01:58.306280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306438+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:01:58.306438+0000","last_peered":"2024-09-12T18:01:58.306438+0000","last_clean":"2024-09-12T18:01:58.306438+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:01:58.306438+0000","last_undegraded":"2024-09-12T18:01:58.306438+0000","last_fullsized":"2024-09-12T18:01:58.306438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305795+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:01:58.305795+0000","last_peered":"2024-09-12T18:01:58.305795+0000","last_clean":"2024-09-12T18:01:58.305795+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:01:58.305795+0000","last_undegraded":"2024-09-12T18:01:58.305795+0000","last_fullsized":"2024-09-12T18:01:58.305795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522943+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:01:58.522943+0000","last_peered":"2024-09-12T18:01:58.522943+0000","last_clean":"2024-09-12T18:01:58.522943+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:01:58.522943+0000","last_undegraded":"2024-09-12T18:01:58.522943+0000","last_fullsized":"2024-09-12T18:01:58.522943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308196+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:01:58.308196+0000","last_peered":"2024-09-12T18:01:58.308196+0000","last_clean":"2024-09-12T18:01:58.308196+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:01:58.308196+0000","last_undegraded":"2024-09-12T18:01:58.308196+0000","last_fullsized":"2024-09-12T18:01:58.308196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307608+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:01:58.307608+0000","last_peered":"2024-09-12T18:01:58.307608+0000","last_clean":"2024-09-12T18:01:58.307608+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:01:58.307608+0000","last_undegraded":"2024-09-12T18:01:58.307608+0000","last_fullsized":"2024-09-12T18:01:58.307608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307084+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:01:58.307084+0000","last_peered":"2024-09-12T18:01:58.307084+0000","last_clean":"2024-09-12T18:01:58.307084+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:01:58.307084+0000","last_undegraded":"2024-09-12T18:01:58.307084+0000","last_fullsized":"2024-09-12T18:01:58.307084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306901+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:01:58.306901+0000","last_peered":"2024-09-12T18:01:58.306901+0000","last_clean":"2024-09-12T18:01:58.306901+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:01:58.306901+0000","last_undegraded":"2024-09-12T18:01:58.306901+0000","last_fullsized":"2024-09-12T18:01:58.306901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306334+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:01:58.306334+0000","last_peered":"2024-09-12T18:01:58.306334+0000","last_clean":"2024-09-12T18:01:58.306334+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:01:58.306334+0000","last_undegraded":"2024-09-12T18:01:58.306334+0000","last_fullsized":"2024-09-12T18:01:58.306334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306757+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:01:58.306757+0000","last_peered":"2024-09-12T18:01:58.306757+0000","last_clean":"2024-09-12T18:01:58.306757+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:01:58.306757+0000","last_undegraded":"2024-09-12T18:01:58.306757+0000","last_fullsized":"2024-09-12T18:01:58.306757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305977+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:01:58.305977+0000","last_peered":"2024-09-12T18:01:58.305977+0000","last_clean":"2024-09-12T18:01:58.305977+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:01:58.305977+0000","last_undegraded":"2024-09-12T18:01:58.305977+0000","last_fullsized":"2024-09-12T18:01:58.305977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523801+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:01:58.523801+0000","last_peered":"2024-09-12T18:01:58.523801+0000","last_clean":"2024-09-12T18:01:58.523801+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:01:58.523801+0000","last_undegraded":"2024-09-12T18:01:58.523801+0000","last_fullsized":"2024-09-12T18:01:58.523801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308722+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:01:58.308722+0000","last_peered":"2024-09-12T18:01:58.308722+0000","last_clean":"2024-09-12T18:01:58.308722+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:01:58.308722+0000","last_undegraded":"2024-09-12T18:01:58.308722+0000","last_fullsized":"2024-09-12T18:01:58.308722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522685+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:01:58.522685+0000","last_peered":"2024-09-12T18:01:58.522685+0000","last_clean":"2024-09-12T18:01:58.522685+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:01:58.522685+0000","last_undegraded":"2024-09-12T18:01:58.522685+0000","last_fullsized":"2024-09-12T18:01:58.522685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308165+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:01:58.308165+0000","last_peered":"2024-09-12T18:01:58.308165+0000","last_clean":"2024-09-12T18:01:58.308165+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:01:58.308165+0000","last_undegraded":"2024-09-12T18:01:58.308165+0000","last_fullsized":"2024-09-12T18:01:58.308165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306938+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:01:58.306938+0000","last_peered":"2024-09-12T18:01:58.306938+0000","last_clean":"2024-09-12T18:01:58.306938+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:01:58.306938+0000","last_undegraded":"2024-09-12T18:01:58.306938+0000","last_fullsized":"2024-09-12T18:01:58.306938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307068+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:01:58.307068+0000","last_peered":"2024-09-12T18:01:58.307068+0000","last_clean":"2024-09-12T18:01:58.307068+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:01:58.307068+0000","last_undegraded":"2024-09-12T18:01:58.307068+0000","last_fullsized":"2024-09-12T18:01:58.307068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520263+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:01:58.520263+0000","last_peered":"2024-09-12T18:01:58.520263+0000","last_clean":"2024-09-12T18:01:58.520263+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:01:58.520263+0000","last_undegraded":"2024-09-12T18:01:58.520263+0000","last_fullsized":"2024-09-12T18:01:58.520263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306530+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:01:58.306530+0000","last_peered":"2024-09-12T18:01:58.306530+0000","last_clean":"2024-09-12T18:01:58.306530+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:01:58.306530+0000","last_undegraded":"2024-09-12T18:01:58.306530+0000","last_fullsized":"2024-09-12T18:01:58.306530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308760+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:01:58.308760+0000","last_peered":"2024-09-12T18:01:58.308760+0000","last_clean":"2024-09-12T18:01:58.308760+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:01:58.308760+0000","last_undegraded":"2024-09-12T18:01:58.308760+0000","last_fullsized":"2024-09-12T18:01:58.308760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523307+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:01:58.523307+0000","last_peered":"2024-09-12T18:01:58.523307+0000","last_clean":"2024-09-12T18:01:58.523307+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:01:58.523307+0000","last_undegraded":"2024-09-12T18:01:58.523307+0000","last_fullsized":"2024-09-12T18:01:58.523307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307840+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:01:58.307840+0000","last_peered":"2024-09-12T18:01:58.307840+0000","last_clean":"2024-09-12T18:01:58.307840+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:01:58.307840+0000","last_undegraded":"2024-09-12T18:01:58.307840+0000","last_fullsized":"2024-09-12T18:01:58.307840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308048+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:01:58.308048+0000","last_peered":"2024-09-12T18:01:58.308048+0000","last_clean":"2024-09-12T18:01:58.308048+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:01:58.308048+0000","last_undegraded":"2024-09-12T18:01:58.308048+0000","last_fullsized":"2024-09-12T18:01:58.308048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522201+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:01:58.522201+0000","last_peered":"2024-09-12T18:01:58.522201+0000","last_clean":"2024-09-12T18:01:58.522201+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:01:58.522201+0000","last_undegraded":"2024-09-12T18:01:58.522201+0000","last_fullsized":"2024-09-12T18:01:58.522201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307453+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:01:58.307453+0000","last_peered":"2024-09-12T18:01:58.307453+0000","last_clean":"2024-09-12T18:01:58.307453+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:01:58.307453+0000","last_undegraded":"2024-09-12T18:01:58.307453+0000","last_fullsized":"2024-09-12T18:01:58.307453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520383+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:01:58.520383+0000","last_peered":"2024-09-12T18:01:58.520383+0000","last_clean":"2024-09-12T18:01:58.520383+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:01:58.520383+0000","last_undegraded":"2024-09-12T18:01:58.520383+0000","last_fullsized":"2024-09-12T18:01:58.520383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306046+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:01:58.306046+0000","last_peered":"2024-09-12T18:01:58.306046+0000","last_clean":"2024-09-12T18:01:58.306046+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:01:58.306046+0000","last_undegraded":"2024-09-12T18:01:58.306046+0000","last_fullsized":"2024-09-12T18:01:58.306046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307713+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:01:58.307713+0000","last_peered":"2024-09-12T18:01:58.307713+0000","last_clean":"2024-09-12T18:01:58.307713+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:01:58.307713+0000","last_undegraded":"2024-09-12T18:01:58.307713+0000","last_fullsized":"2024-09-12T18:01:58.307713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307021+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:01:58.307021+0000","last_peered":"2024-09-12T18:01:58.307021+0000","last_clean":"2024-09-12T18:01:58.307021+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:01:58.307021+0000","last_undegraded":"2024-09-12T18:01:58.307021+0000","last_fullsized":"2024-09-12T18:01:58.307021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308169+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:01:58.308169+0000","last_peered":"2024-09-12T18:01:58.308169+0000","last_clean":"2024-09-12T18:01:58.308169+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:01:58.308169+0000","last_undegraded":"2024-09-12T18:01:58.308169+0000","last_fullsized":"2024-09-12T18:01:58.308169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521151+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:01:58.521151+0000","last_peered":"2024-09-12T18:01:58.521151+0000","last_clean":"2024-09-12T18:01:58.521151+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:01:58.521151+0000","last_undegraded":"2024-09-12T18:01:58.521151+0000","last_fullsized":"2024-09-12T18:01:58.521151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523536+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:01:58.523536+0000","last_peered":"2024-09-12T18:01:58.523536+0000","last_clean":"2024-09-12T18:01:58.523536+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:01:58.523536+0000","last_undegraded":"2024-09-12T18:01:58.523536+0000","last_fullsized":"2024-09-12T18:01:58.523536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306809+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:01:58.306809+0000","last_peered":"2024-09-12T18:01:58.306809+0000","last_clean":"2024-09-12T18:01:58.306809+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:01:58.306809+0000","last_undegraded":"2024-09-12T18:01:58.306809+0000","last_fullsized":"2024-09-12T18:01:58.306809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523210+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:01:58.523210+0000","last_peered":"2024-09-12T18:01:58.523210+0000","last_clean":"2024-09-12T18:01:58.523210+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:01:58.523210+0000","last_undegraded":"2024-09-12T18:01:58.523210+0000","last_fullsized":"2024-09-12T18:01:58.523210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306263+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:01:58.306263+0000","last_peered":"2024-09-12T18:01:58.306263+0000","last_clean":"2024-09-12T18:01:58.306263+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:01:58.306263+0000","last_undegraded":"2024-09-12T18:01:58.306263+0000","last_fullsized":"2024-09-12T18:01:58.306263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308667+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:01:58.308667+0000","last_peered":"2024-09-12T18:01:58.308667+0000","last_clean":"2024-09-12T18:01:58.308667+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:01:58.308667+0000","last_undegraded":"2024-09-12T18:01:58.308667+0000","last_fullsized":"2024-09-12T18:01:58.308667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306836+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:01:58.306836+0000","last_peered":"2024-09-12T18:01:58.306836+0000","last_clean":"2024-09-12T18:01:58.306836+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:01:58.306836+0000","last_undegraded":"2024-09-12T18:01:58.306836+0000","last_fullsized":"2024-09-12T18:01:58.306836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308728+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:01:58.308728+0000","last_peered":"2024-09-12T18:01:58.308728+0000","last_clean":"2024-09-12T18:01:58.308728+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:01:58.308728+0000","last_undegraded":"2024-09-12T18:01:58.308728+0000","last_fullsized":"2024-09-12T18:01:58.308728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306551+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:01:58.306551+0000","last_peered":"2024-09-12T18:01:58.306551+0000","last_clean":"2024-09-12T18:01:58.306551+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:01:58.306551+0000","last_undegraded":"2024-09-12T18:01:58.306551+0000","last_fullsized":"2024-09-12T18:01:58.306551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308374+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:01:58.308374+0000","last_peered":"2024-09-12T18:01:58.308374+0000","last_clean":"2024-09-12T18:01:58.308374+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:01:58.308374+0000","last_undegraded":"2024-09-12T18:01:58.308374+0000","last_fullsized":"2024-09-12T18:01:58.308374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306564+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:01:58.306564+0000","last_peered":"2024-09-12T18:01:58.306564+0000","last_clean":"2024-09-12T18:01:58.306564+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:01:58.306564+0000","last_undegraded":"2024-09-12T18:01:58.306564+0000","last_fullsized":"2024-09-12T18:01:58.306564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308773+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:01:58.308773+0000","last_peered":"2024-09-12T18:01:58.308773+0000","last_clean":"2024-09-12T18:01:58.308773+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:01:58.308773+0000","last_undegraded":"2024-09-12T18:01:58.308773+0000","last_fullsized":"2024-09-12T18:01:58.308773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521950+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:01:58.521950+0000","last_peered":"2024-09-12T18:01:58.521950+0000","last_clean":"2024-09-12T18:01:58.521950+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:01:58.521950+0000","last_undegraded":"2024-09-12T18:01:58.521950+0000","last_fullsized":"2024-09-12T18:01:58.521950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522420+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:01:58.522420+0000","last_peered":"2024-09-12T18:01:58.522420+0000","last_clean":"2024-09-12T18:01:58.522420+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:01:58.522420+0000","last_undegraded":"2024-09-12T18:01:58.522420+0000","last_fullsized":"2024-09-12T18:01:58.522420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308436+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:01:58.308436+0000","last_peered":"2024-09-12T18:01:58.308436+0000","last_clean":"2024-09-12T18:01:58.308436+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:01:58.308436+0000","last_undegraded":"2024-09-12T18:01:58.308436+0000","last_fullsized":"2024-09-12T18:01:58.308436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307114+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:01:58.307114+0000","last_peered":"2024-09-12T18:01:58.307114+0000","last_clean":"2024-09-12T18:01:58.307114+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:01:58.307114+0000","last_undegraded":"2024-09-12T18:01:58.307114+0000","last_fullsized":"2024-09-12T18:01:58.307114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308096+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:01:58.308096+0000","last_peered":"2024-09-12T18:01:58.308096+0000","last_clean":"2024-09-12T18:01:58.308096+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:01:58.308096+0000","last_undegraded":"2024-09-12T18:01:58.308096+0000","last_fullsized":"2024-09-12T18:01:58.308096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307081+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:01:58.307081+0000","last_peered":"2024-09-12T18:01:58.307081+0000","last_clean":"2024-09-12T18:01:58.307081+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:01:58.307081+0000","last_undegraded":"2024-09-12T18:01:58.307081+0000","last_fullsized":"2024-09-12T18:01:58.307081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307801+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:01:58.307801+0000","last_peered":"2024-09-12T18:01:58.307801+0000","last_clean":"2024-09-12T18:01:58.307801+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:01:58.307801+0000","last_undegraded":"2024-09-12T18:01:58.307801+0000","last_fullsized":"2024-09-12T18:01:58.307801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306861+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:01:58.306861+0000","last_peered":"2024-09-12T18:01:58.306861+0000","last_clean":"2024-09-12T18:01:58.306861+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:01:58.306861+0000","last_undegraded":"2024-09-12T18:01:58.306861+0000","last_fullsized":"2024-09-12T18:01:58.306861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523209+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:01:58.523209+0000","last_peered":"2024-09-12T18:01:58.523209+0000","last_clean":"2024-09-12T18:01:58.523209+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:01:58.523209+0000","last_undegraded":"2024-09-12T18:01:58.523209+0000","last_fullsized":"2024-09-12T18:01:58.523209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307284+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:01:58.307284+0000","last_peered":"2024-09-12T18:01:58.307284+0000","last_clean":"2024-09-12T18:01:58.307284+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:01:58.307284+0000","last_undegraded":"2024-09-12T18:01:58.307284+0000","last_fullsized":"2024-09-12T18:01:58.307284+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307391+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:01:58.307391+0000","last_peered":"2024-09-12T18:01:58.307391+0000","last_clean":"2024-09-12T18:01:58.307391+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:01:58.307391+0000","last_undegraded":"2024-09-12T18:01:58.307391+0000","last_fullsized":"2024-09-12T18:01:58.307391+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521347+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:01:58.521347+0000","last_peered":"2024-09-12T18:01:58.521347+0000","last_clean":"2024-09-12T18:01:58.521347+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:01:58.521347+0000","last_undegraded":"2024-09-12T18:01:58.521347+0000","last_fullsized":"2024-09-12T18:01:58.521347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308303+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:01:58.308303+0000","last_peered":"2024-09-12T18:01:58.308303+0000","last_clean":"2024-09-12T18:01:58.308303+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:01:58.308303+0000","last_undegraded":"2024-09-12T18:01:58.308303+0000","last_fullsized":"2024-09-12T18:01:58.308303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306710+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:01:58.306710+0000","last_peered":"2024-09-12T18:01:58.306710+0000","last_clean":"2024-09-12T18:01:58.306710+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:01:58.306710+0000","last_undegraded":"2024-09-12T18:01:58.306710+0000","last_fullsized":"2024-09-12T18:01:58.306710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520927+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:01:58.520927+0000","last_peered":"2024-09-12T18:01:58.520927+0000","last_clean":"2024-09-12T18:01:58.520927+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:01:58.520927+0000","last_undegraded":"2024-09-12T18:01:58.520927+0000","last_fullsized":"2024-09-12T18:01:58.520927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308440+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:01:58.308440+0000","last_peered":"2024-09-12T18:01:58.308440+0000","last_clean":"2024-09-12T18:01:58.308440+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:01:58.308440+0000","last_undegraded":"2024-09-12T18:01:58.308440+0000","last_fullsized":"2024-09-12T18:01:58.308440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521264+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:01:58.521264+0000","last_peered":"2024-09-12T18:01:58.521264+0000","last_clean":"2024-09-12T18:01:58.521264+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:01:58.521264+0000","last_undegraded":"2024-09-12T18:01:58.521264+0000","last_fullsized":"2024-09-12T18:01:58.521264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307103+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:01:58.307103+0000","last_peered":"2024-09-12T18:01:58.307103+0000","last_clean":"2024-09-12T18:01:58.307103+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:01:58.307103+0000","last_undegraded":"2024-09-12T18:01:58.307103+0000","last_fullsized":"2024-09-12T18:01:58.307103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523358+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:01:58.523358+0000","last_peered":"2024-09-12T18:01:58.523358+0000","last_clean":"2024-09-12T18:01:58.523358+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:01:58.523358+0000","last_undegraded":"2024-09-12T18:01:58.523358+0000","last_fullsized":"2024-09-12T18:01:58.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307334+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:01:58.307334+0000","last_peered":"2024-09-12T18:01:58.307334+0000","last_clean":"2024-09-12T18:01:58.307334+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:01:58.307334+0000","last_undegraded":"2024-09-12T18:01:58.307334+0000","last_fullsized":"2024-09-12T18:01:58.307334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307283+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:01:58.307283+0000","last_peered":"2024-09-12T18:01:58.307283+0000","last_clean":"2024-09-12T18:01:58.307283+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:01:58.307283+0000","last_undegraded":"2024-09-12T18:01:58.307283+0000","last_fullsized":"2024-09-12T18:01:58.307283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522497+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:01:58.522497+0000","last_peered":"2024-09-12T18:01:58.522497+0000","last_clean":"2024-09-12T18:01:58.522497+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:01:58.522497+0000","last_undegraded":"2024-09-12T18:01:58.522497+0000","last_fullsized":"2024-09-12T18:01:58.522497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308613+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:01:58.308613+0000","last_peered":"2024-09-12T18:01:58.308613+0000","last_clean":"2024-09-12T18:01:58.308613+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:01:58.308613+0000","last_undegraded":"2024-09-12T18:01:58.308613+0000","last_fullsized":"2024-09-12T18:01:58.308613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522819+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:01:58.522819+0000","last_peered":"2024-09-12T18:01:58.522819+0000","last_clean":"2024-09-12T18:01:58.522819+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:01:58.522819+0000","last_undegraded":"2024-09-12T18:01:58.522819+0000","last_fullsized":"2024-09-12T18:01:58.522819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307143+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:01:58.307143+0000","last_peered":"2024-09-12T18:01:58.307143+0000","last_clean":"2024-09-12T18:01:58.307143+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:01:58.307143+0000","last_undegraded":"2024-09-12T18:01:58.307143+0000","last_fullsized":"2024-09-12T18:01:58.307143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522522+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:01:58.522522+0000","last_peered":"2024-09-12T18:01:58.522522+0000","last_clean":"2024-09-12T18:01:58.522522+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:01:58.522522+0000","last_undegraded":"2024-09-12T18:01:58.522522+0000","last_fullsized":"2024-09-12T18:01:58.522522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308821+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:01:58.308821+0000","last_peered":"2024-09-12T18:01:58.308821+0000","last_clean":"2024-09-12T18:01:58.308821+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:01:58.308821+0000","last_undegraded":"2024-09-12T18:01:58.308821+0000","last_fullsized":"2024-09-12T18:01:58.308821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307004+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:01:58.307004+0000","last_peered":"2024-09-12T18:01:58.307004+0000","last_clean":"2024-09-12T18:01:58.307004+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:01:58.307004+0000","last_undegraded":"2024-09-12T18:01:58.307004+0000","last_fullsized":"2024-09-12T18:01:58.307004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523799+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:01:58.523799+0000","last_peered":"2024-09-12T18:01:58.523799+0000","last_clean":"2024-09-12T18:01:58.523799+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:01:58.523799+0000","last_undegraded":"2024-09-12T18:01:58.523799+0000","last_fullsized":"2024-09-12T18:01:58.523799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523895+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:01:58.523895+0000","last_peered":"2024-09-12T18:01:58.523895+0000","last_clean":"2024-09-12T18:01:58.523895+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:01:58.523895+0000","last_undegraded":"2024-09-12T18:01:58.523895+0000","last_fullsized":"2024-09-12T18:01:58.523895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520611+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:01:58.520611+0000","last_peered":"2024-09-12T18:01:58.520611+0000","last_clean":"2024-09-12T18:01:58.520611+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:01:58.520611+0000","last_undegraded":"2024-09-12T18:01:58.520611+0000","last_fullsized":"2024-09-12T18:01:58.520611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523802+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:01:58.523802+0000","last_peered":"2024-09-12T18:01:58.523802+0000","last_clean":"2024-09-12T18:01:58.523802+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:01:58.523802+0000","last_undegraded":"2024-09-12T18:01:58.523802+0000","last_fullsized":"2024-09-12T18:01:58.523802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308763+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:01:58.308763+0000","last_peered":"2024-09-12T18:01:58.308763+0000","last_clean":"2024-09-12T18:01:58.308763+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:01:58.308763+0000","last_undegraded":"2024-09-12T18:01:58.308763+0000","last_fullsized":"2024-09-12T18:01:58.308763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306540+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:01:58.306540+0000","last_peered":"2024-09-12T18:01:58.306540+0000","last_clean":"2024-09-12T18:01:58.306540+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:01:58.306540+0000","last_undegraded":"2024-09-12T18:01:58.306540+0000","last_fullsized":"2024-09-12T18:01:58.306540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306657+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:01:58.306657+0000","last_peered":"2024-09-12T18:01:58.306657+0000","last_clean":"2024-09-12T18:01:58.306657+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:01:58.306657+0000","last_undegraded":"2024-09-12T18:01:58.306657+0000","last_fullsized":"2024-09-12T18:01:58.306657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308692+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:01:58.308692+0000","last_peered":"2024-09-12T18:01:58.308692+0000","last_clean":"2024-09-12T18:01:58.308692+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:01:58.308692+0000","last_undegraded":"2024-09-12T18:01:58.308692+0000","last_fullsized":"2024-09-12T18:01:58.308692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520948+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:01:58.520948+0000","last_peered":"2024-09-12T18:01:58.520948+0000","last_clean":"2024-09-12T18:01:58.520948+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:01:58.520948+0000","last_undegraded":"2024-09-12T18:01:58.520948+0000","last_fullsized":"2024-09-12T18:01:58.520948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308438+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:01:58.308438+0000","last_peered":"2024-09-12T18:01:58.308438+0000","last_clean":"2024-09-12T18:01:58.308438+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:01:58.308438+0000","last_undegraded":"2024-09-12T18:01:58.308438+0000","last_fullsized":"2024-09-12T18:01:58.308438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307996+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:01:58.307996+0000","last_peered":"2024-09-12T18:01:58.307996+0000","last_clean":"2024-09-12T18:01:58.307996+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:01:58.307996+0000","last_undegraded":"2024-09-12T18:01:58.307996+0000","last_fullsized":"2024-09-12T18:01:58.307996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520540+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:01:58.520540+0000","last_peered":"2024-09-12T18:01:58.520540+0000","last_clean":"2024-09-12T18:01:58.520540+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:01:58.520540+0000","last_undegraded":"2024-09-12T18:01:58.520540+0000","last_fullsized":"2024-09-12T18:01:58.520540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523593+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:01:58.523593+0000","last_peered":"2024-09-12T18:01:58.523593+0000","last_clean":"2024-09-12T18:01:58.523593+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:01:58.523593+0000","last_undegraded":"2024-09-12T18:01:58.523593+0000","last_fullsized":"2024-09-12T18:01:58.523593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520359+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:01:58.520359+0000","last_peered":"2024-09-12T18:01:58.520359+0000","last_clean":"2024-09-12T18:01:58.520359+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:01:58.520359+0000","last_undegraded":"2024-09-12T18:01:58.520359+0000","last_fullsized":"2024-09-12T18:01:58.520359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308770+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:01:58.308770+0000","last_peered":"2024-09-12T18:01:58.308770+0000","last_clean":"2024-09-12T18:01:58.308770+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:01:58.308770+0000","last_undegraded":"2024-09-12T18:01:58.308770+0000","last_fullsized":"2024-09-12T18:01:58.308770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520712+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:01:58.520712+0000","last_peered":"2024-09-12T18:01:58.520712+0000","last_clean":"2024-09-12T18:01:58.520712+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:01:58.520712+0000","last_undegraded":"2024-09-12T18:01:58.520712+0000","last_fullsized":"2024-09-12T18:01:58.520712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523105+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:01:58.523105+0000","last_peered":"2024-09-12T18:01:58.523105+0000","last_clean":"2024-09-12T18:01:58.523105+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:01:58.523105+0000","last_undegraded":"2024-09-12T18:01:58.523105+0000","last_fullsized":"2024-09-12T18:01:58.523105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520913+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:01:58.520913+0000","last_peered":"2024-09-12T18:01:58.520913+0000","last_clean":"2024-09-12T18:01:58.520913+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:01:58.520913+0000","last_undegraded":"2024-09-12T18:01:58.520913+0000","last_fullsized":"2024-09-12T18:01:58.520913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307918+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:01:58.307918+0000","last_peered":"2024-09-12T18:01:58.307918+0000","last_clean":"2024-09-12T18:01:58.307918+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:01:58.307918+0000","last_undegraded":"2024-09-12T18:01:58.307918+0000","last_fullsized":"2024-09-12T18:01:58.307918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307691+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:01:58.307691+0000","last_peered":"2024-09-12T18:01:58.307691+0000","last_clean":"2024-09-12T18:01:58.307691+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:01:58.307691+0000","last_undegraded":"2024-09-12T18:01:58.307691+0000","last_fullsized":"2024-09-12T18:01:58.307691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307440+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:01:58.307440+0000","last_peered":"2024-09-12T18:01:58.307440+0000","last_clean":"2024-09-12T18:01:58.307440+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:01:58.307440+0000","last_undegraded":"2024-09-12T18:01:58.307440+0000","last_fullsized":"2024-09-12T18:01:58.307440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307331+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:01:58.307331+0000","last_peered":"2024-09-12T18:01:58.307331+0000","last_clean":"2024-09-12T18:01:58.307331+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:01:58.307331+0000","last_undegraded":"2024-09-12T18:01:58.307331+0000","last_fullsized":"2024-09-12T18:01:58.307331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306520+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:01:58.306520+0000","last_peered":"2024-09-12T18:01:58.306520+0000","last_clean":"2024-09-12T18:01:58.306520+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:01:58.306520+0000","last_undegraded":"2024-09-12T18:01:58.306520+0000","last_fullsized":"2024-09-12T18:01:58.306520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308501+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:01:58.308501+0000","last_peered":"2024-09-12T18:01:58.308501+0000","last_clean":"2024-09-12T18:01:58.308501+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:01:58.308501+0000","last_undegraded":"2024-09-12T18:01:58.308501+0000","last_fullsized":"2024-09-12T18:01:58.308501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306832+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:01:58.306832+0000","last_peered":"2024-09-12T18:01:58.306832+0000","last_clean":"2024-09-12T18:01:58.306832+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:01:58.306832+0000","last_undegraded":"2024-09-12T18:01:58.306832+0000","last_fullsized":"2024-09-12T18:01:58.306832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308276+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:01:58.308276+0000","last_peered":"2024-09-12T18:01:58.308276+0000","last_clean":"2024-09-12T18:01:58.308276+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:01:58.308276+0000","last_undegraded":"2024-09-12T18:01:58.308276+0000","last_fullsized":"2024-09-12T18:01:58.308276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307335+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:01:58.307335+0000","last_peered":"2024-09-12T18:01:58.307335+0000","last_clean":"2024-09-12T18:01:58.307335+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:01:58.307335+0000","last_undegraded":"2024-09-12T18:01:58.307335+0000","last_fullsized":"2024-09-12T18:01:58.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523494+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:01:58.523494+0000","last_peered":"2024-09-12T18:01:58.523494+0000","last_clean":"2024-09-12T18:01:58.523494+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:01:58.523494+0000","last_undegraded":"2024-09-12T18:01:58.523494+0000","last_fullsized":"2024-09-12T18:01:58.523494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307856+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:01:58.307856+0000","last_peered":"2024-09-12T18:01:58.307856+0000","last_clean":"2024-09-12T18:01:58.307856+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:01:58.307856+0000","last_undegraded":"2024-09-12T18:01:58.307856+0000","last_fullsized":"2024-09-12T18:01:58.307856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523461+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:01:58.523461+0000","last_peered":"2024-09-12T18:01:58.523461+0000","last_clean":"2024-09-12T18:01:58.523461+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:01:58.523461+0000","last_undegraded":"2024-09-12T18:01:58.523461+0000","last_fullsized":"2024-09-12T18:01:58.523461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:12.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:12.669 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:12.669+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:12.685 INFO:teuthology.orchestra.run.smithi052.stdout:45 2024-09-12T18:02:12.685 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T18:02:12.685 DEBUG:teuthology.orchestra.run.smithi052:> sudo stdin-killer -- python3 -c ' 2024-09-12T18:02:12.685 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2024-09-12T18:02:12.685 DEBUG:teuthology.orchestra.run.smithi052:> import re 2024-09-12T18:02:12.685 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T18:02:12.686 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T18:02:12.687 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T18:02:12.687 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2024-09-12T18:02:12.687 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2024-09-12T18:02:12.687 DEBUG:teuthology.orchestra.run.smithi052:> return f 2024-09-12T18:02:12.687 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T18:02:12.687 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-12T18:02:12.687 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.0")) 2024-09-12T18:02:12.687 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-12T18:02:12.699 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:12.700 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:12.700 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:12.700 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:12.714 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:12.770 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:12.770+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:12.801 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.0.23648.asok 2024-09-12T18:02:12.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-12T18:02:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T18:02:12.813 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.23648.asok 2024-09-12T18:02:12.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:12.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.23648.asok status 2024-09-12T18:02:12.834 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:12.834 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:12.834 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:12.834 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:12.834 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:12.850 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:12.873 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:12.869+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:12.968 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "46406987da2067f022005d68ecbb989daaabb837", 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.3.0-4870-g46406987 (46406987da2067f022005d68ecbb989daaabb837) squid (dev)", 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "0", 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "23648", 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4587, 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2024-09-12T18:02:12.969 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 4587 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3167685230 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3167685230 2024-09-12T18:02:12.970 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.4587 192.168.0.1:0/3167685230", 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.1:0/3167685230", 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 6, 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 22, 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2024-09-12T18:02:12.971 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:02:12.974 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:12.973+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:12.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:12.983 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2024-09-12T18:02:12.983 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:12.989 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2024-09-12T18:02:12.989 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:12.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:02:12.989 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:13.000 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:13.002 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:13.011 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:02:13.025 INFO:tasks.workunit:Pulling workunits from ref 0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-12T18:02:13.026 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:02:13.026 INFO:tasks.workunit:timeout=3h 2024-09-12T18:02:13.026 INFO:tasks.workunit:cleanup=True 2024-09-12T18:02:13.027 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:13.028 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T18:02:12.563279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":192,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90112,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025408,"statfs":{"total":289910292480,"available":289818017792,"internally_reserved":0,"allocated":720896,"data_stored":1375416,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001199"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308558+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:01:58.308558+0000","last_peered":"2024-09-12T18:01:58.308558+0000","last_clean":"2024-09-12T18:01:58.308558+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:01:58.308558+0000","last_undegraded":"2024-09-12T18:01:58.308558+0000","last_fullsized":"2024-09-12T18:01:58.308558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308285+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:01:58.308285+0000","last_peered":"2024-09-12T18:01:58.308285+0000","last_clean":"2024-09-12T18:01:58.308285+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:01:58.308285+0000","last_undegraded":"2024-09-12T18:01:58.308285+0000","last_fullsized":"2024-09-12T18:01:58.308285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307148+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:01:58.307148+0000","last_peered":"2024-09-12T18:01:58.307148+0000","last_clean":"2024-09-12T18:01:58.307148+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:01:58.307148+0000","last_undegraded":"2024-09-12T18:01:58.307148+0000","last_fullsized":"2024-09-12T18:01:58.307148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307863+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:01:58.307863+0000","last_peered":"2024-09-12T18:01:58.307863+0000","last_clean":"2024-09-12T18:01:58.307863+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:01:58.307863+0000","last_undegraded":"2024-09-12T18:01:58.307863+0000","last_fullsized":"2024-09-12T18:01:58.307863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307179+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:01:58.307179+0000","last_peered":"2024-09-12T18:01:58.307179+0000","last_clean":"2024-09-12T18:01:58.307179+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:01:58.307179+0000","last_undegraded":"2024-09-12T18:01:58.307179+0000","last_fullsized":"2024-09-12T18:01:58.307179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306280+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:01:58.306280+0000","last_peered":"2024-09-12T18:01:58.306280+0000","last_clean":"2024-09-12T18:01:58.306280+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:01:58.306280+0000","last_undegraded":"2024-09-12T18:01:58.306280+0000","last_fullsized":"2024-09-12T18:01:58.306280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306438+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:01:58.306438+0000","last_peered":"2024-09-12T18:01:58.306438+0000","last_clean":"2024-09-12T18:01:58.306438+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:01:58.306438+0000","last_undegraded":"2024-09-12T18:01:58.306438+0000","last_fullsized":"2024-09-12T18:01:58.306438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305795+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:01:58.305795+0000","last_peered":"2024-09-12T18:01:58.305795+0000","last_clean":"2024-09-12T18:01:58.305795+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:01:58.305795+0000","last_undegraded":"2024-09-12T18:01:58.305795+0000","last_fullsized":"2024-09-12T18:01:58.305795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522943+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:01:58.522943+0000","last_peered":"2024-09-12T18:01:58.522943+0000","last_clean":"2024-09-12T18:01:58.522943+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:01:58.522943+0000","last_undegraded":"2024-09-12T18:01:58.522943+0000","last_fullsized":"2024-09-12T18:01:58.522943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308196+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:01:58.308196+0000","last_peered":"2024-09-12T18:01:58.308196+0000","last_clean":"2024-09-12T18:01:58.308196+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:01:58.308196+0000","last_undegraded":"2024-09-12T18:01:58.308196+0000","last_fullsized":"2024-09-12T18:01:58.308196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307608+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:01:58.307608+0000","last_peered":"2024-09-12T18:01:58.307608+0000","last_clean":"2024-09-12T18:01:58.307608+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:01:58.307608+0000","last_undegraded":"2024-09-12T18:01:58.307608+0000","last_fullsized":"2024-09-12T18:01:58.307608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307084+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:01:58.307084+0000","last_peered":"2024-09-12T18:01:58.307084+0000","last_clean":"2024-09-12T18:01:58.307084+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:01:58.307084+0000","last_undegraded":"2024-09-12T18:01:58.307084+0000","last_fullsized":"2024-09-12T18:01:58.307084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306901+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:01:58.306901+0000","last_peered":"2024-09-12T18:01:58.306901+0000","last_clean":"2024-09-12T18:01:58.306901+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:01:58.306901+0000","last_undegraded":"2024-09-12T18:01:58.306901+0000","last_fullsized":"2024-09-12T18:01:58.306901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306334+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:01:58.306334+0000","last_peered":"2024-09-12T18:01:58.306334+0000","last_clean":"2024-09-12T18:01:58.306334+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:01:58.306334+0000","last_undegraded":"2024-09-12T18:01:58.306334+0000","last_fullsized":"2024-09-12T18:01:58.306334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306757+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:01:58.306757+0000","last_peered":"2024-09-12T18:01:58.306757+0000","last_clean":"2024-09-12T18:01:58.306757+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:01:58.306757+0000","last_undegraded":"2024-09-12T18:01:58.306757+0000","last_fullsized":"2024-09-12T18:01:58.306757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.305977+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:01:58.305977+0000","last_peered":"2024-09-12T18:01:58.305977+0000","last_clean":"2024-09-12T18:01:58.305977+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:01:58.305977+0000","last_undegraded":"2024-09-12T18:01:58.305977+0000","last_fullsized":"2024-09-12T18:01:58.305977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523801+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:01:58.523801+0000","last_peered":"2024-09-12T18:01:58.523801+0000","last_clean":"2024-09-12T18:01:58.523801+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:01:58.523801+0000","last_undegraded":"2024-09-12T18:01:58.523801+0000","last_fullsized":"2024-09-12T18:01:58.523801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308722+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:01:58.308722+0000","last_peered":"2024-09-12T18:01:58.308722+0000","last_clean":"2024-09-12T18:01:58.308722+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:01:58.308722+0000","last_undegraded":"2024-09-12T18:01:58.308722+0000","last_fullsized":"2024-09-12T18:01:58.308722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522685+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:01:58.522685+0000","last_peered":"2024-09-12T18:01:58.522685+0000","last_clean":"2024-09-12T18:01:58.522685+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:01:58.522685+0000","last_undegraded":"2024-09-12T18:01:58.522685+0000","last_fullsized":"2024-09-12T18:01:58.522685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308165+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:01:58.308165+0000","last_peered":"2024-09-12T18:01:58.308165+0000","last_clean":"2024-09-12T18:01:58.308165+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:01:58.308165+0000","last_undegraded":"2024-09-12T18:01:58.308165+0000","last_fullsized":"2024-09-12T18:01:58.308165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306938+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:01:58.306938+0000","last_peered":"2024-09-12T18:01:58.306938+0000","last_clean":"2024-09-12T18:01:58.306938+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:01:58.306938+0000","last_undegraded":"2024-09-12T18:01:58.306938+0000","last_fullsized":"2024-09-12T18:01:58.306938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307068+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:01:58.307068+0000","last_peered":"2024-09-12T18:01:58.307068+0000","last_clean":"2024-09-12T18:01:58.307068+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:01:58.307068+0000","last_undegraded":"2024-09-12T18:01:58.307068+0000","last_fullsized":"2024-09-12T18:01:58.307068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520263+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:01:58.520263+0000","last_peered":"2024-09-12T18:01:58.520263+0000","last_clean":"2024-09-12T18:01:58.520263+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:01:58.520263+0000","last_undegraded":"2024-09-12T18:01:58.520263+0000","last_fullsized":"2024-09-12T18:01:58.520263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306530+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:01:58.306530+0000","last_peered":"2024-09-12T18:01:58.306530+0000","last_clean":"2024-09-12T18:01:58.306530+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:01:58.306530+0000","last_undegraded":"2024-09-12T18:01:58.306530+0000","last_fullsized":"2024-09-12T18:01:58.306530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308760+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:01:58.308760+0000","last_peered":"2024-09-12T18:01:58.308760+0000","last_clean":"2024-09-12T18:01:58.308760+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:01:58.308760+0000","last_undegraded":"2024-09-12T18:01:58.308760+0000","last_fullsized":"2024-09-12T18:01:58.308760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523307+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:01:58.523307+0000","last_peered":"2024-09-12T18:01:58.523307+0000","last_clean":"2024-09-12T18:01:58.523307+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:01:58.523307+0000","last_undegraded":"2024-09-12T18:01:58.523307+0000","last_fullsized":"2024-09-12T18:01:58.523307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307840+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:01:58.307840+0000","last_peered":"2024-09-12T18:01:58.307840+0000","last_clean":"2024-09-12T18:01:58.307840+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:01:58.307840+0000","last_undegraded":"2024-09-12T18:01:58.307840+0000","last_fullsized":"2024-09-12T18:01:58.307840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308048+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:01:58.308048+0000","last_peered":"2024-09-12T18:01:58.308048+0000","last_clean":"2024-09-12T18:01:58.308048+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:01:58.308048+0000","last_undegraded":"2024-09-12T18:01:58.308048+0000","last_fullsized":"2024-09-12T18:01:58.308048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522201+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:01:58.522201+0000","last_peered":"2024-09-12T18:01:58.522201+0000","last_clean":"2024-09-12T18:01:58.522201+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:01:58.522201+0000","last_undegraded":"2024-09-12T18:01:58.522201+0000","last_fullsized":"2024-09-12T18:01:58.522201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307453+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:01:58.307453+0000","last_peered":"2024-09-12T18:01:58.307453+0000","last_clean":"2024-09-12T18:01:58.307453+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:01:58.307453+0000","last_undegraded":"2024-09-12T18:01:58.307453+0000","last_fullsized":"2024-09-12T18:01:58.307453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520383+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:01:58.520383+0000","last_peered":"2024-09-12T18:01:58.520383+0000","last_clean":"2024-09-12T18:01:58.520383+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:01:58.520383+0000","last_undegraded":"2024-09-12T18:01:58.520383+0000","last_fullsized":"2024-09-12T18:01:58.520383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306046+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:01:58.306046+0000","last_peered":"2024-09-12T18:01:58.306046+0000","last_clean":"2024-09-12T18:01:58.306046+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:01:58.306046+0000","last_undegraded":"2024-09-12T18:01:58.306046+0000","last_fullsized":"2024-09-12T18:01:58.306046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307713+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:01:58.307713+0000","last_peered":"2024-09-12T18:01:58.307713+0000","last_clean":"2024-09-12T18:01:58.307713+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:01:58.307713+0000","last_undegraded":"2024-09-12T18:01:58.307713+0000","last_fullsized":"2024-09-12T18:01:58.307713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307021+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:01:58.307021+0000","last_peered":"2024-09-12T18:01:58.307021+0000","last_clean":"2024-09-12T18:01:58.307021+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:01:58.307021+0000","last_undegraded":"2024-09-12T18:01:58.307021+0000","last_fullsized":"2024-09-12T18:01:58.307021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308169+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:01:58.308169+0000","last_peered":"2024-09-12T18:01:58.308169+0000","last_clean":"2024-09-12T18:01:58.308169+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:01:58.308169+0000","last_undegraded":"2024-09-12T18:01:58.308169+0000","last_fullsized":"2024-09-12T18:01:58.308169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521151+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:01:58.521151+0000","last_peered":"2024-09-12T18:01:58.521151+0000","last_clean":"2024-09-12T18:01:58.521151+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:01:58.521151+0000","last_undegraded":"2024-09-12T18:01:58.521151+0000","last_fullsized":"2024-09-12T18:01:58.521151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523536+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:01:58.523536+0000","last_peered":"2024-09-12T18:01:58.523536+0000","last_clean":"2024-09-12T18:01:58.523536+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:01:58.523536+0000","last_undegraded":"2024-09-12T18:01:58.523536+0000","last_fullsized":"2024-09-12T18:01:58.523536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306809+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:01:58.306809+0000","last_peered":"2024-09-12T18:01:58.306809+0000","last_clean":"2024-09-12T18:01:58.306809+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:01:58.306809+0000","last_undegraded":"2024-09-12T18:01:58.306809+0000","last_fullsized":"2024-09-12T18:01:58.306809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523210+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:01:58.523210+0000","last_peered":"2024-09-12T18:01:58.523210+0000","last_clean":"2024-09-12T18:01:58.523210+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:01:58.523210+0000","last_undegraded":"2024-09-12T18:01:58.523210+0000","last_fullsized":"2024-09-12T18:01:58.523210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306263+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:01:58.306263+0000","last_peered":"2024-09-12T18:01:58.306263+0000","last_clean":"2024-09-12T18:01:58.306263+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:01:58.306263+0000","last_undegraded":"2024-09-12T18:01:58.306263+0000","last_fullsized":"2024-09-12T18:01:58.306263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308667+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:01:58.308667+0000","last_peered":"2024-09-12T18:01:58.308667+0000","last_clean":"2024-09-12T18:01:58.308667+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:01:58.308667+0000","last_undegraded":"2024-09-12T18:01:58.308667+0000","last_fullsized":"2024-09-12T18:01:58.308667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306836+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:01:58.306836+0000","last_peered":"2024-09-12T18:01:58.306836+0000","last_clean":"2024-09-12T18:01:58.306836+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:01:58.306836+0000","last_undegraded":"2024-09-12T18:01:58.306836+0000","last_fullsized":"2024-09-12T18:01:58.306836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308728+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:01:58.308728+0000","last_peered":"2024-09-12T18:01:58.308728+0000","last_clean":"2024-09-12T18:01:58.308728+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:01:58.308728+0000","last_undegraded":"2024-09-12T18:01:58.308728+0000","last_fullsized":"2024-09-12T18:01:58.308728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306551+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:01:58.306551+0000","last_peered":"2024-09-12T18:01:58.306551+0000","last_clean":"2024-09-12T18:01:58.306551+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:01:58.306551+0000","last_undegraded":"2024-09-12T18:01:58.306551+0000","last_fullsized":"2024-09-12T18:01:58.306551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308374+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:01:58.308374+0000","last_peered":"2024-09-12T18:01:58.308374+0000","last_clean":"2024-09-12T18:01:58.308374+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:01:58.308374+0000","last_undegraded":"2024-09-12T18:01:58.308374+0000","last_fullsized":"2024-09-12T18:01:58.308374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306564+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:01:58.306564+0000","last_peered":"2024-09-12T18:01:58.306564+0000","last_clean":"2024-09-12T18:01:58.306564+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:01:58.306564+0000","last_undegraded":"2024-09-12T18:01:58.306564+0000","last_fullsized":"2024-09-12T18:01:58.306564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308773+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:01:58.308773+0000","last_peered":"2024-09-12T18:01:58.308773+0000","last_clean":"2024-09-12T18:01:58.308773+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:01:58.308773+0000","last_undegraded":"2024-09-12T18:01:58.308773+0000","last_fullsized":"2024-09-12T18:01:58.308773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521950+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:01:58.521950+0000","last_peered":"2024-09-12T18:01:58.521950+0000","last_clean":"2024-09-12T18:01:58.521950+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:01:58.521950+0000","last_undegraded":"2024-09-12T18:01:58.521950+0000","last_fullsized":"2024-09-12T18:01:58.521950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522420+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:01:58.522420+0000","last_peered":"2024-09-12T18:01:58.522420+0000","last_clean":"2024-09-12T18:01:58.522420+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:01:58.522420+0000","last_undegraded":"2024-09-12T18:01:58.522420+0000","last_fullsized":"2024-09-12T18:01:58.522420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308436+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:01:58.308436+0000","last_peered":"2024-09-12T18:01:58.308436+0000","last_clean":"2024-09-12T18:01:58.308436+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:01:58.308436+0000","last_undegraded":"2024-09-12T18:01:58.308436+0000","last_fullsized":"2024-09-12T18:01:58.308436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307114+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:01:58.307114+0000","last_peered":"2024-09-12T18:01:58.307114+0000","last_clean":"2024-09-12T18:01:58.307114+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:01:58.307114+0000","last_undegraded":"2024-09-12T18:01:58.307114+0000","last_fullsized":"2024-09-12T18:01:58.307114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308096+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:01:58.308096+0000","last_peered":"2024-09-12T18:01:58.308096+0000","last_clean":"2024-09-12T18:01:58.308096+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:01:58.308096+0000","last_undegraded":"2024-09-12T18:01:58.308096+0000","last_fullsized":"2024-09-12T18:01:58.308096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307081+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:01:58.307081+0000","last_peered":"2024-09-12T18:01:58.307081+0000","last_clean":"2024-09-12T18:01:58.307081+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:01:58.307081+0000","last_undegraded":"2024-09-12T18:01:58.307081+0000","last_fullsized":"2024-09-12T18:01:58.307081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307801+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:01:58.307801+0000","last_peered":"2024-09-12T18:01:58.307801+0000","last_clean":"2024-09-12T18:01:58.307801+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:01:58.307801+0000","last_undegraded":"2024-09-12T18:01:58.307801+0000","last_fullsized":"2024-09-12T18:01:58.307801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306861+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:01:58.306861+0000","last_peered":"2024-09-12T18:01:58.306861+0000","last_clean":"2024-09-12T18:01:58.306861+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:01:58.306861+0000","last_undegraded":"2024-09-12T18:01:58.306861+0000","last_fullsized":"2024-09-12T18:01:58.306861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523209+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:01:58.523209+0000","last_peered":"2024-09-12T18:01:58.523209+0000","last_clean":"2024-09-12T18:01:58.523209+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:01:58.523209+0000","last_undegraded":"2024-09-12T18:01:58.523209+0000","last_fullsized":"2024-09-12T18:01:58.523209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307284+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:01:58.307284+0000","last_peered":"2024-09-12T18:01:58.307284+0000","last_clean":"2024-09-12T18:01:58.307284+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:01:58.307284+0000","last_undegraded":"2024-09-12T18:01:58.307284+0000","last_fullsized":"2024-09-12T18:01:58.307284+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307391+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:01:58.307391+0000","last_peered":"2024-09-12T18:01:58.307391+0000","last_clean":"2024-09-12T18:01:58.307391+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:01:58.307391+0000","last_undegraded":"2024-09-12T18:01:58.307391+0000","last_fullsized":"2024-09-12T18:01:58.307391+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521347+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:01:58.521347+0000","last_peered":"2024-09-12T18:01:58.521347+0000","last_clean":"2024-09-12T18:01:58.521347+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:01:58.521347+0000","last_undegraded":"2024-09-12T18:01:58.521347+0000","last_fullsized":"2024-09-12T18:01:58.521347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308303+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:01:58.308303+0000","last_peered":"2024-09-12T18:01:58.308303+0000","last_clean":"2024-09-12T18:01:58.308303+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:01:58.308303+0000","last_undegraded":"2024-09-12T18:01:58.308303+0000","last_fullsized":"2024-09-12T18:01:58.308303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306710+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:01:58.306710+0000","last_peered":"2024-09-12T18:01:58.306710+0000","last_clean":"2024-09-12T18:01:58.306710+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:01:58.306710+0000","last_undegraded":"2024-09-12T18:01:58.306710+0000","last_fullsized":"2024-09-12T18:01:58.306710+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520927+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:01:58.520927+0000","last_peered":"2024-09-12T18:01:58.520927+0000","last_clean":"2024-09-12T18:01:58.520927+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:01:58.520927+0000","last_undegraded":"2024-09-12T18:01:58.520927+0000","last_fullsized":"2024-09-12T18:01:58.520927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308440+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:01:58.308440+0000","last_peered":"2024-09-12T18:01:58.308440+0000","last_clean":"2024-09-12T18:01:58.308440+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:01:58.308440+0000","last_undegraded":"2024-09-12T18:01:58.308440+0000","last_fullsized":"2024-09-12T18:01:58.308440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.521264+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:01:58.521264+0000","last_peered":"2024-09-12T18:01:58.521264+0000","last_clean":"2024-09-12T18:01:58.521264+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:01:58.521264+0000","last_undegraded":"2024-09-12T18:01:58.521264+0000","last_fullsized":"2024-09-12T18:01:58.521264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307103+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:01:58.307103+0000","last_peered":"2024-09-12T18:01:58.307103+0000","last_clean":"2024-09-12T18:01:58.307103+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:01:58.307103+0000","last_undegraded":"2024-09-12T18:01:58.307103+0000","last_fullsized":"2024-09-12T18:01:58.307103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523358+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:01:58.523358+0000","last_peered":"2024-09-12T18:01:58.523358+0000","last_clean":"2024-09-12T18:01:58.523358+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:01:58.523358+0000","last_undegraded":"2024-09-12T18:01:58.523358+0000","last_fullsized":"2024-09-12T18:01:58.523358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307334+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:01:58.307334+0000","last_peered":"2024-09-12T18:01:58.307334+0000","last_clean":"2024-09-12T18:01:58.307334+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:01:58.307334+0000","last_undegraded":"2024-09-12T18:01:58.307334+0000","last_fullsized":"2024-09-12T18:01:58.307334+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307283+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:01:58.307283+0000","last_peered":"2024-09-12T18:01:58.307283+0000","last_clean":"2024-09-12T18:01:58.307283+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:01:58.307283+0000","last_undegraded":"2024-09-12T18:01:58.307283+0000","last_fullsized":"2024-09-12T18:01:58.307283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522497+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:01:58.522497+0000","last_peered":"2024-09-12T18:01:58.522497+0000","last_clean":"2024-09-12T18:01:58.522497+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:01:58.522497+0000","last_undegraded":"2024-09-12T18:01:58.522497+0000","last_fullsized":"2024-09-12T18:01:58.522497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308613+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:01:58.308613+0000","last_peered":"2024-09-12T18:01:58.308613+0000","last_clean":"2024-09-12T18:01:58.308613+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:01:58.308613+0000","last_undegraded":"2024-09-12T18:01:58.308613+0000","last_fullsized":"2024-09-12T18:01:58.308613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522819+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:01:58.522819+0000","last_peered":"2024-09-12T18:01:58.522819+0000","last_clean":"2024-09-12T18:01:58.522819+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:01:58.522819+0000","last_undegraded":"2024-09-12T18:01:58.522819+0000","last_fullsized":"2024-09-12T18:01:58.522819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307143+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:01:58.307143+0000","last_peered":"2024-09-12T18:01:58.307143+0000","last_clean":"2024-09-12T18:01:58.307143+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:01:58.307143+0000","last_undegraded":"2024-09-12T18:01:58.307143+0000","last_fullsized":"2024-09-12T18:01:58.307143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.522522+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:01:58.522522+0000","last_peered":"2024-09-12T18:01:58.522522+0000","last_clean":"2024-09-12T18:01:58.522522+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:01:58.522522+0000","last_undegraded":"2024-09-12T18:01:58.522522+0000","last_fullsized":"2024-09-12T18:01:58.522522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308821+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:01:58.308821+0000","last_peered":"2024-09-12T18:01:58.308821+0000","last_clean":"2024-09-12T18:01:58.308821+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:01:58.308821+0000","last_undegraded":"2024-09-12T18:01:58.308821+0000","last_fullsized":"2024-09-12T18:01:58.308821+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307004+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:01:58.307004+0000","last_peered":"2024-09-12T18:01:58.307004+0000","last_clean":"2024-09-12T18:01:58.307004+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:01:58.307004+0000","last_undegraded":"2024-09-12T18:01:58.307004+0000","last_fullsized":"2024-09-12T18:01:58.307004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523799+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:01:58.523799+0000","last_peered":"2024-09-12T18:01:58.523799+0000","last_clean":"2024-09-12T18:01:58.523799+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:01:58.523799+0000","last_undegraded":"2024-09-12T18:01:58.523799+0000","last_fullsized":"2024-09-12T18:01:58.523799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523895+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:01:58.523895+0000","last_peered":"2024-09-12T18:01:58.523895+0000","last_clean":"2024-09-12T18:01:58.523895+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:01:58.523895+0000","last_undegraded":"2024-09-12T18:01:58.523895+0000","last_fullsized":"2024-09-12T18:01:58.523895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520611+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:01:58.520611+0000","last_peered":"2024-09-12T18:01:58.520611+0000","last_clean":"2024-09-12T18:01:58.520611+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:01:58.520611+0000","last_undegraded":"2024-09-12T18:01:58.520611+0000","last_fullsized":"2024-09-12T18:01:58.520611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523802+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:01:58.523802+0000","last_peered":"2024-09-12T18:01:58.523802+0000","last_clean":"2024-09-12T18:01:58.523802+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:01:58.523802+0000","last_undegraded":"2024-09-12T18:01:58.523802+0000","last_fullsized":"2024-09-12T18:01:58.523802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308763+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:01:58.308763+0000","last_peered":"2024-09-12T18:01:58.308763+0000","last_clean":"2024-09-12T18:01:58.308763+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:01:58.308763+0000","last_undegraded":"2024-09-12T18:01:58.308763+0000","last_fullsized":"2024-09-12T18:01:58.308763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306540+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:01:58.306540+0000","last_peered":"2024-09-12T18:01:58.306540+0000","last_clean":"2024-09-12T18:01:58.306540+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:01:58.306540+0000","last_undegraded":"2024-09-12T18:01:58.306540+0000","last_fullsized":"2024-09-12T18:01:58.306540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306657+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:01:58.306657+0000","last_peered":"2024-09-12T18:01:58.306657+0000","last_clean":"2024-09-12T18:01:58.306657+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:01:58.306657+0000","last_undegraded":"2024-09-12T18:01:58.306657+0000","last_fullsized":"2024-09-12T18:01:58.306657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308692+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:01:58.308692+0000","last_peered":"2024-09-12T18:01:58.308692+0000","last_clean":"2024-09-12T18:01:58.308692+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:01:58.308692+0000","last_undegraded":"2024-09-12T18:01:58.308692+0000","last_fullsized":"2024-09-12T18:01:58.308692+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520948+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:01:58.520948+0000","last_peered":"2024-09-12T18:01:58.520948+0000","last_clean":"2024-09-12T18:01:58.520948+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:01:58.520948+0000","last_undegraded":"2024-09-12T18:01:58.520948+0000","last_fullsized":"2024-09-12T18:01:58.520948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308438+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:01:58.308438+0000","last_peered":"2024-09-12T18:01:58.308438+0000","last_clean":"2024-09-12T18:01:58.308438+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:01:58.308438+0000","last_undegraded":"2024-09-12T18:01:58.308438+0000","last_fullsized":"2024-09-12T18:01:58.308438+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307996+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:01:58.307996+0000","last_peered":"2024-09-12T18:01:58.307996+0000","last_clean":"2024-09-12T18:01:58.307996+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:01:58.307996+0000","last_undegraded":"2024-09-12T18:01:58.307996+0000","last_fullsized":"2024-09-12T18:01:58.307996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520540+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:01:58.520540+0000","last_peered":"2024-09-12T18:01:58.520540+0000","last_clean":"2024-09-12T18:01:58.520540+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:01:58.520540+0000","last_undegraded":"2024-09-12T18:01:58.520540+0000","last_fullsized":"2024-09-12T18:01:58.520540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523593+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:01:58.523593+0000","last_peered":"2024-09-12T18:01:58.523593+0000","last_clean":"2024-09-12T18:01:58.523593+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:01:58.523593+0000","last_undegraded":"2024-09-12T18:01:58.523593+0000","last_fullsized":"2024-09-12T18:01:58.523593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520359+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:01:58.520359+0000","last_peered":"2024-09-12T18:01:58.520359+0000","last_clean":"2024-09-12T18:01:58.520359+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:01:58.520359+0000","last_undegraded":"2024-09-12T18:01:58.520359+0000","last_fullsized":"2024-09-12T18:01:58.520359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308770+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:01:58.308770+0000","last_peered":"2024-09-12T18:01:58.308770+0000","last_clean":"2024-09-12T18:01:58.308770+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:01:58.308770+0000","last_undegraded":"2024-09-12T18:01:58.308770+0000","last_fullsized":"2024-09-12T18:01:58.308770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520712+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:01:58.520712+0000","last_peered":"2024-09-12T18:01:58.520712+0000","last_clean":"2024-09-12T18:01:58.520712+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:01:58.520712+0000","last_undegraded":"2024-09-12T18:01:58.520712+0000","last_fullsized":"2024-09-12T18:01:58.520712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523105+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:01:58.523105+0000","last_peered":"2024-09-12T18:01:58.523105+0000","last_clean":"2024-09-12T18:01:58.523105+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:01:58.523105+0000","last_undegraded":"2024-09-12T18:01:58.523105+0000","last_fullsized":"2024-09-12T18:01:58.523105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.520913+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:01:58.520913+0000","last_peered":"2024-09-12T18:01:58.520913+0000","last_clean":"2024-09-12T18:01:58.520913+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:01:58.520913+0000","last_undegraded":"2024-09-12T18:01:58.520913+0000","last_fullsized":"2024-09-12T18:01:58.520913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307918+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:01:58.307918+0000","last_peered":"2024-09-12T18:01:58.307918+0000","last_clean":"2024-09-12T18:01:58.307918+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:01:58.307918+0000","last_undegraded":"2024-09-12T18:01:58.307918+0000","last_fullsized":"2024-09-12T18:01:58.307918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307691+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:01:58.307691+0000","last_peered":"2024-09-12T18:01:58.307691+0000","last_clean":"2024-09-12T18:01:58.307691+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:01:58.307691+0000","last_undegraded":"2024-09-12T18:01:58.307691+0000","last_fullsized":"2024-09-12T18:01:58.307691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307440+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:01:58.307440+0000","last_peered":"2024-09-12T18:01:58.307440+0000","last_clean":"2024-09-12T18:01:58.307440+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:01:58.307440+0000","last_undegraded":"2024-09-12T18:01:58.307440+0000","last_fullsized":"2024-09-12T18:01:58.307440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307331+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:01:58.307331+0000","last_peered":"2024-09-12T18:01:58.307331+0000","last_clean":"2024-09-12T18:01:58.307331+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:01:58.307331+0000","last_undegraded":"2024-09-12T18:01:58.307331+0000","last_fullsized":"2024-09-12T18:01:58.307331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306520+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:01:58.306520+0000","last_peered":"2024-09-12T18:01:58.306520+0000","last_clean":"2024-09-12T18:01:58.306520+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:01:58.306520+0000","last_undegraded":"2024-09-12T18:01:58.306520+0000","last_fullsized":"2024-09-12T18:01:58.306520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308501+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:01:58.308501+0000","last_peered":"2024-09-12T18:01:58.308501+0000","last_clean":"2024-09-12T18:01:58.308501+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:01:58.308501+0000","last_undegraded":"2024-09-12T18:01:58.308501+0000","last_fullsized":"2024-09-12T18:01:58.308501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.306832+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:01:58.306832+0000","last_peered":"2024-09-12T18:01:58.306832+0000","last_clean":"2024-09-12T18:01:58.306832+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:01:58.306832+0000","last_undegraded":"2024-09-12T18:01:58.306832+0000","last_fullsized":"2024-09-12T18:01:58.306832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.308276+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:01:58.308276+0000","last_peered":"2024-09-12T18:01:58.308276+0000","last_clean":"2024-09-12T18:01:58.308276+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:01:58.308276+0000","last_undegraded":"2024-09-12T18:01:58.308276+0000","last_fullsized":"2024-09-12T18:01:58.308276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307335+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:01:58.307335+0000","last_peered":"2024-09-12T18:01:58.307335+0000","last_clean":"2024-09-12T18:01:58.307335+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:01:58.307335+0000","last_undegraded":"2024-09-12T18:01:58.307335+0000","last_fullsized":"2024-09-12T18:01:58.307335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523494+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:01:58.523494+0000","last_peered":"2024-09-12T18:01:58.523494+0000","last_clean":"2024-09-12T18:01:58.523494+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:01:58.523494+0000","last_undegraded":"2024-09-12T18:01:58.523494+0000","last_fullsized":"2024-09-12T18:01:58.523494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.307856+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:01:58.307856+0000","last_peered":"2024-09-12T18:01:58.307856+0000","last_clean":"2024-09-12T18:01:58.307856+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:01:58.307856+0000","last_undegraded":"2024-09-12T18:01:58.307856+0000","last_fullsized":"2024-09-12T18:01:58.307856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T18:01:58.523461+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:01:58.523461+0000","last_peered":"2024-09-12T18:01:58.523461+0000","last_clean":"2024-09-12T18:01:58.523461+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:01:58.523461+0000","last_undegraded":"2024-09-12T18:01:58.523461+0000","last_fullsized":"2024-09-12T18:01:58.523461+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":63909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":655436,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":656071,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:13.032 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:02:13.032 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:02:13.032 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:02:13.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:02:13.033 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.37618239, 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.034 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:13.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:13.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.376065342, 2024-09-12T18:02:13.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:13.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:13.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:13.046 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.375775273999999, 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:13.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.375592686000001, 2024-09-12T18:02:13.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:13.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:13.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.058 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.374905818999999, 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:13.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.064 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.374759309000002, 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.070 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.374671887000002, 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:13.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:13.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.076 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.269476438000002, 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:13.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:13.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:13.082 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.269393382000001, 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:13.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:13.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.269325063, 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:13.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:13.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:13.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.269146024000001, 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.095 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:13.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:13.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:13.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.164819421000001, 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:13.101 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:13.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:13.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:13.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:13.107 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.164773422, 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:13.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:13.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:13.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:13.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.164655978999999, 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.114 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:13.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:13.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.060424704999999, 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.120 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:13.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:13.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:13.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.060391092, 2024-09-12T18:02:13.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:13.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.060221689999999, 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:13.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.138 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.060182477000001, 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:13.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:13.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.144 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.06013841, 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:13.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:13.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.060020090999998, 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:13.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:13.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:13.156 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:13.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:13.159 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:13.156+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:13.164 INFO:teuthology.orchestra.run.smithi052.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:13.164 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T18:02:13.164 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-09-12T18:02:13.164 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:02:13.164 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T18:02:13.164 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-12 18:01:55.683021523 +0000 2024-09-12T18:02:13.164 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-12 18:02:13.011046710 +0000 2024-09-12T18:02:13.164 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-12T18:02:13.165 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:02:13.165 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T18:02:13.228 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-12T18:02:13.245 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:02:13.251 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:02:13.258 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:13.258+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:13.290 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:13.291 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:13.291 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:13.291 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:13.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:13.359 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:13.357+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:13.420 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:13.420 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:13.420 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:13.420 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:13.420 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:13.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:13.473 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "da5a949a-216b-4267-953a-8d92e3d25b1d", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-09-12T18:01:33.537080+0000", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-09-12T18:02:13.237344+0000", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-09-12T18:01:42.466111+0000", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-09-12T18:01:34.442067+0000", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5806080, 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "nodeep-scrub", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "noscrub", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-09-12T18:02:13.474 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "jewel", 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "squid", 2024-09-12T18:02:13.475 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:42.598261+0000", 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:13.476 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:13.477 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:13.478 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:13.479 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:13.480 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:13.481 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.482 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:48.792102+0000", 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 8193, 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:13.484 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:13.485 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "15", 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 2, 2024-09-12T18:02:13.486 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 15, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:13.487 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:13.488 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:13.489 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:53.545540+0000", 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:13.490 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-09-12T18:02:13.491 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:13.492 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:13.493 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:13.494 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:13.495 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:13.496 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:54.024396+0000", 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:13.497 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-09-12T18:02:13.498 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "19", 2024-09-12T18:02:13.499 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:13.500 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.501 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-09-12T18:02:13.502 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:13.503 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "f692452d-28b8-4aad-928e-fe1805e23b68", 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:13.504 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6800", 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:13.505 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6801", 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6802", 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:13.506 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6803", 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6806", 2024-09-12T18:02:13.507 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6807", 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6804", 2024-09-12T18:02:13.508 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6805", 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.111:6801/177809282", 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.111:6803/177809282", 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.111:6807/177809282", 2024-09-12T18:02:13.509 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.111:6805/177809282", 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "b5b3807e-e3b5-4530-adc6-af19dd31e340", 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:13.510 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.511 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6800", 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6801", 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:13.512 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6802", 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6803", 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:13.513 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6806", 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6807", 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:13.514 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6804", 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6805", 2024-09-12T18:02:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.121:6801/3534339867", 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.121:6803/3534339867", 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.121:6807/3534339867", 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.121:6805/3534339867", 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "926e4870-279e-45c7-9d6c-5841397a5e6c", 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6800", 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6801", 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6802", 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6803", 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.519 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6806", 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6807", 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.520 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6804", 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6805", 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.521 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.153:6801/284634690", 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.153:6803/284634690", 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.153:6807/284634690", 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.153:6805/284634690", 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:13.522 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.382866+0000", 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:13.523 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.379192+0000", 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.336708+0000", 2024-09-12T18:02:13.524 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [], 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-09-12T18:02:13.525 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-09-12T18:02:13.526 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:02:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:02:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-09-12T18:02:13.527 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:13.527 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:02:13.528 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:13.480+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:13.529 INFO:tasks.thrashosds.thrasher:j is {'epoch': 24, 'fsid': 'da5a949a-216b-4267-953a-8d92e3d25b1d', 'created': '2024-09-12T18:01:33.537080+0000', 'modified': '2024-09-12T18:02:13.237344+0000', 'last_up_change': '2024-09-12T18:01:42.466111+0000', 'last_in_change': '2024-09-12T18:01:34.442067+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:01:42.598261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:01:48.792102+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:01:53.545540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:01:54.024396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f692452d-28b8-4aad-928e-fe1805e23b68', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 177809282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 177809282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 177809282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 177809282}]}, 'public_addr': '172.21.15.111:6801/177809282', 'cluster_addr': '172.21.15.111:6803/177809282', 'heartbeat_back_addr': '172.21.15.111:6807/177809282', 'heartbeat_front_addr': '172.21.15.111:6805/177809282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'b5b3807e-e3b5-4530-adc6-af19dd31e340', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6800', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6801', 'nonce': 3534339867}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6802', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6803', 'nonce': 3534339867}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6806', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6807', 'nonce': 3534339867}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6804', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6805', 'nonce': 3534339867}]}, 'public_addr': '172.21.15.121:6801/3534339867', 'cluster_addr': '172.21.15.121:6803/3534339867', 'heartbeat_back_addr': '172.21.15.121:6807/3534339867', 'heartbeat_front_addr': '172.21.15.121:6805/3534339867', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '926e4870-279e-45c7-9d6c-5841397a5e6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 284634690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 284634690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 284634690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 284634690}]}, 'public_addr': '172.21.15.153:6801/284634690', 'cluster_addr': '172.21.15.153:6803/284634690', 'heartbeat_back_addr': '172.21.15.153:6807/284634690', 'heartbeat_front_addr': '172.21.15.153:6805/284634690', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.382866+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.379192+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.336708+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:02:13.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:13.554 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:13.554 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:13.554 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.909850130999999, 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:13.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.556 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.909176945999999, 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.559 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.560 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.561 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:13.563 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.908567844, 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.565 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:13.566 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:13.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:13.568 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.908040531000001, 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:13.571 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.907599494999999, 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.573 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:13.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:13.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.906821450999999, 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:13.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.580 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.581 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.906329484, 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.582 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.583 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:13.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:13.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.586 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.905761926, 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:13.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.591 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.905257509999998, 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:13.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:13.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.904780236000001, 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.596 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:13.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.904334404, 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:13.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:13.605 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.903793348000001, 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:13.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.903454910000001, 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.610 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.614 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 28.802611499000001, 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:13.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.617 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:13.619 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 17.863371978, 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:13.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:13.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 17.863252529, 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:13.625 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:13.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.630 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 17.86307729, 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.631 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:13.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:13.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.636 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 17.86301344, 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:13.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:13.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:13.642 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 17.862894757999999, 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:13.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:13.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 17.862826945999998, 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:13.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:13.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:13.652 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:13.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:13.654 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:13.654+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:13.755 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:13.753+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:13.788 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:13.788 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:13.788 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:13.788 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:13.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:13.849 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:13.850 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:13.856 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:13.856+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:13.869 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-12T18:02:13.243276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":194,"num_write_kb":2690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90176,"kb_used_data":760,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025344,"statfs":{"total":289910292480,"available":289817952256,"internally_reserved":0,"allocated":778240,"data_stored":1405838,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":441,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.680719"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244180+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:02:12.244180+0000","last_peered":"2024-09-12T18:02:12.244180+0000","last_clean":"2024-09-12T18:02:12.244180+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:02:12.244180+0000","last_undegraded":"2024-09-12T18:02:12.244180+0000","last_fullsized":"2024-09-12T18:02:12.244180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243953+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:02:12.243953+0000","last_peered":"2024-09-12T18:02:12.243953+0000","last_clean":"2024-09-12T18:02:12.243953+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:02:12.243953+0000","last_undegraded":"2024-09-12T18:02:12.243953+0000","last_fullsized":"2024-09-12T18:02:12.243953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244141+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:02:12.244141+0000","last_peered":"2024-09-12T18:02:12.244141+0000","last_clean":"2024-09-12T18:02:12.244141+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:02:12.244141+0000","last_undegraded":"2024-09-12T18:02:12.244141+0000","last_fullsized":"2024-09-12T18:02:12.244141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244158+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:02:12.244158+0000","last_peered":"2024-09-12T18:02:12.244158+0000","last_clean":"2024-09-12T18:02:12.244158+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:02:12.244158+0000","last_undegraded":"2024-09-12T18:02:12.244158+0000","last_fullsized":"2024-09-12T18:02:12.244158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243504+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:02:12.243504+0000","last_peered":"2024-09-12T18:02:12.243504+0000","last_clean":"2024-09-12T18:02:12.243504+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:02:12.243504+0000","last_undegraded":"2024-09-12T18:02:12.243504+0000","last_fullsized":"2024-09-12T18:02:12.243504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243344+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:02:12.243344+0000","last_peered":"2024-09-12T18:02:12.243344+0000","last_clean":"2024-09-12T18:02:12.243344+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:02:12.243344+0000","last_undegraded":"2024-09-12T18:02:12.243344+0000","last_fullsized":"2024-09-12T18:02:12.243344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243555+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:02:12.243555+0000","last_peered":"2024-09-12T18:02:12.243555+0000","last_clean":"2024-09-12T18:02:12.243555+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:02:12.243555+0000","last_undegraded":"2024-09-12T18:02:12.243555+0000","last_fullsized":"2024-09-12T18:02:12.243555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242925+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:02:12.242925+0000","last_peered":"2024-09-12T18:02:12.242925+0000","last_clean":"2024-09-12T18:02:12.242925+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:02:12.242925+0000","last_undegraded":"2024-09-12T18:02:12.242925+0000","last_fullsized":"2024-09-12T18:02:12.242925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.622459+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:02:11.622459+0000","last_peered":"2024-09-12T18:02:11.622459+0000","last_clean":"2024-09-12T18:02:11.622459+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:02:11.622459+0000","last_undegraded":"2024-09-12T18:02:11.622459+0000","last_fullsized":"2024-09-12T18:02:11.622459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243897+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:02:12.243897+0000","last_peered":"2024-09-12T18:02:12.243897+0000","last_clean":"2024-09-12T18:02:12.243897+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:02:12.243897+0000","last_undegraded":"2024-09-12T18:02:12.243897+0000","last_fullsized":"2024-09-12T18:02:12.243897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244650+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:02:12.244650+0000","last_peered":"2024-09-12T18:02:12.244650+0000","last_clean":"2024-09-12T18:02:12.244650+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:02:12.244650+0000","last_undegraded":"2024-09-12T18:02:12.244650+0000","last_fullsized":"2024-09-12T18:02:12.244650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243158+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:02:12.243158+0000","last_peered":"2024-09-12T18:02:12.243158+0000","last_clean":"2024-09-12T18:02:12.243158+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:02:12.243158+0000","last_undegraded":"2024-09-12T18:02:12.243158+0000","last_fullsized":"2024-09-12T18:02:12.243158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242860+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:02:12.242860+0000","last_peered":"2024-09-12T18:02:12.242860+0000","last_clean":"2024-09-12T18:02:12.242860+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:02:12.242860+0000","last_undegraded":"2024-09-12T18:02:12.242860+0000","last_fullsized":"2024-09-12T18:02:12.242860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243457+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:02:12.243457+0000","last_peered":"2024-09-12T18:02:12.243457+0000","last_clean":"2024-09-12T18:02:12.243457+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:02:12.243457+0000","last_undegraded":"2024-09-12T18:02:12.243457+0000","last_fullsized":"2024-09-12T18:02:12.243457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243864+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:02:12.243864+0000","last_peered":"2024-09-12T18:02:12.243864+0000","last_clean":"2024-09-12T18:02:12.243864+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:02:12.243864+0000","last_undegraded":"2024-09-12T18:02:12.243864+0000","last_fullsized":"2024-09-12T18:02:12.243864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243132+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:02:12.243132+0000","last_peered":"2024-09-12T18:02:12.243132+0000","last_clean":"2024-09-12T18:02:12.243132+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:02:12.243132+0000","last_undegraded":"2024-09-12T18:02:12.243132+0000","last_fullsized":"2024-09-12T18:02:12.243132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621630+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:02:11.621630+0000","last_peered":"2024-09-12T18:02:11.621630+0000","last_clean":"2024-09-12T18:02:11.621630+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:02:11.621630+0000","last_undegraded":"2024-09-12T18:02:11.621630+0000","last_fullsized":"2024-09-12T18:02:11.621630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244404+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:02:12.244404+0000","last_peered":"2024-09-12T18:02:12.244404+0000","last_clean":"2024-09-12T18:02:12.244404+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:02:12.244404+0000","last_undegraded":"2024-09-12T18:02:12.244404+0000","last_fullsized":"2024-09-12T18:02:12.244404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.620838+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:02:11.620838+0000","last_peered":"2024-09-12T18:02:11.620838+0000","last_clean":"2024-09-12T18:02:11.620838+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:02:11.620838+0000","last_undegraded":"2024-09-12T18:02:11.620838+0000","last_fullsized":"2024-09-12T18:02:11.620838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244248+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:02:12.244248+0000","last_peered":"2024-09-12T18:02:12.244248+0000","last_clean":"2024-09-12T18:02:12.244248+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:02:12.244248+0000","last_undegraded":"2024-09-12T18:02:12.244248+0000","last_fullsized":"2024-09-12T18:02:12.244248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244269+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:02:12.244269+0000","last_peered":"2024-09-12T18:02:12.244269+0000","last_clean":"2024-09-12T18:02:12.244269+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:02:12.244269+0000","last_undegraded":"2024-09-12T18:02:12.244269+0000","last_fullsized":"2024-09-12T18:02:12.244269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242580+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:02:12.242580+0000","last_peered":"2024-09-12T18:02:12.242580+0000","last_clean":"2024-09-12T18:02:12.242580+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:02:12.242580+0000","last_undegraded":"2024-09-12T18:02:12.242580+0000","last_fullsized":"2024-09-12T18:02:12.242580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621207+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:02:11.621207+0000","last_peered":"2024-09-12T18:02:11.621207+0000","last_clean":"2024-09-12T18:02:11.621207+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:02:11.621207+0000","last_undegraded":"2024-09-12T18:02:11.621207+0000","last_fullsized":"2024-09-12T18:02:11.621207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242000+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:02:12.242000+0000","last_peered":"2024-09-12T18:02:12.242000+0000","last_clean":"2024-09-12T18:02:12.242000+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:02:12.242000+0000","last_undegraded":"2024-09-12T18:02:12.242000+0000","last_fullsized":"2024-09-12T18:02:12.242000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244243+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:02:12.244243+0000","last_peered":"2024-09-12T18:02:12.244243+0000","last_clean":"2024-09-12T18:02:12.244243+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:02:12.244243+0000","last_undegraded":"2024-09-12T18:02:12.244243+0000","last_fullsized":"2024-09-12T18:02:12.244243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621813+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:02:11.621813+0000","last_peered":"2024-09-12T18:02:11.621813+0000","last_clean":"2024-09-12T18:02:11.621813+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:02:11.621813+0000","last_undegraded":"2024-09-12T18:02:11.621813+0000","last_fullsized":"2024-09-12T18:02:11.621813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245325+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:02:12.245325+0000","last_peered":"2024-09-12T18:02:12.245325+0000","last_clean":"2024-09-12T18:02:12.245325+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:02:12.245325+0000","last_undegraded":"2024-09-12T18:02:12.245325+0000","last_fullsized":"2024-09-12T18:02:12.245325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243782+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:02:12.243782+0000","last_peered":"2024-09-12T18:02:12.243782+0000","last_clean":"2024-09-12T18:02:12.243782+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:02:12.243782+0000","last_undegraded":"2024-09-12T18:02:12.243782+0000","last_fullsized":"2024-09-12T18:02:12.243782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.620833+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:02:11.620833+0000","last_peered":"2024-09-12T18:02:11.620833+0000","last_clean":"2024-09-12T18:02:11.620833+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:02:11.620833+0000","last_undegraded":"2024-09-12T18:02:11.620833+0000","last_fullsized":"2024-09-12T18:02:11.620833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243231+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:02:12.243231+0000","last_peered":"2024-09-12T18:02:12.243231+0000","last_clean":"2024-09-12T18:02:12.243231+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:02:12.243231+0000","last_undegraded":"2024-09-12T18:02:12.243231+0000","last_fullsized":"2024-09-12T18:02:12.243231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.620863+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:02:11.620863+0000","last_peered":"2024-09-12T18:02:11.620863+0000","last_clean":"2024-09-12T18:02:11.620863+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:02:11.620863+0000","last_undegraded":"2024-09-12T18:02:11.620863+0000","last_fullsized":"2024-09-12T18:02:11.620863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243218+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:02:12.243218+0000","last_peered":"2024-09-12T18:02:12.243218+0000","last_clean":"2024-09-12T18:02:12.243218+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:02:12.243218+0000","last_undegraded":"2024-09-12T18:02:12.243218+0000","last_fullsized":"2024-09-12T18:02:12.243218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243446+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:02:12.243446+0000","last_peered":"2024-09-12T18:02:12.243446+0000","last_clean":"2024-09-12T18:02:12.243446+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:02:12.243446+0000","last_undegraded":"2024-09-12T18:02:12.243446+0000","last_fullsized":"2024-09-12T18:02:12.243446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244357+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:02:12.244357+0000","last_peered":"2024-09-12T18:02:12.244357+0000","last_clean":"2024-09-12T18:02:12.244357+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:02:12.244357+0000","last_undegraded":"2024-09-12T18:02:12.244357+0000","last_fullsized":"2024-09-12T18:02:12.244357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243567+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:02:12.243567+0000","last_peered":"2024-09-12T18:02:12.243567+0000","last_clean":"2024-09-12T18:02:12.243567+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:02:12.243567+0000","last_undegraded":"2024-09-12T18:02:12.243567+0000","last_fullsized":"2024-09-12T18:02:12.243567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.624149+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:02:11.624149+0000","last_peered":"2024-09-12T18:02:11.624149+0000","last_clean":"2024-09-12T18:02:11.624149+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:02:11.624149+0000","last_undegraded":"2024-09-12T18:02:11.624149+0000","last_fullsized":"2024-09-12T18:02:11.624149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621045+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:02:11.621045+0000","last_peered":"2024-09-12T18:02:11.621045+0000","last_clean":"2024-09-12T18:02:11.621045+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:02:11.621045+0000","last_undegraded":"2024-09-12T18:02:11.621045+0000","last_fullsized":"2024-09-12T18:02:11.621045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242627+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:02:12.242627+0000","last_peered":"2024-09-12T18:02:12.242627+0000","last_clean":"2024-09-12T18:02:12.242627+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:02:12.242627+0000","last_undegraded":"2024-09-12T18:02:12.242627+0000","last_fullsized":"2024-09-12T18:02:12.242627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.622326+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:02:11.622326+0000","last_peered":"2024-09-12T18:02:11.622326+0000","last_clean":"2024-09-12T18:02:11.622326+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:02:11.622326+0000","last_undegraded":"2024-09-12T18:02:11.622326+0000","last_fullsized":"2024-09-12T18:02:11.622326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243439+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:02:12.243439+0000","last_peered":"2024-09-12T18:02:12.243439+0000","last_clean":"2024-09-12T18:02:12.243439+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:02:12.243439+0000","last_undegraded":"2024-09-12T18:02:12.243439+0000","last_fullsized":"2024-09-12T18:02:12.243439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245271+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:02:12.245271+0000","last_peered":"2024-09-12T18:02:12.245271+0000","last_clean":"2024-09-12T18:02:12.245271+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:02:12.245271+0000","last_undegraded":"2024-09-12T18:02:12.245271+0000","last_fullsized":"2024-09-12T18:02:12.245271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242087+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:02:12.242087+0000","last_peered":"2024-09-12T18:02:12.242087+0000","last_clean":"2024-09-12T18:02:12.242087+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:02:12.242087+0000","last_undegraded":"2024-09-12T18:02:12.242087+0000","last_fullsized":"2024-09-12T18:02:12.242087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244459+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:02:12.244459+0000","last_peered":"2024-09-12T18:02:12.244459+0000","last_clean":"2024-09-12T18:02:12.244459+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:02:12.244459+0000","last_undegraded":"2024-09-12T18:02:12.244459+0000","last_fullsized":"2024-09-12T18:02:12.244459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242339+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:02:12.242339+0000","last_peered":"2024-09-12T18:02:12.242339+0000","last_clean":"2024-09-12T18:02:12.242339+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:02:12.242339+0000","last_undegraded":"2024-09-12T18:02:12.242339+0000","last_fullsized":"2024-09-12T18:02:12.242339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245669+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:02:12.245669+0000","last_peered":"2024-09-12T18:02:12.245669+0000","last_clean":"2024-09-12T18:02:12.245669+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:02:12.245669+0000","last_undegraded":"2024-09-12T18:02:12.245669+0000","last_fullsized":"2024-09-12T18:02:12.245669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243676+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:02:12.243676+0000","last_peered":"2024-09-12T18:02:12.243676+0000","last_clean":"2024-09-12T18:02:12.243676+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:02:12.243676+0000","last_undegraded":"2024-09-12T18:02:12.243676+0000","last_fullsized":"2024-09-12T18:02:12.243676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244982+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:02:12.244982+0000","last_peered":"2024-09-12T18:02:12.244982+0000","last_clean":"2024-09-12T18:02:12.244982+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:02:12.244982+0000","last_undegraded":"2024-09-12T18:02:12.244982+0000","last_fullsized":"2024-09-12T18:02:12.244982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621594+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:02:11.621594+0000","last_peered":"2024-09-12T18:02:11.621594+0000","last_clean":"2024-09-12T18:02:11.621594+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:02:11.621594+0000","last_undegraded":"2024-09-12T18:02:11.621594+0000","last_fullsized":"2024-09-12T18:02:11.621594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.624235+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:02:11.624235+0000","last_peered":"2024-09-12T18:02:11.624235+0000","last_clean":"2024-09-12T18:02:11.624235+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:02:11.624235+0000","last_undegraded":"2024-09-12T18:02:11.624235+0000","last_fullsized":"2024-09-12T18:02:11.624235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244430+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:02:12.244430+0000","last_peered":"2024-09-12T18:02:12.244430+0000","last_clean":"2024-09-12T18:02:12.244430+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:02:12.244430+0000","last_undegraded":"2024-09-12T18:02:12.244430+0000","last_fullsized":"2024-09-12T18:02:12.244430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244493+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:02:12.244493+0000","last_peered":"2024-09-12T18:02:12.244493+0000","last_clean":"2024-09-12T18:02:12.244493+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:02:12.244493+0000","last_undegraded":"2024-09-12T18:02:12.244493+0000","last_fullsized":"2024-09-12T18:02:12.244493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245527+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:02:12.245527+0000","last_peered":"2024-09-12T18:02:12.245527+0000","last_clean":"2024-09-12T18:02:12.245527+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:02:12.245527+0000","last_undegraded":"2024-09-12T18:02:12.245527+0000","last_fullsized":"2024-09-12T18:02:12.245527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242881+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:02:12.242881+0000","last_peered":"2024-09-12T18:02:12.242881+0000","last_clean":"2024-09-12T18:02:12.242881+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:02:12.242881+0000","last_undegraded":"2024-09-12T18:02:12.242881+0000","last_fullsized":"2024-09-12T18:02:12.242881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245104+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:02:12.245104+0000","last_peered":"2024-09-12T18:02:12.245104+0000","last_clean":"2024-09-12T18:02:12.245104+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:02:12.245104+0000","last_undegraded":"2024-09-12T18:02:12.245104+0000","last_fullsized":"2024-09-12T18:02:12.245104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242161+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:02:12.242161+0000","last_peered":"2024-09-12T18:02:12.242161+0000","last_clean":"2024-09-12T18:02:12.242161+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:02:12.242161+0000","last_undegraded":"2024-09-12T18:02:12.242161+0000","last_fullsized":"2024-09-12T18:02:12.242161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.622172+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:02:11.622172+0000","last_peered":"2024-09-12T18:02:11.622172+0000","last_clean":"2024-09-12T18:02:11.622172+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:02:11.622172+0000","last_undegraded":"2024-09-12T18:02:11.622172+0000","last_fullsized":"2024-09-12T18:02:11.622172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244110+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:02:12.244110+0000","last_peered":"2024-09-12T18:02:12.244110+0000","last_clean":"2024-09-12T18:02:12.244110+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:02:12.244110+0000","last_undegraded":"2024-09-12T18:02:12.244110+0000","last_fullsized":"2024-09-12T18:02:12.244110+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244665+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:02:12.244665+0000","last_peered":"2024-09-12T18:02:12.244665+0000","last_clean":"2024-09-12T18:02:12.244665+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:02:12.244665+0000","last_undegraded":"2024-09-12T18:02:12.244665+0000","last_fullsized":"2024-09-12T18:02:12.244665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621476+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:02:11.621476+0000","last_peered":"2024-09-12T18:02:11.621476+0000","last_clean":"2024-09-12T18:02:11.621476+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:02:11.621476+0000","last_undegraded":"2024-09-12T18:02:11.621476+0000","last_fullsized":"2024-09-12T18:02:11.621476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245540+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:02:12.245540+0000","last_peered":"2024-09-12T18:02:12.245540+0000","last_clean":"2024-09-12T18:02:12.245540+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:02:12.245540+0000","last_undegraded":"2024-09-12T18:02:12.245540+0000","last_fullsized":"2024-09-12T18:02:12.245540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243764+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:02:12.243764+0000","last_peered":"2024-09-12T18:02:12.243764+0000","last_clean":"2024-09-12T18:02:12.243764+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:02:12.243764+0000","last_undegraded":"2024-09-12T18:02:12.243764+0000","last_fullsized":"2024-09-12T18:02:12.243764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.623444+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:02:11.623444+0000","last_peered":"2024-09-12T18:02:11.623444+0000","last_clean":"2024-09-12T18:02:11.623444+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:02:11.623444+0000","last_undegraded":"2024-09-12T18:02:11.623444+0000","last_fullsized":"2024-09-12T18:02:11.623444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244222+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:02:12.244222+0000","last_peered":"2024-09-12T18:02:12.244222+0000","last_clean":"2024-09-12T18:02:12.244222+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:02:12.244222+0000","last_undegraded":"2024-09-12T18:02:12.244222+0000","last_fullsized":"2024-09-12T18:02:12.244222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.623718+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:02:11.623718+0000","last_peered":"2024-09-12T18:02:11.623718+0000","last_clean":"2024-09-12T18:02:11.623718+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:02:11.623718+0000","last_undegraded":"2024-09-12T18:02:11.623718+0000","last_fullsized":"2024-09-12T18:02:11.623718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242344+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:02:12.242344+0000","last_peered":"2024-09-12T18:02:12.242344+0000","last_clean":"2024-09-12T18:02:12.242344+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:02:12.242344+0000","last_undegraded":"2024-09-12T18:02:12.242344+0000","last_fullsized":"2024-09-12T18:02:12.242344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621975+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:02:11.621975+0000","last_peered":"2024-09-12T18:02:11.621975+0000","last_clean":"2024-09-12T18:02:11.621975+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:02:11.621975+0000","last_undegraded":"2024-09-12T18:02:11.621975+0000","last_fullsized":"2024-09-12T18:02:11.621975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244740+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:02:12.244740+0000","last_peered":"2024-09-12T18:02:12.244740+0000","last_clean":"2024-09-12T18:02:12.244740+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:02:12.244740+0000","last_undegraded":"2024-09-12T18:02:12.244740+0000","last_fullsized":"2024-09-12T18:02:12.244740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244517+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:02:12.244517+0000","last_peered":"2024-09-12T18:02:12.244517+0000","last_clean":"2024-09-12T18:02:12.244517+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:02:12.244517+0000","last_undegraded":"2024-09-12T18:02:12.244517+0000","last_fullsized":"2024-09-12T18:02:12.244517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621241+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:02:11.621241+0000","last_peered":"2024-09-12T18:02:11.621241+0000","last_clean":"2024-09-12T18:02:11.621241+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:02:11.621241+0000","last_undegraded":"2024-09-12T18:02:11.621241+0000","last_fullsized":"2024-09-12T18:02:11.621241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245700+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:02:12.245700+0000","last_peered":"2024-09-12T18:02:12.245700+0000","last_clean":"2024-09-12T18:02:12.245700+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:02:12.245700+0000","last_undegraded":"2024-09-12T18:02:12.245700+0000","last_fullsized":"2024-09-12T18:02:12.245700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.625155+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:02:11.625155+0000","last_peered":"2024-09-12T18:02:11.625155+0000","last_clean":"2024-09-12T18:02:11.625155+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:02:11.625155+0000","last_undegraded":"2024-09-12T18:02:11.625155+0000","last_fullsized":"2024-09-12T18:02:11.625155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242875+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:02:12.242875+0000","last_peered":"2024-09-12T18:02:12.242875+0000","last_clean":"2024-09-12T18:02:12.242875+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:02:12.242875+0000","last_undegraded":"2024-09-12T18:02:12.242875+0000","last_fullsized":"2024-09-12T18:02:12.242875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.620837+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:02:11.620837+0000","last_peered":"2024-09-12T18:02:11.620837+0000","last_clean":"2024-09-12T18:02:11.620837+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:02:11.620837+0000","last_undegraded":"2024-09-12T18:02:11.620837+0000","last_fullsized":"2024-09-12T18:02:11.620837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244190+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:02:12.244190+0000","last_peered":"2024-09-12T18:02:12.244190+0000","last_clean":"2024-09-12T18:02:12.244190+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:02:12.244190+0000","last_undegraded":"2024-09-12T18:02:12.244190+0000","last_fullsized":"2024-09-12T18:02:12.244190+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243122+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:02:12.243122+0000","last_peered":"2024-09-12T18:02:12.243122+0000","last_clean":"2024-09-12T18:02:12.243122+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:02:12.243122+0000","last_undegraded":"2024-09-12T18:02:12.243122+0000","last_fullsized":"2024-09-12T18:02:12.243122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621044+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:02:11.621044+0000","last_peered":"2024-09-12T18:02:11.621044+0000","last_clean":"2024-09-12T18:02:11.621044+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:02:11.621044+0000","last_undegraded":"2024-09-12T18:02:11.621044+0000","last_fullsized":"2024-09-12T18:02:11.621044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.625182+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:02:11.625182+0000","last_peered":"2024-09-12T18:02:11.625182+0000","last_clean":"2024-09-12T18:02:11.625182+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:02:11.625182+0000","last_undegraded":"2024-09-12T18:02:11.625182+0000","last_fullsized":"2024-09-12T18:02:11.625182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.620476+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:02:11.620476+0000","last_peered":"2024-09-12T18:02:11.620476+0000","last_clean":"2024-09-12T18:02:11.620476+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:02:11.620476+0000","last_undegraded":"2024-09-12T18:02:11.620476+0000","last_fullsized":"2024-09-12T18:02:11.620476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.625194+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:02:11.625194+0000","last_peered":"2024-09-12T18:02:11.625194+0000","last_clean":"2024-09-12T18:02:11.625194+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:02:11.625194+0000","last_undegraded":"2024-09-12T18:02:11.625194+0000","last_fullsized":"2024-09-12T18:02:11.625194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245376+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:02:12.245376+0000","last_peered":"2024-09-12T18:02:12.245376+0000","last_clean":"2024-09-12T18:02:12.245376+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:02:12.245376+0000","last_undegraded":"2024-09-12T18:02:12.245376+0000","last_fullsized":"2024-09-12T18:02:12.245376+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242346+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:02:12.242346+0000","last_peered":"2024-09-12T18:02:12.242346+0000","last_clean":"2024-09-12T18:02:12.242346+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:02:12.242346+0000","last_undegraded":"2024-09-12T18:02:12.242346+0000","last_fullsized":"2024-09-12T18:02:12.242346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244034+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:02:12.244034+0000","last_peered":"2024-09-12T18:02:12.244034+0000","last_clean":"2024-09-12T18:02:12.244034+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:02:12.244034+0000","last_undegraded":"2024-09-12T18:02:12.244034+0000","last_fullsized":"2024-09-12T18:02:12.244034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"22'8","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244708+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:02:12.244708+0000","last_peered":"2024-09-12T18:02:12.244708+0000","last_clean":"2024-09-12T18:02:12.244708+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:02:12.244708+0000","last_undegraded":"2024-09-12T18:02:12.244708+0000","last_fullsized":"2024-09-12T18:02:12.244708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2053,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.623103+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:02:11.623103+0000","last_peered":"2024-09-12T18:02:11.623103+0000","last_clean":"2024-09-12T18:02:11.623103+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:02:11.623103+0000","last_undegraded":"2024-09-12T18:02:11.623103+0000","last_fullsized":"2024-09-12T18:02:11.623103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244014+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:02:12.244014+0000","last_peered":"2024-09-12T18:02:12.244014+0000","last_clean":"2024-09-12T18:02:12.244014+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:02:12.244014+0000","last_undegraded":"2024-09-12T18:02:12.244014+0000","last_fullsized":"2024-09-12T18:02:12.244014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.245323+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:02:12.245323+0000","last_peered":"2024-09-12T18:02:12.245323+0000","last_clean":"2024-09-12T18:02:12.245323+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:02:12.245323+0000","last_undegraded":"2024-09-12T18:02:12.245323+0000","last_fullsized":"2024-09-12T18:02:12.245323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621038+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:02:11.621038+0000","last_peered":"2024-09-12T18:02:11.621038+0000","last_clean":"2024-09-12T18:02:11.621038+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:02:11.621038+0000","last_undegraded":"2024-09-12T18:02:11.621038+0000","last_fullsized":"2024-09-12T18:02:11.621038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.623168+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:02:11.623168+0000","last_peered":"2024-09-12T18:02:11.623168+0000","last_clean":"2024-09-12T18:02:11.623168+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:02:11.623168+0000","last_undegraded":"2024-09-12T18:02:11.623168+0000","last_fullsized":"2024-09-12T18:02:11.623168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.620891+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:02:11.620891+0000","last_peered":"2024-09-12T18:02:11.620891+0000","last_clean":"2024-09-12T18:02:11.620891+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:02:11.620891+0000","last_undegraded":"2024-09-12T18:02:11.620891+0000","last_fullsized":"2024-09-12T18:02:11.620891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244478+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:02:12.244478+0000","last_peered":"2024-09-12T18:02:12.244478+0000","last_clean":"2024-09-12T18:02:12.244478+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:02:12.244478+0000","last_undegraded":"2024-09-12T18:02:12.244478+0000","last_fullsized":"2024-09-12T18:02:12.244478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.620465+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:02:11.620465+0000","last_peered":"2024-09-12T18:02:11.620465+0000","last_clean":"2024-09-12T18:02:11.620465+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:02:11.620465+0000","last_undegraded":"2024-09-12T18:02:11.620465+0000","last_fullsized":"2024-09-12T18:02:11.620465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.622095+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:02:11.622095+0000","last_peered":"2024-09-12T18:02:11.622095+0000","last_clean":"2024-09-12T18:02:11.622095+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:02:11.622095+0000","last_undegraded":"2024-09-12T18:02:11.622095+0000","last_fullsized":"2024-09-12T18:02:11.622095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.623476+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:02:11.623476+0000","last_peered":"2024-09-12T18:02:11.623476+0000","last_clean":"2024-09-12T18:02:11.623476+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:02:11.623476+0000","last_undegraded":"2024-09-12T18:02:11.623476+0000","last_fullsized":"2024-09-12T18:02:11.623476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.242996+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:02:12.242996+0000","last_peered":"2024-09-12T18:02:12.242996+0000","last_clean":"2024-09-12T18:02:12.242996+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:02:12.242996+0000","last_undegraded":"2024-09-12T18:02:12.242996+0000","last_fullsized":"2024-09-12T18:02:12.242996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243251+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:02:12.243251+0000","last_peered":"2024-09-12T18:02:12.243251+0000","last_clean":"2024-09-12T18:02:12.243251+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:02:12.243251+0000","last_undegraded":"2024-09-12T18:02:12.243251+0000","last_fullsized":"2024-09-12T18:02:12.243251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243144+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:02:12.243144+0000","last_peered":"2024-09-12T18:02:12.243144+0000","last_clean":"2024-09-12T18:02:12.243144+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:02:12.243144+0000","last_undegraded":"2024-09-12T18:02:12.243144+0000","last_fullsized":"2024-09-12T18:02:12.243144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243554+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:02:12.243554+0000","last_peered":"2024-09-12T18:02:12.243554+0000","last_clean":"2024-09-12T18:02:12.243554+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:02:12.243554+0000","last_undegraded":"2024-09-12T18:02:12.243554+0000","last_fullsized":"2024-09-12T18:02:12.243554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243946+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:02:12.243946+0000","last_peered":"2024-09-12T18:02:12.243946+0000","last_clean":"2024-09-12T18:02:12.243946+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:02:12.243946+0000","last_undegraded":"2024-09-12T18:02:12.243946+0000","last_fullsized":"2024-09-12T18:02:12.243946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.244783+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:02:12.244783+0000","last_peered":"2024-09-12T18:02:12.244783+0000","last_clean":"2024-09-12T18:02:12.244783+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:02:12.244783+0000","last_undegraded":"2024-09-12T18:02:12.244783+0000","last_fullsized":"2024-09-12T18:02:12.244783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243972+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:02:12.243972+0000","last_peered":"2024-09-12T18:02:12.243972+0000","last_clean":"2024-09-12T18:02:12.243972+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:02:12.243972+0000","last_undegraded":"2024-09-12T18:02:12.243972+0000","last_fullsized":"2024-09-12T18:02:12.243972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243743+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:02:12.243743+0000","last_peered":"2024-09-12T18:02:12.243743+0000","last_clean":"2024-09-12T18:02:12.243743+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:02:12.243743+0000","last_undegraded":"2024-09-12T18:02:12.243743+0000","last_fullsized":"2024-09-12T18:02:12.243743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243259+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:02:12.243259+0000","last_peered":"2024-09-12T18:02:12.243259+0000","last_clean":"2024-09-12T18:02:12.243259+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:02:12.243259+0000","last_undegraded":"2024-09-12T18:02:12.243259+0000","last_fullsized":"2024-09-12T18:02:12.243259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.621206+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:02:11.621206+0000","last_peered":"2024-09-12T18:02:11.621206+0000","last_clean":"2024-09-12T18:02:11.621206+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:02:11.621206+0000","last_undegraded":"2024-09-12T18:02:11.621206+0000","last_fullsized":"2024-09-12T18:02:11.621206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T18:02:12.243505+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:02:12.243505+0000","last_peered":"2024-09-12T18:02:12.243505+0000","last_clean":"2024-09-12T18:02:12.243505+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:02:12.243505+0000","last_undegraded":"2024-09-12T18:02:12.243505+0000","last_fullsized":"2024-09-12T18:02:12.243505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:02:11.622778+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:02:11.622778+0000","last_peered":"2024-09-12T18:02:11.622778+0000","last_clean":"2024-09-12T18:02:11.622778+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:02:11.622778+0000","last_undegraded":"2024-09-12T18:02:11.622778+0000","last_fullsized":"2024-09-12T18:02:11.622778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2851,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":68129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":286720,"data_stored":668537,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":669172,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:13.873 INFO:tasks.thrashosds.thrasher:Setting 3.3 to [0, 2, 1] 2024-09-12T18:02:13.873 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.3', '0', '2', '1'] 2024-09-12T18:02:13.873 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.3 0 2 1 2024-09-12T18:02:13.957 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:13.956+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:13.971 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:13.971 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:13.972 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:13.972 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:13.987 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:14.058 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:14.060+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 23.573789729000001, 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.112 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:14.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.116 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.571485532000001, 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:14.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.568178484000001, 2024-09-12T18:02:14.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:14.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420790330999999, 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:14.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:14.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.131 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420697268000001, 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:14.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.137 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420654795000001, 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:14.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:14.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420550569, 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:14.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:14.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420514736000001, 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.149 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:14.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420483717, 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.155 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:14.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420432776999998, 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:14.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420377704, 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.165 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.420343888000001, 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:14.169 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:14.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.173 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.419000311000001, 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:14.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.418730892999999, 2024-09-12T18:02:14.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:14.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:14.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.416970417000002, 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:14.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.186 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.416814762000001, 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:14.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.415058942000002, 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00051837900000000002, 2024-09-12T18:02:14.191 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695531+0000", 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5460000000000001e-06 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695538+0000", 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0700000000000001e-06 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695559+0000", 2024-09-12T18:02:14.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1203999999999999e-05 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695577+0000", 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7785999999999999e-05 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695716+0000", 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013935299999999999 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695738+0000", 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1290000000000001e-05 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696048+0000", 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031012999999999999 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:14.195 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.414654261999999, 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:14.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:14.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:14.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.425439667999999, 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:14.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:14.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:14.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:14.206 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.423486311, 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:14.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:14.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:14.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:14.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:14.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:14.213 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:14.214 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:14.213+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:14.215 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:14.231 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-12T18:02:14.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:02:14.259 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-12T18:02:14.316 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:14.313+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:14.349 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:14.349 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:14.365 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:14.381 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:14.402 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:14.403 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:14.416 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:14.413+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:14.424 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:14.481 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:14.481 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:14.495 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:14.540 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:14.542+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:14.618 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:14.617+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:14.618 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:14.618 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:14.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:14.719 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:14.717+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:14.762 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:14.762 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:14.776 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:14.819 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:14.817+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:14.896 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:14.896 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:14.910 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:14.921 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:14.921+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:15.022 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:15.021+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:15.027 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:15.027 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:15.042 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:15.123 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:15.121+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:15.174 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:15.174 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:15.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:15.229 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:15.229+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:15.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:02:15.325 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:15.324+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:15.355 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:15.355 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:15.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:15.426 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:15.426+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:15.491 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:15.491 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:15.505 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:15.552 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:15.554+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:15.628 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:15.625+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:15.635 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:15.635 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:15.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:15.740 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:15.742+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:15.820 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:15.821 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:15.830 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:15.832+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:15.834 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:15.931 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:15.929+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:15.996 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:15.996 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:16.010 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:16.031 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:16.030+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:16.132 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:16.134+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:16.140 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:16.140 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:16.154 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:16.233 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:16.233+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:16.259 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:02:16.279 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:16.279 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:16.293 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:16.337 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:16.336+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:16.409 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:16.409 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:16.423 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:16.435 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:16.434+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:16.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:16.536 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:16.534+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:16.554 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:16.554 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:16.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:16.589 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:16.589 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:16.610 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:16.628 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:16.628 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:16.637 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:16.636+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:16.689 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:16.689 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:16.689 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:16.689 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:16.689 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:16.703 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:16.738 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:16.738+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:16.820 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:16.820 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:16.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:16.820 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.283593163999999, 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:16.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.281288966999998, 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.826 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:16.827 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.828 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.829 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 24.277981918999998, 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.831 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.832 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.833 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.834 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130593766, 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.836 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:16.837 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:16.838 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.839 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.840 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130500702999999, 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.841 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:16.842 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:16.843 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.844 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:16.845 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130458229999999, 2024-09-12T18:02:16.846 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:16.848 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.849 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.850 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:16.851 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130354004000001, 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.852 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:16.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:16.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.857 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130318170999999, 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:16.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:16.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130287152000001, 2024-09-12T18:02:16.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:16.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130236212, 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.869 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:16.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:16.873 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130181139000001, 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:16.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.877 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.130147322999999, 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:16.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.128803745999999, 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:16.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:16.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.128534328000001, 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:16.885 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:16.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.126773851999999, 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:16.894 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.126618196999999, 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:16.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:16.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.124862376999999, 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00051837900000000002, 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.899 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695531+0000", 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5460000000000001e-06 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695538+0000", 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0700000000000001e-06 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695559+0000", 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1203999999999999e-05 2024-09-12T18:02:16.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695577+0000", 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7785999999999999e-05 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695716+0000", 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013935299999999999 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695738+0000", 2024-09-12T18:02:16.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1290000000000001e-05 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696048+0000", 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031012999999999999 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.124457697, 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:16.903 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:16.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.135243103000001, 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:16.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:16.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:16.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:16.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:16.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.133289746, 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:16.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:16.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:16.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:16.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:16.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:16.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:16.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.920 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:16.920 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:16.920 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:16.921 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:16.922 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:16.922+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:17.022 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:17.021+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:17.057 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:17.057 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:17.057 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:17.057 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:17.072 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:17.123 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:17.121+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:17.195 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:17.195 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:17.195 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:17.195 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:17.195 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:17.210 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:17.224 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:17.220+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:17.325 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:17.326+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:17.331 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:17.331 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:17.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:17.331 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:17.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.331 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.331 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.686987707999997, 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:17.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:17.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:17.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.686870659999997, 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.338 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:17.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:17.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.686580591999999, 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.345 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:17.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:17.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:17.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:17.351 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.686398003999997, 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:17.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:17.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:17.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.685711136999998, 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.358 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:17.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:17.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:17.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:17.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.365 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.365 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:17.365 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.685564626999998, 2024-09-12T18:02:17.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:17.365 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.365 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.365 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:17.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:17.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.371 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.685477204999998, 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:17.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:17.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:17.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:17.378 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.580281755999998, 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:17.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:17.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:17.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:17.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:17.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:17.385 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.580198699999997, 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:17.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:17.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:17.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.580130381000004, 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.392 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:17.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:17.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:17.398 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.579951342000001, 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:17.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:17.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.475624738999997, 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:17.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:17.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.475578740000003, 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:17.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:17.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.475461297000003, 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.418 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:17.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:17.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.371230023000003, 2024-09-12T18:02:17.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:17.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.371196410000003, 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.431 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:17.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:17.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.437 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.371027007999999, 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:17.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:17.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:17.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.370987794999998, 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.444 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:17.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.450 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.370943728, 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 32.370825408999998, 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:17.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:17.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:17.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.463 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:17.463 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:17.463 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:17.464 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:17.465 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:17.461+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:17.568 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:17.565+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:17.595 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:17.595 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:17.595 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:17.595 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:17.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:17.666 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:17.666+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:17.727 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:17.727 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:17.727 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:17.727 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:17.727 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:17.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:17.785 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:17.784+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.214380759999997, 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.860 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:17.861 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.862 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:17.863 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.213707575000001, 2024-09-12T18:02:17.864 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.865 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.866 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:17.867 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.868 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.213098473000002, 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.869 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.870 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:17.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.872 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:17.873 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.212571160000003, 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.874 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.876 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:17.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.878 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.212130123999998, 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.879 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.880 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.881 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:17.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.883 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.211352079999997, 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.884 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:17.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.888 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.210860113000003, 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.889 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:17.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:17.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:17.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:17.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.210292555000002, 2024-09-12T18:02:17.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:17.895 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.896 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:17.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:17.899 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.209788138999997, 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:17.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:17.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:17.904 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.209310864999999, 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.208865033000002, 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:17.909 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.208323976999999, 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.914 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:17.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:17.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:17.918 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.207985538999999, 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:17.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:17.922 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 33.107142128, 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.923 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.924 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:17.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:17.927 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 22.167902606999998, 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:17.929 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:17.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.933 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 22.167783157999999, 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:17.934 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.935 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:17.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.938 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 22.167607919000002, 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.942 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.943 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.944 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 22.167544069000002, 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:17.946 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.947 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:17.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:17.951 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 22.167425387000002, 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:17.952 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:17.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:17.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:17.957 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 22.167357575, 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:17.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:17.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:17.962 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:17.964 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:17.965 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:17.960+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:18.064 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:18.060+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:18.097 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:18.097 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:18.098 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:18.111 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:18.165 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:18.165+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:18.233 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:18.233 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:18.233 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:18.233 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:18.233 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:18.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:18.266 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:18.266+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:18.280 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:02:18.367 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:18.365+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.870277331, 2024-09-12T18:02:18.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:18.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:18.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:18.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.867973134, 2024-09-12T18:02:18.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:18.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.864666086, 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.417 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:18.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.717277932999998, 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:18.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:18.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.717184870000001, 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:18.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:18.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.717142397, 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:18.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:18.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.717038170999999, 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:18.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:18.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.717002338, 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:18.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:18.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.716971318999999, 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:18.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:18.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:18.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:18.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.457 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.716920379000001, 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:18.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.716865305999999, 2024-09-12T18:02:18.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.716831490000001, 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:18.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:18.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.715487913, 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.471 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.715218494999998, 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.475 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:18.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.713458019000001, 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:18.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:18.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:18.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.713302364, 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:18.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:18.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e18/16 ondisk, result = 0)", 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.711546544000001, 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00051837900000000002, 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.489 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695529+0000", 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695531+0000", 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5460000000000001e-06 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695538+0000", 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0700000000000001e-06 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695559+0000", 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1203999999999999e-05 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695577+0000", 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7785999999999999e-05 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695716+0000", 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013935299999999999 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695738+0000", 2024-09-12T18:02:18.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1290000000000001e-05 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696048+0000", 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031012999999999999 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:18.493 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.711141863999998, 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:18.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:18.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.721927269999998, 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:18.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:18.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.503 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.7199739130000005, 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:18.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:18.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:18.510 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:18.512 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:18.513+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:18.512 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:18.613 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:18.614+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:18.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:18.645 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:18.645 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:18.645 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:18.645 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:18.660 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:18.713 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:18.712+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:18.780 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:18.781 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:18.800 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:18.801 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:18.814 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:18.814+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:18.820 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:18.821 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:18.832 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:18.832 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:18.846 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:18.916 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:18.916+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:19.010 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:19.010 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:19.016 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:19.018+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:19.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:19.117 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:19.116+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:19.157 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:19.157 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:19.171 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:19.257 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:19.256+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:19.260 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:02:19.260 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:02:19.261 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:02:19.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:02:19.318 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:19.318+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:19.333 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:19.333 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:19.347 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:19.419 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:19.418+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:19.516 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:19.516 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:19.519 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:19.517+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:19.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 25, 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "da5a949a-216b-4267-953a-8d92e3d25b1d", 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-09-12T18:01:33.537080+0000", 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-09-12T18:02:16.252782+0000", 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-09-12T18:01:42.466111+0000", 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-09-12T18:01:34.442067+0000", 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5804032, 2024-09-12T18:02:19.560 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "nodeep-scrub", 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:02:19.561 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "jewel", 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "squid", 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:42.598261+0000", 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:19.562 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:19.563 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:19.564 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:19.565 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:19.566 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:19.567 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:48.792102+0000", 2024-09-12T18:02:19.568 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 8193, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:19.569 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "15", 2024-09-12T18:02:19.570 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 2, 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 15, 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:19.571 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.572 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-09-12T18:02:19.573 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.574 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:53.545540+0000", 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:19.576 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:19.577 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:19.578 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:19.579 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:19.580 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-09-12T18:02:19.581 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:54.024396+0000", 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:19.582 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:19.583 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "19", 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:19.584 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:19.585 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-09-12T18:02:19.586 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:19.587 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "f692452d-28b8-4aad-928e-fe1805e23b68", 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:19.588 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6800", 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.589 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6801", 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6802", 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.590 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6803", 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6806", 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:19.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6807", 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6804", 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:19.592 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6805", 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.111:6801/177809282", 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.111:6803/177809282", 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.111:6807/177809282", 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.111:6805/177809282", 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:19.593 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "b5b3807e-e3b5-4530-adc6-af19dd31e340", 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:19.594 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6800", 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.595 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6801", 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6802", 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.596 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6803", 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6806", 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.597 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6807", 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6804", 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.598 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6805", 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.121:6801/3534339867", 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.121:6803/3534339867", 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.121:6807/3534339867", 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.121:6805/3534339867", 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.599 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "926e4870-279e-45c7-9d6c-5841397a5e6c", 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.600 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6800", 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6801", 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.601 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6802", 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6803", 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.602 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6806", 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6807", 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:19.603 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6804", 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6805", 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.153:6801/284634690", 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.153:6803/284634690", 2024-09-12T18:02:19.604 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.153:6807/284634690", 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.153:6805/284634690", 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:19.605 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.382866+0000", 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.379192+0000", 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.336708+0000", 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [], 2024-09-12T18:02:19.607 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-09-12T18:02:19.608 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:19.609 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:02:19.611 INFO:tasks.thrashosds.thrasher:j is {'epoch': 25, 'fsid': 'da5a949a-216b-4267-953a-8d92e3d25b1d', 'created': '2024-09-12T18:01:33.537080+0000', 'modified': '2024-09-12T18:02:16.252782+0000', 'last_up_change': '2024-09-12T18:01:42.466111+0000', 'last_in_change': '2024-09-12T18:01:34.442067+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:01:42.598261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:01:48.792102+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:01:53.545540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:01:54.024396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f692452d-28b8-4aad-928e-fe1805e23b68', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 177809282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 177809282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 177809282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 177809282}]}, 'public_addr': '172.21.15.111:6801/177809282', 'cluster_addr': '172.21.15.111:6803/177809282', 'heartbeat_back_addr': '172.21.15.111:6807/177809282', 'heartbeat_front_addr': '172.21.15.111:6805/177809282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'b5b3807e-e3b5-4530-adc6-af19dd31e340', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6800', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6801', 'nonce': 3534339867}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6802', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6803', 'nonce': 3534339867}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6806', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6807', 'nonce': 3534339867}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6804', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6805', 'nonce': 3534339867}]}, 'public_addr': '172.21.15.121:6801/3534339867', 'cluster_addr': '172.21.15.121:6803/3534339867', 'heartbeat_back_addr': '172.21.15.121:6807/3534339867', 'heartbeat_front_addr': '172.21.15.121:6805/3534339867', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '926e4870-279e-45c7-9d6c-5841397a5e6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 284634690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 284634690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 284634690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 284634690}]}, 'public_addr': '172.21.15.153:6801/284634690', 'cluster_addr': '172.21.15.153:6803/284634690', 'heartbeat_back_addr': '172.21.15.153:6807/284634690', 'heartbeat_front_addr': '172.21.15.153:6805/284634690', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.382866+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.379192+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.336708+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:02:19.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:19.620 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:19.622+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:19.622 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:02:19.661 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:19.661 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:19.675 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:19.721 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:19.722+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:19.791 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:19.805 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:19.822 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:19.820+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:19.915 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:19.917 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:19.919 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:19.919 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:19.923 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:19.922+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:19.932 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:19.933 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-12T18:02:19.620285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596069,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":197,"num_write_kb":2694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90236,"kb_used_data":832,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025284,"statfs":{"total":289910292480,"available":289817890816,"internally_reserved":0,"allocated":851968,"data_stored":1445212,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.057006"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267814+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:02:16.267814+0000","last_peered":"2024-09-12T18:02:16.267814+0000","last_clean":"2024-09-12T18:02:16.267814+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:02:16.267814+0000","last_undegraded":"2024-09-12T18:02:16.267814+0000","last_fullsized":"2024-09-12T18:02:16.267814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266790+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:02:16.266790+0000","last_peered":"2024-09-12T18:02:16.266790+0000","last_clean":"2024-09-12T18:02:16.266790+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:02:16.266790+0000","last_undegraded":"2024-09-12T18:02:16.266790+0000","last_fullsized":"2024-09-12T18:02:16.266790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268819+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:02:16.268819+0000","last_peered":"2024-09-12T18:02:16.268819+0000","last_clean":"2024-09-12T18:02:16.268819+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:02:16.268819+0000","last_undegraded":"2024-09-12T18:02:16.268819+0000","last_fullsized":"2024-09-12T18:02:16.268819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268826+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:02:16.268826+0000","last_peered":"2024-09-12T18:02:16.268826+0000","last_clean":"2024-09-12T18:02:16.268826+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:02:16.268826+0000","last_undegraded":"2024-09-12T18:02:16.268826+0000","last_fullsized":"2024-09-12T18:02:16.268826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267037+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:02:16.267037+0000","last_peered":"2024-09-12T18:02:16.267037+0000","last_clean":"2024-09-12T18:02:16.267037+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:02:16.267037+0000","last_undegraded":"2024-09-12T18:02:16.267037+0000","last_fullsized":"2024-09-12T18:02:16.267037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268289+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:02:16.268289+0000","last_peered":"2024-09-12T18:02:16.268289+0000","last_clean":"2024-09-12T18:02:16.268289+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:02:16.268289+0000","last_undegraded":"2024-09-12T18:02:16.268289+0000","last_fullsized":"2024-09-12T18:02:16.268289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268423+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:02:16.268423+0000","last_peered":"2024-09-12T18:02:16.268423+0000","last_clean":"2024-09-12T18:02:16.268423+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:02:16.268423+0000","last_undegraded":"2024-09-12T18:02:16.268423+0000","last_fullsized":"2024-09-12T18:02:16.268423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267850+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:02:16.267850+0000","last_peered":"2024-09-12T18:02:16.267850+0000","last_clean":"2024-09-12T18:02:16.267850+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:02:16.267850+0000","last_undegraded":"2024-09-12T18:02:16.267850+0000","last_fullsized":"2024-09-12T18:02:16.267850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367998+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:02:16.367998+0000","last_peered":"2024-09-12T18:02:16.367998+0000","last_clean":"2024-09-12T18:02:16.367998+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:02:16.367998+0000","last_undegraded":"2024-09-12T18:02:16.367998+0000","last_fullsized":"2024-09-12T18:02:16.367998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266929+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:02:16.266929+0000","last_peered":"2024-09-12T18:02:16.266929+0000","last_clean":"2024-09-12T18:02:16.266929+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:02:16.266929+0000","last_undegraded":"2024-09-12T18:02:16.266929+0000","last_fullsized":"2024-09-12T18:02:16.266929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269240+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:02:16.269240+0000","last_peered":"2024-09-12T18:02:16.269240+0000","last_clean":"2024-09-12T18:02:16.269240+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:02:16.269240+0000","last_undegraded":"2024-09-12T18:02:16.269240+0000","last_fullsized":"2024-09-12T18:02:16.269240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267380+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:02:16.267380+0000","last_peered":"2024-09-12T18:02:16.267380+0000","last_clean":"2024-09-12T18:02:16.267380+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:02:16.267380+0000","last_undegraded":"2024-09-12T18:02:16.267380+0000","last_fullsized":"2024-09-12T18:02:16.267380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266577+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:02:16.266577+0000","last_peered":"2024-09-12T18:02:16.266577+0000","last_clean":"2024-09-12T18:02:16.266577+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:02:16.266577+0000","last_undegraded":"2024-09-12T18:02:16.266577+0000","last_fullsized":"2024-09-12T18:02:16.266577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268435+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:02:16.268435+0000","last_peered":"2024-09-12T18:02:16.268435+0000","last_clean":"2024-09-12T18:02:16.268435+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:02:16.268435+0000","last_undegraded":"2024-09-12T18:02:16.268435+0000","last_fullsized":"2024-09-12T18:02:16.268435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268837+0000","last_change":"2024-09-12T18:01:55.587644+0000","last_active":"2024-09-12T18:02:16.268837+0000","last_peered":"2024-09-12T18:02:16.268837+0000","last_clean":"2024-09-12T18:02:16.268837+0000","last_became_active":"2024-09-12T18:01:55.587076+0000","last_became_peered":"2024-09-12T18:01:55.587076+0000","last_unstale":"2024-09-12T18:02:16.268837+0000","last_undegraded":"2024-09-12T18:02:16.268837+0000","last_fullsized":"2024-09-12T18:02:16.268837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268045+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:02:16.268045+0000","last_peered":"2024-09-12T18:02:16.268045+0000","last_clean":"2024-09-12T18:02:16.268045+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:02:16.268045+0000","last_undegraded":"2024-09-12T18:02:16.268045+0000","last_fullsized":"2024-09-12T18:02:16.268045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.369063+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:02:16.369063+0000","last_peered":"2024-09-12T18:02:16.369063+0000","last_clean":"2024-09-12T18:02:16.369063+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:02:16.369063+0000","last_undegraded":"2024-09-12T18:02:16.369063+0000","last_fullsized":"2024-09-12T18:02:16.369063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267607+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:02:16.267607+0000","last_peered":"2024-09-12T18:02:16.267607+0000","last_clean":"2024-09-12T18:02:16.267607+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:02:16.267607+0000","last_undegraded":"2024-09-12T18:02:16.267607+0000","last_fullsized":"2024-09-12T18:02:16.267607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368578+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:02:16.368578+0000","last_peered":"2024-09-12T18:02:16.368578+0000","last_clean":"2024-09-12T18:02:16.368578+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:02:16.368578+0000","last_undegraded":"2024-09-12T18:02:16.368578+0000","last_fullsized":"2024-09-12T18:02:16.368578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268926+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:02:16.268926+0000","last_peered":"2024-09-12T18:02:16.268926+0000","last_clean":"2024-09-12T18:02:16.268926+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:02:16.268926+0000","last_undegraded":"2024-09-12T18:02:16.268926+0000","last_fullsized":"2024-09-12T18:02:16.268926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.270127+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:02:16.270127+0000","last_peered":"2024-09-12T18:02:16.270127+0000","last_clean":"2024-09-12T18:02:16.270127+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:02:16.270127+0000","last_undegraded":"2024-09-12T18:02:16.270127+0000","last_fullsized":"2024-09-12T18:02:16.270127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266901+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:02:16.266901+0000","last_peered":"2024-09-12T18:02:16.266901+0000","last_clean":"2024-09-12T18:02:16.266901+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:02:16.266901+0000","last_undegraded":"2024-09-12T18:02:16.266901+0000","last_fullsized":"2024-09-12T18:02:16.266901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.366873+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:02:16.366873+0000","last_peered":"2024-09-12T18:02:16.366873+0000","last_clean":"2024-09-12T18:02:16.366873+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:02:16.366873+0000","last_undegraded":"2024-09-12T18:02:16.366873+0000","last_fullsized":"2024-09-12T18:02:16.366873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266144+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:02:16.266144+0000","last_peered":"2024-09-12T18:02:16.266144+0000","last_clean":"2024-09-12T18:02:16.266144+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:02:16.266144+0000","last_undegraded":"2024-09-12T18:02:16.266144+0000","last_fullsized":"2024-09-12T18:02:16.266144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267939+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:02:16.267939+0000","last_peered":"2024-09-12T18:02:16.267939+0000","last_clean":"2024-09-12T18:02:16.267939+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:02:16.267939+0000","last_undegraded":"2024-09-12T18:02:16.267939+0000","last_fullsized":"2024-09-12T18:02:16.267939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368587+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:02:16.368587+0000","last_peered":"2024-09-12T18:02:16.368587+0000","last_clean":"2024-09-12T18:02:16.368587+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:02:16.368587+0000","last_undegraded":"2024-09-12T18:02:16.368587+0000","last_fullsized":"2024-09-12T18:02:16.368587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269401+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:02:16.269401+0000","last_peered":"2024-09-12T18:02:16.269401+0000","last_clean":"2024-09-12T18:02:16.269401+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:02:16.269401+0000","last_undegraded":"2024-09-12T18:02:16.269401+0000","last_fullsized":"2024-09-12T18:02:16.269401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267905+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:02:16.267905+0000","last_peered":"2024-09-12T18:02:16.267905+0000","last_clean":"2024-09-12T18:02:16.267905+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:02:16.267905+0000","last_undegraded":"2024-09-12T18:02:16.267905+0000","last_fullsized":"2024-09-12T18:02:16.267905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367972+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:02:16.367972+0000","last_peered":"2024-09-12T18:02:16.367972+0000","last_clean":"2024-09-12T18:02:16.367972+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:02:16.367972+0000","last_undegraded":"2024-09-12T18:02:16.367972+0000","last_fullsized":"2024-09-12T18:02:16.367972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267464+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:02:16.267464+0000","last_peered":"2024-09-12T18:02:16.267464+0000","last_clean":"2024-09-12T18:02:16.267464+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:02:16.267464+0000","last_undegraded":"2024-09-12T18:02:16.267464+0000","last_fullsized":"2024-09-12T18:02:16.267464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367087+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:02:16.367087+0000","last_peered":"2024-09-12T18:02:16.367087+0000","last_clean":"2024-09-12T18:02:16.367087+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:02:16.367087+0000","last_undegraded":"2024-09-12T18:02:16.367087+0000","last_fullsized":"2024-09-12T18:02:16.367087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268102+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:02:16.268102+0000","last_peered":"2024-09-12T18:02:16.268102+0000","last_clean":"2024-09-12T18:02:16.268102+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:02:16.268102+0000","last_undegraded":"2024-09-12T18:02:16.268102+0000","last_fullsized":"2024-09-12T18:02:16.268102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267647+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:02:16.267647+0000","last_peered":"2024-09-12T18:02:16.267647+0000","last_clean":"2024-09-12T18:02:16.267647+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:02:16.267647+0000","last_undegraded":"2024-09-12T18:02:16.267647+0000","last_fullsized":"2024-09-12T18:02:16.267647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.270355+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:02:16.270355+0000","last_peered":"2024-09-12T18:02:16.270355+0000","last_clean":"2024-09-12T18:02:16.270355+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:02:16.270355+0000","last_undegraded":"2024-09-12T18:02:16.270355+0000","last_fullsized":"2024-09-12T18:02:16.270355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266951+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:02:16.266951+0000","last_peered":"2024-09-12T18:02:16.266951+0000","last_clean":"2024-09-12T18:02:16.266951+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:02:16.266951+0000","last_undegraded":"2024-09-12T18:02:16.266951+0000","last_fullsized":"2024-09-12T18:02:16.266951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367968+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:02:16.367968+0000","last_peered":"2024-09-12T18:02:16.367968+0000","last_clean":"2024-09-12T18:02:16.367968+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:02:16.367968+0000","last_undegraded":"2024-09-12T18:02:16.367968+0000","last_fullsized":"2024-09-12T18:02:16.367968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368996+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:02:16.368996+0000","last_peered":"2024-09-12T18:02:16.368996+0000","last_clean":"2024-09-12T18:02:16.368996+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:02:16.368996+0000","last_undegraded":"2024-09-12T18:02:16.368996+0000","last_fullsized":"2024-09-12T18:02:16.368996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266258+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:02:16.266258+0000","last_peered":"2024-09-12T18:02:16.266258+0000","last_clean":"2024-09-12T18:02:16.266258+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:02:16.266258+0000","last_undegraded":"2024-09-12T18:02:16.266258+0000","last_fullsized":"2024-09-12T18:02:16.266258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368119+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:02:16.368119+0000","last_peered":"2024-09-12T18:02:16.368119+0000","last_clean":"2024-09-12T18:02:16.368119+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:02:16.368119+0000","last_undegraded":"2024-09-12T18:02:16.368119+0000","last_fullsized":"2024-09-12T18:02:16.368119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268313+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:02:16.268313+0000","last_peered":"2024-09-12T18:02:16.268313+0000","last_clean":"2024-09-12T18:02:16.268313+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:02:16.268313+0000","last_undegraded":"2024-09-12T18:02:16.268313+0000","last_fullsized":"2024-09-12T18:02:16.268313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269460+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:02:16.269460+0000","last_peered":"2024-09-12T18:02:16.269460+0000","last_clean":"2024-09-12T18:02:16.269460+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:02:16.269460+0000","last_undegraded":"2024-09-12T18:02:16.269460+0000","last_fullsized":"2024-09-12T18:02:16.269460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266188+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:02:16.266188+0000","last_peered":"2024-09-12T18:02:16.266188+0000","last_clean":"2024-09-12T18:02:16.266188+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:02:16.266188+0000","last_undegraded":"2024-09-12T18:02:16.266188+0000","last_fullsized":"2024-09-12T18:02:16.266188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267712+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:02:16.267712+0000","last_peered":"2024-09-12T18:02:16.267712+0000","last_clean":"2024-09-12T18:02:16.267712+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:02:16.267712+0000","last_undegraded":"2024-09-12T18:02:16.267712+0000","last_fullsized":"2024-09-12T18:02:16.267712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266166+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:02:16.266166+0000","last_peered":"2024-09-12T18:02:16.266166+0000","last_clean":"2024-09-12T18:02:16.266166+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:02:16.266166+0000","last_undegraded":"2024-09-12T18:02:16.266166+0000","last_fullsized":"2024-09-12T18:02:16.266166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269964+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:02:16.269964+0000","last_peered":"2024-09-12T18:02:16.269964+0000","last_clean":"2024-09-12T18:02:16.269964+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:02:16.269964+0000","last_undegraded":"2024-09-12T18:02:16.269964+0000","last_fullsized":"2024-09-12T18:02:16.269964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268583+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:02:16.268583+0000","last_peered":"2024-09-12T18:02:16.268583+0000","last_clean":"2024-09-12T18:02:16.268583+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:02:16.268583+0000","last_undegraded":"2024-09-12T18:02:16.268583+0000","last_fullsized":"2024-09-12T18:02:16.268583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269410+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:02:16.269410+0000","last_peered":"2024-09-12T18:02:16.269410+0000","last_clean":"2024-09-12T18:02:16.269410+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:02:16.269410+0000","last_undegraded":"2024-09-12T18:02:16.269410+0000","last_fullsized":"2024-09-12T18:02:16.269410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367668+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:02:16.367668+0000","last_peered":"2024-09-12T18:02:16.367668+0000","last_clean":"2024-09-12T18:02:16.367668+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:02:16.367668+0000","last_undegraded":"2024-09-12T18:02:16.367668+0000","last_fullsized":"2024-09-12T18:02:16.367668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368249+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:02:16.368249+0000","last_peered":"2024-09-12T18:02:16.368249+0000","last_clean":"2024-09-12T18:02:16.368249+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:02:16.368249+0000","last_undegraded":"2024-09-12T18:02:16.368249+0000","last_fullsized":"2024-09-12T18:02:16.368249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269101+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:02:16.269101+0000","last_peered":"2024-09-12T18:02:16.269101+0000","last_clean":"2024-09-12T18:02:16.269101+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:02:16.269101+0000","last_undegraded":"2024-09-12T18:02:16.269101+0000","last_fullsized":"2024-09-12T18:02:16.269101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269743+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:02:16.269743+0000","last_peered":"2024-09-12T18:02:16.269743+0000","last_clean":"2024-09-12T18:02:16.269743+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:02:16.269743+0000","last_undegraded":"2024-09-12T18:02:16.269743+0000","last_fullsized":"2024-09-12T18:02:16.269743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269663+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:02:16.269663+0000","last_peered":"2024-09-12T18:02:16.269663+0000","last_clean":"2024-09-12T18:02:16.269663+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:02:16.269663+0000","last_undegraded":"2024-09-12T18:02:16.269663+0000","last_fullsized":"2024-09-12T18:02:16.269663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266305+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:02:16.266305+0000","last_peered":"2024-09-12T18:02:16.266305+0000","last_clean":"2024-09-12T18:02:16.266305+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:02:16.266305+0000","last_undegraded":"2024-09-12T18:02:16.266305+0000","last_fullsized":"2024-09-12T18:02:16.266305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.270070+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:02:16.270070+0000","last_peered":"2024-09-12T18:02:16.270070+0000","last_clean":"2024-09-12T18:02:16.270070+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:02:16.270070+0000","last_undegraded":"2024-09-12T18:02:16.270070+0000","last_fullsized":"2024-09-12T18:02:16.270070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266384+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:02:16.266384+0000","last_peered":"2024-09-12T18:02:16.266384+0000","last_clean":"2024-09-12T18:02:16.266384+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:02:16.266384+0000","last_undegraded":"2024-09-12T18:02:16.266384+0000","last_fullsized":"2024-09-12T18:02:16.266384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368245+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:02:16.368245+0000","last_peered":"2024-09-12T18:02:16.368245+0000","last_clean":"2024-09-12T18:02:16.368245+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:02:16.368245+0000","last_undegraded":"2024-09-12T18:02:16.368245+0000","last_fullsized":"2024-09-12T18:02:16.368245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268870+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:02:16.268870+0000","last_peered":"2024-09-12T18:02:16.268870+0000","last_clean":"2024-09-12T18:02:16.268870+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:02:16.268870+0000","last_undegraded":"2024-09-12T18:02:16.268870+0000","last_fullsized":"2024-09-12T18:02:16.268870+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.270492+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:02:16.270492+0000","last_peered":"2024-09-12T18:02:16.270492+0000","last_clean":"2024-09-12T18:02:16.270492+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:02:16.270492+0000","last_undegraded":"2024-09-12T18:02:16.270492+0000","last_fullsized":"2024-09-12T18:02:16.270492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368395+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:02:16.368395+0000","last_peered":"2024-09-12T18:02:16.368395+0000","last_clean":"2024-09-12T18:02:16.368395+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:02:16.368395+0000","last_undegraded":"2024-09-12T18:02:16.368395+0000","last_fullsized":"2024-09-12T18:02:16.368395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269951+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:02:16.269951+0000","last_peered":"2024-09-12T18:02:16.269951+0000","last_clean":"2024-09-12T18:02:16.269951+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:02:16.269951+0000","last_undegraded":"2024-09-12T18:02:16.269951+0000","last_fullsized":"2024-09-12T18:02:16.269951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268596+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:02:16.268596+0000","last_peered":"2024-09-12T18:02:16.268596+0000","last_clean":"2024-09-12T18:02:16.268596+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:02:16.268596+0000","last_undegraded":"2024-09-12T18:02:16.268596+0000","last_fullsized":"2024-09-12T18:02:16.268596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367555+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:02:16.367555+0000","last_peered":"2024-09-12T18:02:16.367555+0000","last_clean":"2024-09-12T18:02:16.367555+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:02:16.367555+0000","last_undegraded":"2024-09-12T18:02:16.367555+0000","last_fullsized":"2024-09-12T18:02:16.367555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266964+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:02:16.266964+0000","last_peered":"2024-09-12T18:02:16.266964+0000","last_clean":"2024-09-12T18:02:16.266964+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:02:16.266964+0000","last_undegraded":"2024-09-12T18:02:16.266964+0000","last_fullsized":"2024-09-12T18:02:16.266964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368921+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:02:16.368921+0000","last_peered":"2024-09-12T18:02:16.368921+0000","last_clean":"2024-09-12T18:02:16.368921+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:02:16.368921+0000","last_undegraded":"2024-09-12T18:02:16.368921+0000","last_fullsized":"2024-09-12T18:02:16.368921+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266435+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:02:16.266435+0000","last_peered":"2024-09-12T18:02:16.266435+0000","last_clean":"2024-09-12T18:02:16.266435+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:02:16.266435+0000","last_undegraded":"2024-09-12T18:02:16.266435+0000","last_fullsized":"2024-09-12T18:02:16.266435+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368767+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:02:16.368767+0000","last_peered":"2024-09-12T18:02:16.368767+0000","last_clean":"2024-09-12T18:02:16.368767+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:02:16.368767+0000","last_undegraded":"2024-09-12T18:02:16.368767+0000","last_fullsized":"2024-09-12T18:02:16.368767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269920+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:02:16.269920+0000","last_peered":"2024-09-12T18:02:16.269920+0000","last_clean":"2024-09-12T18:02:16.269920+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:02:16.269920+0000","last_undegraded":"2024-09-12T18:02:16.269920+0000","last_fullsized":"2024-09-12T18:02:16.269920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.270353+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:02:16.270353+0000","last_peered":"2024-09-12T18:02:16.270353+0000","last_clean":"2024-09-12T18:02:16.270353+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:02:16.270353+0000","last_undegraded":"2024-09-12T18:02:16.270353+0000","last_fullsized":"2024-09-12T18:02:16.270353+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368654+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:02:16.368654+0000","last_peered":"2024-09-12T18:02:16.368654+0000","last_clean":"2024-09-12T18:02:16.368654+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:02:16.368654+0000","last_undegraded":"2024-09-12T18:02:16.368654+0000","last_fullsized":"2024-09-12T18:02:16.368654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.270229+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:02:16.270229+0000","last_peered":"2024-09-12T18:02:16.270229+0000","last_clean":"2024-09-12T18:02:16.270229+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:02:16.270229+0000","last_undegraded":"2024-09-12T18:02:16.270229+0000","last_fullsized":"2024-09-12T18:02:16.270229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368979+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:02:16.368979+0000","last_peered":"2024-09-12T18:02:16.368979+0000","last_clean":"2024-09-12T18:02:16.368979+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:02:16.368979+0000","last_undegraded":"2024-09-12T18:02:16.368979+0000","last_fullsized":"2024-09-12T18:02:16.368979+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267229+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:02:16.267229+0000","last_peered":"2024-09-12T18:02:16.267229+0000","last_clean":"2024-09-12T18:02:16.267229+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:02:16.267229+0000","last_undegraded":"2024-09-12T18:02:16.267229+0000","last_fullsized":"2024-09-12T18:02:16.267229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.369283+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:02:16.369283+0000","last_peered":"2024-09-12T18:02:16.369283+0000","last_clean":"2024-09-12T18:02:16.369283+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:02:16.369283+0000","last_undegraded":"2024-09-12T18:02:16.369283+0000","last_fullsized":"2024-09-12T18:02:16.369283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267471+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:02:16.267471+0000","last_peered":"2024-09-12T18:02:16.267471+0000","last_clean":"2024-09-12T18:02:16.267471+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:02:16.267471+0000","last_undegraded":"2024-09-12T18:02:16.267471+0000","last_fullsized":"2024-09-12T18:02:16.267471+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266777+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:02:16.266777+0000","last_peered":"2024-09-12T18:02:16.266777+0000","last_clean":"2024-09-12T18:02:16.266777+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:02:16.266777+0000","last_undegraded":"2024-09-12T18:02:16.266777+0000","last_fullsized":"2024-09-12T18:02:16.266777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.369308+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:02:16.369308+0000","last_peered":"2024-09-12T18:02:16.369308+0000","last_clean":"2024-09-12T18:02:16.369308+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:02:16.369308+0000","last_undegraded":"2024-09-12T18:02:16.369308+0000","last_fullsized":"2024-09-12T18:02:16.369308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.369213+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:02:16.369213+0000","last_peered":"2024-09-12T18:02:16.369213+0000","last_clean":"2024-09-12T18:02:16.369213+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:02:16.369213+0000","last_undegraded":"2024-09-12T18:02:16.369213+0000","last_fullsized":"2024-09-12T18:02:16.369213+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367220+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:02:16.367220+0000","last_peered":"2024-09-12T18:02:16.367220+0000","last_clean":"2024-09-12T18:02:16.367220+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:02:16.367220+0000","last_undegraded":"2024-09-12T18:02:16.367220+0000","last_fullsized":"2024-09-12T18:02:16.367220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'2","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.369147+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:02:16.369147+0000","last_peered":"2024-09-12T18:02:16.369147+0000","last_clean":"2024-09-12T18:02:16.369147+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:02:16.369147+0000","last_undegraded":"2024-09-12T18:02:16.369147+0000","last_fullsized":"2024-09-12T18:02:16.369147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269566+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:02:16.269566+0000","last_peered":"2024-09-12T18:02:16.269566+0000","last_clean":"2024-09-12T18:02:16.269566+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:02:16.269566+0000","last_undegraded":"2024-09-12T18:02:16.269566+0000","last_fullsized":"2024-09-12T18:02:16.269566+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266191+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:02:16.266191+0000","last_peered":"2024-09-12T18:02:16.266191+0000","last_clean":"2024-09-12T18:02:16.266191+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:02:16.266191+0000","last_undegraded":"2024-09-12T18:02:16.266191+0000","last_fullsized":"2024-09-12T18:02:16.266191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269721+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:02:16.269721+0000","last_peered":"2024-09-12T18:02:16.269721+0000","last_clean":"2024-09-12T18:02:16.269721+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:02:16.269721+0000","last_undegraded":"2024-09-12T18:02:16.269721+0000","last_fullsized":"2024-09-12T18:02:16.269721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'9","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269248+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:02:16.269248+0000","last_peered":"2024-09-12T18:02:16.269248+0000","last_clean":"2024-09-12T18:02:16.269248+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:02:16.269248+0000","last_undegraded":"2024-09-12T18:02:16.269248+0000","last_fullsized":"2024-09-12T18:02:16.269248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367266+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:02:16.367266+0000","last_peered":"2024-09-12T18:02:16.367266+0000","last_clean":"2024-09-12T18:02:16.367266+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:02:16.367266+0000","last_undegraded":"2024-09-12T18:02:16.367266+0000","last_fullsized":"2024-09-12T18:02:16.367266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267211+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:02:16.267211+0000","last_peered":"2024-09-12T18:02:16.267211+0000","last_clean":"2024-09-12T18:02:16.267211+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:02:16.267211+0000","last_undegraded":"2024-09-12T18:02:16.267211+0000","last_fullsized":"2024-09-12T18:02:16.267211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.270360+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:02:16.270360+0000","last_peered":"2024-09-12T18:02:16.270360+0000","last_clean":"2024-09-12T18:02:16.270360+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:02:16.270360+0000","last_undegraded":"2024-09-12T18:02:16.270360+0000","last_fullsized":"2024-09-12T18:02:16.270360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367194+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:02:16.367194+0000","last_peered":"2024-09-12T18:02:16.367194+0000","last_clean":"2024-09-12T18:02:16.367194+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:02:16.367194+0000","last_undegraded":"2024-09-12T18:02:16.367194+0000","last_fullsized":"2024-09-12T18:02:16.367194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.369056+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:02:16.369056+0000","last_peered":"2024-09-12T18:02:16.369056+0000","last_clean":"2024-09-12T18:02:16.369056+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:02:16.369056+0000","last_undegraded":"2024-09-12T18:02:16.369056+0000","last_fullsized":"2024-09-12T18:02:16.369056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367129+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:02:16.367129+0000","last_peered":"2024-09-12T18:02:16.367129+0000","last_clean":"2024-09-12T18:02:16.367129+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:02:16.367129+0000","last_undegraded":"2024-09-12T18:02:16.367129+0000","last_fullsized":"2024-09-12T18:02:16.367129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268064+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:02:16.268064+0000","last_peered":"2024-09-12T18:02:16.268064+0000","last_clean":"2024-09-12T18:02:16.268064+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:02:16.268064+0000","last_undegraded":"2024-09-12T18:02:16.268064+0000","last_fullsized":"2024-09-12T18:02:16.268064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367582+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:02:16.367582+0000","last_peered":"2024-09-12T18:02:16.367582+0000","last_clean":"2024-09-12T18:02:16.367582+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:02:16.367582+0000","last_undegraded":"2024-09-12T18:02:16.367582+0000","last_fullsized":"2024-09-12T18:02:16.367582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368258+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:02:16.368258+0000","last_peered":"2024-09-12T18:02:16.368258+0000","last_clean":"2024-09-12T18:02:16.368258+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:02:16.368258+0000","last_undegraded":"2024-09-12T18:02:16.368258+0000","last_fullsized":"2024-09-12T18:02:16.368258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.367490+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:02:16.367490+0000","last_peered":"2024-09-12T18:02:16.367490+0000","last_clean":"2024-09-12T18:02:16.367490+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:02:16.367490+0000","last_undegraded":"2024-09-12T18:02:16.367490+0000","last_fullsized":"2024-09-12T18:02:16.367490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266768+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:02:16.266768+0000","last_peered":"2024-09-12T18:02:16.266768+0000","last_clean":"2024-09-12T18:02:16.266768+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:02:16.266768+0000","last_undegraded":"2024-09-12T18:02:16.266768+0000","last_fullsized":"2024-09-12T18:02:16.266768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267501+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:02:16.267501+0000","last_peered":"2024-09-12T18:02:16.267501+0000","last_clean":"2024-09-12T18:02:16.267501+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:02:16.267501+0000","last_undegraded":"2024-09-12T18:02:16.267501+0000","last_fullsized":"2024-09-12T18:02:16.267501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267634+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:02:16.267634+0000","last_peered":"2024-09-12T18:02:16.267634+0000","last_clean":"2024-09-12T18:02:16.267634+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:02:16.267634+0000","last_undegraded":"2024-09-12T18:02:16.267634+0000","last_fullsized":"2024-09-12T18:02:16.267634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267309+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:02:16.267309+0000","last_peered":"2024-09-12T18:02:16.267309+0000","last_clean":"2024-09-12T18:02:16.267309+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:02:16.267309+0000","last_undegraded":"2024-09-12T18:02:16.267309+0000","last_fullsized":"2024-09-12T18:02:16.267309+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.270070+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:02:16.270070+0000","last_peered":"2024-09-12T18:02:16.270070+0000","last_clean":"2024-09-12T18:02:16.270070+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:02:16.270070+0000","last_undegraded":"2024-09-12T18:02:16.270070+0000","last_fullsized":"2024-09-12T18:02:16.270070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269202+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:02:16.269202+0000","last_peered":"2024-09-12T18:02:16.269202+0000","last_clean":"2024-09-12T18:02:16.269202+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:02:16.269202+0000","last_undegraded":"2024-09-12T18:02:16.269202+0000","last_fullsized":"2024-09-12T18:02:16.269202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.269637+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:02:16.269637+0000","last_peered":"2024-09-12T18:02:16.269637+0000","last_clean":"2024-09-12T18:02:16.269637+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:02:16.269637+0000","last_undegraded":"2024-09-12T18:02:16.269637+0000","last_fullsized":"2024-09-12T18:02:16.269637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.267045+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:02:16.267045+0000","last_peered":"2024-09-12T18:02:16.267045+0000","last_clean":"2024-09-12T18:02:16.267045+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:02:16.267045+0000","last_undegraded":"2024-09-12T18:02:16.267045+0000","last_fullsized":"2024-09-12T18:02:16.267045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.266359+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:02:16.266359+0000","last_peered":"2024-09-12T18:02:16.266359+0000","last_clean":"2024-09-12T18:02:16.266359+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:02:16.266359+0000","last_undegraded":"2024-09-12T18:02:16.266359+0000","last_fullsized":"2024-09-12T18:02:16.266359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368977+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:02:16.368977+0000","last_peered":"2024-09-12T18:02:16.368977+0000","last_clean":"2024-09-12T18:02:16.368977+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:02:16.368977+0000","last_undegraded":"2024-09-12T18:02:16.368977+0000","last_fullsized":"2024-09-12T18:02:16.368977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.268384+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:02:16.268384+0000","last_peered":"2024-09-12T18:02:16.268384+0000","last_clean":"2024-09-12T18:02:16.268384+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:02:16.268384+0000","last_undegraded":"2024-09-12T18:02:16.268384+0000","last_fullsized":"2024-09-12T18:02:16.268384+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T18:02:16.368540+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:02:16.368540+0000","last_peered":"2024-09-12T18:02:16.368540+0000","last_clean":"2024-09-12T18:02:16.368540+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:02:16.368540+0000","last_undegraded":"2024-09-12T18:02:16.368540+0000","last_fullsized":"2024-09-12T18:02:16.368540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5682,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":84993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":307200,"data_stored":679792,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":319488,"data_stored":680427,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:19.937 INFO:tasks.thrashosds.thrasher:Setting 4.31 to [0, 2] 2024-09-12T18:02:19.937 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.31', '0', '2'] 2024-09-12T18:02:19.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.31 0 2 2024-09-12T18:02:20.025 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:20.026+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:20.067 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:20.067 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:20.081 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:20.126 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:20.125+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:20.226 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:20.228+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:20.245 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:20.245 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:20.261 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:20.327 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:20.328+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:20.384 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:20.384 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:20.398 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:20.445 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:20.444+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:20.529 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:20.529+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:20.530 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:20.530 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:20.544 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:20.633 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:20.632+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:20.647 INFO:teuthology.orchestra.run.smithi052.stderr:set 4.31 pg_upmap mapping to [0,2] 2024-09-12T18:02:20.709 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:20.709 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:20.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:20.731 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:20.729+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:20.832 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:20.834+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:20.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:20.888 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:20.889 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:20.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:20.949 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:20.949+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:20.993 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:20.993 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:21.014 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:21.033 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:21.033+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:21.036 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:21.036 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:21.037 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:21.037 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:21.037 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:21.037 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:21.051 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:21.141 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:21.141+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:21.214 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:21.214 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:21.214 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:21.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:21.273 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:21.273+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:21.335 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:21.334+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:21.395 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.857241324, 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.854937126999999, 2024-09-12T18:02:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 28.851630079, 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.704241926000002, 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.704148863, 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:21.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:21.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.70410639, 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:21.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:21.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.427 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.704002163999998, 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:21.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:21.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:21.433 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.703966331, 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:21.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:21.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.703935311999999, 2024-09-12T18:02:21.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:21.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:21.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.703884372000001, 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.445 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:21.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.449 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.703829298999999, 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.453 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.703795483, 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:21.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:21.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.702451906, 2024-09-12T18:02:21.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:21.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:21.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.702182487999998, 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:21.462 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:21.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:21.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.700422012000001, 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.467 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:21.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:21.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.700266357, 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:21.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.476 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.698105857000002, 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:21.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:21.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 24.708891263000002, 2024-09-12T18:02:21.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:21.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.7069379060000003, 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.487 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:21.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:21.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.7063661049999999, 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:21.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:21.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:21.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.499 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:21.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:21.500 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:21.501 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:21.502 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:21.500+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:21.602 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:21.602+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:21.632 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:21.633 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:21.633 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:21.633 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:21.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:02:21.647 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:21.703 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:21.700+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:21.804 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:21.805+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:21.809 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:21.809 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:21.810 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:21.823 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:21.905 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:21.906+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.299834134000001, 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:21.944 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:21.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:21.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:21.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.299717086000001, 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.951 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:21.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:21.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:21.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.299427018000003, 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.958 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:21.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:21.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.299244430000002, 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:21.964 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:21.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.298557563000003, 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:21.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:21.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.976 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.298411053000002, 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:21.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:21.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.298323631000002, 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.983 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:21.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:21.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.193128182000002, 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:21.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:21.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.994 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.193045126000001, 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:21.995 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:21.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:21.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:21.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.000 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.192976807000001, 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.001 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:22.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:22.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.192797767999998, 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.007 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:22.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.088471165000001, 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.013 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:22.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:22.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:22.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.088425166, 2024-09-12T18:02:22.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:22.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:22.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:22.025 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 37.088307723, 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:22.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.031 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.984076449, 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:22.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:22.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.984042836, 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.038 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.043 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.983873434000003, 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.044 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:22.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.983834221000002, 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.050 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:22.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:22.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.983790153999998, 2024-09-12T18:02:22.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:22.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:22.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:22.062 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.983671835000003, 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:22.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:22.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:22.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:22.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:22.068 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:22.069 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:22.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:22.071 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:22.069+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:22.171 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:22.168+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:22.201 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:22.201 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:22.201 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:22.202 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:22.215 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:22.271 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:22.269+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:22.372 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:22.374+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:22.379 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:22.379 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:22.379 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:22.379 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:22.379 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:22.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:22.473 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:22.473+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:22.519 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:22.519 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:22.520 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:22.520 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:22.520 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.520 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:22.520 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:22.520 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.874959132000001, 2024-09-12T18:02:22.520 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:22.520 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.521 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:22.522 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.523 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.524 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:22.525 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.874285946999997, 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.526 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.527 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:22.528 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.529 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.873676844999999, 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.530 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.531 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.532 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.533 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:22.534 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.873149531999999, 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.535 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.536 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.537 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.538 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.539 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.872708496000001, 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.540 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:22.541 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.542 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.544 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.871930452000001, 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.545 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:22.546 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.547 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.548 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:22.549 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.871438484999999, 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.550 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.551 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.552 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:22.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.554 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.555 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.870870926999999, 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:22.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.870366511, 2024-09-12T18:02:22.560 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.561 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:22.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:22.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.869889237000002, 2024-09-12T18:02:22.565 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.869443404999998, 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.571 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:22.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:22.575 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.868902349000003, 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:22.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:22.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:22.580 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.868563911000003, 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.581 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:22.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:22.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 37.767720500000003, 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:22.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:22.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.590 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.828480978999998, 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.591 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:22.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:22.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.828361529999999, 2024-09-12T18:02:22.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:22.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:22.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.828186291000002, 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:22.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:22.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:22.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:22.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.828122441000001, 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.610 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:22.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:22.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.828003759000001, 2024-09-12T18:02:22.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:22.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:22.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:22.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:22.622 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.827935947, 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:22.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:22.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.626 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.627 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.627 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:22.627 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:22.627 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:22.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:22.629 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:22.630+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:22.660 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:02:22.729 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:22.728+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:22.761 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:22.761 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:22.761 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:22.775 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:22.830 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:22.832+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:22.896 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:22.897 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:22.897 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:22.910 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:22.957 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:22.957+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:23.030 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:23.030 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:23.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:23.030 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:23.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:23.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.492280739999998, 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:23.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:23.035 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.489976543000001, 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:23.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.486669495000001, 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:23.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.045 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.339281342, 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:23.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:23.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:23.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.051 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.339188278999998, 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:23.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:23.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.057 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.339145806000001, 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:23.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:23.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.33904158, 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.064 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:23.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:23.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.339005747000002, 2024-09-12T18:02:23.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:23.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:23.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.076 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.338974728, 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:23.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:23.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.338923787999999, 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:23.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:23.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.338868715, 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:23.087 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:23.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.338834898999998, 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:23.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:23.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:23.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.337491321999998, 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:23.096 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.337221904, 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:23.100 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:23.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:23.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.335461427999999, 2024-09-12T18:02:23.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:23.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:23.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.335305773000002, 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:23.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.333145273, 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.114 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:23.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.343930679, 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.119 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:23.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:23.125 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.341977322, 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:23.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:23.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.3414055210000004, 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:23.132 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:23.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:23.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:23.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:23.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:23.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:23.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.138 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:23.138 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:23.138 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:23.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:23.140 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:23.142+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:23.141 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:23.240 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:23.241+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:23.272 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:23.272 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:23.272 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:23.272 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:23.289 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:23.290 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:23.291 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:23.316 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:23.316 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:23.339 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:23.340 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:23.341 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:23.342+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:23.411 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:23.411 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:23.425 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:23.442 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:23.444+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:23.542 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:23.542+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:23.595 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:23.596 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:23.609 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:23.643 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:23.641+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:23.739 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:23.739 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:23.744 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:23.740+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:23.753 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:23.845 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:23.846+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:23.927 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:23.927 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:23.942 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:23.989 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:23.988+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:24.047 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:24.046+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:24.059 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:24.059 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:24.075 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:24.148 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:24.145+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:24.208 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:24.208 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:24.222 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:24.248 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:24.244+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:24.349 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:24.350+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:24.388 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:24.388 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:24.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:24.450 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:24.450+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:24.519 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:24.519 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:24.533 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:24.580 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:24.582+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:24.652 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:24.649+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:24.665 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:24.665 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:24.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:24.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:02:24.753 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:24.753+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:24.841 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:24.841 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:24.853 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:24.853+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:24.855 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:24.954 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:24.954+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:24.975 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:24.975 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:24.989 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:25.055 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:25.054+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:25.120 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:25.120 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:25.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:25.155 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:25.153+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:25.251 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:25.251 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:25.256 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:25.257+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:25.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:25.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:25.358 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:25.358+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:25.388 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:25.388 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:25.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:25.458 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:25.457+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:25.526 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:25.526 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:25.535 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:25.535 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:25.548 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:25.548 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:25.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:25.559 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:25.560+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:25.567 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:25.567 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:25.660 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:25.662+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:25.665 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:02:25.665 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:02:25.665 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:02:25.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:02:25.678 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:02:25.713 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:25.713 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:25.713 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:25.714 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:25.714 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:25.729 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:25.760 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:25.762+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:25.852 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:25.852 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:25.852 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:25.852 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:25.852 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.852 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:25.852 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:25.852 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.315279050000001, 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.853 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.854 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:25.855 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:25.856 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.312974853, 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.857 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.858 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.859 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.860 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.309667804999997, 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.861 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:25.862 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:25.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:25.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.162279651999999, 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:25.865 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.162186589000001, 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.162144116, 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:25.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.162039889999999, 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:25.881 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:25.886 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.162004057000001, 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.891 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.161973037999999, 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.896 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.161922098000002, 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.161867024999999, 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:25.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.904 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.161833209000001, 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:25.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:25.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.908 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.160489632000001, 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:25.912 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.160220213999999, 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:25.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.158459738000001, 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.917 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:25.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.158304083000001, 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:25.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:25.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:25.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:25.926 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.156143582999999, 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:25.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.928 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:25.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 29.166928988999999, 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:25.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:25.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:25.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.164975632000001, 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:25.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:25.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:25.943 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 7.1644038309999996, 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:25.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:25.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:25.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:25.949 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:25.951 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:25.951 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:25.949+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:26.021 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:26.021 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 30, 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "da5a949a-216b-4267-953a-8d92e3d25b1d", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-09-12T18:01:33.537080+0000", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-09-12T18:02:25.670282+0000", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-09-12T18:01:42.466111+0000", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-09-12T18:01:34.442067+0000", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5806080, 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "nodeep-scrub", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "noscrub", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-09-12T18:02:26.022 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "luminous", 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "squid", 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-09-12T18:02:26.023 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:42.598261+0000", 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:26.024 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:26.025 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:26.026 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:26.027 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:26.028 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:02:26.029 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:48.792102+0000", 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 8193, 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:02:26.030 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-09-12T18:02:26.031 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "15", 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:26.032 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 2, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 15, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:26.033 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:26.034 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:26.035 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.036 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:53.545540+0000", 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:26.037 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:26.038 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:26.039 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:26.040 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:26.042 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:54.024396+0000", 2024-09-12T18:02:26.043 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-09-12T18:02:26.044 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "19", 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:26.046 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:26.047 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:02:26.048 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:26.049 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "f692452d-28b8-4aad-928e-fe1805e23b68", 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:26.050 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 27, 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6800", 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.051 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6801", 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6802", 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.052 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6803", 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6806", 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.053 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6807", 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6804", 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.054 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6805", 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.111:6801/177809282", 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.111:6803/177809282", 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.111:6807/177809282", 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.111:6805/177809282", 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.055 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "b5b3807e-e3b5-4530-adc6-af19dd31e340", 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:26.056 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6800", 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6801", 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.057 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6802", 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6803", 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.058 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6806", 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6807", 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.059 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6804", 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6805", 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.121:6801/3534339867", 2024-09-12T18:02:26.060 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.121:6803/3534339867", 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.121:6807/3534339867", 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.121:6805/3534339867", 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "926e4870-279e-45c7-9d6c-5841397a5e6c", 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:26.061 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6800", 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.062 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6801", 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6802", 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.063 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6803", 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6806", 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.064 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6807", 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6804", 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.065 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6805", 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.153:6801/284634690", 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.153:6803/284634690", 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.153:6807/284634690", 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.153:6805/284634690", 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.066 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.382866+0000", 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:26.067 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.379192+0000", 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:26.068 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.336708+0000", 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [ 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: "pgid": "4.31", 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: 0, 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: 2 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-09-12T18:02:26.069 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-09-12T18:02:26.070 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:26.071 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:02:26.073 INFO:tasks.thrashosds.thrasher:j is {'epoch': 30, 'fsid': 'da5a949a-216b-4267-953a-8d92e3d25b1d', 'created': '2024-09-12T18:01:33.537080+0000', 'modified': '2024-09-12T18:02:25.670282+0000', 'last_up_change': '2024-09-12T18:01:42.466111+0000', 'last_in_change': '2024-09-12T18:01:34.442067+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:01:42.598261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:01:48.792102+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:01:53.545540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:01:54.024396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f692452d-28b8-4aad-928e-fe1805e23b68', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 177809282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 177809282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 177809282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 177809282}]}, 'public_addr': '172.21.15.111:6801/177809282', 'cluster_addr': '172.21.15.111:6803/177809282', 'heartbeat_back_addr': '172.21.15.111:6807/177809282', 'heartbeat_front_addr': '172.21.15.111:6805/177809282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'b5b3807e-e3b5-4530-adc6-af19dd31e340', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6800', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6801', 'nonce': 3534339867}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6802', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6803', 'nonce': 3534339867}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6806', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6807', 'nonce': 3534339867}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6804', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6805', 'nonce': 3534339867}]}, 'public_addr': '172.21.15.121:6801/3534339867', 'cluster_addr': '172.21.15.121:6803/3534339867', 'heartbeat_back_addr': '172.21.15.121:6807/3534339867', 'heartbeat_front_addr': '172.21.15.121:6805/3534339867', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '926e4870-279e-45c7-9d6c-5841397a5e6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 284634690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 284634690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 284634690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 284634690}]}, 'public_addr': '172.21.15.153:6801/284634690', 'cluster_addr': '172.21.15.153:6803/284634690', 'heartbeat_back_addr': '172.21.15.153:6807/284634690', 'heartbeat_front_addr': '172.21.15.153:6805/284634690', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.382866+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.379192+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.336708+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.31', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:02:26.073 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T18:02:26.073 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:26.072+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:26.084 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:26.084 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:26.084 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:26.084 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:26.098 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:26.173 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:26.174+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:26.220 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:26.220 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:26.220 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:26.234 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:26.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:26.272+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:26.375 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:26.373+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:26.406 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:26.406 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:26.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.761811590000001, 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.407 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:26.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:26.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:26.413 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.761694542000001, 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.414 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:26.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.761404474000003, 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:26.422 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:26.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.761221886000001, 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.430 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:26.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:26.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:26.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.436 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.760535019000002, 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.437 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:26.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:26.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:26.444 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.760388509000002, 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:26.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.451 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.760301087000002, 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:26.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:26.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:26.458 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.655105638000002, 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.459 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.655022582000001, 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:26.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:26.474 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.654954263, 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:26.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:26.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:26.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.654775223999998, 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.482 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:26.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:26.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.550448621000001, 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.490 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.550402622, 2024-09-12T18:02:26.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:26.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.550285178999999, 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.505 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:26.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:26.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:26.512 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.446053904999999, 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:26.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.446020292, 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.520 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:26.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:26.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:26.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.527 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.445850890000003, 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:26.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:26.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:26.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.445811677000002, 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:26.535 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:26.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:26.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.445767609999997, 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:26.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:26.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:26.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.445649291000002, 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:26.550 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:26.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:26.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:26.557 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:26.559 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:26.560 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:26.558+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:26.659 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:26.656+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:26.692 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:26.692 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:26.692 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:26.692 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:26.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:26.797 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:26.796+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:26.860 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:26.862+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:26.872 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:26.872 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:26.872 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:26.872 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:26.872 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:26.887 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:26.973 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:26.972+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.410205646999998, 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:27.055 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:27.056 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.057 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:27.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:27.059 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.060 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.409532462000001, 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.061 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.062 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.064 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.065 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.408923360000003, 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.067 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.068 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.069 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.070 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.071 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.408396046999997, 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.072 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.073 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.074 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.075 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:27.076 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.077 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.077 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.077 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:27.077 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:27.077 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.077 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.077 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.407955010999999, 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:27.078 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.079 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:27.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.083 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.407176966999998, 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:27.084 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:27.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.088 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.406685000000003, 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.089 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:27.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:27.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.092 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.093 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.094 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.406117442000003, 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:27.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:27.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:27.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.101 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:27.101 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:27.101 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.405613025999997, 2024-09-12T18:02:27.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:27.101 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.101 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.103 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.104 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.106 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.405135752, 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:27.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.110 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.404689920000003, 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.111 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:27.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.404148864, 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.117 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.119 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.121 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.122 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.403810426, 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.123 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:27.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:27.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 42.302967015, 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:27.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:27.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.363727493999999, 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.133 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:27.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:27.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.139 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.363608044999999, 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.140 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:27.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:27.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:27.145 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.363432805999999, 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.146 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:27.147 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:27.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:27.149 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.152 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.363368955999999, 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:27.153 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.154 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:27.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.157 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:27.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.160 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.363250273999999, 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.161 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:27.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:27.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.363182462000001, 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:27.167 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:27.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:27.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:27.171 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:27.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:27.174 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:27.172+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:27.274 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:27.272+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:27.302 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:27.303 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:27.303 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:27.303 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:27.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:27.375 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:27.373+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:27.433 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:27.433 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:27.433 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:27.433 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:27.433 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:27.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:27.476 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:27.478+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:27.577 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:27.575+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:27.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:27.619 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.082734905999999, 2024-09-12T18:02:27.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:27.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.080430708999998, 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:27.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.077123661000002, 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:27.630 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929735508, 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:27.635 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:27.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.641 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929642444999999, 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:27.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:27.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:27.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.647 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929599971999998, 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:27.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:27.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929495746000001, 2024-09-12T18:02:27.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:27.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:27.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929459912999999, 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:27.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.666 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929428894000001, 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:27.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.673 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929377954, 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:27.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:27.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929322881000001, 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:27.678 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:27.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.929289064999999, 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:27.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:27.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:27.687 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.927945487999999, 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:27.692 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.92767607, 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:27.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:27.697 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.925915593999999, 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:27.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.925759938999999, 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.703 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:27.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.923599439, 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:27.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.934384845, 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:27.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:27.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.932431488000001, 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:27.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:27.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:27.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:27.727 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.9318596869999993, 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:27.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:27.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:27.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:27.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:27.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.734 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:27.734 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:27.734 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:27.735 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:02:27.736 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:27.734+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:27.737 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:27.753 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:27.753 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:27.774 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:27.774 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:27.798 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:27.798 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:27.836 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:27.838+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:27.867 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:27.867 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:27.883 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:27.968 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:27.970+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:28.038 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:28.035+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:28.045 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:28.045 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:28.059 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:28.148 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:28.150+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:28.224 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:28.224 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:28.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:28.240 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:28.239+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:28.341 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:28.342+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:28.370 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:28.370 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:28.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:28.442 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:28.439+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:28.506 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:28.506 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:28.520 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:28.543 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:28.542+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:28.643 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:28.642+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:28.683 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:28.683 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:28.698 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:28.745 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:28.745+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:28.790 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:02:28.829 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:28.829 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:28.843 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:28.885 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:28.885+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:28.945 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:28.946+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:29.007 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:29.007 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:29.021 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:29.046 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:29.046+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:29.144 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:29.144 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:29.147 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:29.145+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:29.158 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:29.249 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:29.249+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:29.288 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:29.288 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:29.302 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:29.349 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:29.349+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:29.425 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:29.428 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:29.439 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:29.450 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:29.449+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:29.551 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:29.551+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:29.556 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:29.556 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:29.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:29.652 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:29.649+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:29.703 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:29.703 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:29.718 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:29.754 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:29.753+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:29.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:29.841 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:29.841 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:29.855 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:29.854+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:29.856 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:29.956 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:29.951+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:29.960 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:29.960 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:29.979 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:29.980 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:29.981 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:29.981 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:29.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:29.981 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:29.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.981 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:29.981 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:29.981 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.338013205999999, 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:29.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:29.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:29.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:29.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:29.985 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:29.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:29.986 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.337340021000003, 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:29.987 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:29.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:29.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:29.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.336730918999997, 2024-09-12T18:02:29.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:29.993 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:29.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:29.997 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.336203605999998, 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:29.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:29.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:30.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.002 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.33576257, 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.003 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.004 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:30.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.334984526, 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:30.008 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:30.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.334492558999997, 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.013 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:30.017 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.333925000999997, 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.018 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.019 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.020 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:30.021 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.022 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.333420584999999, 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.023 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:30.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.026 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.027 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.332943311000001, 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.028 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.029 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:30.030 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.031 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.032 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.332497478999997, 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:30.033 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.034 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:30.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.036 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.037 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.331956423000001, 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.038 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:30.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.040 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:30.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.042 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.331617985000001, 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.043 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.044 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.045 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:30.046 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.047 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 45.230774574000002, 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.048 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.049 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.050 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:30.051 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.052 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.291535052999997, 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.053 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:30.054 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:30.055 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.056 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:30.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:30.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:30.059 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.291415604000001, 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.060 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.061 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:30.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.064 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:30.065 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.291240365, 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.066 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.067 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.068 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:30.069 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.070 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:30.071 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.072 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.291176514999997, 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.073 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.074 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:30.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:30.076 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:30.077 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.078 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.291057832999996, 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.079 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:30.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:30.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:30.083 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:30.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:30.086 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.290990020999999, 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:30.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:30.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:30.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:30.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:30.091 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.091 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.091 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.091 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:30.091 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:30.091 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:30.092 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:30.094 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:30.095 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:30.095 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:30.094+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:30.193 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:30.191+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:30.226 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:30.226 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:30.226 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:30.226 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:30.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:30.295 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:30.294+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:30.358 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:30.358 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:30.358 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:30.358 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:30.358 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:30.372 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:30.417 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:30.417+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.957403298000003, 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:30.495 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:30.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:30.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.955099101000002, 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.500 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:30.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 37.951792052999998, 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.505 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:30.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:30.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.804403899999997, 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.510 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:30.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:30.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.804310837000003, 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:30.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.804268364000002, 2024-09-12T18:02:30.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:30.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:30.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.528 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.804164137999997, 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:30.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.804128304999999, 2024-09-12T18:02:30.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:30.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:30.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:30.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:30.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.541 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.804097286000001, 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:30.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:30.547 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.804046346, 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:30.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.550 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.803991273000001, 2024-09-12T18:02:30.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:30.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:30.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.803957457000003, 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:30.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.559 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.802613880000003, 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:30.561 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.564 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.802344462000001, 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:30.565 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.567 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:30.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.569 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:30.570 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:30.570 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.570 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.570 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.570 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.570 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:30.570 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.800583985999999, 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:30.572 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.573 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:30.574 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:30.575 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.800428330999999, 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.576 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:30.577 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.578 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.579 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.580 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.798267830999997, 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.581 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.582 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.583 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:30.584 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.585 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 33.809053237000001, 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.586 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.587 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:30.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.589 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.590 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:30.591 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.807099879999999, 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.592 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.593 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.594 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:30.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:30.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 11.806528079, 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:30.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:30.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.604 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:30.605 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:30.605 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:30.606 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:30.605+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:30.607 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:30.707 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:30.707+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:30.738 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:30.738 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:30.738 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:30.738 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:30.754 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:30.808 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:30.805+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:30.811 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:02:30.875 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:30.876 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:30.876 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:30.889 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:30.936 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:30.938+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.365308030999998, 2024-09-12T18:02:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.365190982999998, 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.364900915, 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.364718326999999, 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.36403146, 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.363884949999999, 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.363797527999999, 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.258602078999999, 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.258519022999998, 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:31.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:31.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:31.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.258450703999998, 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.067 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:31.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.258271665000002, 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.073 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:31.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:31.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.153945061999998, 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.079 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:31.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:31.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.153899062999997, 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.086 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:31.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:31.091 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.153781619999997, 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.092 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:31.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:31.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:31.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.049550345999997, 2024-09-12T18:02:31.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:31.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:31.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.049516732999997, 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.105 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:31.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.049347331, 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.111 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:31.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.117 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.049308117999999, 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.118 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:31.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.123 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.049264051000002, 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 46.049145731999999, 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:31.130 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:31.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:31.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:31.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:31.136 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:31.137 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:02:31.137 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:02:31.137 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:02:31.137 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:02:31.139 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:31.137+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:31.139 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:31.238 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:31.237+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:31.270 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:31.270 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:31.270 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:31.270 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:31.285 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:31.339 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:31.335+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:31.402 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:31.403 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:31.403 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:31.403 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:31.403 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:31.417 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:31.440 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:31.437+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:31.541 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:31.541+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:31.585 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:31.585 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:31.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:31.585 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:31.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.585 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:31.585 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.941479082999997, 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:31.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:31.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:31.590 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.940805898000001, 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:31.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:31.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:31.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:31.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:31.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:31.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:31.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:31.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:31.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:31.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:31.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.597 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.940196796000002, 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:31.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:31.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.939669483000003, 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:31.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:31.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.939228446999998, 2024-09-12T18:02:31.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.610 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.611 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.938450402999997, 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:31.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.616 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.937958436000002, 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:31.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.937390878000002, 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.621 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:31.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.625 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.936886461999997, 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:31.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.936409187999999, 2024-09-12T18:02:31.630 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.631 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:31.634 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.935963356000002, 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:31.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:31.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:31.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.639 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:31.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:31.640 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.640 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.640 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.640 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.640 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:31.640 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.935422299999999, 2024-09-12T18:02:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:31.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:31.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:31.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:31.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:31.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.935083861999999, 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.647 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:31.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:31.649 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 46.834240450999999, 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.652 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:31.653 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.654 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.655 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 35.895000930000002, 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.656 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.657 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:31.658 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:31.659 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:31.661 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:31.661 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.661 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.661 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.661 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:31.661 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:31.661 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.661 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.662 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:31.663 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:31.663 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 35.894881480999999, 2024-09-12T18:02:31.663 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:31.663 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.663 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.663 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.663 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.663 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.664 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.664 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:31.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.664 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.664 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.664 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.664 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:31.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.665 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:31.665 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:31.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:31.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:31.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:31.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:31.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:31.668 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 35.894706241999998, 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.670 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.673 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:31.675 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 35.894642392000002, 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.677 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:31.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:31.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.680 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.680 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:31.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 35.894523710000001, 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:31.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:31.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 35.894455897999997, 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:31.690 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:31.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:31.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:31.694 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:31.697 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:31.697 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:31.695+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:31.697 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:31.697 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:02:31.697 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 31, 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "da5a949a-216b-4267-953a-8d92e3d25b1d", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-09-12T18:01:33.537080+0000", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-09-12T18:02:28.782976+0000", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-09-12T18:01:42.466111+0000", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-09-12T18:01:34.442067+0000", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5804032, 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "nodeep-scrub", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-09-12T18:02:31.698 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "luminous", 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "squid", 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-09-12T18:02:31.699 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:42.598261+0000", 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:31.700 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:31.701 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:31.702 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:31.703 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:31.704 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:02:31.705 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:48.792102+0000", 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 8193, 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:02:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-09-12T18:02:31.707 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "15", 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:31.708 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 2, 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 15, 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:31.709 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:31.710 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.711 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.712 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:53.545540+0000", 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:31.713 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:31.714 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:31.715 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:31.716 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:31.718 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:54.024396+0000", 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:31.719 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-09-12T18:02:31.720 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "19", 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:31.721 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:31.722 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:31.723 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:02:31.724 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:31.725 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "f692452d-28b8-4aad-928e-fe1805e23b68", 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:31.726 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 27, 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6800", 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.727 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6801", 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6802", 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.728 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6803", 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6806", 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.729 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6807", 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6804", 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.730 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6805", 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.111:6801/177809282", 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.111:6803/177809282", 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.111:6807/177809282", 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.111:6805/177809282", 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.731 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "b5b3807e-e3b5-4530-adc6-af19dd31e340", 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:31.732 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6800", 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6801", 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.733 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6802", 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6803", 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.734 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6806", 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6807", 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.735 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6804", 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6805", 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:31.736 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.121:6801/3534339867", 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.121:6803/3534339867", 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.121:6807/3534339867", 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.121:6805/3534339867", 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.737 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "926e4870-279e-45c7-9d6c-5841397a5e6c", 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:31.738 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6800", 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6801", 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.739 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6802", 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6803", 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.740 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6806", 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6807", 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.741 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6804", 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6805", 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.742 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.153:6801/284634690", 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.153:6803/284634690", 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.153:6807/284634690", 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.153:6805/284634690", 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.382866+0000", 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:31.744 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.379192+0000", 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.336708+0000", 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:31.745 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [ 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: "pgid": "4.31", 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: 0, 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: 2 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-09-12T18:02:31.746 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-09-12T18:02:31.747 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:31.748 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:02:31.749 INFO:tasks.thrashosds.thrasher:j is {'epoch': 31, 'fsid': 'da5a949a-216b-4267-953a-8d92e3d25b1d', 'created': '2024-09-12T18:01:33.537080+0000', 'modified': '2024-09-12T18:02:28.782976+0000', 'last_up_change': '2024-09-12T18:01:42.466111+0000', 'last_in_change': '2024-09-12T18:01:34.442067+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:01:42.598261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:01:48.792102+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:01:53.545540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:01:54.024396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f692452d-28b8-4aad-928e-fe1805e23b68', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 177809282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 177809282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 177809282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 177809282}]}, 'public_addr': '172.21.15.111:6801/177809282', 'cluster_addr': '172.21.15.111:6803/177809282', 'heartbeat_back_addr': '172.21.15.111:6807/177809282', 'heartbeat_front_addr': '172.21.15.111:6805/177809282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'b5b3807e-e3b5-4530-adc6-af19dd31e340', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6800', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6801', 'nonce': 3534339867}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6802', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6803', 'nonce': 3534339867}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6806', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6807', 'nonce': 3534339867}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6804', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6805', 'nonce': 3534339867}]}, 'public_addr': '172.21.15.121:6801/3534339867', 'cluster_addr': '172.21.15.121:6803/3534339867', 'heartbeat_back_addr': '172.21.15.121:6807/3534339867', 'heartbeat_front_addr': '172.21.15.121:6805/3534339867', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '926e4870-279e-45c7-9d6c-5841397a5e6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 284634690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 284634690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 284634690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 284634690}]}, 'public_addr': '172.21.15.153:6801/284634690', 'cluster_addr': '172.21.15.153:6803/284634690', 'heartbeat_back_addr': '172.21.15.153:6807/284634690', 'heartbeat_front_addr': '172.21.15.153:6805/284634690', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.382866+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.379192+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.336708+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.31', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:02:31.749 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:31.796 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:31.795+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:31.809 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:02:31.883 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:31.883 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:31.883 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:31.883 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:31.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:31.899 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:31.897+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:31.998 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:31.998+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:32.061 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:32.062 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:32.062 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:32.062 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:32.062 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:32.077 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:32.095 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:32.099 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:32.098+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:32.195 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:32.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 41.657206592999998, 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:32.200 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.654902395999997, 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.201 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.202 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:32.205 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.651595348000001, 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:32.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:32.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.504207194999999, 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:32.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:32.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.504114131999998, 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.217 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:32.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:32.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.223 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.504071658999997, 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:32.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:32.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.503967433, 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:32.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:32.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.235 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.503931600000001, 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:32.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:32.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:32.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.503900581000003, 2024-09-12T18:02:32.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:32.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:32.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.503849641000002, 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:32.247 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:32.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.251 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.503794568000004, 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.503760751999998, 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:32.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.502417174999998, 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.260 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:32.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.502147757000003, 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.264 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:32.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:32.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:32.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:32.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.500387281000002, 2024-09-12T18:02:32.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.500231626000001, 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.274 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:32.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:32.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.278 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.498071125999999, 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.283 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.508856532000003, 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:32.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:32.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:32.289 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.506903175000001, 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:32.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:32.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:32.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.506331374, 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:32.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:32.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:32.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:32.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:32.302 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:32.302 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:32.303 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:32.304 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:32.302+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:32.306 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:32.308 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:32.309 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-12T18:02:31.809277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597738,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":200,"num_write_kb":2697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90360,"kb_used_data":952,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025160,"statfs":{"total":289910292480,"available":289817763840,"internally_reserved":0,"allocated":974848,"data_stored":1512189,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.242884"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682459+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:02:25.682459+0000","last_peered":"2024-09-12T18:02:25.682459+0000","last_clean":"2024-09-12T18:02:25.682459+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:02:25.682459+0000","last_undegraded":"2024-09-12T18:02:25.682459+0000","last_fullsized":"2024-09-12T18:02:25.682459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682181+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:02:25.682181+0000","last_peered":"2024-09-12T18:02:25.682181+0000","last_clean":"2024-09-12T18:02:25.682181+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:02:25.682181+0000","last_undegraded":"2024-09-12T18:02:25.682181+0000","last_fullsized":"2024-09-12T18:02:25.682181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682774+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:02:25.682774+0000","last_peered":"2024-09-12T18:02:25.682774+0000","last_clean":"2024-09-12T18:02:25.682774+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:02:25.682774+0000","last_undegraded":"2024-09-12T18:02:25.682774+0000","last_fullsized":"2024-09-12T18:02:25.682774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682922+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:02:25.682922+0000","last_peered":"2024-09-12T18:02:25.682922+0000","last_clean":"2024-09-12T18:02:25.682922+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:02:25.682922+0000","last_undegraded":"2024-09-12T18:02:25.682922+0000","last_fullsized":"2024-09-12T18:02:25.682922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681363+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:02:25.681363+0000","last_peered":"2024-09-12T18:02:25.681363+0000","last_clean":"2024-09-12T18:02:25.681363+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:02:25.681363+0000","last_undegraded":"2024-09-12T18:02:25.681363+0000","last_fullsized":"2024-09-12T18:02:25.681363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682415+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:02:25.682415+0000","last_peered":"2024-09-12T18:02:25.682415+0000","last_clean":"2024-09-12T18:02:25.682415+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:02:25.682415+0000","last_undegraded":"2024-09-12T18:02:25.682415+0000","last_fullsized":"2024-09-12T18:02:25.682415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682409+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:02:25.682409+0000","last_peered":"2024-09-12T18:02:25.682409+0000","last_clean":"2024-09-12T18:02:25.682409+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:02:25.682409+0000","last_undegraded":"2024-09-12T18:02:25.682409+0000","last_fullsized":"2024-09-12T18:02:25.682409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681665+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:02:25.681665+0000","last_peered":"2024-09-12T18:02:25.681665+0000","last_clean":"2024-09-12T18:02:25.681665+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:02:25.681665+0000","last_undegraded":"2024-09-12T18:02:25.681665+0000","last_fullsized":"2024-09-12T18:02:25.681665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399457+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:02:26.399457+0000","last_peered":"2024-09-12T18:02:26.399457+0000","last_clean":"2024-09-12T18:02:26.399457+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:02:26.399457+0000","last_undegraded":"2024-09-12T18:02:26.399457+0000","last_fullsized":"2024-09-12T18:02:26.399457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682280+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:02:25.682280+0000","last_peered":"2024-09-12T18:02:25.682280+0000","last_clean":"2024-09-12T18:02:25.682280+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:02:25.682280+0000","last_undegraded":"2024-09-12T18:02:25.682280+0000","last_fullsized":"2024-09-12T18:02:25.682280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683135+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:02:25.683135+0000","last_peered":"2024-09-12T18:02:25.683135+0000","last_clean":"2024-09-12T18:02:25.683135+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:02:25.683135+0000","last_undegraded":"2024-09-12T18:02:25.683135+0000","last_fullsized":"2024-09-12T18:02:25.683135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681424+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:02:25.681424+0000","last_peered":"2024-09-12T18:02:25.681424+0000","last_clean":"2024-09-12T18:02:25.681424+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:02:25.681424+0000","last_undegraded":"2024-09-12T18:02:25.681424+0000","last_fullsized":"2024-09-12T18:02:25.681424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681107+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:02:25.681107+0000","last_peered":"2024-09-12T18:02:25.681107+0000","last_clean":"2024-09-12T18:02:25.681107+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:02:25.681107+0000","last_undegraded":"2024-09-12T18:02:25.681107+0000","last_fullsized":"2024-09-12T18:02:25.681107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682512+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:02:25.682512+0000","last_peered":"2024-09-12T18:02:25.682512+0000","last_clean":"2024-09-12T18:02:25.682512+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:02:25.682512+0000","last_undegraded":"2024-09-12T18:02:25.682512+0000","last_fullsized":"2024-09-12T18:02:25.682512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682842+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:02:25.682842+0000","last_peered":"2024-09-12T18:02:25.682842+0000","last_clean":"2024-09-12T18:02:25.682842+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:02:25.682842+0000","last_undegraded":"2024-09-12T18:02:25.682842+0000","last_fullsized":"2024-09-12T18:02:25.682842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681816+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:02:25.681816+0000","last_peered":"2024-09-12T18:02:25.681816+0000","last_clean":"2024-09-12T18:02:25.681816+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:02:25.681816+0000","last_undegraded":"2024-09-12T18:02:25.681816+0000","last_fullsized":"2024-09-12T18:02:25.681816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.400001+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:02:26.400001+0000","last_peered":"2024-09-12T18:02:26.400001+0000","last_clean":"2024-09-12T18:02:26.400001+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:02:26.400001+0000","last_undegraded":"2024-09-12T18:02:26.400001+0000","last_fullsized":"2024-09-12T18:02:26.400001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682756+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:02:25.682756+0000","last_peered":"2024-09-12T18:02:25.682756+0000","last_clean":"2024-09-12T18:02:25.682756+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:02:25.682756+0000","last_undegraded":"2024-09-12T18:02:25.682756+0000","last_fullsized":"2024-09-12T18:02:25.682756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399156+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:02:26.399156+0000","last_peered":"2024-09-12T18:02:26.399156+0000","last_clean":"2024-09-12T18:02:26.399156+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:02:26.399156+0000","last_undegraded":"2024-09-12T18:02:26.399156+0000","last_fullsized":"2024-09-12T18:02:26.399156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683099+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:02:25.683099+0000","last_peered":"2024-09-12T18:02:25.683099+0000","last_clean":"2024-09-12T18:02:25.683099+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:02:25.683099+0000","last_undegraded":"2024-09-12T18:02:25.683099+0000","last_fullsized":"2024-09-12T18:02:25.683099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683067+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:02:25.683067+0000","last_peered":"2024-09-12T18:02:25.683067+0000","last_clean":"2024-09-12T18:02:25.683067+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:02:25.683067+0000","last_undegraded":"2024-09-12T18:02:25.683067+0000","last_fullsized":"2024-09-12T18:02:25.683067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681097+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:02:25.681097+0000","last_peered":"2024-09-12T18:02:25.681097+0000","last_clean":"2024-09-12T18:02:25.681097+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:02:25.681097+0000","last_undegraded":"2024-09-12T18:02:25.681097+0000","last_fullsized":"2024-09-12T18:02:25.681097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.397526+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:02:26.397526+0000","last_peered":"2024-09-12T18:02:26.397526+0000","last_clean":"2024-09-12T18:02:26.397526+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:02:26.397526+0000","last_undegraded":"2024-09-12T18:02:26.397526+0000","last_fullsized":"2024-09-12T18:02:26.397526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.680568+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:02:25.680568+0000","last_peered":"2024-09-12T18:02:25.680568+0000","last_clean":"2024-09-12T18:02:25.680568+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:02:25.680568+0000","last_undegraded":"2024-09-12T18:02:25.680568+0000","last_fullsized":"2024-09-12T18:02:25.680568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682555+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:02:25.682555+0000","last_peered":"2024-09-12T18:02:25.682555+0000","last_clean":"2024-09-12T18:02:25.682555+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:02:25.682555+0000","last_undegraded":"2024-09-12T18:02:25.682555+0000","last_fullsized":"2024-09-12T18:02:25.682555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399537+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:02:26.399537+0000","last_peered":"2024-09-12T18:02:26.399537+0000","last_clean":"2024-09-12T18:02:26.399537+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:02:26.399537+0000","last_undegraded":"2024-09-12T18:02:26.399537+0000","last_fullsized":"2024-09-12T18:02:26.399537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683306+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:02:25.683306+0000","last_peered":"2024-09-12T18:02:25.683306+0000","last_clean":"2024-09-12T18:02:25.683306+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:02:25.683306+0000","last_undegraded":"2024-09-12T18:02:25.683306+0000","last_fullsized":"2024-09-12T18:02:25.683306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681974+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:02:25.681974+0000","last_peered":"2024-09-12T18:02:25.681974+0000","last_clean":"2024-09-12T18:02:25.681974+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:02:25.681974+0000","last_undegraded":"2024-09-12T18:02:25.681974+0000","last_fullsized":"2024-09-12T18:02:25.681974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398732+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:02:26.398732+0000","last_peered":"2024-09-12T18:02:26.398732+0000","last_clean":"2024-09-12T18:02:26.398732+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:02:26.398732+0000","last_undegraded":"2024-09-12T18:02:26.398732+0000","last_fullsized":"2024-09-12T18:02:26.398732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681368+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:02:25.681368+0000","last_peered":"2024-09-12T18:02:25.681368+0000","last_clean":"2024-09-12T18:02:25.681368+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:02:25.681368+0000","last_undegraded":"2024-09-12T18:02:25.681368+0000","last_fullsized":"2024-09-12T18:02:25.681368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.397563+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:02:26.397563+0000","last_peered":"2024-09-12T18:02:26.397563+0000","last_clean":"2024-09-12T18:02:26.397563+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:02:26.397563+0000","last_undegraded":"2024-09-12T18:02:26.397563+0000","last_fullsized":"2024-09-12T18:02:26.397563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681880+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:02:25.681880+0000","last_peered":"2024-09-12T18:02:25.681880+0000","last_clean":"2024-09-12T18:02:25.681880+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:02:25.681880+0000","last_undegraded":"2024-09-12T18:02:25.681880+0000","last_fullsized":"2024-09-12T18:02:25.681880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681695+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:02:25.681695+0000","last_peered":"2024-09-12T18:02:25.681695+0000","last_clean":"2024-09-12T18:02:25.681695+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:02:25.681695+0000","last_undegraded":"2024-09-12T18:02:25.681695+0000","last_fullsized":"2024-09-12T18:02:25.681695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683880+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:02:25.683880+0000","last_peered":"2024-09-12T18:02:25.683880+0000","last_clean":"2024-09-12T18:02:25.683880+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:02:25.683880+0000","last_undegraded":"2024-09-12T18:02:25.683880+0000","last_fullsized":"2024-09-12T18:02:25.683880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682221+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:02:25.682221+0000","last_peered":"2024-09-12T18:02:25.682221+0000","last_clean":"2024-09-12T18:02:25.682221+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:02:25.682221+0000","last_undegraded":"2024-09-12T18:02:25.682221+0000","last_fullsized":"2024-09-12T18:02:25.682221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398052+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:02:26.398052+0000","last_peered":"2024-09-12T18:02:26.398052+0000","last_clean":"2024-09-12T18:02:26.398052+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:02:26.398052+0000","last_undegraded":"2024-09-12T18:02:26.398052+0000","last_fullsized":"2024-09-12T18:02:26.398052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399741+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:02:26.399741+0000","last_peered":"2024-09-12T18:02:26.399741+0000","last_clean":"2024-09-12T18:02:26.399741+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:02:26.399741+0000","last_undegraded":"2024-09-12T18:02:26.399741+0000","last_fullsized":"2024-09-12T18:02:26.399741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681686+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:02:25.681686+0000","last_peered":"2024-09-12T18:02:25.681686+0000","last_clean":"2024-09-12T18:02:25.681686+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:02:25.681686+0000","last_undegraded":"2024-09-12T18:02:25.681686+0000","last_fullsized":"2024-09-12T18:02:25.681686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399454+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:02:26.399454+0000","last_peered":"2024-09-12T18:02:26.399454+0000","last_clean":"2024-09-12T18:02:26.399454+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:02:26.399454+0000","last_undegraded":"2024-09-12T18:02:26.399454+0000","last_fullsized":"2024-09-12T18:02:26.399454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682046+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:02:25.682046+0000","last_peered":"2024-09-12T18:02:25.682046+0000","last_clean":"2024-09-12T18:02:25.682046+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:02:25.682046+0000","last_undegraded":"2024-09-12T18:02:25.682046+0000","last_fullsized":"2024-09-12T18:02:25.682046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.684495+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:02:25.684495+0000","last_peered":"2024-09-12T18:02:25.684495+0000","last_clean":"2024-09-12T18:02:25.684495+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:02:25.684495+0000","last_undegraded":"2024-09-12T18:02:25.684495+0000","last_fullsized":"2024-09-12T18:02:25.684495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.680582+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:02:25.680582+0000","last_peered":"2024-09-12T18:02:25.680582+0000","last_clean":"2024-09-12T18:02:25.680582+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:02:25.680582+0000","last_undegraded":"2024-09-12T18:02:25.680582+0000","last_fullsized":"2024-09-12T18:02:25.680582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682752+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:02:25.682752+0000","last_peered":"2024-09-12T18:02:25.682752+0000","last_clean":"2024-09-12T18:02:25.682752+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:02:25.682752+0000","last_undegraded":"2024-09-12T18:02:25.682752+0000","last_fullsized":"2024-09-12T18:02:25.682752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.680597+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:02:25.680597+0000","last_peered":"2024-09-12T18:02:25.680597+0000","last_clean":"2024-09-12T18:02:25.680597+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:02:25.680597+0000","last_undegraded":"2024-09-12T18:02:25.680597+0000","last_fullsized":"2024-09-12T18:02:25.680597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683936+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:02:25.683936+0000","last_peered":"2024-09-12T18:02:25.683936+0000","last_clean":"2024-09-12T18:02:25.683936+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:02:25.683936+0000","last_undegraded":"2024-09-12T18:02:25.683936+0000","last_fullsized":"2024-09-12T18:02:25.683936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682732+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:02:25.682732+0000","last_peered":"2024-09-12T18:02:25.682732+0000","last_clean":"2024-09-12T18:02:25.682732+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:02:25.682732+0000","last_undegraded":"2024-09-12T18:02:25.682732+0000","last_fullsized":"2024-09-12T18:02:25.682732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.684140+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:02:25.684140+0000","last_peered":"2024-09-12T18:02:25.684140+0000","last_clean":"2024-09-12T18:02:25.684140+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:02:25.684140+0000","last_undegraded":"2024-09-12T18:02:25.684140+0000","last_fullsized":"2024-09-12T18:02:25.684140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398458+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:02:26.398458+0000","last_peered":"2024-09-12T18:02:26.398458+0000","last_clean":"2024-09-12T18:02:26.398458+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:02:26.398458+0000","last_undegraded":"2024-09-12T18:02:26.398458+0000","last_fullsized":"2024-09-12T18:02:26.398458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398893+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:02:26.398893+0000","last_peered":"2024-09-12T18:02:26.398893+0000","last_clean":"2024-09-12T18:02:26.398893+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:02:26.398893+0000","last_undegraded":"2024-09-12T18:02:26.398893+0000","last_fullsized":"2024-09-12T18:02:26.398893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683235+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:02:25.683235+0000","last_peered":"2024-09-12T18:02:25.683235+0000","last_clean":"2024-09-12T18:02:25.683235+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:02:25.683235+0000","last_undegraded":"2024-09-12T18:02:25.683235+0000","last_fullsized":"2024-09-12T18:02:25.683235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683397+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:02:25.683397+0000","last_peered":"2024-09-12T18:02:25.683397+0000","last_clean":"2024-09-12T18:02:25.683397+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:02:25.683397+0000","last_undegraded":"2024-09-12T18:02:25.683397+0000","last_fullsized":"2024-09-12T18:02:25.683397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683632+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:02:25.683632+0000","last_peered":"2024-09-12T18:02:25.683632+0000","last_clean":"2024-09-12T18:02:25.683632+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:02:25.683632+0000","last_undegraded":"2024-09-12T18:02:25.683632+0000","last_fullsized":"2024-09-12T18:02:25.683632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681705+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:02:25.681705+0000","last_peered":"2024-09-12T18:02:25.681705+0000","last_clean":"2024-09-12T18:02:25.681705+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:02:25.681705+0000","last_undegraded":"2024-09-12T18:02:25.681705+0000","last_fullsized":"2024-09-12T18:02:25.681705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.684047+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:02:25.684047+0000","last_peered":"2024-09-12T18:02:25.684047+0000","last_clean":"2024-09-12T18:02:25.684047+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:02:25.684047+0000","last_undegraded":"2024-09-12T18:02:25.684047+0000","last_fullsized":"2024-09-12T18:02:25.684047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.680881+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:02:25.680881+0000","last_peered":"2024-09-12T18:02:25.680881+0000","last_clean":"2024-09-12T18:02:25.680881+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:02:25.680881+0000","last_undegraded":"2024-09-12T18:02:25.680881+0000","last_fullsized":"2024-09-12T18:02:25.680881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399637+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:02:26.399637+0000","last_peered":"2024-09-12T18:02:26.399637+0000","last_clean":"2024-09-12T18:02:26.399637+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:02:26.399637+0000","last_undegraded":"2024-09-12T18:02:26.399637+0000","last_fullsized":"2024-09-12T18:02:26.399637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682423+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:02:25.682423+0000","last_peered":"2024-09-12T18:02:25.682423+0000","last_clean":"2024-09-12T18:02:25.682423+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:02:25.682423+0000","last_undegraded":"2024-09-12T18:02:25.682423+0000","last_fullsized":"2024-09-12T18:02:25.682423+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683653+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:02:25.683653+0000","last_peered":"2024-09-12T18:02:25.683653+0000","last_clean":"2024-09-12T18:02:25.683653+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:02:25.683653+0000","last_undegraded":"2024-09-12T18:02:25.683653+0000","last_fullsized":"2024-09-12T18:02:25.683653+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398243+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:02:26.398243+0000","last_peered":"2024-09-12T18:02:26.398243+0000","last_clean":"2024-09-12T18:02:26.398243+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:02:26.398243+0000","last_undegraded":"2024-09-12T18:02:26.398243+0000","last_fullsized":"2024-09-12T18:02:26.398243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683639+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:02:25.683639+0000","last_peered":"2024-09-12T18:02:25.683639+0000","last_clean":"2024-09-12T18:02:25.683639+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:02:25.683639+0000","last_undegraded":"2024-09-12T18:02:25.683639+0000","last_fullsized":"2024-09-12T18:02:25.683639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682320+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:02:25.682320+0000","last_peered":"2024-09-12T18:02:25.682320+0000","last_clean":"2024-09-12T18:02:25.682320+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:02:25.682320+0000","last_undegraded":"2024-09-12T18:02:25.682320+0000","last_fullsized":"2024-09-12T18:02:25.682320+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398103+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:02:26.398103+0000","last_peered":"2024-09-12T18:02:26.398103+0000","last_clean":"2024-09-12T18:02:26.398103+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:02:26.398103+0000","last_undegraded":"2024-09-12T18:02:26.398103+0000","last_fullsized":"2024-09-12T18:02:26.398103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682469+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:02:25.682469+0000","last_peered":"2024-09-12T18:02:25.682469+0000","last_clean":"2024-09-12T18:02:25.682469+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:02:25.682469+0000","last_undegraded":"2024-09-12T18:02:25.682469+0000","last_fullsized":"2024-09-12T18:02:25.682469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398389+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:02:26.398389+0000","last_peered":"2024-09-12T18:02:26.398389+0000","last_clean":"2024-09-12T18:02:26.398389+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:02:26.398389+0000","last_undegraded":"2024-09-12T18:02:26.398389+0000","last_fullsized":"2024-09-12T18:02:26.398389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681010+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:02:25.681010+0000","last_peered":"2024-09-12T18:02:25.681010+0000","last_clean":"2024-09-12T18:02:25.681010+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:02:25.681010+0000","last_undegraded":"2024-09-12T18:02:25.681010+0000","last_fullsized":"2024-09-12T18:02:25.681010+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399739+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:02:26.399739+0000","last_peered":"2024-09-12T18:02:26.399739+0000","last_clean":"2024-09-12T18:02:26.399739+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:02:26.399739+0000","last_undegraded":"2024-09-12T18:02:26.399739+0000","last_fullsized":"2024-09-12T18:02:26.399739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683682+0000","last_change":"2024-09-12T18:01:52.540201+0000","last_active":"2024-09-12T18:02:25.683682+0000","last_peered":"2024-09-12T18:02:25.683682+0000","last_clean":"2024-09-12T18:02:25.683682+0000","last_became_active":"2024-09-12T18:01:50.536927+0000","last_became_peered":"2024-09-12T18:01:50.536927+0000","last_unstale":"2024-09-12T18:02:25.683682+0000","last_undegraded":"2024-09-12T18:02:25.683682+0000","last_fullsized":"2024-09-12T18:02:25.683682+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:31.310695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683376+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:02:25.683376+0000","last_peered":"2024-09-12T18:02:25.683376+0000","last_clean":"2024-09-12T18:02:25.683376+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:02:25.683376+0000","last_undegraded":"2024-09-12T18:02:25.683376+0000","last_fullsized":"2024-09-12T18:02:25.683376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398985+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:02:26.398985+0000","last_peered":"2024-09-12T18:02:26.398985+0000","last_clean":"2024-09-12T18:02:26.398985+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:02:26.398985+0000","last_undegraded":"2024-09-12T18:02:26.398985+0000","last_fullsized":"2024-09-12T18:02:26.398985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683932+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:02:25.683932+0000","last_peered":"2024-09-12T18:02:25.683932+0000","last_clean":"2024-09-12T18:02:25.683932+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:02:25.683932+0000","last_undegraded":"2024-09-12T18:02:25.683932+0000","last_fullsized":"2024-09-12T18:02:25.683932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399255+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:02:26.399255+0000","last_peered":"2024-09-12T18:02:26.399255+0000","last_clean":"2024-09-12T18:02:26.399255+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:02:26.399255+0000","last_undegraded":"2024-09-12T18:02:26.399255+0000","last_fullsized":"2024-09-12T18:02:26.399255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681263+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:02:25.681263+0000","last_peered":"2024-09-12T18:02:25.681263+0000","last_clean":"2024-09-12T18:02:25.681263+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:02:25.681263+0000","last_undegraded":"2024-09-12T18:02:25.681263+0000","last_fullsized":"2024-09-12T18:02:25.681263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399159+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:02:26.399159+0000","last_peered":"2024-09-12T18:02:26.399159+0000","last_clean":"2024-09-12T18:02:26.399159+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:02:26.399159+0000","last_undegraded":"2024-09-12T18:02:26.399159+0000","last_fullsized":"2024-09-12T18:02:26.399159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682969+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:02:25.682969+0000","last_peered":"2024-09-12T18:02:25.682969+0000","last_clean":"2024-09-12T18:02:25.682969+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:02:25.682969+0000","last_undegraded":"2024-09-12T18:02:25.682969+0000","last_fullsized":"2024-09-12T18:02:25.682969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681208+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:02:25.681208+0000","last_peered":"2024-09-12T18:02:25.681208+0000","last_clean":"2024-09-12T18:02:25.681208+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:02:25.681208+0000","last_undegraded":"2024-09-12T18:02:25.681208+0000","last_fullsized":"2024-09-12T18:02:25.681208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.400134+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:02:26.400134+0000","last_peered":"2024-09-12T18:02:26.400134+0000","last_clean":"2024-09-12T18:02:26.400134+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:02:26.400134+0000","last_undegraded":"2024-09-12T18:02:26.400134+0000","last_fullsized":"2024-09-12T18:02:26.400134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399976+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:02:26.399976+0000","last_peered":"2024-09-12T18:02:26.399976+0000","last_clean":"2024-09-12T18:02:26.399976+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:02:26.399976+0000","last_undegraded":"2024-09-12T18:02:26.399976+0000","last_fullsized":"2024-09-12T18:02:26.399976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.397715+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:02:26.397715+0000","last_peered":"2024-09-12T18:02:26.397715+0000","last_clean":"2024-09-12T18:02:26.397715+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:02:26.397715+0000","last_undegraded":"2024-09-12T18:02:26.397715+0000","last_fullsized":"2024-09-12T18:02:26.397715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399870+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:02:26.399870+0000","last_peered":"2024-09-12T18:02:26.399870+0000","last_clean":"2024-09-12T18:02:26.399870+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:02:26.399870+0000","last_undegraded":"2024-09-12T18:02:26.399870+0000","last_fullsized":"2024-09-12T18:02:26.399870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.684551+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:02:25.684551+0000","last_peered":"2024-09-12T18:02:25.684551+0000","last_clean":"2024-09-12T18:02:25.684551+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:02:25.684551+0000","last_undegraded":"2024-09-12T18:02:25.684551+0000","last_fullsized":"2024-09-12T18:02:25.684551+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.680768+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:02:25.680768+0000","last_peered":"2024-09-12T18:02:25.680768+0000","last_clean":"2024-09-12T18:02:25.680768+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:02:25.680768+0000","last_undegraded":"2024-09-12T18:02:25.680768+0000","last_fullsized":"2024-09-12T18:02:25.680768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682682+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:02:25.682682+0000","last_peered":"2024-09-12T18:02:25.682682+0000","last_clean":"2024-09-12T18:02:25.682682+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:02:25.682682+0000","last_undegraded":"2024-09-12T18:02:25.682682+0000","last_fullsized":"2024-09-12T18:02:25.682682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683803+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:02:25.683803+0000","last_peered":"2024-09-12T18:02:25.683803+0000","last_clean":"2024-09-12T18:02:25.683803+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:02:25.683803+0000","last_undegraded":"2024-09-12T18:02:25.683803+0000","last_fullsized":"2024-09-12T18:02:25.683803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.397776+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:02:26.397776+0000","last_peered":"2024-09-12T18:02:26.397776+0000","last_clean":"2024-09-12T18:02:26.397776+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:02:26.397776+0000","last_undegraded":"2024-09-12T18:02:26.397776+0000","last_fullsized":"2024-09-12T18:02:26.397776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682704+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:02:25.682704+0000","last_peered":"2024-09-12T18:02:25.682704+0000","last_clean":"2024-09-12T18:02:25.682704+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:02:25.682704+0000","last_undegraded":"2024-09-12T18:02:25.682704+0000","last_fullsized":"2024-09-12T18:02:25.682704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.684158+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:02:25.684158+0000","last_peered":"2024-09-12T18:02:25.684158+0000","last_clean":"2024-09-12T18:02:25.684158+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:02:25.684158+0000","last_undegraded":"2024-09-12T18:02:25.684158+0000","last_fullsized":"2024-09-12T18:02:25.684158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.397841+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:02:26.397841+0000","last_peered":"2024-09-12T18:02:26.397841+0000","last_clean":"2024-09-12T18:02:26.397841+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:02:26.397841+0000","last_undegraded":"2024-09-12T18:02:26.397841+0000","last_fullsized":"2024-09-12T18:02:26.397841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399978+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:02:26.399978+0000","last_peered":"2024-09-12T18:02:26.399978+0000","last_clean":"2024-09-12T18:02:26.399978+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:02:26.399978+0000","last_undegraded":"2024-09-12T18:02:26.399978+0000","last_fullsized":"2024-09-12T18:02:26.399978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.397863+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:02:26.397863+0000","last_peered":"2024-09-12T18:02:26.397863+0000","last_clean":"2024-09-12T18:02:26.397863+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:02:26.397863+0000","last_undegraded":"2024-09-12T18:02:26.397863+0000","last_fullsized":"2024-09-12T18:02:26.397863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682739+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:02:25.682739+0000","last_peered":"2024-09-12T18:02:25.682739+0000","last_clean":"2024-09-12T18:02:25.682739+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:02:25.682739+0000","last_undegraded":"2024-09-12T18:02:25.682739+0000","last_fullsized":"2024-09-12T18:02:25.682739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398021+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:02:26.398021+0000","last_peered":"2024-09-12T18:02:26.398021+0000","last_clean":"2024-09-12T18:02:26.398021+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:02:26.398021+0000","last_undegraded":"2024-09-12T18:02:26.398021+0000","last_fullsized":"2024-09-12T18:02:26.398021+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399244+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:02:26.399244+0000","last_peered":"2024-09-12T18:02:26.399244+0000","last_clean":"2024-09-12T18:02:26.399244+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:02:26.399244+0000","last_undegraded":"2024-09-12T18:02:26.399244+0000","last_fullsized":"2024-09-12T18:02:26.399244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.398041+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:02:26.398041+0000","last_peered":"2024-09-12T18:02:26.398041+0000","last_clean":"2024-09-12T18:02:26.398041+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:02:26.398041+0000","last_undegraded":"2024-09-12T18:02:26.398041+0000","last_fullsized":"2024-09-12T18:02:26.398041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681880+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:02:25.681880+0000","last_peered":"2024-09-12T18:02:25.681880+0000","last_clean":"2024-09-12T18:02:25.681880+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:02:25.681880+0000","last_undegraded":"2024-09-12T18:02:25.681880+0000","last_fullsized":"2024-09-12T18:02:25.681880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681437+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:02:25.681437+0000","last_peered":"2024-09-12T18:02:25.681437+0000","last_clean":"2024-09-12T18:02:25.681437+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:02:25.681437+0000","last_undegraded":"2024-09-12T18:02:25.681437+0000","last_fullsized":"2024-09-12T18:02:25.681437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681582+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:02:25.681582+0000","last_peered":"2024-09-12T18:02:25.681582+0000","last_clean":"2024-09-12T18:02:25.681582+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:02:25.681582+0000","last_undegraded":"2024-09-12T18:02:25.681582+0000","last_fullsized":"2024-09-12T18:02:25.681582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681469+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:02:25.681469+0000","last_peered":"2024-09-12T18:02:25.681469+0000","last_clean":"2024-09-12T18:02:25.681469+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:02:25.681469+0000","last_undegraded":"2024-09-12T18:02:25.681469+0000","last_fullsized":"2024-09-12T18:02:25.681469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682719+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:02:25.682719+0000","last_peered":"2024-09-12T18:02:25.682719+0000","last_clean":"2024-09-12T18:02:25.682719+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:02:25.682719+0000","last_undegraded":"2024-09-12T18:02:25.682719+0000","last_fullsized":"2024-09-12T18:02:25.682719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683521+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:02:25.683521+0000","last_peered":"2024-09-12T18:02:25.683521+0000","last_clean":"2024-09-12T18:02:25.683521+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:02:25.683521+0000","last_undegraded":"2024-09-12T18:02:25.683521+0000","last_fullsized":"2024-09-12T18:02:25.683521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.683281+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:02:25.683281+0000","last_peered":"2024-09-12T18:02:25.683281+0000","last_clean":"2024-09-12T18:02:25.683281+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:02:25.683281+0000","last_undegraded":"2024-09-12T18:02:25.683281+0000","last_fullsized":"2024-09-12T18:02:25.683281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682487+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:02:25.682487+0000","last_peered":"2024-09-12T18:02:25.682487+0000","last_clean":"2024-09-12T18:02:25.682487+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:02:25.682487+0000","last_undegraded":"2024-09-12T18:02:25.682487+0000","last_fullsized":"2024-09-12T18:02:25.682487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.681975+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:02:25.681975+0000","last_peered":"2024-09-12T18:02:25.681975+0000","last_clean":"2024-09-12T18:02:25.681975+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:02:25.681975+0000","last_undegraded":"2024-09-12T18:02:25.681975+0000","last_fullsized":"2024-09-12T18:02:25.681975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399721+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:02:26.399721+0000","last_peered":"2024-09-12T18:02:26.399721+0000","last_clean":"2024-09-12T18:02:26.399721+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:02:26.399721+0000","last_undegraded":"2024-09-12T18:02:26.399721+0000","last_fullsized":"2024-09-12T18:02:26.399721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:25.682107+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:02:25.682107+0000","last_peered":"2024-09-12T18:02:25.682107+0000","last_clean":"2024-09-12T18:02:25.682107+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:02:25.682107+0000","last_undegraded":"2024-09-12T18:02:25.682107+0000","last_fullsized":"2024-09-12T18:02:25.682107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-12T18:02:26.399774+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:02:26.399774+0000","last_peered":"2024-09-12T18:02:26.399774+0000","last_clean":"2024-09-12T18:02:26.399774+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:02:26.399774+0000","last_undegraded":"2024-09-12T18:02:26.399774+0000","last_fullsized":"2024-09-12T18:02:26.399774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":106206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738381,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":348160,"data_stored":702674,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":360448,"data_stored":703309,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:32.313 INFO:tasks.thrashosds.thrasher:Setting 2.2 to [0, 1] 2024-09-12T18:02:32.313 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.2', '0', '1'] 2024-09-12T18:02:32.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.2 0 1 2024-09-12T18:02:32.314 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:32.314 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:32.332 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:32.367 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:32.404 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:32.401+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:32.435 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:32.436 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:32.449 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:32.505 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:32.506+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:32.572 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:32.572 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:32.587 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:32.606 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:32.607+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:32.707 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:32.707+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:32.752 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:32.752 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:32.767 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:32.813 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:32.811+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:32.900 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:32.901 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:32.909 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:32.903+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:32.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:33.010 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:33.009+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:33.086 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:33.086 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:33.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:33.111 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:33.110+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:33.211 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:33.210+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:33.218 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:33.218 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:33.232 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:33.312 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:33.309+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:33.365 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:33.365 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:33.379 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:33.413 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:33.414+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:33.514 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:33.515+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:33.535 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:33.535 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:33.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:33.615 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:33.614+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:33.670 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:33.670 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:33.683 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:33.716 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:33.713+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:33.814 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:33.814 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:33.814 INFO:teuthology.orchestra.run.smithi052.stderr:set 2.2 pg_upmap mapping to [0,1] 2024-09-12T18:02:33.820 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:33.817+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:33.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:33.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:02:33.917 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:33.915+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:33.951 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:33.952 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:33.965 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:34.018 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:34.018+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:34.086 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:34.086 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:34.100 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:34.146 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:34.143+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:34.220 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:34.217+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:34.228 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:34.228 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:34.243 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:34.321 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:34.321+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:34.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:34.405 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:34.405 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:34.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:34.422 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:34.421+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:34.523 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:34.519+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:34.528 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:34.528 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:34.536 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:34.537 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:34.548 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:34.548 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:34.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:34.569 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:34.569 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:34.624 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:34.619+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:34.678 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:34.678 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:34.678 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:34.692 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:34.725 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:34.719+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:34.811 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:34.812 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:34.812 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:34.812 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:34.812 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:34.820 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:02:34.826 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:34.826 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:34.825+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:34.926 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:34.925+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:34.989 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.451972427999998, 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.449668230999997, 2024-09-12T18:02:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 42.446361183, 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298973029999999, 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298879966999998, 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298837493999997, 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298733267999999, 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298697435000001, 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298666416000003, 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298615476000002, 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298560403000003, 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.298526586999998, 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.297183009999998, 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.296913592000003, 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.295153116000002, 2024-09-12T18:02:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.294997461000001, 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.292836960999999, 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 38.303622367000003, 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.301669010000001, 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.301097209000002, 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:35.094 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:35.095 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:35.096 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:35.095+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:35.197 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:35.195+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:35.228 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:35.228 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:35.243 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:35.297 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:35.297+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:35.366 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:35.366 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:35.366 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:35.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:35.398 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:35.397+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:35.499 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:35.497+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.861412979000001, 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.506 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:35.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:35.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.861295931000001, 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.513 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:35.520 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.861005863000003, 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.521 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:35.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.527 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.860823275000001, 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:35.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.860136408000002, 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:35.534 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:35.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.540 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.859989898000002, 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.541 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:35.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.859902476000002, 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:35.547 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:35.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:35.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.553 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.754707027000002, 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:35.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:35.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:35.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.754623971000001, 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:35.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:35.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:35.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.754555652000001, 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.568 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:35.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:35.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.754376612999998, 2024-09-12T18:02:35.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:35.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:35.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.580 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.650050010000001, 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:35.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:35.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.586 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.650004011, 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.587 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:35.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:35.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.649886567999999, 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.593 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:35.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:35.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:35.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.545655293999999, 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.600 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:35.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:35.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.606 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.545621681, 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.607 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:35.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:35.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.545452279000003, 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.613 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:35.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:35.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:35.619 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.545413066000002, 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.545368998999997, 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:35.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:35.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:35.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.545250680000002, 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:35.632 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:35.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:35.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:35.638 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:35.639 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:35.640 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:35.640 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:35.637+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:35.741 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:35.741+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:35.772 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:35.772 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:35.772 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:35.772 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:35.788 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:35.842 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:35.841+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:35.908 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:35.908 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:35.908 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:35.908 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:35.908 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:35.922 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:35.943 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:35.941+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:36.039 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:36.039 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.395576226999999, 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.040 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:36.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.042 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.044 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.394903042000003, 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.045 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.046 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:36.047 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.048 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.049 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.394293939999997, 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.050 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:36.051 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:36.052 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.053 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.054 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.393766626999998, 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.055 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.056 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:36.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.058 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:36.059 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.393325591, 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.060 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.061 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:36.062 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.063 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.392547546999999, 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.064 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.065 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.066 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.067 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.068 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.392055579999997, 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.069 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.070 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:36.071 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.072 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.073 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.391488021999997, 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.074 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.076 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:36.077 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.390983605999999, 2024-09-12T18:02:36.079 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:36.080 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:36.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.083 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.390506332000001, 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:36.084 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:36.085 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:36.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.390060499999997, 2024-09-12T18:02:36.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:36.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.092 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:36.093 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.094 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.389519444000001, 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.098 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:36.099 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.389181006000001, 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:36.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.104 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 51.288337595000002, 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:36.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.106 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:36.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 40.349098073999997, 2024-09-12T18:02:36.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:36.110 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.111 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:36.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 40.348978625000001, 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.115 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.116 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:36.117 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.119 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:36.120 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 40.348803386, 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.121 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:36.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.123 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:36.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 40.348739535999997, 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.127 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:36.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:36.132 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 40.348620854000004, 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:36.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:36.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 40.348553041999999, 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:36.141 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:36.143 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:36.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:36.146 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:36.141+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:36.246 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:36.245+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:36.277 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:36.277 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:36.277 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:36.291 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:36.347 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:36.345+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:36.413 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:36.413 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:36.427 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:36.469 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:36.469+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:36.549 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:36.549+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:36.587 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.056828218, 2024-09-12T18:02:36.595 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:36.596 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.597 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.598 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.599 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.054524020999999, 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:36.600 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.601 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.602 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.603 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.604 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.051216973000002, 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.605 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.606 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.607 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.608 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.609 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903828820000001, 2024-09-12T18:02:36.610 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:36.612 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:36.614 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.615 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.616 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903735757, 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.617 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.618 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:36.619 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.620 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:36.621 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.622 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903693283999999, 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.623 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.624 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:36.625 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.626 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.628 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903589058000001, 2024-09-12T18:02:36.629 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.630 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.631 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:36.632 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:36.633 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.634 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.635 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903553225000003, 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:36.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903522205999998, 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.642 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:36.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:36.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903471265999997, 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:36.648 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.652 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903416192999998, 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:36.653 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:36.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.903382377, 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:36.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.662 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.9020388, 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:36.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:36.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.901769381999998, 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.667 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:36.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:36.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.671 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.900008905999997, 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.899853251000003, 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:36.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.897692751000001, 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:36.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:36.686 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.908478156999998, 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:36.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.9065248, 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.693 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:36.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.905952999, 2024-09-12T18:02:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:36.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:36.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:36.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:36.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:36.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:36.706 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:36.708 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:36.705+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:36.708 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:36.786 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:36.787 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:36.808 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:36.809+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:36.821 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:36.841 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:36.841 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:36.843 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:02:36.855 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:36.857 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:36.858 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:36.909 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:36.907+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:36.977 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:36.978 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:36.992 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:37.036 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:37.037+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:37.110 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:37.110 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:37.110 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:37.109+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:37.211 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:37.209+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:37.254 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:37.255 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:37.269 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:37.312 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:37.313+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:37.393 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:37.393 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:37.407 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:37.453 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:37.455+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:37.513 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:37.513+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:37.523 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:37.524 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:37.538 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:37.614 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:37.613+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:37.668 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:37.669 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:37.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:37.715 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:37.715+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:37.804 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:37.804 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:37.816 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:37.813+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:37.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:37.831 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:02:37.917 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:37.919+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:37.982 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:37.982 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:37.996 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:38.018 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:38.019+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:38.120 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:38.117+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:38.127 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:38.127 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:38.141 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:38.221 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:38.219+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:38.306 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:38.306 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:38.320 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:38.322 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:38.323+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:38.422 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:38.421+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:38.436 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:38.437 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:38.451 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:38.524 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:38.523+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:38.582 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:38.582 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:38.596 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:38.638 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:38.639+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:38.725 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:38.725+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:38.760 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:38.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:38.827 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:38.825+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:38.838 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:02:38.838 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:02:38.838 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T18:02:38.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:02:38.880 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:38.896 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:38.897 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:38.910 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:38.958 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:38.956+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:39.029 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:39.027+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:39.044 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:39.044 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:39.058 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:39.088 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:39.088 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:39.121 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:39.122 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:39.130 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:39.129+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:39.152 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:39.152 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:39.223 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:39.224 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:39.224 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:39.232 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:39.231+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:39.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:39.334 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:39.333+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:39.360 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:39.360 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 35, 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "da5a949a-216b-4267-953a-8d92e3d25b1d", 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-09-12T18:01:33.537080+0000", 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-09-12T18:02:37.822944+0000", 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-09-12T18:01:42.466111+0000", 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-09-12T18:01:34.442067+0000", 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5806080, 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "nodeep-scrub", 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "noscrub", 2024-09-12T18:02:39.361 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-09-12T18:02:39.362 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "luminous", 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "squid", 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:42.598261+0000", 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:39.363 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-09-12T18:02:39.364 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:39.365 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:39.366 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.367 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:39.368 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-09-12T18:02:39.369 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:48.792102+0000", 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 8193, 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:02:39.370 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-09-12T18:02:39.371 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-09-12T18:02:39.372 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-09-12T18:02:39.372 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-09-12T18:02:39.372 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-09-12T18:02:39.372 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:39.372 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:39.372 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:39.372 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:39.372 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "15", 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 2, 2024-09-12T18:02:39.373 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 15, 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:39.374 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:39.375 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.376 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.377 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:53.545540+0000", 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:39.378 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:39.379 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:39.380 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:39.381 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-09-12T18:02:39.383 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:39.384 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:54.024396+0000", 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:02:39.385 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-09-12T18:02:39.386 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "19", 2024-09-12T18:02:39.387 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:02:39.388 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:02:39.389 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:02:39.390 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:02:39.391 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:39.392 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "f692452d-28b8-4aad-928e-fe1805e23b68", 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 33, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:39.393 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6800", 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6801", 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:39.394 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6802", 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6803", 2024-09-12T18:02:39.395 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6806", 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.396 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6807", 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6804", 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:39.397 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6805", 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.111:6801/177809282", 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.111:6803/177809282", 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.111:6807/177809282", 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.111:6805/177809282", 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:39.398 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "b5b3807e-e3b5-4530-adc6-af19dd31e340", 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:39.399 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6800", 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.400 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6801", 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6802", 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:39.401 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6803", 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6806", 2024-09-12T18:02:39.402 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6807", 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.403 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6804", 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6805", 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.121:6801/3534339867", 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.121:6803/3534339867", 2024-09-12T18:02:39.404 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.121:6807/3534339867", 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.121:6805/3534339867", 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "926e4870-279e-45c7-9d6c-5841397a5e6c", 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:02:39.405 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6800", 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:39.406 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6801", 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.407 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6802", 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6803", 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:02:39.408 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6806", 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6807", 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.409 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6804", 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6805", 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:02:39.410 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.153:6801/284634690", 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.153:6803/284634690", 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.153:6807/284634690", 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.153:6805/284634690", 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:39.411 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.382866+0000", 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:02:39.412 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.379192+0000", 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:02:39.413 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.336708+0000", 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [ 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: "pgid": "2.2", 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: 0, 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: 1 2024-09-12T18:02:39.414 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: "pgid": "4.31", 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: 0, 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: 2 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-09-12T18:02:39.415 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-09-12T18:02:39.416 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:02:39.417 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:02:39.420 INFO:tasks.thrashosds.thrasher:j is {'epoch': 35, 'fsid': 'da5a949a-216b-4267-953a-8d92e3d25b1d', 'created': '2024-09-12T18:01:33.537080+0000', 'modified': '2024-09-12T18:02:37.822944+0000', 'last_up_change': '2024-09-12T18:01:42.466111+0000', 'last_in_change': '2024-09-12T18:01:34.442067+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:01:42.598261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:01:48.792102+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:01:53.545540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:01:54.024396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f692452d-28b8-4aad-928e-fe1805e23b68', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 177809282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 177809282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 177809282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 177809282}]}, 'public_addr': '172.21.15.111:6801/177809282', 'cluster_addr': '172.21.15.111:6803/177809282', 'heartbeat_back_addr': '172.21.15.111:6807/177809282', 'heartbeat_front_addr': '172.21.15.111:6805/177809282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'b5b3807e-e3b5-4530-adc6-af19dd31e340', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6800', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6801', 'nonce': 3534339867}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6802', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6803', 'nonce': 3534339867}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6806', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6807', 'nonce': 3534339867}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6804', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6805', 'nonce': 3534339867}]}, 'public_addr': '172.21.15.121:6801/3534339867', 'cluster_addr': '172.21.15.121:6803/3534339867', 'heartbeat_back_addr': '172.21.15.121:6807/3534339867', 'heartbeat_front_addr': '172.21.15.121:6805/3534339867', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '926e4870-279e-45c7-9d6c-5841397a5e6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 284634690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 284634690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 284634690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 284634690}]}, 'public_addr': '172.21.15.153:6801/284634690', 'cluster_addr': '172.21.15.153:6803/284634690', 'heartbeat_back_addr': '172.21.15.153:6807/284634690', 'heartbeat_front_addr': '172.21.15.153:6805/284634690', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.382866+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.379192+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.336708+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.2', 'osds': [0, 1]}, {'pgid': '4.31', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:02:39.420 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.827112982999999, 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.421 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:39.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.824808785999998, 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.426 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:39.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.430 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 46.821501738000002, 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:39.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:39.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:39.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:39.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.674113585000001, 2024-09-12T18:02:39.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:39.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:39.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.443 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.674020521999999, 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:39.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:39.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:39.450 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.673978048999999, 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:39.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:39.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:39.456 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.673873823000001, 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:39.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:39.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.673837990000003, 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:39.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:39.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.673806970999998, 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:39.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:39.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.673756031000003, 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.475 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:39.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.479 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.673700957999998, 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.673667141999999, 2024-09-12T18:02:39.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.488 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.672323564999999, 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.672054146999997, 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.493 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:39.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.670293671000003, 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.498 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:39.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.502 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.670138016000003, 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:39.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.667977516000001, 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:39.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.512 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 42.678762921999997, 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:39.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.676809564999999, 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:39.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:39.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:39.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.525 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.676237764, 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:39.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:39.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.532 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:39.532 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:39.532 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:39.532 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:39.534 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:39.532+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:39.635 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:39.635+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:39.666 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:39.666 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:39.666 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:39.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:39.736 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:39.732+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:39.803 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:39.803 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:39.804 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:39.817 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:39.837 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:39.835+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:39.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:02:39.938 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:39.939+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:39.942 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:39.942 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.297461873000003, 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:39.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:39.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:39.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.950 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.297344825000003, 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.951 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:39.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:39.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:39.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.957 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.297054756999998, 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:39.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:39.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.963 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.296872168999997, 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.964 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:39.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:39.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.296185301999998, 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.970 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:39.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:39.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.296038791999997, 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.977 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:39.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.295951369999997, 2024-09-12T18:02:39.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:39.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:39.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:39.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:39.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.190755920999997, 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.990 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:39.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:39.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.190672865000003, 2024-09-12T18:02:39.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:39.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:39.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.002 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.190604546000003, 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.003 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.190425507, 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:40.009 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:40.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:40.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:40.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.086098904000004, 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.016 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:40.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.086052905000003, 2024-09-12T18:02:40.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:40.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:40.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:40.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:40.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.085935462000002, 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:40.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.981704188000002, 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.036 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:40.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.981670575000003, 2024-09-12T18:02:40.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:40.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:40.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.051 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.981501172999998, 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:40.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:40.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:40.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.981461959999997, 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.058 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:40.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.981417893, 2024-09-12T18:02:40.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:40.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:40.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 54.981299573999998, 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.071 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:40.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:40.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:40.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.077 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.077 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:40.077 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:40.077 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:40.081 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:40.081 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:40.083 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:40.084 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-09-12T18:02:38.570107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597738,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":200,"num_write_kb":2697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90464,"kb_used_data":1048,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025056,"statfs":{"total":289910292480,"available":289817657344,"internally_reserved":0,"allocated":1073152,"data_stored":1563366,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001014"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824370+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:02:34.824370+0000","last_peered":"2024-09-12T18:02:34.824370+0000","last_clean":"2024-09-12T18:02:34.824370+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:02:34.824370+0000","last_undegraded":"2024-09-12T18:02:34.824370+0000","last_fullsized":"2024-09-12T18:02:34.824370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824088+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:02:34.824088+0000","last_peered":"2024-09-12T18:02:34.824088+0000","last_clean":"2024-09-12T18:02:34.824088+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:02:34.824088+0000","last_undegraded":"2024-09-12T18:02:34.824088+0000","last_fullsized":"2024-09-12T18:02:34.824088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824894+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:02:34.824894+0000","last_peered":"2024-09-12T18:02:34.824894+0000","last_clean":"2024-09-12T18:02:34.824894+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:02:34.824894+0000","last_undegraded":"2024-09-12T18:02:34.824894+0000","last_fullsized":"2024-09-12T18:02:34.824894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824737+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:02:34.824737+0000","last_peered":"2024-09-12T18:02:34.824737+0000","last_clean":"2024-09-12T18:02:34.824737+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:02:34.824737+0000","last_undegraded":"2024-09-12T18:02:34.824737+0000","last_fullsized":"2024-09-12T18:02:34.824737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823693+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:02:34.823693+0000","last_peered":"2024-09-12T18:02:34.823693+0000","last_clean":"2024-09-12T18:02:34.823693+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:02:34.823693+0000","last_undegraded":"2024-09-12T18:02:34.823693+0000","last_fullsized":"2024-09-12T18:02:34.823693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823837+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:02:34.823837+0000","last_peered":"2024-09-12T18:02:34.823837+0000","last_clean":"2024-09-12T18:02:34.823837+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:02:34.823837+0000","last_undegraded":"2024-09-12T18:02:34.823837+0000","last_fullsized":"2024-09-12T18:02:34.823837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823858+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:02:34.823858+0000","last_peered":"2024-09-12T18:02:34.823858+0000","last_clean":"2024-09-12T18:02:34.823858+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:02:34.823858+0000","last_undegraded":"2024-09-12T18:02:34.823858+0000","last_fullsized":"2024-09-12T18:02:34.823858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823172+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:02:34.823172+0000","last_peered":"2024-09-12T18:02:34.823172+0000","last_clean":"2024-09-12T18:02:34.823172+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:02:34.823172+0000","last_undegraded":"2024-09-12T18:02:34.823172+0000","last_fullsized":"2024-09-12T18:02:34.823172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828918+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:02:34.828918+0000","last_peered":"2024-09-12T18:02:34.828918+0000","last_clean":"2024-09-12T18:02:34.828918+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:02:34.828918+0000","last_undegraded":"2024-09-12T18:02:34.828918+0000","last_fullsized":"2024-09-12T18:02:34.828918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824375+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:02:34.824375+0000","last_peered":"2024-09-12T18:02:34.824375+0000","last_clean":"2024-09-12T18:02:34.824375+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:02:34.824375+0000","last_undegraded":"2024-09-12T18:02:34.824375+0000","last_fullsized":"2024-09-12T18:02:34.824375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825504+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:02:34.825504+0000","last_peered":"2024-09-12T18:02:34.825504+0000","last_clean":"2024-09-12T18:02:34.825504+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:02:34.825504+0000","last_undegraded":"2024-09-12T18:02:34.825504+0000","last_fullsized":"2024-09-12T18:02:34.825504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823621+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:02:34.823621+0000","last_peered":"2024-09-12T18:02:34.823621+0000","last_clean":"2024-09-12T18:02:34.823621+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:02:34.823621+0000","last_undegraded":"2024-09-12T18:02:34.823621+0000","last_fullsized":"2024-09-12T18:02:34.823621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823387+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:02:34.823387+0000","last_peered":"2024-09-12T18:02:34.823387+0000","last_clean":"2024-09-12T18:02:34.823387+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:02:34.823387+0000","last_undegraded":"2024-09-12T18:02:34.823387+0000","last_fullsized":"2024-09-12T18:02:34.823387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823942+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:02:34.823942+0000","last_peered":"2024-09-12T18:02:34.823942+0000","last_clean":"2024-09-12T18:02:34.823942+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:02:34.823942+0000","last_undegraded":"2024-09-12T18:02:34.823942+0000","last_fullsized":"2024-09-12T18:02:34.823942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824050+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:02:34.824050+0000","last_peered":"2024-09-12T18:02:34.824050+0000","last_clean":"2024-09-12T18:02:34.824050+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:02:34.824050+0000","last_undegraded":"2024-09-12T18:02:34.824050+0000","last_fullsized":"2024-09-12T18:02:34.824050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823319+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:02:34.823319+0000","last_peered":"2024-09-12T18:02:34.823319+0000","last_clean":"2024-09-12T18:02:34.823319+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:02:34.823319+0000","last_undegraded":"2024-09-12T18:02:34.823319+0000","last_fullsized":"2024-09-12T18:02:34.823319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829218+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:02:34.829218+0000","last_peered":"2024-09-12T18:02:34.829218+0000","last_clean":"2024-09-12T18:02:34.829218+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:02:34.829218+0000","last_undegraded":"2024-09-12T18:02:34.829218+0000","last_fullsized":"2024-09-12T18:02:34.829218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824696+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:02:34.824696+0000","last_peered":"2024-09-12T18:02:34.824696+0000","last_clean":"2024-09-12T18:02:34.824696+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:02:34.824696+0000","last_undegraded":"2024-09-12T18:02:34.824696+0000","last_fullsized":"2024-09-12T18:02:34.824696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828779+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:02:34.828779+0000","last_peered":"2024-09-12T18:02:34.828779+0000","last_clean":"2024-09-12T18:02:34.828779+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:02:34.828779+0000","last_undegraded":"2024-09-12T18:02:34.828779+0000","last_fullsized":"2024-09-12T18:02:34.828779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824788+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:02:34.824788+0000","last_peered":"2024-09-12T18:02:34.824788+0000","last_clean":"2024-09-12T18:02:34.824788+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:02:34.824788+0000","last_undegraded":"2024-09-12T18:02:34.824788+0000","last_fullsized":"2024-09-12T18:02:34.824788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824771+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:02:34.824771+0000","last_peered":"2024-09-12T18:02:34.824771+0000","last_clean":"2024-09-12T18:02:34.824771+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:02:34.824771+0000","last_undegraded":"2024-09-12T18:02:34.824771+0000","last_fullsized":"2024-09-12T18:02:34.824771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823155+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:02:34.823155+0000","last_peered":"2024-09-12T18:02:34.823155+0000","last_clean":"2024-09-12T18:02:34.823155+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:02:34.823155+0000","last_undegraded":"2024-09-12T18:02:34.823155+0000","last_fullsized":"2024-09-12T18:02:34.823155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.827815+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:02:34.827815+0000","last_peered":"2024-09-12T18:02:34.827815+0000","last_clean":"2024-09-12T18:02:34.827815+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:02:34.827815+0000","last_undegraded":"2024-09-12T18:02:34.827815+0000","last_fullsized":"2024-09-12T18:02:34.827815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.822598+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:02:34.822598+0000","last_peered":"2024-09-12T18:02:34.822598+0000","last_clean":"2024-09-12T18:02:34.822598+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:02:34.822598+0000","last_undegraded":"2024-09-12T18:02:34.822598+0000","last_fullsized":"2024-09-12T18:02:34.822598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824386+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:02:34.824386+0000","last_peered":"2024-09-12T18:02:34.824386+0000","last_clean":"2024-09-12T18:02:34.824386+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:02:34.824386+0000","last_undegraded":"2024-09-12T18:02:34.824386+0000","last_fullsized":"2024-09-12T18:02:34.824386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829022+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:02:34.829022+0000","last_peered":"2024-09-12T18:02:34.829022+0000","last_clean":"2024-09-12T18:02:34.829022+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:02:34.829022+0000","last_undegraded":"2024-09-12T18:02:34.829022+0000","last_fullsized":"2024-09-12T18:02:34.829022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825209+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:02:34.825209+0000","last_peered":"2024-09-12T18:02:34.825209+0000","last_clean":"2024-09-12T18:02:34.825209+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:02:34.825209+0000","last_undegraded":"2024-09-12T18:02:34.825209+0000","last_fullsized":"2024-09-12T18:02:34.825209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824243+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:02:34.824243+0000","last_peered":"2024-09-12T18:02:34.824243+0000","last_clean":"2024-09-12T18:02:34.824243+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:02:34.824243+0000","last_undegraded":"2024-09-12T18:02:34.824243+0000","last_fullsized":"2024-09-12T18:02:34.824243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828438+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:02:34.828438+0000","last_peered":"2024-09-12T18:02:34.828438+0000","last_clean":"2024-09-12T18:02:34.828438+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:02:34.828438+0000","last_undegraded":"2024-09-12T18:02:34.828438+0000","last_fullsized":"2024-09-12T18:02:34.828438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823550+0000","last_change":"2024-09-12T18:01:55.581980+0000","last_active":"2024-09-12T18:02:34.823550+0000","last_peered":"2024-09-12T18:02:34.823550+0000","last_clean":"2024-09-12T18:02:34.823550+0000","last_became_active":"2024-09-12T18:01:55.581051+0000","last_became_peered":"2024-09-12T18:01:55.581051+0000","last_unstale":"2024-09-12T18:02:34.823550+0000","last_undegraded":"2024-09-12T18:02:34.823550+0000","last_fullsized":"2024-09-12T18:02:34.823550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:24.748611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.827831+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:02:34.827831+0000","last_peered":"2024-09-12T18:02:34.827831+0000","last_clean":"2024-09-12T18:02:34.827831+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:02:34.827831+0000","last_undegraded":"2024-09-12T18:02:34.827831+0000","last_fullsized":"2024-09-12T18:02:34.827831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823414+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:02:34.823414+0000","last_peered":"2024-09-12T18:02:34.823414+0000","last_clean":"2024-09-12T18:02:34.823414+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:02:34.823414+0000","last_undegraded":"2024-09-12T18:02:34.823414+0000","last_fullsized":"2024-09-12T18:02:34.823414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823912+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:02:34.823912+0000","last_peered":"2024-09-12T18:02:34.823912+0000","last_clean":"2024-09-12T18:02:34.823912+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:02:34.823912+0000","last_undegraded":"2024-09-12T18:02:34.823912+0000","last_fullsized":"2024-09-12T18:02:34.823912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824806+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:02:34.824806+0000","last_peered":"2024-09-12T18:02:34.824806+0000","last_clean":"2024-09-12T18:02:34.824806+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:02:34.824806+0000","last_undegraded":"2024-09-12T18:02:34.824806+0000","last_fullsized":"2024-09-12T18:02:34.824806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824421+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:02:34.824421+0000","last_peered":"2024-09-12T18:02:34.824421+0000","last_clean":"2024-09-12T18:02:34.824421+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:02:34.824421+0000","last_undegraded":"2024-09-12T18:02:34.824421+0000","last_fullsized":"2024-09-12T18:02:34.824421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828287+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:02:34.828287+0000","last_peered":"2024-09-12T18:02:34.828287+0000","last_clean":"2024-09-12T18:02:34.828287+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:02:34.828287+0000","last_undegraded":"2024-09-12T18:02:34.828287+0000","last_fullsized":"2024-09-12T18:02:34.828287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829202+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:02:34.829202+0000","last_peered":"2024-09-12T18:02:34.829202+0000","last_clean":"2024-09-12T18:02:34.829202+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:02:34.829202+0000","last_undegraded":"2024-09-12T18:02:34.829202+0000","last_fullsized":"2024-09-12T18:02:34.829202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.822879+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:02:34.822879+0000","last_peered":"2024-09-12T18:02:34.822879+0000","last_clean":"2024-09-12T18:02:34.822879+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:02:34.822879+0000","last_undegraded":"2024-09-12T18:02:34.822879+0000","last_fullsized":"2024-09-12T18:02:34.822879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828948+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:02:34.828948+0000","last_peered":"2024-09-12T18:02:34.828948+0000","last_clean":"2024-09-12T18:02:34.828948+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:02:34.828948+0000","last_undegraded":"2024-09-12T18:02:34.828948+0000","last_fullsized":"2024-09-12T18:02:34.828948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823479+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:02:34.823479+0000","last_peered":"2024-09-12T18:02:34.823479+0000","last_clean":"2024-09-12T18:02:34.823479+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:02:34.823479+0000","last_undegraded":"2024-09-12T18:02:34.823479+0000","last_fullsized":"2024-09-12T18:02:34.823479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825873+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:02:34.825873+0000","last_peered":"2024-09-12T18:02:34.825873+0000","last_clean":"2024-09-12T18:02:34.825873+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:02:34.825873+0000","last_undegraded":"2024-09-12T18:02:34.825873+0000","last_fullsized":"2024-09-12T18:02:34.825873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.822616+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:02:34.822616+0000","last_peered":"2024-09-12T18:02:34.822616+0000","last_clean":"2024-09-12T18:02:34.822616+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:02:34.822616+0000","last_undegraded":"2024-09-12T18:02:34.822616+0000","last_fullsized":"2024-09-12T18:02:34.822616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824854+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:02:34.824854+0000","last_peered":"2024-09-12T18:02:34.824854+0000","last_clean":"2024-09-12T18:02:34.824854+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:02:34.824854+0000","last_undegraded":"2024-09-12T18:02:34.824854+0000","last_fullsized":"2024-09-12T18:02:34.824854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.822619+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:02:34.822619+0000","last_peered":"2024-09-12T18:02:34.822619+0000","last_clean":"2024-09-12T18:02:34.822619+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:02:34.822619+0000","last_undegraded":"2024-09-12T18:02:34.822619+0000","last_fullsized":"2024-09-12T18:02:34.822619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825773+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:02:34.825773+0000","last_peered":"2024-09-12T18:02:34.825773+0000","last_clean":"2024-09-12T18:02:34.825773+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:02:34.825773+0000","last_undegraded":"2024-09-12T18:02:34.825773+0000","last_fullsized":"2024-09-12T18:02:34.825773+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824137+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:02:34.824137+0000","last_peered":"2024-09-12T18:02:34.824137+0000","last_clean":"2024-09-12T18:02:34.824137+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:02:34.824137+0000","last_undegraded":"2024-09-12T18:02:34.824137+0000","last_fullsized":"2024-09-12T18:02:34.824137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825527+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:02:34.825527+0000","last_peered":"2024-09-12T18:02:34.825527+0000","last_clean":"2024-09-12T18:02:34.825527+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:02:34.825527+0000","last_undegraded":"2024-09-12T18:02:34.825527+0000","last_fullsized":"2024-09-12T18:02:34.825527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828287+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:02:34.828287+0000","last_peered":"2024-09-12T18:02:34.828287+0000","last_clean":"2024-09-12T18:02:34.828287+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:02:34.828287+0000","last_undegraded":"2024-09-12T18:02:34.828287+0000","last_fullsized":"2024-09-12T18:02:34.828287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828588+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:02:34.828588+0000","last_peered":"2024-09-12T18:02:34.828588+0000","last_clean":"2024-09-12T18:02:34.828588+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:02:34.828588+0000","last_undegraded":"2024-09-12T18:02:34.828588+0000","last_fullsized":"2024-09-12T18:02:34.828588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824980+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:02:34.824980+0000","last_peered":"2024-09-12T18:02:34.824980+0000","last_clean":"2024-09-12T18:02:34.824980+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:02:34.824980+0000","last_undegraded":"2024-09-12T18:02:34.824980+0000","last_fullsized":"2024-09-12T18:02:34.824980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824418+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:02:34.824418+0000","last_peered":"2024-09-12T18:02:34.824418+0000","last_clean":"2024-09-12T18:02:34.824418+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:02:34.824418+0000","last_undegraded":"2024-09-12T18:02:34.824418+0000","last_fullsized":"2024-09-12T18:02:34.824418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825625+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:02:34.825625+0000","last_peered":"2024-09-12T18:02:34.825625+0000","last_clean":"2024-09-12T18:02:34.825625+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:02:34.825625+0000","last_undegraded":"2024-09-12T18:02:34.825625+0000","last_fullsized":"2024-09-12T18:02:34.825625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823043+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:02:34.823043+0000","last_peered":"2024-09-12T18:02:34.823043+0000","last_clean":"2024-09-12T18:02:34.823043+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:02:34.823043+0000","last_undegraded":"2024-09-12T18:02:34.823043+0000","last_fullsized":"2024-09-12T18:02:34.823043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.826285+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:02:34.826285+0000","last_peered":"2024-09-12T18:02:34.826285+0000","last_clean":"2024-09-12T18:02:34.826285+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:02:34.826285+0000","last_undegraded":"2024-09-12T18:02:34.826285+0000","last_fullsized":"2024-09-12T18:02:34.826285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.822811+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:02:34.822811+0000","last_peered":"2024-09-12T18:02:34.822811+0000","last_clean":"2024-09-12T18:02:34.822811+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:02:34.822811+0000","last_undegraded":"2024-09-12T18:02:34.822811+0000","last_fullsized":"2024-09-12T18:02:34.822811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829014+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:02:34.829014+0000","last_peered":"2024-09-12T18:02:34.829014+0000","last_clean":"2024-09-12T18:02:34.829014+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:02:34.829014+0000","last_undegraded":"2024-09-12T18:02:34.829014+0000","last_fullsized":"2024-09-12T18:02:34.829014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824026+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:02:34.824026+0000","last_peered":"2024-09-12T18:02:34.824026+0000","last_clean":"2024-09-12T18:02:34.824026+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:02:34.824026+0000","last_undegraded":"2024-09-12T18:02:34.824026+0000","last_fullsized":"2024-09-12T18:02:34.824026+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825104+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:02:34.825104+0000","last_peered":"2024-09-12T18:02:34.825104+0000","last_clean":"2024-09-12T18:02:34.825104+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:02:34.825104+0000","last_undegraded":"2024-09-12T18:02:34.825104+0000","last_fullsized":"2024-09-12T18:02:34.825104+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828466+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:02:34.828466+0000","last_peered":"2024-09-12T18:02:34.828466+0000","last_clean":"2024-09-12T18:02:34.828466+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:02:34.828466+0000","last_undegraded":"2024-09-12T18:02:34.828466+0000","last_fullsized":"2024-09-12T18:02:34.828466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825641+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:02:34.825641+0000","last_peered":"2024-09-12T18:02:34.825641+0000","last_clean":"2024-09-12T18:02:34.825641+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:02:34.825641+0000","last_undegraded":"2024-09-12T18:02:34.825641+0000","last_fullsized":"2024-09-12T18:02:34.825641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823780+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:02:34.823780+0000","last_peered":"2024-09-12T18:02:34.823780+0000","last_clean":"2024-09-12T18:02:34.823780+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:02:34.823780+0000","last_undegraded":"2024-09-12T18:02:34.823780+0000","last_fullsized":"2024-09-12T18:02:34.823780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828190+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:02:34.828190+0000","last_peered":"2024-09-12T18:02:34.828190+0000","last_clean":"2024-09-12T18:02:34.828190+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:02:34.828190+0000","last_undegraded":"2024-09-12T18:02:34.828190+0000","last_fullsized":"2024-09-12T18:02:34.828190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824386+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:02:34.824386+0000","last_peered":"2024-09-12T18:02:34.824386+0000","last_clean":"2024-09-12T18:02:34.824386+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:02:34.824386+0000","last_undegraded":"2024-09-12T18:02:34.824386+0000","last_fullsized":"2024-09-12T18:02:34.824386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828401+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:02:34.828401+0000","last_peered":"2024-09-12T18:02:34.828401+0000","last_clean":"2024-09-12T18:02:34.828401+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:02:34.828401+0000","last_undegraded":"2024-09-12T18:02:34.828401+0000","last_fullsized":"2024-09-12T18:02:34.828401+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.822915+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:02:34.822915+0000","last_peered":"2024-09-12T18:02:34.822915+0000","last_clean":"2024-09-12T18:02:34.822915+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:02:34.822915+0000","last_undegraded":"2024-09-12T18:02:34.822915+0000","last_fullsized":"2024-09-12T18:02:34.822915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829048+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:02:34.829048+0000","last_peered":"2024-09-12T18:02:34.829048+0000","last_clean":"2024-09-12T18:02:34.829048+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:02:34.829048+0000","last_undegraded":"2024-09-12T18:02:34.829048+0000","last_fullsized":"2024-09-12T18:02:34.829048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.836347+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:02:34.836347+0000","last_peered":"2024-09-12T18:02:34.836347+0000","last_clean":"2024-09-12T18:02:34.836347+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:02:34.836347+0000","last_undegraded":"2024-09-12T18:02:34.836347+0000","last_fullsized":"2024-09-12T18:02:34.836347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825028+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:02:34.825028+0000","last_peered":"2024-09-12T18:02:34.825028+0000","last_clean":"2024-09-12T18:02:34.825028+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:02:34.825028+0000","last_undegraded":"2024-09-12T18:02:34.825028+0000","last_fullsized":"2024-09-12T18:02:34.825028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829201+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:02:34.829201+0000","last_peered":"2024-09-12T18:02:34.829201+0000","last_clean":"2024-09-12T18:02:34.829201+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:02:34.829201+0000","last_undegraded":"2024-09-12T18:02:34.829201+0000","last_fullsized":"2024-09-12T18:02:34.829201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825915+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:02:34.825915+0000","last_peered":"2024-09-12T18:02:34.825915+0000","last_clean":"2024-09-12T18:02:34.825915+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:02:34.825915+0000","last_undegraded":"2024-09-12T18:02:34.825915+0000","last_fullsized":"2024-09-12T18:02:34.825915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829423+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:02:34.829423+0000","last_peered":"2024-09-12T18:02:34.829423+0000","last_clean":"2024-09-12T18:02:34.829423+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:02:34.829423+0000","last_undegraded":"2024-09-12T18:02:34.829423+0000","last_fullsized":"2024-09-12T18:02:34.829423+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823405+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:02:34.823405+0000","last_peered":"2024-09-12T18:02:34.823405+0000","last_clean":"2024-09-12T18:02:34.823405+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:02:34.823405+0000","last_undegraded":"2024-09-12T18:02:34.823405+0000","last_fullsized":"2024-09-12T18:02:34.823405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829217+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:02:34.829217+0000","last_peered":"2024-09-12T18:02:34.829217+0000","last_clean":"2024-09-12T18:02:34.829217+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:02:34.829217+0000","last_undegraded":"2024-09-12T18:02:34.829217+0000","last_fullsized":"2024-09-12T18:02:34.829217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824867+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:02:34.824867+0000","last_peered":"2024-09-12T18:02:34.824867+0000","last_clean":"2024-09-12T18:02:34.824867+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:02:34.824867+0000","last_undegraded":"2024-09-12T18:02:34.824867+0000","last_fullsized":"2024-09-12T18:02:34.824867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823427+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:02:34.823427+0000","last_peered":"2024-09-12T18:02:34.823427+0000","last_clean":"2024-09-12T18:02:34.823427+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:02:34.823427+0000","last_undegraded":"2024-09-12T18:02:34.823427+0000","last_fullsized":"2024-09-12T18:02:34.823427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829229+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:02:34.829229+0000","last_peered":"2024-09-12T18:02:34.829229+0000","last_clean":"2024-09-12T18:02:34.829229+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:02:34.829229+0000","last_undegraded":"2024-09-12T18:02:34.829229+0000","last_fullsized":"2024-09-12T18:02:34.829229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829341+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:02:34.829341+0000","last_peered":"2024-09-12T18:02:34.829341+0000","last_clean":"2024-09-12T18:02:34.829341+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:02:34.829341+0000","last_undegraded":"2024-09-12T18:02:34.829341+0000","last_fullsized":"2024-09-12T18:02:34.829341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.827962+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:02:34.827962+0000","last_peered":"2024-09-12T18:02:34.827962+0000","last_clean":"2024-09-12T18:02:34.827962+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:02:34.827962+0000","last_undegraded":"2024-09-12T18:02:34.827962+0000","last_fullsized":"2024-09-12T18:02:34.827962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829288+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:02:34.829288+0000","last_peered":"2024-09-12T18:02:34.829288+0000","last_clean":"2024-09-12T18:02:34.829288+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:02:34.829288+0000","last_undegraded":"2024-09-12T18:02:34.829288+0000","last_fullsized":"2024-09-12T18:02:34.829288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825985+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:02:34.825985+0000","last_peered":"2024-09-12T18:02:34.825985+0000","last_clean":"2024-09-12T18:02:34.825985+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:02:34.825985+0000","last_undegraded":"2024-09-12T18:02:34.825985+0000","last_fullsized":"2024-09-12T18:02:34.825985+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.822772+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:02:34.822772+0000","last_peered":"2024-09-12T18:02:34.822772+0000","last_clean":"2024-09-12T18:02:34.822772+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:02:34.822772+0000","last_undegraded":"2024-09-12T18:02:34.822772+0000","last_fullsized":"2024-09-12T18:02:34.822772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824476+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:02:34.824476+0000","last_peered":"2024-09-12T18:02:34.824476+0000","last_clean":"2024-09-12T18:02:34.824476+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:02:34.824476+0000","last_undegraded":"2024-09-12T18:02:34.824476+0000","last_fullsized":"2024-09-12T18:02:34.824476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825338+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:02:34.825338+0000","last_peered":"2024-09-12T18:02:34.825338+0000","last_clean":"2024-09-12T18:02:34.825338+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:02:34.825338+0000","last_undegraded":"2024-09-12T18:02:34.825338+0000","last_fullsized":"2024-09-12T18:02:34.825338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828233+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:02:34.828233+0000","last_peered":"2024-09-12T18:02:34.828233+0000","last_clean":"2024-09-12T18:02:34.828233+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:02:34.828233+0000","last_undegraded":"2024-09-12T18:02:34.828233+0000","last_fullsized":"2024-09-12T18:02:34.828233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824697+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:02:34.824697+0000","last_peered":"2024-09-12T18:02:34.824697+0000","last_clean":"2024-09-12T18:02:34.824697+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:02:34.824697+0000","last_undegraded":"2024-09-12T18:02:34.824697+0000","last_fullsized":"2024-09-12T18:02:34.824697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.826512+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:02:34.826512+0000","last_peered":"2024-09-12T18:02:34.826512+0000","last_clean":"2024-09-12T18:02:34.826512+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:02:34.826512+0000","last_undegraded":"2024-09-12T18:02:34.826512+0000","last_fullsized":"2024-09-12T18:02:34.826512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.827948+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:02:34.827948+0000","last_peered":"2024-09-12T18:02:34.827948+0000","last_clean":"2024-09-12T18:02:34.827948+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:02:34.827948+0000","last_undegraded":"2024-09-12T18:02:34.827948+0000","last_fullsized":"2024-09-12T18:02:34.827948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829163+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:02:34.829163+0000","last_peered":"2024-09-12T18:02:34.829163+0000","last_clean":"2024-09-12T18:02:34.829163+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:02:34.829163+0000","last_undegraded":"2024-09-12T18:02:34.829163+0000","last_fullsized":"2024-09-12T18:02:34.829163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828173+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:02:34.828173+0000","last_peered":"2024-09-12T18:02:34.828173+0000","last_clean":"2024-09-12T18:02:34.828173+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:02:34.828173+0000","last_undegraded":"2024-09-12T18:02:34.828173+0000","last_fullsized":"2024-09-12T18:02:34.828173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824664+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:02:34.824664+0000","last_peered":"2024-09-12T18:02:34.824664+0000","last_clean":"2024-09-12T18:02:34.824664+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:02:34.824664+0000","last_undegraded":"2024-09-12T18:02:34.824664+0000","last_fullsized":"2024-09-12T18:02:34.824664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828084+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:02:34.828084+0000","last_peered":"2024-09-12T18:02:34.828084+0000","last_clean":"2024-09-12T18:02:34.828084+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:02:34.828084+0000","last_undegraded":"2024-09-12T18:02:34.828084+0000","last_fullsized":"2024-09-12T18:02:34.828084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828917+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:02:34.828917+0000","last_peered":"2024-09-12T18:02:34.828917+0000","last_clean":"2024-09-12T18:02:34.828917+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:02:34.828917+0000","last_undegraded":"2024-09-12T18:02:34.828917+0000","last_fullsized":"2024-09-12T18:02:34.828917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.828059+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:02:34.828059+0000","last_peered":"2024-09-12T18:02:34.828059+0000","last_clean":"2024-09-12T18:02:34.828059+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:02:34.828059+0000","last_undegraded":"2024-09-12T18:02:34.828059+0000","last_fullsized":"2024-09-12T18:02:34.828059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823956+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:02:34.823956+0000","last_peered":"2024-09-12T18:02:34.823956+0000","last_clean":"2024-09-12T18:02:34.823956+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:02:34.823956+0000","last_undegraded":"2024-09-12T18:02:34.823956+0000","last_fullsized":"2024-09-12T18:02:34.823956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823669+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:02:34.823669+0000","last_peered":"2024-09-12T18:02:34.823669+0000","last_clean":"2024-09-12T18:02:34.823669+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:02:34.823669+0000","last_undegraded":"2024-09-12T18:02:34.823669+0000","last_fullsized":"2024-09-12T18:02:34.823669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823513+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:02:34.823513+0000","last_peered":"2024-09-12T18:02:34.823513+0000","last_clean":"2024-09-12T18:02:34.823513+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:02:34.823513+0000","last_undegraded":"2024-09-12T18:02:34.823513+0000","last_fullsized":"2024-09-12T18:02:34.823513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823859+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:02:34.823859+0000","last_peered":"2024-09-12T18:02:34.823859+0000","last_clean":"2024-09-12T18:02:34.823859+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:02:34.823859+0000","last_undegraded":"2024-09-12T18:02:34.823859+0000","last_fullsized":"2024-09-12T18:02:34.823859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824371+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:02:34.824371+0000","last_peered":"2024-09-12T18:02:34.824371+0000","last_clean":"2024-09-12T18:02:34.824371+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:02:34.824371+0000","last_undegraded":"2024-09-12T18:02:34.824371+0000","last_fullsized":"2024-09-12T18:02:34.824371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.825250+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:02:34.825250+0000","last_peered":"2024-09-12T18:02:34.825250+0000","last_clean":"2024-09-12T18:02:34.825250+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:02:34.825250+0000","last_undegraded":"2024-09-12T18:02:34.825250+0000","last_fullsized":"2024-09-12T18:02:34.825250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824355+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:02:34.824355+0000","last_peered":"2024-09-12T18:02:34.824355+0000","last_clean":"2024-09-12T18:02:34.824355+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:02:34.824355+0000","last_undegraded":"2024-09-12T18:02:34.824355+0000","last_fullsized":"2024-09-12T18:02:34.824355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.824437+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:02:34.824437+0000","last_peered":"2024-09-12T18:02:34.824437+0000","last_clean":"2024-09-12T18:02:34.824437+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:02:34.824437+0000","last_undegraded":"2024-09-12T18:02:34.824437+0000","last_fullsized":"2024-09-12T18:02:34.824437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823170+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:02:34.823170+0000","last_peered":"2024-09-12T18:02:34.823170+0000","last_clean":"2024-09-12T18:02:34.823170+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:02:34.823170+0000","last_undegraded":"2024-09-12T18:02:34.823170+0000","last_fullsized":"2024-09-12T18:02:34.823170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829192+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:02:34.829192+0000","last_peered":"2024-09-12T18:02:34.829192+0000","last_clean":"2024-09-12T18:02:34.829192+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:02:34.829192+0000","last_undegraded":"2024-09-12T18:02:34.829192+0000","last_fullsized":"2024-09-12T18:02:34.829192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.823686+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:02:34.823686+0000","last_peered":"2024-09-12T18:02:34.823686+0000","last_clean":"2024-09-12T18:02:34.823686+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:02:34.823686+0000","last_undegraded":"2024-09-12T18:02:34.823686+0000","last_fullsized":"2024-09-12T18:02:34.823686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T18:02:34.829124+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:02:34.829124+0000","last_peered":"2024-09-12T18:02:34.829124+0000","last_clean":"2024-09-12T18:02:34.829124+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:02:34.829124+0000","last_undegraded":"2024-09-12T18:02:34.829124+0000","last_fullsized":"2024-09-12T18:02:34.829124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":123246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":385024,"data_stored":719752,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":393216,"data_stored":720368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:40.088 INFO:tasks.thrashosds.thrasher:Setting 4.22 to [0, 2] 2024-09-12T18:02:40.088 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.22', '0', '2'] 2024-09-12T18:02:40.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.22 0 2 2024-09-12T18:02:40.089 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:40.079+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:40.180 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:40.177+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:40.219 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:40.219 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:40.219 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:40.220 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:40.233 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:40.280 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:40.280+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:40.355 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:40.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:40.355 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:40.356 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:40.356 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:40.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:40.381 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:40.381+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:40.482 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:40.481+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:40.496 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:40.496 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.851157325999999, 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.497 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:40.498 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:40.499 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.500 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.501 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.850484141000003, 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.502 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:40.503 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.504 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:40.505 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:40.506 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.849875038999997, 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.507 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.508 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.509 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.510 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.849347725999998, 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:40.511 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:40.512 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.513 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:40.514 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.515 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.84890669, 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.516 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.517 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.518 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.519 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:40.520 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.848128645999999, 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.521 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.522 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:40.523 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.524 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.525 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.847636678999997, 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.526 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.527 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:40.528 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.529 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.530 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.847069120999997, 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.531 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:40.532 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.533 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.534 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.535 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.846564704999999, 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:40.536 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.537 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:40.538 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.539 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:40.540 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.846087431000001, 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.541 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:40.542 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:40.544 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.845641598999997, 2024-09-12T18:02:40.545 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:40.546 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.547 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:40.548 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.549 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:40.550 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.845100543000001, 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.551 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:40.552 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.553 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:40.554 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.844762105000001, 2024-09-12T18:02:40.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 55.743918694000001, 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.560 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.562 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:40.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 44.804679172999997, 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.565 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:40.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:40.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.570 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 44.804559724000001, 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.571 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.573 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.576 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 44.804384485, 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:40.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:40.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.582 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 44.804320635000003, 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:40.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.585 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:40.586 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:40.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:40.588 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 44.804201953000003, 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.589 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.591 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:40.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:40.594 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 44.804134140999999, 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:40.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:40.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:40.599 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:40.599 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:40.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:40.601 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:40.601+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:40.702 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:40.702+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:40.731 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:40.731 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:40.731 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:40.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:40.803 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:40.802+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:40.844 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:02:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:set 4.22 pg_upmap mapping to [0,2] 2024-09-12T18:02:40.864 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:40.864 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:40.865 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:40.865 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:40.876 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:40.904 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:40.902+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:40.996 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:40.996 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:40.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:40.996 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:40.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 50.45777897, 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:40.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:40.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:40.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.001 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.455474772999999, 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:41.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.452167725000002, 2024-09-12T18:02:41.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:41.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:41.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304779572000001, 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.011 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:41.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:41.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304686509, 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.017 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:41.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:41.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304644035999999, 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:41.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:41.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:41.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:41.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304539810000001, 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:41.028 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:41.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304503977000003, 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:41.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304472957999998, 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:41.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:41.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304422017999997, 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.049 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304366944999998, 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:41.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.304333129, 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.054 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:41.058 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.302989552, 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.062 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.302720133999998, 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:41.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:41.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.300959657999996, 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:41.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:41.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:41.071 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.300804003000003, 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:41.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:41.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 45.298643503000001, 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.076 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:41.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:41.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.309428908999998, 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:41.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.086 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.307475552, 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:41.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:41.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:41.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:41.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.306903751, 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:41.093 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:41.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:41.098 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:41.100 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:41.100 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:41.098+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:41.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:41.201 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:41.201+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:41.232 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:41.232 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:41.233 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:41.246 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:41.310 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:41.310 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:41.330 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:41.332 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:41.333+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:41.351 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:41.402 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:41.401+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:41.409 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:41.409 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:41.423 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:41.503 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:41.500+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:41.585 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:41.585 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:41.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:41.603 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:41.600+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:41.705 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:41.700+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:41.728 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:41.728 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:41.742 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:41.806 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:41.804+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:41.866 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:41.866 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:41.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:41.906 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:41.905+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:42.005 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:42.005 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:42.007 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:42.009+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:42.019 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:42.108 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:42.106+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:42.149 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:42.149 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:42.164 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:42.210 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:42.208+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:42.286 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:42.286 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:42.301 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:42.309 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:42.306+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:42.410 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:42.409+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:42.469 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:42.469 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:42.484 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:42.511 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:42.508+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:42.611 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:42.608+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:42.617 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:42.617 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:42.631 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:42.712 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:42.713+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:42.753 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:42.754 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:42.768 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:42.813 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:42.808+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:42.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:02:42.914 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:42.913+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:42.929 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:42.929 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:42.943 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:43.015 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:43.014+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:43.076 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:43.076 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:43.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:43.116 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:43.116+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:43.217 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:43.217+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:43.257 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:43.257 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:43.272 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:43.318 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:43.318+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:43.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:43.395 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:43.395 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:43.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:43.419 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:43.417+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:43.521 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:43.516+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:43.545 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:43.545 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:43.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:43.569 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:43.569 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:43.603 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:43.603 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:43.621 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:43.618+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:43.635 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:43.635 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:43.722 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:43.722+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:43.727 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:43.728 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:43.728 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:43.728 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:43.728 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:43.742 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:43.823 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:43.822+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:43.856 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:02:43.866 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.866 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.329168115000002, 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.867 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.868 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:43.869 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.870 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.326863918000001, 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.871 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.872 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.873 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.874 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:43.875 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 51.323556869999997, 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.876 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.878 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.879 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.176168717000003, 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.880 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.881 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.882 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:43.883 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:43.884 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.885 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.176075654000002, 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.886 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:43.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:43.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.176033181000001, 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:43.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:43.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:43.897 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.175928955000003, 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:43.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:43.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:43.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.175893121999998, 2024-09-12T18:02:43.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:43.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:43.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:43.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:43.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.175862103, 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.909 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:43.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.913 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.914 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.175811162999999, 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:43.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.17575609, 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:43.919 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:43.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:43.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:43.923 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.175722274000002, 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:43.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:43.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.174378697000002, 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:43.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.174109279, 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.932 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:43.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:43.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.936 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.172348802999998, 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:43.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.172193147999998, 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:43.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:43.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.170032648000003, 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:43.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:43.951 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 47.180818054, 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:43.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:43.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:43.957 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.178864697000002, 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:43.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:43.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:43.964 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 25.178292895999999, 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:43.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:43.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:43.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:43.970 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:43.972 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:43.973 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:43.970+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:44.073 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:44.070+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:44.103 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:44.103 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:44.103 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:44.117 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:44.174 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:44.174+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:44.233 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:44.233 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:44.233 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:44.233 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:44.234 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:44.247 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:44.275 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:44.272+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.721638325000001, 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:44.367 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:44.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:44.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.373 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.721521277000001, 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:44.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:44.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.721231209000003, 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:44.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:44.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:44.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.721048621000001, 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.386 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:44.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:44.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:44.392 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.720361754000002, 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:44.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:44.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.398 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.720215244000002, 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:44.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:44.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.720127822000002, 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:44.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.410 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.614932373000002, 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.411 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:44.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:44.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:44.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.614849317000001, 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.417 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:44.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:44.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.614780998000001, 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.423 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:44.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:44.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:44.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.429 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.614601958999998, 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:44.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:44.433 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:44.434 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.435 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.510275356000001, 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.436 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.437 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:44.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.510229357, 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.442 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:44.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:44.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.510111913999999, 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.448 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:44.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:44.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.405880639999999, 2024-09-12T18:02:44.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:44.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.405847027, 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.461 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:44.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.466 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.405677625000003, 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.467 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:44.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:44.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.405638412000002, 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.473 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:44.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.405594344999997, 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.479 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:44.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:44.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 59.405476026000002, 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:44.485 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:44.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:44.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:44.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:44.491 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:44.493 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:44.493 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:44.493+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:44.594 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:44.592+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:44.623 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:44.623 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:44.623 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:44.623 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:44.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:44.695 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:44.693+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:44.755 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:44.755 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:44.755 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:44.755 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:44.755 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:44.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:44.796 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:44.792+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:44.889 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:44.889 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:44.889 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:44.889 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:44.889 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.243514634999997, 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.890 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:44.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.894 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.894 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:44.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:44.894 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.894 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.895 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.895 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.24284145, 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.899 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:44.900 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.242232348000002, 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.241705035000003, 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.905 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:44.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:44.909 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.241263998999997, 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.914 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.240485954999997, 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:44.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:44.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.919 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.239993988000002, 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:44.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.923 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.239426430000002, 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.924 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.928 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.238922014000003, 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.929 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:44.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:44.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.238444739999998, 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.933 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.935 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:44.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.937 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.237998908000002, 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.938 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:44.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:44.942 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.237457851999999, 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.237119413999999, 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.947 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:44.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:44.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 60.136276002999999, 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:44.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 49.197036482000001, 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.956 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:44.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 49.196917032999998, 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:44.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:44.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.967 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 49.196741793999998, 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:44.968 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:44.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:44.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:44.973 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 49.196677944000001, 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.976 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:44.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:44.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 49.196559262000001, 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:44.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:44.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:44.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 49.196491450000003, 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:44.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:44.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.989 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.989 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.989 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:44.989 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:44.989 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:44.990 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:44.991 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:44.988+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:45.091 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:45.088+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:45.122 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:45.123 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:45.123 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:45.123 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:45.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:45.193 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:45.193+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:45.293 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:45.293+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:45.305 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:45.305 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:45.305 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:45.306 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:45.306 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:45.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:45.394 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:45.394+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:45.447 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:45.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.909472055999998, 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:45.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:45.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:45.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:45.452 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.907167858999998, 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:45.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:45.456 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.903860811000001, 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:45.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.461 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756472658, 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:45.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:45.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.467 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756379594999999, 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:45.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:45.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756337121999998, 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:45.473 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:45.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:45.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756232896, 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:45.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:45.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.484 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756197063000002, 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:45.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:45.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756166043999997, 2024-09-12T18:02:45.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:45.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:45.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756115104000003, 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:45.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.500 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756060030999997, 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.756026214999999, 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:45.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:45.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.754682637999998, 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:45.509 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:45.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:45.512 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.754413220000004, 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:45.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.517 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.752652744000002, 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:45.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.752497089000002, 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:45.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.750336589, 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.528 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:45.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.761121995000003, 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:45.531 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:45.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.534 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:45.536 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.759168637999998, 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:45.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:45.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:45.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:45.543 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 26.758596836999999, 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:45.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:45.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:45.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:45.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:45.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.549 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:45.549 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:45.549 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:45.550 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:45.551 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:45.549+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:45.651 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:45.650+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:45.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:45.677 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:45.677 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:45.677 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:45.677 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:45.691 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:45.752 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:45.752+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:45.798 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:45.798 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:45.798 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:45.798 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:45.798 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:45.810 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:45.853 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:45.854 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:45.857 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:45.857+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:45.875 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:02:45.875 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:02:45.875 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:02:45.887 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:45.887 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:45.917 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:45.917 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:45.921 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:45.921 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:45.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:45.973 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:02:45.973 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:45.973+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:46.055 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:46.053+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:46.061 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:46.061 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:46.075 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:46.156 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:46.152+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:46.191 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:46.191 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:46.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:46.257 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:46.257+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:46.328 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:46.328 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:46.342 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:46.358 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:46.357+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:46.398 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:02:46.402 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:02:46.434 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T18:02:44.571355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597738,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":200,"num_write_kb":2697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90520,"kb_used_data":1112,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283025000,"statfs":{"total":289910292480,"available":289817600000,"internally_reserved":0,"allocated":1138688,"data_stored":1597774,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001248"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600569+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:02:42.600569+0000","last_peered":"2024-09-12T18:02:42.600569+0000","last_clean":"2024-09-12T18:02:42.600569+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:02:42.600569+0000","last_undegraded":"2024-09-12T18:02:42.600569+0000","last_fullsized":"2024-09-12T18:02:42.600569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599850+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:02:42.599850+0000","last_peered":"2024-09-12T18:02:42.599850+0000","last_clean":"2024-09-12T18:02:42.599850+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:02:42.599850+0000","last_undegraded":"2024-09-12T18:02:42.599850+0000","last_fullsized":"2024-09-12T18:02:42.599850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856475+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:02:41.856475+0000","last_peered":"2024-09-12T18:02:41.856475+0000","last_clean":"2024-09-12T18:02:41.856475+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:02:41.856475+0000","last_undegraded":"2024-09-12T18:02:41.856475+0000","last_fullsized":"2024-09-12T18:02:41.856475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856431+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:02:41.856431+0000","last_peered":"2024-09-12T18:02:41.856431+0000","last_clean":"2024-09-12T18:02:41.856431+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:02:41.856431+0000","last_undegraded":"2024-09-12T18:02:41.856431+0000","last_fullsized":"2024-09-12T18:02:41.856431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599676+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:02:42.599676+0000","last_peered":"2024-09-12T18:02:42.599676+0000","last_clean":"2024-09-12T18:02:42.599676+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:02:42.599676+0000","last_undegraded":"2024-09-12T18:02:42.599676+0000","last_fullsized":"2024-09-12T18:02:42.599676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855604+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:02:41.855604+0000","last_peered":"2024-09-12T18:02:41.855604+0000","last_clean":"2024-09-12T18:02:41.855604+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:02:41.855604+0000","last_undegraded":"2024-09-12T18:02:41.855604+0000","last_fullsized":"2024-09-12T18:02:41.855604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855536+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:02:41.855536+0000","last_peered":"2024-09-12T18:02:41.855536+0000","last_clean":"2024-09-12T18:02:41.855536+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:02:41.855536+0000","last_undegraded":"2024-09-12T18:02:41.855536+0000","last_fullsized":"2024-09-12T18:02:41.855536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855065+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:02:41.855065+0000","last_peered":"2024-09-12T18:02:41.855065+0000","last_clean":"2024-09-12T18:02:41.855065+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:02:41.855065+0000","last_undegraded":"2024-09-12T18:02:41.855065+0000","last_fullsized":"2024-09-12T18:02:41.855065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857375+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:02:41.857375+0000","last_peered":"2024-09-12T18:02:41.857375+0000","last_clean":"2024-09-12T18:02:41.857375+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:02:41.857375+0000","last_undegraded":"2024-09-12T18:02:41.857375+0000","last_fullsized":"2024-09-12T18:02:41.857375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600097+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:02:42.600097+0000","last_peered":"2024-09-12T18:02:42.600097+0000","last_clean":"2024-09-12T18:02:42.600097+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:02:42.600097+0000","last_undegraded":"2024-09-12T18:02:42.600097+0000","last_fullsized":"2024-09-12T18:02:42.600097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857324+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:02:41.857324+0000","last_peered":"2024-09-12T18:02:41.857324+0000","last_clean":"2024-09-12T18:02:41.857324+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:02:41.857324+0000","last_undegraded":"2024-09-12T18:02:41.857324+0000","last_fullsized":"2024-09-12T18:02:41.857324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599594+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:02:42.599594+0000","last_peered":"2024-09-12T18:02:42.599594+0000","last_clean":"2024-09-12T18:02:42.599594+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:02:42.599594+0000","last_undegraded":"2024-09-12T18:02:42.599594+0000","last_fullsized":"2024-09-12T18:02:42.599594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599422+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:02:42.599422+0000","last_peered":"2024-09-12T18:02:42.599422+0000","last_clean":"2024-09-12T18:02:42.599422+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:02:42.599422+0000","last_undegraded":"2024-09-12T18:02:42.599422+0000","last_fullsized":"2024-09-12T18:02:42.599422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855878+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:02:41.855878+0000","last_peered":"2024-09-12T18:02:41.855878+0000","last_clean":"2024-09-12T18:02:41.855878+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:02:41.855878+0000","last_undegraded":"2024-09-12T18:02:41.855878+0000","last_fullsized":"2024-09-12T18:02:41.855878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855845+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:02:41.855845+0000","last_peered":"2024-09-12T18:02:41.855845+0000","last_clean":"2024-09-12T18:02:41.855845+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:02:41.855845+0000","last_undegraded":"2024-09-12T18:02:41.855845+0000","last_fullsized":"2024-09-12T18:02:41.855845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855205+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:02:41.855205+0000","last_peered":"2024-09-12T18:02:41.855205+0000","last_clean":"2024-09-12T18:02:41.855205+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:02:41.855205+0000","last_undegraded":"2024-09-12T18:02:41.855205+0000","last_fullsized":"2024-09-12T18:02:41.855205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.858065+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:02:41.858065+0000","last_peered":"2024-09-12T18:02:41.858065+0000","last_clean":"2024-09-12T18:02:41.858065+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:02:41.858065+0000","last_undegraded":"2024-09-12T18:02:41.858065+0000","last_fullsized":"2024-09-12T18:02:41.858065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600525+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:02:42.600525+0000","last_peered":"2024-09-12T18:02:42.600525+0000","last_clean":"2024-09-12T18:02:42.600525+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:02:42.600525+0000","last_undegraded":"2024-09-12T18:02:42.600525+0000","last_fullsized":"2024-09-12T18:02:42.600525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857206+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:02:41.857206+0000","last_peered":"2024-09-12T18:02:41.857206+0000","last_clean":"2024-09-12T18:02:41.857206+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:02:41.857206+0000","last_undegraded":"2024-09-12T18:02:41.857206+0000","last_fullsized":"2024-09-12T18:02:41.857206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856674+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:02:41.856674+0000","last_peered":"2024-09-12T18:02:41.856674+0000","last_clean":"2024-09-12T18:02:41.856674+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:02:41.856674+0000","last_undegraded":"2024-09-12T18:02:41.856674+0000","last_fullsized":"2024-09-12T18:02:41.856674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857375+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:02:41.857375+0000","last_peered":"2024-09-12T18:02:41.857375+0000","last_clean":"2024-09-12T18:02:41.857375+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:02:41.857375+0000","last_undegraded":"2024-09-12T18:02:41.857375+0000","last_fullsized":"2024-09-12T18:02:41.857375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599358+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:02:42.599358+0000","last_peered":"2024-09-12T18:02:42.599358+0000","last_clean":"2024-09-12T18:02:42.599358+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:02:42.599358+0000","last_undegraded":"2024-09-12T18:02:42.599358+0000","last_fullsized":"2024-09-12T18:02:42.599358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.854782+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:02:41.854782+0000","last_peered":"2024-09-12T18:02:41.854782+0000","last_clean":"2024-09-12T18:02:41.854782+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:02:41.854782+0000","last_undegraded":"2024-09-12T18:02:41.854782+0000","last_fullsized":"2024-09-12T18:02:41.854782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.598487+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:02:42.598487+0000","last_peered":"2024-09-12T18:02:42.598487+0000","last_clean":"2024-09-12T18:02:42.598487+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:02:42.598487+0000","last_undegraded":"2024-09-12T18:02:42.598487+0000","last_fullsized":"2024-09-12T18:02:42.598487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600524+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:02:42.600524+0000","last_peered":"2024-09-12T18:02:42.600524+0000","last_clean":"2024-09-12T18:02:42.600524+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:02:42.600524+0000","last_undegraded":"2024-09-12T18:02:42.600524+0000","last_fullsized":"2024-09-12T18:02:42.600524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857555+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:02:41.857555+0000","last_peered":"2024-09-12T18:02:41.857555+0000","last_clean":"2024-09-12T18:02:41.857555+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:02:41.857555+0000","last_undegraded":"2024-09-12T18:02:41.857555+0000","last_fullsized":"2024-09-12T18:02:41.857555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856779+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:02:41.856779+0000","last_peered":"2024-09-12T18:02:41.856779+0000","last_clean":"2024-09-12T18:02:41.856779+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:02:41.856779+0000","last_undegraded":"2024-09-12T18:02:41.856779+0000","last_fullsized":"2024-09-12T18:02:41.856779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600360+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:02:42.600360+0000","last_peered":"2024-09-12T18:02:42.600360+0000","last_clean":"2024-09-12T18:02:42.600360+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:02:42.600360+0000","last_undegraded":"2024-09-12T18:02:42.600360+0000","last_fullsized":"2024-09-12T18:02:42.600360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855755+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:02:41.855755+0000","last_peered":"2024-09-12T18:02:41.855755+0000","last_clean":"2024-09-12T18:02:41.855755+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:02:41.855755+0000","last_undegraded":"2024-09-12T18:02:41.855755+0000","last_fullsized":"2024-09-12T18:02:41.855755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.864623+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:02:41.864623+0000","last_peered":"2024-09-12T18:02:41.864623+0000","last_clean":"2024-09-12T18:02:41.864623+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:02:41.864623+0000","last_undegraded":"2024-09-12T18:02:41.864623+0000","last_fullsized":"2024-09-12T18:02:41.864623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.854786+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:02:41.854786+0000","last_peered":"2024-09-12T18:02:41.854786+0000","last_clean":"2024-09-12T18:02:41.854786+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:02:41.854786+0000","last_undegraded":"2024-09-12T18:02:41.854786+0000","last_fullsized":"2024-09-12T18:02:41.854786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855297+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:02:41.855297+0000","last_peered":"2024-09-12T18:02:41.855297+0000","last_clean":"2024-09-12T18:02:41.855297+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:02:41.855297+0000","last_undegraded":"2024-09-12T18:02:41.855297+0000","last_fullsized":"2024-09-12T18:02:41.855297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600091+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:02:42.600091+0000","last_peered":"2024-09-12T18:02:42.600091+0000","last_clean":"2024-09-12T18:02:42.600091+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:02:42.600091+0000","last_undegraded":"2024-09-12T18:02:42.600091+0000","last_fullsized":"2024-09-12T18:02:42.600091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857635+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:02:41.857635+0000","last_peered":"2024-09-12T18:02:41.857635+0000","last_clean":"2024-09-12T18:02:41.857635+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:02:41.857635+0000","last_undegraded":"2024-09-12T18:02:41.857635+0000","last_fullsized":"2024-09-12T18:02:41.857635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600083+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:02:42.600083+0000","last_peered":"2024-09-12T18:02:42.600083+0000","last_clean":"2024-09-12T18:02:42.600083+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:02:42.600083+0000","last_undegraded":"2024-09-12T18:02:42.600083+0000","last_fullsized":"2024-09-12T18:02:42.600083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855262+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:02:41.855262+0000","last_peered":"2024-09-12T18:02:41.855262+0000","last_clean":"2024-09-12T18:02:41.855262+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:02:41.855262+0000","last_undegraded":"2024-09-12T18:02:41.855262+0000","last_fullsized":"2024-09-12T18:02:41.855262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857867+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:02:41.857867+0000","last_peered":"2024-09-12T18:02:41.857867+0000","last_clean":"2024-09-12T18:02:41.857867+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:02:41.857867+0000","last_undegraded":"2024-09-12T18:02:41.857867+0000","last_fullsized":"2024-09-12T18:02:41.857867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.598842+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:02:42.598842+0000","last_peered":"2024-09-12T18:02:42.598842+0000","last_clean":"2024-09-12T18:02:42.598842+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:02:42.598842+0000","last_undegraded":"2024-09-12T18:02:42.598842+0000","last_fullsized":"2024-09-12T18:02:42.598842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857529+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:02:41.857529+0000","last_peered":"2024-09-12T18:02:41.857529+0000","last_clean":"2024-09-12T18:02:41.857529+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:02:41.857529+0000","last_undegraded":"2024-09-12T18:02:41.857529+0000","last_fullsized":"2024-09-12T18:02:41.857529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855484+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:02:41.855484+0000","last_peered":"2024-09-12T18:02:41.855484+0000","last_clean":"2024-09-12T18:02:41.855484+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:02:41.855484+0000","last_undegraded":"2024-09-12T18:02:41.855484+0000","last_fullsized":"2024-09-12T18:02:41.855484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857068+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:02:41.857068+0000","last_peered":"2024-09-12T18:02:41.857068+0000","last_clean":"2024-09-12T18:02:41.857068+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:02:41.857068+0000","last_undegraded":"2024-09-12T18:02:41.857068+0000","last_fullsized":"2024-09-12T18:02:41.857068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.598555+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:02:42.598555+0000","last_peered":"2024-09-12T18:02:42.598555+0000","last_clean":"2024-09-12T18:02:42.598555+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:02:42.598555+0000","last_undegraded":"2024-09-12T18:02:42.598555+0000","last_fullsized":"2024-09-12T18:02:42.598555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600580+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:02:42.600580+0000","last_peered":"2024-09-12T18:02:42.600580+0000","last_clean":"2024-09-12T18:02:42.600580+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:02:42.600580+0000","last_undegraded":"2024-09-12T18:02:42.600580+0000","last_fullsized":"2024-09-12T18:02:42.600580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.598581+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:02:42.598581+0000","last_peered":"2024-09-12T18:02:42.598581+0000","last_clean":"2024-09-12T18:02:42.598581+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:02:42.598581+0000","last_undegraded":"2024-09-12T18:02:42.598581+0000","last_fullsized":"2024-09-12T18:02:42.598581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857629+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:02:41.857629+0000","last_peered":"2024-09-12T18:02:41.857629+0000","last_clean":"2024-09-12T18:02:41.857629+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:02:41.857629+0000","last_undegraded":"2024-09-12T18:02:41.857629+0000","last_fullsized":"2024-09-12T18:02:41.857629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856286+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:02:41.856286+0000","last_peered":"2024-09-12T18:02:41.856286+0000","last_clean":"2024-09-12T18:02:41.856286+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:02:41.856286+0000","last_undegraded":"2024-09-12T18:02:41.856286+0000","last_fullsized":"2024-09-12T18:02:41.856286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857638+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:02:41.857638+0000","last_peered":"2024-09-12T18:02:41.857638+0000","last_clean":"2024-09-12T18:02:41.857638+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:02:41.857638+0000","last_undegraded":"2024-09-12T18:02:41.857638+0000","last_fullsized":"2024-09-12T18:02:41.857638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855611+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:02:41.855611+0000","last_peered":"2024-09-12T18:02:41.855611+0000","last_clean":"2024-09-12T18:02:41.855611+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:02:41.855611+0000","last_undegraded":"2024-09-12T18:02:41.855611+0000","last_fullsized":"2024-09-12T18:02:41.855611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855881+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:02:41.855881+0000","last_peered":"2024-09-12T18:02:41.855881+0000","last_clean":"2024-09-12T18:02:41.855881+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:02:41.855881+0000","last_undegraded":"2024-09-12T18:02:41.855881+0000","last_fullsized":"2024-09-12T18:02:41.855881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856836+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:02:41.856836+0000","last_peered":"2024-09-12T18:02:41.856836+0000","last_clean":"2024-09-12T18:02:41.856836+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:02:41.856836+0000","last_undegraded":"2024-09-12T18:02:41.856836+0000","last_fullsized":"2024-09-12T18:02:41.856836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857295+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:02:41.857295+0000","last_peered":"2024-09-12T18:02:41.857295+0000","last_clean":"2024-09-12T18:02:41.857295+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:02:41.857295+0000","last_undegraded":"2024-09-12T18:02:41.857295+0000","last_fullsized":"2024-09-12T18:02:41.857295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857298+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:02:41.857298+0000","last_peered":"2024-09-12T18:02:41.857298+0000","last_clean":"2024-09-12T18:02:41.857298+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:02:41.857298+0000","last_undegraded":"2024-09-12T18:02:41.857298+0000","last_fullsized":"2024-09-12T18:02:41.857298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599027+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:02:42.599027+0000","last_peered":"2024-09-12T18:02:42.599027+0000","last_clean":"2024-09-12T18:02:42.599027+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:02:42.599027+0000","last_undegraded":"2024-09-12T18:02:42.599027+0000","last_fullsized":"2024-09-12T18:02:42.599027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856456+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:02:41.856456+0000","last_peered":"2024-09-12T18:02:41.856456+0000","last_clean":"2024-09-12T18:02:41.856456+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:02:41.856456+0000","last_undegraded":"2024-09-12T18:02:41.856456+0000","last_fullsized":"2024-09-12T18:02:41.856456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.598748+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:02:42.598748+0000","last_peered":"2024-09-12T18:02:42.598748+0000","last_clean":"2024-09-12T18:02:42.598748+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:02:42.598748+0000","last_undegraded":"2024-09-12T18:02:42.598748+0000","last_fullsized":"2024-09-12T18:02:42.598748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857627+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:02:41.857627+0000","last_peered":"2024-09-12T18:02:41.857627+0000","last_clean":"2024-09-12T18:02:41.857627+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:02:41.857627+0000","last_undegraded":"2024-09-12T18:02:41.857627+0000","last_fullsized":"2024-09-12T18:02:41.857627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":201,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855961+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:02:41.855961+0000","last_peered":"2024-09-12T18:02:41.855961+0000","last_clean":"2024-09-12T18:02:41.855961+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:02:41.855961+0000","last_undegraded":"2024-09-12T18:02:41.855961+0000","last_fullsized":"2024-09-12T18:02:41.855961+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.858034+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:02:41.858034+0000","last_peered":"2024-09-12T18:02:41.858034+0000","last_clean":"2024-09-12T18:02:41.858034+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:02:41.858034+0000","last_undegraded":"2024-09-12T18:02:41.858034+0000","last_fullsized":"2024-09-12T18:02:41.858034+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855405+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:02:41.855405+0000","last_peered":"2024-09-12T18:02:41.855405+0000","last_clean":"2024-09-12T18:02:41.855405+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:02:41.855405+0000","last_undegraded":"2024-09-12T18:02:41.855405+0000","last_fullsized":"2024-09-12T18:02:41.855405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857564+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:02:41.857564+0000","last_peered":"2024-09-12T18:02:41.857564+0000","last_clean":"2024-09-12T18:02:41.857564+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:02:41.857564+0000","last_undegraded":"2024-09-12T18:02:41.857564+0000","last_fullsized":"2024-09-12T18:02:41.857564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855793+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:02:41.855793+0000","last_peered":"2024-09-12T18:02:41.855793+0000","last_clean":"2024-09-12T18:02:41.855793+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:02:41.855793+0000","last_undegraded":"2024-09-12T18:02:41.855793+0000","last_fullsized":"2024-09-12T18:02:41.855793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855585+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:02:41.855585+0000","last_peered":"2024-09-12T18:02:41.855585+0000","last_clean":"2024-09-12T18:02:41.855585+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:02:41.855585+0000","last_undegraded":"2024-09-12T18:02:41.855585+0000","last_fullsized":"2024-09-12T18:02:41.855585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600280+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:02:42.600280+0000","last_peered":"2024-09-12T18:02:42.600280+0000","last_clean":"2024-09-12T18:02:42.600280+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:02:42.600280+0000","last_undegraded":"2024-09-12T18:02:42.600280+0000","last_fullsized":"2024-09-12T18:02:42.600280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855817+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:02:41.855817+0000","last_peered":"2024-09-12T18:02:41.855817+0000","last_clean":"2024-09-12T18:02:41.855817+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:02:41.855817+0000","last_undegraded":"2024-09-12T18:02:41.855817+0000","last_fullsized":"2024-09-12T18:02:41.855817+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.598845+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:02:42.598845+0000","last_peered":"2024-09-12T18:02:42.598845+0000","last_clean":"2024-09-12T18:02:42.598845+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:02:42.598845+0000","last_undegraded":"2024-09-12T18:02:42.598845+0000","last_fullsized":"2024-09-12T18:02:42.598845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857814+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:02:41.857814+0000","last_peered":"2024-09-12T18:02:41.857814+0000","last_clean":"2024-09-12T18:02:41.857814+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:02:41.857814+0000","last_undegraded":"2024-09-12T18:02:41.857814+0000","last_fullsized":"2024-09-12T18:02:41.857814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857312+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:02:41.857312+0000","last_peered":"2024-09-12T18:02:41.857312+0000","last_clean":"2024-09-12T18:02:41.857312+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:02:41.857312+0000","last_undegraded":"2024-09-12T18:02:41.857312+0000","last_fullsized":"2024-09-12T18:02:41.857312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857746+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:02:41.857746+0000","last_peered":"2024-09-12T18:02:41.857746+0000","last_clean":"2024-09-12T18:02:41.857746+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:02:41.857746+0000","last_undegraded":"2024-09-12T18:02:41.857746+0000","last_fullsized":"2024-09-12T18:02:41.857746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857280+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:02:41.857280+0000","last_peered":"2024-09-12T18:02:41.857280+0000","last_clean":"2024-09-12T18:02:41.857280+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:02:41.857280+0000","last_undegraded":"2024-09-12T18:02:41.857280+0000","last_fullsized":"2024-09-12T18:02:41.857280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857815+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:02:41.857815+0000","last_peered":"2024-09-12T18:02:41.857815+0000","last_clean":"2024-09-12T18:02:41.857815+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:02:41.857815+0000","last_undegraded":"2024-09-12T18:02:41.857815+0000","last_fullsized":"2024-09-12T18:02:41.857815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857610+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:02:41.857610+0000","last_peered":"2024-09-12T18:02:41.857610+0000","last_clean":"2024-09-12T18:02:41.857610+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:02:41.857610+0000","last_undegraded":"2024-09-12T18:02:41.857610+0000","last_fullsized":"2024-09-12T18:02:41.857610+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599646+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:02:42.599646+0000","last_peered":"2024-09-12T18:02:42.599646+0000","last_clean":"2024-09-12T18:02:42.599646+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:02:42.599646+0000","last_undegraded":"2024-09-12T18:02:42.599646+0000","last_fullsized":"2024-09-12T18:02:42.599646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857599+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:02:41.857599+0000","last_peered":"2024-09-12T18:02:41.857599+0000","last_clean":"2024-09-12T18:02:41.857599+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:02:41.857599+0000","last_undegraded":"2024-09-12T18:02:41.857599+0000","last_fullsized":"2024-09-12T18:02:41.857599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.601081+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:02:42.601081+0000","last_peered":"2024-09-12T18:02:42.601081+0000","last_clean":"2024-09-12T18:02:42.601081+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:02:42.601081+0000","last_undegraded":"2024-09-12T18:02:42.601081+0000","last_fullsized":"2024-09-12T18:02:42.601081+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599547+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:02:42.599547+0000","last_peered":"2024-09-12T18:02:42.599547+0000","last_clean":"2024-09-12T18:02:42.599547+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:02:42.599547+0000","last_undegraded":"2024-09-12T18:02:42.599547+0000","last_fullsized":"2024-09-12T18:02:42.599547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.858282+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:02:41.858282+0000","last_peered":"2024-09-12T18:02:41.858282+0000","last_clean":"2024-09-12T18:02:41.858282+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:02:41.858282+0000","last_undegraded":"2024-09-12T18:02:41.858282+0000","last_fullsized":"2024-09-12T18:02:41.858282+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.858101+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:02:41.858101+0000","last_peered":"2024-09-12T18:02:41.858101+0000","last_clean":"2024-09-12T18:02:41.858101+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:02:41.858101+0000","last_undegraded":"2024-09-12T18:02:41.858101+0000","last_fullsized":"2024-09-12T18:02:41.858101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.854938+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:02:41.854938+0000","last_peered":"2024-09-12T18:02:41.854938+0000","last_clean":"2024-09-12T18:02:41.854938+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:02:41.854938+0000","last_undegraded":"2024-09-12T18:02:41.854938+0000","last_fullsized":"2024-09-12T18:02:41.854938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"25'3","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.858089+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:02:41.858089+0000","last_peered":"2024-09-12T18:02:41.858089+0000","last_clean":"2024-09-12T18:02:41.858089+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:02:41.858089+0000","last_undegraded":"2024-09-12T18:02:41.858089+0000","last_fullsized":"2024-09-12T18:02:41.858089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857008+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:02:41.857008+0000","last_peered":"2024-09-12T18:02:41.857008+0000","last_clean":"2024-09-12T18:02:41.857008+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:02:41.857008+0000","last_undegraded":"2024-09-12T18:02:41.857008+0000","last_fullsized":"2024-09-12T18:02:41.857008+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.598768+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:02:42.598768+0000","last_peered":"2024-09-12T18:02:42.598768+0000","last_clean":"2024-09-12T18:02:42.598768+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:02:42.598768+0000","last_undegraded":"2024-09-12T18:02:42.598768+0000","last_fullsized":"2024-09-12T18:02:42.598768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856985+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:02:41.856985+0000","last_peered":"2024-09-12T18:02:41.856985+0000","last_clean":"2024-09-12T18:02:41.856985+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:02:41.856985+0000","last_undegraded":"2024-09-12T18:02:41.856985+0000","last_fullsized":"2024-09-12T18:02:41.856985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857399+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:02:41.857399+0000","last_peered":"2024-09-12T18:02:41.857399+0000","last_clean":"2024-09-12T18:02:41.857399+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:02:41.857399+0000","last_undegraded":"2024-09-12T18:02:41.857399+0000","last_fullsized":"2024-09-12T18:02:41.857399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.854995+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:02:41.854995+0000","last_peered":"2024-09-12T18:02:41.854995+0000","last_clean":"2024-09-12T18:02:41.854995+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:02:41.854995+0000","last_undegraded":"2024-09-12T18:02:41.854995+0000","last_fullsized":"2024-09-12T18:02:41.854995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600801+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:02:42.600801+0000","last_peered":"2024-09-12T18:02:42.600801+0000","last_clean":"2024-09-12T18:02:42.600801+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:02:42.600801+0000","last_undegraded":"2024-09-12T18:02:42.600801+0000","last_fullsized":"2024-09-12T18:02:42.600801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857166+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:02:41.857166+0000","last_peered":"2024-09-12T18:02:41.857166+0000","last_clean":"2024-09-12T18:02:41.857166+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:02:41.857166+0000","last_undegraded":"2024-09-12T18:02:41.857166+0000","last_fullsized":"2024-09-12T18:02:41.857166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855069+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:02:41.855069+0000","last_peered":"2024-09-12T18:02:41.855069+0000","last_clean":"2024-09-12T18:02:41.855069+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:02:41.855069+0000","last_undegraded":"2024-09-12T18:02:41.855069+0000","last_fullsized":"2024-09-12T18:02:41.855069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.858074+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:02:41.858074+0000","last_peered":"2024-09-12T18:02:41.858074+0000","last_clean":"2024-09-12T18:02:41.858074+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:02:41.858074+0000","last_undegraded":"2024-09-12T18:02:41.858074+0000","last_fullsized":"2024-09-12T18:02:41.858074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.854938+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:02:41.854938+0000","last_peered":"2024-09-12T18:02:41.854938+0000","last_clean":"2024-09-12T18:02:41.854938+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:02:41.854938+0000","last_undegraded":"2024-09-12T18:02:41.854938+0000","last_fullsized":"2024-09-12T18:02:41.854938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600800+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:02:42.600800+0000","last_peered":"2024-09-12T18:02:42.600800+0000","last_clean":"2024-09-12T18:02:42.600800+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:02:42.600800+0000","last_undegraded":"2024-09-12T18:02:42.600800+0000","last_fullsized":"2024-09-12T18:02:42.600800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855213+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:02:41.855213+0000","last_peered":"2024-09-12T18:02:41.855213+0000","last_clean":"2024-09-12T18:02:41.855213+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:02:41.855213+0000","last_undegraded":"2024-09-12T18:02:41.855213+0000","last_fullsized":"2024-09-12T18:02:41.855213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857291+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:02:41.857291+0000","last_peered":"2024-09-12T18:02:41.857291+0000","last_clean":"2024-09-12T18:02:41.857291+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:02:41.857291+0000","last_undegraded":"2024-09-12T18:02:41.857291+0000","last_fullsized":"2024-09-12T18:02:41.857291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855513+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:02:41.855513+0000","last_peered":"2024-09-12T18:02:41.855513+0000","last_clean":"2024-09-12T18:02:41.855513+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:02:41.855513+0000","last_undegraded":"2024-09-12T18:02:41.855513+0000","last_fullsized":"2024-09-12T18:02:41.855513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599499+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:02:42.599499+0000","last_peered":"2024-09-12T18:02:42.599499+0000","last_clean":"2024-09-12T18:02:42.599499+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:02:42.599499+0000","last_undegraded":"2024-09-12T18:02:42.599499+0000","last_fullsized":"2024-09-12T18:02:42.599499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600635+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:02:42.600635+0000","last_peered":"2024-09-12T18:02:42.600635+0000","last_clean":"2024-09-12T18:02:42.600635+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:02:42.600635+0000","last_undegraded":"2024-09-12T18:02:42.600635+0000","last_fullsized":"2024-09-12T18:02:42.600635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599889+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:02:42.599889+0000","last_peered":"2024-09-12T18:02:42.599889+0000","last_clean":"2024-09-12T18:02:42.599889+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:02:42.599889+0000","last_undegraded":"2024-09-12T18:02:42.599889+0000","last_fullsized":"2024-09-12T18:02:42.599889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599863+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:02:42.599863+0000","last_peered":"2024-09-12T18:02:42.599863+0000","last_clean":"2024-09-12T18:02:42.599863+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:02:42.599863+0000","last_undegraded":"2024-09-12T18:02:42.599863+0000","last_fullsized":"2024-09-12T18:02:42.599863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.856591+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:02:41.856591+0000","last_peered":"2024-09-12T18:02:41.856591+0000","last_clean":"2024-09-12T18:02:41.856591+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:02:41.856591+0000","last_undegraded":"2024-09-12T18:02:41.856591+0000","last_fullsized":"2024-09-12T18:02:41.856591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857127+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:02:41.857127+0000","last_peered":"2024-09-12T18:02:41.857127+0000","last_clean":"2024-09-12T18:02:41.857127+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:02:41.857127+0000","last_undegraded":"2024-09-12T18:02:41.857127+0000","last_fullsized":"2024-09-12T18:02:41.857127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857030+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:02:41.857030+0000","last_peered":"2024-09-12T18:02:41.857030+0000","last_clean":"2024-09-12T18:02:41.857030+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:02:41.857030+0000","last_undegraded":"2024-09-12T18:02:41.857030+0000","last_fullsized":"2024-09-12T18:02:41.857030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.600336+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:02:42.600336+0000","last_peered":"2024-09-12T18:02:42.600336+0000","last_clean":"2024-09-12T18:02:42.600336+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:02:42.600336+0000","last_undegraded":"2024-09-12T18:02:42.600336+0000","last_fullsized":"2024-09-12T18:02:42.600336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:42.599076+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:02:42.599076+0000","last_peered":"2024-09-12T18:02:42.599076+0000","last_clean":"2024-09-12T18:02:42.599076+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:02:42.599076+0000","last_undegraded":"2024-09-12T18:02:42.599076+0000","last_fullsized":"2024-09-12T18:02:42.599076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857829+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:02:41.857829+0000","last_peered":"2024-09-12T18:02:41.857829+0000","last_clean":"2024-09-12T18:02:41.857829+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:02:41.857829+0000","last_undegraded":"2024-09-12T18:02:41.857829+0000","last_fullsized":"2024-09-12T18:02:41.857829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.855556+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:02:41.855556+0000","last_peered":"2024-09-12T18:02:41.855556+0000","last_clean":"2024-09-12T18:02:41.855556+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:02:41.855556+0000","last_undegraded":"2024-09-12T18:02:41.855556+0000","last_fullsized":"2024-09-12T18:02:41.855556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-12T18:02:41.857818+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:02:41.857818+0000","last_peered":"2024-09-12T18:02:41.857818+0000","last_clean":"2024-09-12T18:02:41.857818+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:02:41.857818+0000","last_undegraded":"2024-09-12T18:02:41.857818+0000","last_fullsized":"2024-09-12T18:02:41.857818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738384,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":319488,"data_stored":136151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":401408,"data_stored":728350,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738384,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":417792,"data_stored":733273,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:02:46.459 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:46.456+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:46.474 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:46.475 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:46.489 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:46.559 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:46.558+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:46.653 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:46.653 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:46.660 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:46.658+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:46.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:46.761 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:46.761+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:46.783 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:46.783 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:46.797 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:46.862 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:46.861+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:46.864 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:02:46.929 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:46.929 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:46.943 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:46.962 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:46.960+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:47.065 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:47.060+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:47.100 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:47.101 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:47.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:47.164 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:47.165+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:47.240 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:47.240 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:47.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:47.266 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:47.264+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:47.367 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:47.365+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:47.387 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:47.387 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:47.401 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:47.468 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:47.466+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:47.525 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:47.525 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:47.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:47.569 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:47.569+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:47.669 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:47.669+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:47.706 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:47.706 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:47.721 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:47.770 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:47.769+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:47.854 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:47.854 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:47.869 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:47.871 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:47.868+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:47.945 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:47.972 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:47.970+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:47.990 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:47.990 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:48.004 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:48.073 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:48.070+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:48.110 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:48.111 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:48.120 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:48.120 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:48.130 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:48.131 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:48.134 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:48.150 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:48.181 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:48.181+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:48.265 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:48.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:48.266 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:48.266 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:48.274 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:48.273+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:48.280 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:48.375 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:48.374+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:48.437 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:48.437 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:48.438 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:48.438 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:48.438 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:48.451 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:48.476 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:48.474+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:48.576 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:48.574+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:48.577 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.932417913000002, 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.578 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:48.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:48.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.584 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.932300865000002, 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:48.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:48.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.932010796999997, 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:48.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.597 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.931828209000003, 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:48.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:48.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.931141341999997, 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.604 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:48.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:48.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.610 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.930994832000003, 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:48.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:48.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.616 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.930907410000003, 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.617 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:48.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:48.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.825711961000003, 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:48.623 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:48.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:48.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:48.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:48.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:48.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.825628905000002, 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.631 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:48.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.637 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.825560586000002, 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:48.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:48.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:48.643 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.825381546999999, 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.644 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:48.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:48.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.721054944000002, 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.721008945000001, 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.720891502000001, 2024-09-12T18:02:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.616660228000001, 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.616626615000001, 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.616457212999997, 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.616418000000003, 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.616373932999998, 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 63.616255613999996, 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:48.708 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:48.710 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:48.711 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:48.710+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:48.811 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:48.810+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:48.843 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:48.843 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:48.843 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:48.843 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:48.858 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:48.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:02:48.911 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:48.912+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:49.012 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:49.013+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:49.019 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:49.019 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:49.020 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:49.020 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:49.020 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:49.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:49.113 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:49.110+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:49.160 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.516395857999996, 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.161 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:49.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.515722672999999, 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:49.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.515113571000001, 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.171 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:49.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:49.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.514586257999994, 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:49.176 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:49.177 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:49.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.514145221999996, 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.181 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:49.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:49.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.513367177999996, 2024-09-12T18:02:49.186 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:49.187 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:49.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.512875210999994, 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.191 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.192 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:49.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.195 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.512307652999993, 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.196 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:49.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.199 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.200 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.511803236999995, 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:49.201 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.202 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:49.203 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.204 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.205 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:49.206 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.511325963000004, 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.207 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.208 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:49.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.210 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:49.211 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.510880130999993, 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:49.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:49.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.510339075000005, 2024-09-12T18:02:49.216 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.217 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:49.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.510000637000005, 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:49.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.224 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:49.225 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:49.226 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 64.409157226000005, 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.228 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:49.229 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.230 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:49.231 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 53.469917705, 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.232 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.233 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:49.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.235 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:49.236 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.237 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.237 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.237 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:49.237 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:49.237 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.237 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.238 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.239 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.239 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.239 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:49.239 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 53.469798255999997, 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.240 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.241 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:49.242 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:49.242 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.242 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.242 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.242 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:49.242 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:49.242 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.242 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.243 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.244 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.245 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 53.469623017000004, 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:49.246 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.247 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.248 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.249 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:49.250 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.251 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 53.469559167, 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:49.252 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.253 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.254 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:49.256 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:49.258 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 53.469440485, 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.259 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:49.260 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:49.262 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:49.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.264 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 53.469372673000002, 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:49.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:49.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:49.268 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.269 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.269 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.269 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:49.269 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:49.269 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:49.270 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:49.271 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:49.268+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:49.371 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:49.370+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:49.402 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:49.403 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:49.403 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:49.403 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:49.417 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:49.472 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:49.468+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:49.533 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:49.533 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:49.533 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:49.533 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:49.533 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:49.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:49.572 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:49.570+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:49.674 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:49.673+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:49.708 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:49.708 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 59.169703329999997, 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:49.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:49.713 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.167399133000004, 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:49.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:49.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.164092085, 2024-09-12T18:02:49.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:49.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:49.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016703931999999, 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:49.723 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:49.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:49.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:49.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016610868999997, 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:49.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:49.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:49.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:49.735 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016568395999997, 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:49.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:49.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.741 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016464169999999, 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:49.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:49.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016428337000001, 2024-09-12T18:02:49.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:49.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:49.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.753 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016397318000003, 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:49.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:49.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016346378000001, 2024-09-12T18:02:49.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:49.763 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016291305000003, 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.764 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:49.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.016257488999997, 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.768 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.014913911999997, 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:49.772 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.014644494000002, 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:49.776 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:49.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.012884018000001, 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.781 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:49.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:49.785 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.012728363000001, 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:49.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:49.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:49.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:49.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:49.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.796 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.796 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 54.010567862999999, 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:49.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:49.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:49.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:49.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:49.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:49.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:49.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:49.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:49.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:49.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.803 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 53.021353269000002, 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:49.804 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.805 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.806 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.807 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.808 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:49.809 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:49.810 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 36.019399911999997, 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.811 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.812 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.813 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:49.814 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.815 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:49.816 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:49.817 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:49.818 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.018828111000001, 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.819 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.820 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.821 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:49.822 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:49.823 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:49.824 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:49.825 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:49.827 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:49.824+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:49.827 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:02:49.928 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:49.926+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:49.960 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:49.960 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:49.960 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:49.960 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:49.975 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:50.029 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:50.029+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:50.097 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:50.097 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:50.097 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:50.111 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:50.130 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:50.130+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:50.166 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:50.231 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:50.230+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.628489028000004, 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:50.274 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:50.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:50.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.280 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.628371979999997, 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:50.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:50.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.628081911999999, 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:50.287 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:50.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.627899323999998, 2024-09-12T18:02:50.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:50.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:50.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:50.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.627212456999999, 2024-09-12T18:02:50.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:50.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:50.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.627065947000006, 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:50.305 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:50.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:50.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:50.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.626978524999998, 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:50.311 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.521783076000006, 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.317 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:50.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.521700019999997, 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.323 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:50.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:50.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:50.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:50.329 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.521631701000004, 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:50.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:50.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.521452662000002, 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.336 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:50.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:50.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.417126058999997, 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.342 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:50.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:50.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.417080060000004, 2024-09-12T18:02:50.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:50.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:50.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.354 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.416962616999996, 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:50.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:50.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.312731342999996, 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.361 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:50.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:50.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.312697729999996, 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.368 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:50.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:50.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.312528327999999, 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.374 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:50.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.380 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.312489115000005, 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:50.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.312445048000001, 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.387 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:50.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:50.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.393 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 65.312326729000006, 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:50.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:50.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:50.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:50.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:50.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:50.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:50.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.400 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:50.400 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:50.400 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:50.401 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:50.402 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:50.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:50.403 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:50.401+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:50.404 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:50.502 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:50.501+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:50.539 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:50.540 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:50.555 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:50.603 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:50.600+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:50.674 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:50.674 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:50.689 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:50.704 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:50.704+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:50.805 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:50.805+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:50.810 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:50.810 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:50.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:50.905 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:50.900+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:50.955 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:50.955 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:50.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:51.006 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:51.006+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:51.107 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:51.104+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:51.135 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:51.136 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:51.148 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:51.208 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:51.206+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:51.296 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:51.296 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:51.309 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:51.310 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:51.306+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:51.410 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:51.408+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:51.438 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:02:51.439 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:02:51.439 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-12T18:02:51.439 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-12T18:02:51.441 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:51.441 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:51.457 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:51.511 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:51.508+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:51.578 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:51.578 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:51.579 INFO:teuthology.orchestra.run.smithi052.stderr:no valid command found; 10 closest matches: 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:0 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:1 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:2 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:abort 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:assert 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:bench [] [] [] [] 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs debug_inject_read_zeros 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs files list 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs stats 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:bluestore allocator dump block 2024-09-12T18:02:51.580 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: invalid command 2024-09-12T18:02:51.582 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:02:51.583 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T18:02:51.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-12T18:02:51.593 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:51.612 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:51.608+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:51.713 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:51.712+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:51.714 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:51.714 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:no valid command found; 10 closest matches: 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:0 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:1 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:2 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:abort 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:assert 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:bench [] [] [] [] 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs debug_inject_read_zeros 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs files list 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs stats 2024-09-12T18:02:51.723 INFO:teuthology.orchestra.run.smithi052.stderr:bluestore allocator dump block 2024-09-12T18:02:51.724 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: invalid command 2024-09-12T18:02:51.727 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:02:51.727 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T18:02:51.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-12T18:02:51.729 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:51.815 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:51.812+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:51.860 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:51.860 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:51.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:no valid command found; 10 closest matches: 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:0 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:1 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:2 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:abort 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:assert 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:bench [] [] [] [] 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs debug_inject_read_zeros 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs files list 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:bluefs stats 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:bluestore allocator dump block 2024-09-12T18:02:51.883 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: invalid command 2024-09-12T18:02:51.886 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:02:51.887 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T18:02:51.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:02:51.915 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:51.916+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:51.997 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:51.997 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:52.011 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:52.016 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:52.012+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:52.117 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:52.116+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:52.133 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:52.133 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:52.147 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:52.218 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:52.218+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:52.279 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:52.279 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:52.293 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:52.308 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:02:52.319 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:52.316+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:52.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:52.411 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:52.411 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:52.420 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:52.416+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:52.425 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:52.521 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:52.520+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:52.557 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:52.557 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:52.591 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:52.591 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:52.600 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:52.600 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:52.611 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:52.611 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:52.614 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:52.622 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:52.622+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:52.723 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:52.720+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:52.746 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:52.746 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:52.747 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:52.760 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:52.824 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:52.820+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:52.877 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:52.877 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:52.877 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:52.891 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:52.925 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:52.922+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:53.026 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:53.024+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:53.060 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:53.060 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.414318613999995, 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:53.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:53.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.067 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.414201566000003, 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:53.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:53.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:53.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.413911498000004, 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.075 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:53.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.080 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.413728910000003, 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.082 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:53.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.413042043000004, 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:53.089 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:53.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:53.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.096 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.412895532999997, 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.097 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:53.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:53.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.412808111000004, 2024-09-12T18:02:53.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:53.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:53.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.307612661999997, 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:53.111 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:53.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.307529606000003, 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.119 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:53.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:53.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.126 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.126 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:53.126 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.307461286999995, 2024-09-12T18:02:53.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:53.126 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:53.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:53.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:53.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.307282248000007, 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.135 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.202955645000003, 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:53.142 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:53.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:53.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.149 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.202909645999995, 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.150 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:53.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.157 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.202792203000001, 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.158 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:53.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.098560929000001, 2024-09-12T18:02:53.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:53.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:53.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:53.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:53.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.172 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.098527316000002, 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:53.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:53.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.098357914000005, 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:53.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:53.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:53.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:53.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.098318700999997, 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.187 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:53.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:53.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:53.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:53.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.194 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.098274634000006, 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 68.098156314999997, 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:53.202 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:53.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:53.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:53.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:53.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:53.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.209 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:53.210 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:53.210 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:53.211 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:53.212 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:53.212+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:53.312 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:53.308+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:53.344 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:53.344 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:53.344 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:53.344 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:53.360 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:53.413 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:53.410+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:53.478 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:53.478 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:53.478 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:53.478 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:53.478 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:53.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:53.514 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:53.512+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:53.615 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:53.616+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:53.663 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:53.663 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.017498716000006, 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.664 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:53.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.668 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.016825530999995, 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:53.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:53.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:53.673 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.016216428999996, 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:53.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:53.676 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.677 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.015689116000004, 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.679 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.680 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:53.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.015248080000006, 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:53.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.014470036000006, 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.688 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.690 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.692 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.013978069000004, 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:53.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.696 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.696 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.696 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:53.696 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:53.696 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.696 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:53.697 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.013410511000004, 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.698 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:53.699 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.700 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.702 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.012906095000005, 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.703 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.704 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:53.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.012428821, 2024-09-12T18:02:53.707 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.011982989000003, 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.712 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:53.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:53.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.715 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.716 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.011441933, 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.717 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:53.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:53.719 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.720 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:53.721 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 69.011103495, 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.722 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:53.723 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.724 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:53.725 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.726 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 68.910260084000001, 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.727 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:53.728 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:53.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:53.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.731 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 57.971020563000003, 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.732 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.734 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:53.735 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.736 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:53.737 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 57.970901114, 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.738 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:53.739 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:53.740 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.741 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.742 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.743 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 57.970725874999999, 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.744 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.745 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:53.746 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.747 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:53.748 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.749 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 57.970662025000003, 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.750 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.751 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.752 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:53.753 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:53.754 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.755 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 57.970543343000003, 2024-09-12T18:02:53.756 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.757 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.758 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.759 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:53.760 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.761 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 57.970475530999998, 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:53.762 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.763 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:53.764 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.765 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:53.766 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:53.768 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:53.769 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:53.766+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:53.868 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:53.864+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:53.899 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:53.899 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:53.899 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:53.900 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:53.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:53.970 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:53.968+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:54.071 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:54.070+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:54.075 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:54.075 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:54.075 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:54.075 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:54.075 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:54.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:54.172 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:54.168+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 63.670015257000003, 2024-09-12T18:02:54.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.209 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:54.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.667711060000002, 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.214 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:54.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:54.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.664404011999999, 2024-09-12T18:02:54.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:54.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:54.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.517015858999997, 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:54.225 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:54.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:54.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.231 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.516922796000003, 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:54.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:54.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.237 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.516880323000002, 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:54.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:54.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:54.243 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.516776096999997, 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:54.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.248 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.516740263999999, 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:54.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.254 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.516709245000001, 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:54.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.259 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.516658305, 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:54.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.516603232000001, 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.516569416000003, 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.268 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:54.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:54.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:54.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:54.272 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.515225839000003, 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:54.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:54.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.514956421000001, 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.513195945, 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:54.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:54.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.513040289999999, 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:54.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:54.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.290 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 58.510879789999997, 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:54.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 57.521665196000001, 2024-09-12T18:02:54.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:54.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 40.519711839000003, 2024-09-12T18:02:54.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:54.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:54.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:54.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 35.519140038000003, 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:54.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.313 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:54.314 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:54.314 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:54.315 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:54.316 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:54.312+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:54.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:02:54.416 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:54.412+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:54.446 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:54.446 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:54.447 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:54.447 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:54.461 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:54.517 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:54.514+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:54.618 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:54.616+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:54.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:54.627 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:54.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:54.628 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:54.628 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:54.641 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:54.719 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:54.718+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.123418168000001, 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.769 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:54.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.775 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.123301119999994, 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:54.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:54.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.123011051999995, 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:54.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.788 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.122828463999994, 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:54.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:54.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.122141596999995, 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.795 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:54.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:54.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.121995087000002, 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.801 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:54.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:54.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:54.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.121907664999995, 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.807 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:54.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.016712216000002, 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:54.813 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.016629159999994, 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:54.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:54.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:54.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.016560841, 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:54.826 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:54.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:54.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.016381801999998, 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.833 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:54.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.912055198999994, 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:54.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:54.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.842 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:54.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.9120092, 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.845 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:54.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:54.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.911891757000006, 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.851 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:54.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.854 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:54.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.807660483000006, 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.857 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.807626870000007, 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.863 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:54.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.866 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.807457467999996, 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.869 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:54.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.807418255000002, 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.875 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:54.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.878 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:54.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.807374187999997, 2024-09-12T18:02:54.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.807255869000002, 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:54.893 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:54.895 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:54.895 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:54.896 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:54.896 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:54.896 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:54.897 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:54.897 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:54.898 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:54.892+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:54.996 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:54.996+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:55.027 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:55.027 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:55.041 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:55.097 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:55.092+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:55.166 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:55.167 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:55.180 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:55.226 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:55.226+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:55.299 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:55.300+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:55.302 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:55.302 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:55.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:55.401 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:55.398+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:55.443 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:55.443 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:55.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:55.501 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:55.498+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:55.565 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:55.565 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:55.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:55.622 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:55.620+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:55.649 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:02:55.683 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:55.683 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:55.696 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:55.702 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:55.702+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:55.804 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:55.802+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:55.831 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:55.831 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:55.847 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:55.905 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:55.900+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:55.968 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:55.968 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:55.982 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:56.025 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:56.024+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:56.106 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:56.104+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:56.149 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:56.149 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:56.163 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:56.210 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:56.210+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:56.297 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:56.298 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:56.308 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:56.306+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:56.313 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:56.410 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:56.408+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:56.474 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:56.474 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:56.488 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:56.534 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:56.534+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:56.611 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:56.611 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:56.612 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:56.610+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:56.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:56.712 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:56.710+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:56.754 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:56.755 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:56.768 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:56.813 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:56.810+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:56.887 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:02:56.887 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:02:56.888 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-12T18:02:56.888 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:02:56.888 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:02:56.888 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-12T18:02:56.890 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:56.890 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:56.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:56.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:02:56.933 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:56.932+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:57.015 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:57.012+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:57.019 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:57.019 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T18:02:57.019 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:57.020 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:57.021 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:57.033 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:57.051 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:57.051 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:57.072 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:57.072 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:57.092 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:57.121 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:57.120+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:57.201 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:57.201 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:57.201 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:57.201 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:57.217 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:57.217 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:57.214+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:57.255 INFO:tasks.workunit.client.0.smithi052.stderr:Updating files: 99% (12821/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T18:02:57.318 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:57.314+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:57.381 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:57.381 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:57.382 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:57.382 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:57.395 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:57.441 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:57.440+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:57.520 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:57.520+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:57.522 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:57.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.877435399999996, 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.523 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:57.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:57.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.877318352000003, 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.529 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:57.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:57.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.877028284000005, 2024-09-12T18:02:57.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:57.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:57.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:57.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.876845696000004, 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.542 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:57.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:57.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.876158829000005, 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.548 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:57.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:57.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.554 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.876012318999997, 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:57.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:57.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.875924897000004, 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.561 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:57.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:57.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:57.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:57.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.770729447999997, 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.568 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:57.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:57.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.770646392000003, 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.574 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:57.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:57.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.770578072999996, 2024-09-12T18:02:57.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:57.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:57.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:57.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:57.586 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.770399033999993, 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.587 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:57.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:57.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:57.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:57.593 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.666072431000003, 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:57.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.666026431999995, 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:57.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:57.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.665908989000002, 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.606 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:57.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:57.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.561677715000002, 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.613 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:57.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:57.618 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.561644102000002, 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.619 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:57.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:57.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:57.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.561474700000005, 2024-09-12T18:02:57.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:57.626 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.626 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.626 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.626 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.626 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.626 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.626 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:57.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.627 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:57.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:57.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.561435486999997, 2024-09-12T18:02:57.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:57.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.639 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.561391420000007, 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.640 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:57.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:57.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:57.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:57.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:57.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:57.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:57.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:57.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:57.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:57.648 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.648 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.648 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.649 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:57.649 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:57.649 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.561273100999998, 2024-09-12T18:02:57.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:57.649 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:57.649 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:57.650 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:57.650 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:57.650 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:57.650 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:57.650 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:57.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.651 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:57.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:57.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:57.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:57.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:57.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:57.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:57.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:57.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:57.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:57.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:57.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:57.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:57.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:57.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:57.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:57.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:57.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:57.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:57.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:57.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:57.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:57.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:57.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:57.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:57.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:57.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:57.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:57.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:57.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:57.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:57.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:57.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:57.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:57.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:57.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:57.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:57.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:57.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:57.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:57.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:57.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.663 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.663 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:57.663 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:57.663 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:57.667 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to '0d61375b8ab53be4c233f5b93e463edfdff9316a'. 2024-09-12T18:02:57.667 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-12T18:02:57.667 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:02:57.667 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:02:57.668 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:02:57.668 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-12T18:02:57.668 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:02:57.668 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:02:57.668 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-12T18:02:57.669 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2024-09-12T18:02:57.669 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-12T18:02:57.669 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2024-09-12T18:02:57.669 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-12T18:02:57.669 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2024-09-12T18:02:57.670 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-12T18:02:57.670 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:02:57.670 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-12T18:02:57.670 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at 0d61375b8ab Merge pull request #59485 from mcv21/cephadm_image_warn 2024-09-12T18:02:57.671 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:57.671 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:57.664+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:57.672 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:02:57.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:02:57.679 INFO:tasks.workunit.client.0.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:02:57.683 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:02:57.683 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:02:57.765 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:57.764+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:57.804 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:57.804 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:57.804 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:02:57.804 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:57.819 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:57.866 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:57.866+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:57.936 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:57.937 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:02:57.937 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:02:57.937 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:02:57.937 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:57.953 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:57.994 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:57.994+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:58.068 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:58.064+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:58.122 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:02:58.123 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:02:58.123 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:02:58.123 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:02:58.123 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.123 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:02:58.123 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:58.124 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.476254815999994, 2024-09-12T18:02:58.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:02:58.124 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.124 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.124 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.125 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:58.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.126 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:02:58.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.127 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:02:58.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:02:58.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:02:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:02:58.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.129 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.129 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:02:58.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:02:58.129 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:02:58.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:02:58.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:02:58.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:02:58.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:02:58.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:02:58.132 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.132 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.133 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.133 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:02:58.133 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:02:58.133 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.133 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:02:58.134 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:02:58.134 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.134 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.134 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.135 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:02:58.135 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:58.135 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.475581630999997, 2024-09-12T18:02:58.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:02:58.136 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.136 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.136 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.136 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:58.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:02:58.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:02:58.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:02:58.139 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.139 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:02:58.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:02:58.140 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.140 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.140 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:02:58.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:02:58.141 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.474972528999999, 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:02:58.144 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.146 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.147 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:02:58.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:58.149 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.474445216000007, 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:02:58.152 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.153 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.154 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.474004179999994, 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.155 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.157 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:02:58.157 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:02:58.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.157 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.157 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.157 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:02:58.157 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.473226135999994, 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:02:58.160 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:02:58.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:02:58.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.165 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.472734169000006, 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:58.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:02:58.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:02:58.170 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.472166611000006, 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.171 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:02:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.175 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.471662194999993, 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:02:58.176 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:02:58.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.471184921000003, 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:02:58.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.186 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.470739089000006, 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.187 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:02:58.188 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:02:58.191 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.470198033000003, 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.192 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:02:58.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.469859595000003, 2024-09-12T18:02:58.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:02:58.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.200 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:02:58.201 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:02:58.202 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 73.369016184000003, 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.203 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.204 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:02:58.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.206 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 62.429776662999998, 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:58.208 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:02:58.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.211 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:02:58.212 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 62.429657214000002, 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:02:58.214 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:02:58.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:02:58.216 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.218 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:02:58.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.220 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 62.429481975000002, 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:02:58.224 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.225 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.226 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.227 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 62.429418124999998, 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.228 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.229 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:02:58.230 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:02:58.231 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.232 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:02:58.233 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 62.429299442999998, 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.234 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.236 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:02:58.237 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:02:58.237 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.237 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.237 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.237 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:02:58.237 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:02:58.237 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:02:58.240 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.241 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.242 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:28 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 62.429231631, 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067409549999999999, 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:02:58.243 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690793+0000", 2024-09-12T18:02:58.244 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690795+0000", 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.564e-06 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690800+0000", 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.366e-06 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.245 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690818+0000", 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.77e-05 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690834+0000", 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.573e-05 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:02:58.246 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690952+0000", 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011833299999999999 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691240+0000", 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028801800000000002 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697534+0000", 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062942440000000001 2024-09-12T18:02:58.247 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.248 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.248 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.248 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:02:58.248 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:02:58.248 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:02:58.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:58.250 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:58.248+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:58.351 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:58.352+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:58.375 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:58.375 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:58.376 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:02:58.376 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:58.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:02:58.423 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:02:58.451 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:58.450+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:58.512 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:58.512 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:02:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:02:58.513 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:02:58.513 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:58.522 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:02:58.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:02:58.553 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:58.552+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:58.574 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:02:58.575 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:02:58.575 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:02:58.624 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:02:58.627 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:02:58.628 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 68.109338534000003, 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.649 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:02:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.653 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.107034337000002, 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:02:58.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.658 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.103727289000005, 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:02:58.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:02:58.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.663 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.956339135999997, 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:02:58.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:02:58.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.956246073000003, 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:58.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:02:58.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.675 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.956203600000002, 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:02:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:02:58.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:58.681 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.956099373999997, 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:02:58.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.956063540999999, 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:02:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:02:58.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.956032522000001, 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.693 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:02:58.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.698 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.955981582, 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:02:58.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.955926509000001, 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.703 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:02:58.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:58.707 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.955892693000003, 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:02:58.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.954549116000003, 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:58.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.954279698000001, 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:02:58.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.952519221999999, 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.720 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:02:58.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:02:58.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.952363566999999, 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:02:58.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.729 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 62.950203066999997, 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:02:58.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 61.960988473, 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:02:58.734 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:02:58.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:02:58.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 44.959035116000003, 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.740 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:02:58.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:02:58.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:02:58.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.746 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 39.958463315000003, 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:02:58.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:02:58.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:02:58.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:02:58.752 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:02:58.754 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:02:58.755 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:02:58.756 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:58.752+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:58.759 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-12T18:02:58.760 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-12T18:02:58.760 DEBUG:teuthology.orchestra.run.smithi052:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0d61375b8ab53be4c233f5b93e463edfdff9316a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-12T18:02:58.818 INFO:tasks.workunit.client.0.smithi052.stderr:+ mkdir -p fsstress 2024-09-12T18:02:58.820 INFO:tasks.workunit.client.0.smithi052.stderr:+ pushd fsstress 2024-09-12T18:02:58.822 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T18:02:58.822 INFO:tasks.workunit.client.0.smithi052.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-12T18:02:58.854 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:58.852+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:58.888 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:58.889 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:58.889 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:02:58.889 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:58.903 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:02:58.955 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:58.952+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:59.025 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:59.025 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:02:59.025 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:02:59.026 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:02:59.026 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:59.039 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:02:59.081 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:59.080+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:59.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:02:59.157 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:59.156+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:59.209 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:02:59.209 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.564010753999995, 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.210 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:02:59.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:02:59.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.563893706000002, 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.217 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:02:59.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:02:59.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.563603638000004, 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.224 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:59.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:02:59.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.563421050000002, 2024-09-12T18:02:59.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:02:59.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:02:59.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.562734183000003, 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:02:59.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:02:59.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:02:59.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:02:59.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.562587672999996, 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.246 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:02:59.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:02:59.252 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.562500251000003, 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.253 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:02:59.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:02:59.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:59.260 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.457304801999996, 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:02:59.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:02:59.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.267 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.457221746000002, 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.268 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:02:59.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:02:59.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.274 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.457153426999994, 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:02:59.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:02:59.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.456974388000006, 2024-09-12T18:02:59.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:02:59.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:02:59.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.352647785000002, 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.288 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.290 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:02:59.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:02:59.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:02:59.294 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.352601785999994, 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.295 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:02:59.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:02:59.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.352484343, 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.302 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:02:59.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.248253069, 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:02:59.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:02:59.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:02:59.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.315 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.248219456000001, 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:02:59.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:02:59.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.248050054000004, 2024-09-12T18:02:59.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:02:59.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:02:59.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.248010840999996, 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:02:59.329 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:59.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:02:59.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:02:59.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:02:59.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.247966774000005, 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:02:59.336 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:59.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:02:59.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:02:59.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 74.247848454999996, 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:02:59.343 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:02:59.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:02:59.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:02:59.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:02:59.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:02:59.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:02:59.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:02:59.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.350 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:02:59.350 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:02:59.350 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:02:59.351 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:02:59.352 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:02:59.352 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:02:59.353 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:02:59.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:02:59.353 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:59.348+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:59.354 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:02:59.355 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:02:59.372 INFO:tasks.workunit.client.0.smithi052.stderr:+ tar xzf ltp-full.tgz 2024-09-12T18:02:59.453 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:59.448+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:59.496 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:59.496 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:59.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:02:59.553 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:59.548+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:59.643 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:59.643 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:59.654 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:02:59.652+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:02:59.659 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:02:59.754 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:59.754+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:59.788 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:59.788 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:59.803 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:02:59.855 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:02:59.854+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:02:59.944 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:02:59.944 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:02:59.957 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:02:59.956+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:02:59.960 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:00.059 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:00.058+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:00.090 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:00.091 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:00.106 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:00.158 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:00.158+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:00.237 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:00.237 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:00.251 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:00.258 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:00.256+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:00.359 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:00.356+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:00.386 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:00.386 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:00.400 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:00.460 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:00.458+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:00.561 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:00.560+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:00.571 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:00.572 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:00.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:00.673 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:00.672+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:00.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:03:00.759 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:00.759 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:00.762 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:00.760+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:00.774 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:00.864 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:00.860+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:00.904 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:00.905 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:00.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:00.964 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:00.960+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:01.060 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:01.060 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:01.065 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:01.062+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:01.077 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:01.166 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:01.164+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:01.252 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:01.252 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:01.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:01.267 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:01.264+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:01.355 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:01.367 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:01.364+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:01.404 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:01.404 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:01.419 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:01.468 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:01.464+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:01.523 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:01.523 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:01.541 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:01.541 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:01.548 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:01.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:01.569 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:01.566+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:01.571 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:01.571 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:01.667 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:03:01.671 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:01.668+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:01.692 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:01.692 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:01.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:01.692 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:01.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.692 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:03:01.692 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:01.692 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 71.154461329, 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:03:01.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:5 2.2 e14/12 2:5cea7035:::rbd_info:head v 14'1, mlcod=0'0)", 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.152157131999999, 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015559409999999999, 2024-09-12T18:03:01.697 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539103+0000", 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9699999999999996e-07 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539110+0000", 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3430000000000001e-06 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539134+0000", 2024-09-12T18:03:01.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4303000000000001e-05 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539148+0000", 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.454e-05 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539272+0000", 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012320899999999999 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.539300+0000", 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8513999999999998e-05 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540558+0000", 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012579399999999999 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:51.540659+0000", 2024-09-12T18:03:01.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010059499999999999 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:7 2.2 e15/12 2:5cea7035:::rbd_info:head v 15'2, mlcod=0'0)", 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 69.148850084000003, 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017176800000000001, 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.702 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542410+0000", 2024-09-12T18:03:01.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.37e-07 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542416+0000", 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1430000000000003e-06 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542441+0000", 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4562999999999998e-05 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542455+0000", 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3747000000000001e-05 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542600+0000", 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014484200000000001 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.542647+0000", 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7153000000000001e-05 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544023+0000", 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013759320000000001 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:52.544127+0000", 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104763 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.706 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001461930999994, 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:03:01.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:03:01.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:01.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.714 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001368868, 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:03:01.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:03:01.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.720 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001326395000007, 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001222169000002, 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:03:01.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:03:01.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001186336000004, 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.733 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:01.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:03:01.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.738 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001155316999998, 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:03:01.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:03:01.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:03:01.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:03:01.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:03:01.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001104377000004, 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:01.745 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:03:01.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:01.749 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001049304000006, 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:03:01.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 66.001015487999993, 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.754 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:03:01.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 4 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.999671910999993, 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021457759999999998, 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691588+0000", 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691590+0000", 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1299999999999999e-06 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691612+0000", 2024-09-12T18:03:01.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1603e-05 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691656+0000", 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4135999999999999e-05 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691697+0000", 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1165999999999999e-05 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020178199999999999 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693734+0000", 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0018349589999999999 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.762 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:14 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.999402493000005, 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019178450000000001, 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691857+0000", 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691859+0000", 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691875+0000", 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5743000000000002e-05 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691899+0000", 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3940000000000001e-05 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691916+0000", 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6773e-05 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692035+0000", 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011906899999999999 2024-09-12T18:03:01.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692081+0000", 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5550000000000003e-05 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693686+0000", 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016056340000000001 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:03:01.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9042999999999994e-05 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:37 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.997642017000004, 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032889080000000001, 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693618+0000", 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693620+0000", 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0930000000000001e-06 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693646+0000", 2024-09-12T18:03:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6449999999999999e-05 2024-09-12T18:03:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693673+0000", 2024-09-12T18:03:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6403000000000001e-05 2024-09-12T18:03:01.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693694+0000", 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1670000000000001e-05 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693826+0000", 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013108600000000001 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693872+0000", 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6366000000000003e-05 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696805+0000", 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002932797 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696907+0000", 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102043 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.771 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:34 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.997486362000004, 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001664214, 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693774+0000", 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693775+0000", 2024-09-12T18:03:01.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06e-06 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693784+0000", 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6739999999999992e-06 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693804+0000", 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0023000000000001e-05 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693818+0000", 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4066000000000001e-05 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693913+0000", 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4240000000000006e-05 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693942+0000", 2024-09-12T18:03:01.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9349999999999999e-05 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695361+0000", 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0014194349999999999 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695438+0000", 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6365999999999994e-05 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.776 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:18 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.995325862000001, 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0017088400000000001, 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695934+0000", 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695936+0000", 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:01.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695945+0000", 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2599999999999994e-06 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695968+0000", 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2887e-05 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695982+0000", 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3716e-05 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696104+0000", 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122069 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696159+0000", 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4892999999999998e-05 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697538+0000", 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013793060000000001 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697643+0000", 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000104949 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.781 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 65.006111267999998, 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0031583459999999998, 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685149+0000", 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685151+0000", 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5969999999999999e-06 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685163+0000", 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1626e-05 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685194+0000", 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1372999999999999e-05 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685209+0000", 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4717e-05 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685346+0000", 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013666899999999999 2024-09-12T18:03:01.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685540+0000", 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019470499999999999 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.685739+0000", 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198445 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.687079+0000", 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013398559999999999 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688151+0000", 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001072525 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688232+0000", 2024-09-12T18:03:01.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0909999999999996e-05 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:56.688307+0000", 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4923000000000001e-05 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:01.787 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 48.004157911, 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:03:01.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:03:01.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:44 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 43.003586110000001, 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002445554, 2024-09-12T18:03:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687674+0000", 2024-09-12T18:03:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687677+0000", 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.977e-06 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687690+0000", 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.362e-05 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687722+0000", 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2023000000000002e-05 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687739+0000", 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6653000000000001e-05 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.687874+0000", 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134783 2024-09-12T18:03:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688026+0000", 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015185099999999999 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.688233+0000", 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000207262 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689628+0000", 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013954760000000001 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.689927+0000", 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029853799999999999 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690014+0000", 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7338999999999998e-05 2024-09-12T18:03:01.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:18.690119+0000", 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010503200000000001 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:01.800 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:01.802 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:01.800+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:01.802 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:01.903 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:01.900+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:01.940 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:01.940 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:1398 4.39 4:9d99a0fa:::10000000863.00000000:head [write 0~2597 in=2597b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:01.940928+0000", 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0011119529999999999, 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001135893, 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:01.941 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 1398 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.940928+0000", 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.940928+0000", 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.940930+0000", 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.717e-06 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.940938+0000", 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0989999999999999e-06 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:01.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.940968+0000", 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0269000000000001e-05 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.940979+0000", 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.092e-05 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.941104+0000", 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012505200000000001 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.941461+0000", 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035640699999999999 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:01.941813+0000", 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035212500000000001 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:01.945 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:01.946 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:03:01.946 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-09-12T18:03:01.946 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:01.956 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:02.004 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:02.000+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:02.035 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:03:02.036 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:03:02.036 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-12T18:03:02.036 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:03:02.036 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:03:02.036 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-12T18:03:02.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:02.104+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:02.136 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:02.136 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:02.136 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:02.153 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:02.174 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:02.174 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "" 2024-09-12T18:03:02.174 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:02.206 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:02.204+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:02.304 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:02.304 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:02.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:02.304 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:02.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.304 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.304 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.657786520000002, 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:03:02.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:03:02.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:03:02.310 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.657669471999995, 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.311 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:03:02.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:03:02.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:03:02.317 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.657379403999997, 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:03:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:03:02.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:03:02.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:03:02.323 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.657196815999995, 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.324 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:03:02.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:03:02.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:03:02.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.656509948999997, 2024-09-12T18:03:02.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:03:02.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.656363439000003, 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.337 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:02.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:03:02.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.342 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.656276016999996, 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.343 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:02.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:03:02.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.551080568000003, 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.349 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:03:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:03:02.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.355 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.550997511999995, 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:03:02.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.550929193000002, 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.362 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:03:02.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:03:02.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:03:02.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:02.368 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.550750153999999, 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.446423550999995, 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.375 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:03:02.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:02.381 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.446377552000001, 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:03:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:03:02.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.446260108999994, 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:03:02.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:03:02.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.342028834999994, 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:03:02.394 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:03:02.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.400 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.341995221999994, 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:02.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:03:02.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:03:02.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.341825819999997, 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.407 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:03:02.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:03:02.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.341786607000003, 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:03:02.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:03:02.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:03:02.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.341742539999998, 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.420 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:03:02.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:03:02.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 77.341624221000004, 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:02.427 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:03:02.428 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.429 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.430 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.431 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:02.432 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:02.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:02.435 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:02.430+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:02.535 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:02.532+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:02.574 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:02.574 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:02.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.574 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:1816 4.3e 4:7f7df7ee:::10000000a1b.00000000:head [write 0~2467 in=2467b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:02.574 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:02.572048+0000", 2024-09-12T18:03:02.574 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0021407660000000001, 2024-09-12T18:03:02.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002179598, 2024-09-12T18:03:02.574 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 1816 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572048+0000", 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572048+0000", 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572049+0000", 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1999999999999999e-06 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572055+0000", 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0850000000000002e-06 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572071+0000", 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5488000000000001e-05 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572079+0000", 2024-09-12T18:03:02.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5750000000000001e-06 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572221+0000", 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014200199999999999 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572564+0000", 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00034232899999999999 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:02.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.572934+0000", 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00036980900000000002 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.574111+0000", 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001177237 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 1 2024-09-12T18:03:02.579 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:02.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:02.636 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:02.632+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:02.720 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:02.720 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:02.720 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:02.720 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:02.720 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:02.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:02.736 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:02.732+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:02.837 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:02.836+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:02.867 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.221576138000003, 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.868 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.869 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:03:02.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.872 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.220902953000007, 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.873 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:03:02.874 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.875 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.220293850999994, 2024-09-12T18:03:02.878 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.879 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.880 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:03:02.881 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.882 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.219766538000002, 2024-09-12T18:03:02.883 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:02.884 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:03:02.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.219325502000004, 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:03:02.888 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.889 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:03:02.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:03:02.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.892 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.218547458000003, 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:03:02.894 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.895 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:03:02.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.218055491000001, 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.898 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:03:02.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:03:02.902 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.217487933000001, 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:03:02.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.216983517000003, 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.907 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:03:02.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.216506242999998, 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.912 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:03:02.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:03:02.916 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.216060411000001, 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:03:02.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.215519354999998, 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.923 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:03:02.924 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:03:02.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.926 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.215180916999998, 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:03:02.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.931 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:66 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'40)", 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 78.114337505999998, 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069855749999999999, 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:03:02.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751009+0000", 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751010+0000", 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.933 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751096+0000", 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6275999999999999e-05 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751115+0000", 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9283000000000002e-05 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.934 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.751125+0000", 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3700000000000001e-06 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753953+0000", 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002828578 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.753995+0000", 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1159999999999999e-05 2024-09-12T18:03:02.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757960+0000", 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0039650420000000002 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.757994+0000", 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4758999999999997e-05 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.937 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 67.175097984999994, 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.938 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:03:02.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.943 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:12 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 67.174978535999998, 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007295724, 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.944 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690368+0000", 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690370+0000", 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.294e-06 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690379+0000", 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8130000000000002e-06 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690393+0000", 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4063000000000001e-05 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690409+0000", 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5670000000000001e-05 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690507+0000", 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8126000000000002e-05 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690680+0000", 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017303199999999999 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690901+0000", 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000221571 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694238+0000", 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003336575 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697539+0000", 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033011410000000001 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697605+0000", 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5685000000000006e-05 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697663+0000", 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8754e-05 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.949 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 67.174803296999997, 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:03:02.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.952 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:03:02.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:27 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 67.174739446999993, 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0073162030000000003, 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690607+0000", 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690608+0000", 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4500000000000001e-06 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690615+0000", 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9229999999999996e-06 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690632+0000", 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7183000000000001e-05 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690646+0000", 2024-09-12T18:03:02.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4003e-05 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691722+0000", 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010758720000000001 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691917+0000", 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019436799999999999 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692198+0000", 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000281551 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694614+0000", 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024157480000000001 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697749+0000", 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031347419999999998 2024-09-12T18:03:02.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697823+0000", 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4129999999999997e-05 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697923+0000", 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100233 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 67.174620765, 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:03:02.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:03:02.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.967 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(mds.0.3:57 3.14 e44/16 3:2e2fa760:::200.00000001:head v 44'19, mlcod=43'17)", 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:02.439550+0000", 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.42579635599999999, 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068861490000000003, 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:02.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.439550+0000", 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.439550+0000", 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:02.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.439551+0000", 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.553e-06 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.441256+0000", 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0017046209999999999 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.441282+0000", 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5469e-05 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.441294+0000", 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2439999999999999e-05 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.441425+0000", 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013104300000000001 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.441462+0000", 2024-09-12T18:03:02.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6604999999999999e-05 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.446328+0000", 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0048662810000000001 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:02.446436+0000", 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000108137 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.972 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:02.973 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:02.973 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:02.974 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:02.975 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:02.972+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:03.075 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:03.074+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:03.110 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:03.110 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:03.110 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:03.110 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:03.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:03.176 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:03.174+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:03.257 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:03.257 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:03.257 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:03.257 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:03.257 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:03.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:03.318 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:03.316+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:03.378 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:03.378+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:03.402 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:03.402 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:03.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:03.402 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 72.862727186000001, 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:03:03.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:03:03.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709727787999995, 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.408 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:03:03.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:03:03.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709634725000001, 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:03:03.414 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:03:03.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.419 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:16 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709592251999993, 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050094780000000004, 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689933+0000", 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689934+0000", 2024-09-12T18:03:03.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689965+0000", 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1056000000000002e-05 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689978+0000", 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2619999999999999e-05 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689987+0000", 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8899999999999996e-06 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690895+0000", 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000907776 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691079+0000", 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018396499999999999 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:03.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691324+0000", 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024557499999999999 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693615+0000", 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022906250000000001 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694806+0000", 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001191405 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694882+0000", 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5815000000000005e-05 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694943+0000", 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0943999999999998e-05 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.425 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709488026000002, 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0059887059999999999, 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690038+0000", 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690039+0000", 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.026e-06 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690044+0000", 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9300000000000002e-06 2024-09-12T18:03:03.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690054+0000", 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0814e-05 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690062+0000", 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8359999999999992e-06 2024-09-12T18:03:03.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691879+0000", 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001816586 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692039+0000", 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016004499999999999 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692327+0000", 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028803100000000001 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694482+0000", 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0021551299999999999 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695757+0000", 2024-09-12T18:03:03.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001275364 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.695919+0000", 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016154799999999999 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696026+0000", 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000107396 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709452193000004, 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:03:03.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:03:03.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709421173999999, 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.438 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:03:03.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:03:03.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709370234000005, 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:03:03.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:03:03.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709315161000006, 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:03:03.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:03:03.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.452 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:33 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 67.709281344999994, 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046166979999999998, 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690244+0000", 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690245+0000", 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.667e-06 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690257+0000", 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0799999999999995e-06 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690264+0000", 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9829999999999999e-06 2024-09-12T18:03:03.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690371+0000", 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000106953 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690618+0000", 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000246825 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694861+0000", 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00424348 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 49.712423768000001, 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:03:03.457 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:03.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:03:03.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:03:03.463 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:1219 4.4 4:23f3088f:::100000007a7.00000000:head [write 0~3290] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:01.672676+0000", 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.7268497919999999, 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074249249999999998, 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:03.464 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1219 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672676+0000", 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672676+0000", 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672678+0000", 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.827e-06 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672702+0000", 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4369e-05 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672722+0000", 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672736+0000", 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3797e-05 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672838+0000", 2024-09-12T18:03:03.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102124 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672845+0000", 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0709999999999997e-06 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.676297+0000", 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034523190000000001 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.676605+0000", 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030799199999999999 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.676941+0000", 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033539699999999997 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.678076+0000", 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001135369 2024-09-12T18:03:03.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.679994+0000", 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019177459999999999 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.680060+0000", 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6080000000000004e-05 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.680101+0000", 2024-09-12T18:03:03.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1090999999999997e-05 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:55 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:01.699099+0000", 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.700426231, 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010270095999999999, 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.471 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699099+0000", 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699099+0000", 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699101+0000", 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699260+0000", 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015961400000000001 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699277+0000", 2024-09-12T18:03:03.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6494000000000002e-05 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699286+0000", 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6149999999999997e-06 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699332+0000", 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6477000000000002e-05 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699383+0000", 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1415000000000002e-05 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.701628+0000", 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022440950000000002 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.703991+0000", 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023632369999999998 2024-09-12T18:03:03.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.709215+0000", 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052243400000000001 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.709299+0000", 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3907999999999997e-05 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.709370+0000", 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0531999999999995e-05 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:1715 4.b 4:d1a6e3f4:::100000009b2.00000000:head [write 0~2443] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:02.400282+0000", 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.99924335500000006, 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044381830000000001, 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.477 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1715 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.400282+0000", 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.400282+0000", 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.400285+0000", 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5830000000000001e-06 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.400297+0000", 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2235999999999999e-05 2024-09-12T18:03:03.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.400329+0000", 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2186e-05 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.400349+0000", 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9247000000000001e-05 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.400494+0000", 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145866 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.400852+0000", 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00035731100000000002 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.401095+0000", 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024311999999999999 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.402259+0000", 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011636800000000001 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.404573+0000", 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00231402 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.404656+0000", 2024-09-12T18:03:03.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3842000000000001e-05 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.404721+0000", 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.4091999999999996e-05 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:1740 4.29 4:95d2b609:::100000009cc.00000000:head [write 0~2494] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:02.434947+0000", 2024-09-12T18:03:03.483 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.96457835000000003, 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045086609999999997, 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1740 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.434947+0000", 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.434947+0000", 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.434950+0000", 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2129999999999998e-06 2024-09-12T18:03:03.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.434963+0000", 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3314e-05 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.434994+0000", 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1585000000000003e-05 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.486 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.435030+0000", 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5553000000000003e-05 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.435187+0000", 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015698599999999999 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.435395+0000", 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020808400000000001 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.435590+0000", 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019487199999999999 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.436764+0000", 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001174023 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.439306+0000", 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025418480000000002 2024-09-12T18:03:03.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.439389+0000", 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3281000000000004e-05 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.439456+0000", 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6902000000000004e-05 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.489 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:61 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:02.700906+0000", 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.69861965599999998, 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016687460000000001, 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.700906+0000", 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.700906+0000", 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.700909+0000", 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4430000000000002e-06 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701178+0000", 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026976600000000001 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701203+0000", 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4423e-05 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701222+0000", 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9673e-05 2024-09-12T18:03:03.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701324+0000", 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101681 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701472+0000", 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014821600000000001 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.708309+0000", 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068365570000000001 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.716758+0000", 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084489500000000002 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.717307+0000", 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054947899999999996 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.717449+0000", 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014128599999999999 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.717594+0000", 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144986 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4587.0:1900 4.22 e44/36 4:47008c94:::10000000a75.00000000:head v 44'42, mlcod=44'40)", 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:02.713653+0000", 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.685873077, 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037877319999999998, 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.713653+0000", 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.713653+0000", 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.713655+0000", 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0200000000000001e-06 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.713676+0000", 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0985999999999999e-05 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.713708+0000", 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2212000000000003e-05 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.713730+0000", 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1722999999999999e-05 2024-09-12T18:03:03.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.713835+0000", 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010491400000000001 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.713872+0000", 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7191999999999999e-05 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.717370+0000", 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034987339999999999 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.717440+0000", 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9950999999999995e-05 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:2019 4.23 4:c55dbfdf:::10000000af9.00000000:head [write 0~33423] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:02.962794+0000", 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.43673162799999998, 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00372741, 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2019 2024-09-12T18:03:03.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.962794+0000", 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.962794+0000", 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.962804+0000", 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0276e-05 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.962878+0000", 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3331000000000007e-05 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.962910+0000", 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.26e-05 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.962925+0000", 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4942e-05 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.963085+0000", 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016024299999999999 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.963421+0000", 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000335571 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.963792+0000", 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00037126699999999999 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.965637+0000", 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001844706 2024-09-12T18:03:03.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.966260+0000", 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000623278 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.966407+0000", 2024-09-12T18:03:03.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146503 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.966522+0000", 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011469299999999999 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:2081 4.11 4:8b7ebca7:::10000000b46.00000000:head [write 0~3076] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:03.137801+0000", 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.26172521999999998, 2024-09-12T18:03:03.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003790538, 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2081 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.137801+0000", 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.137801+0000", 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.137802+0000", 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9429999999999999e-06 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.137811+0000", 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6100000000000006e-06 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.137833+0000", 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2133e-05 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.137853+0000", 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9309000000000001e-05 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.510 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.137935+0000", 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2531e-05 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.138033+0000", 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8047999999999994e-05 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.138127+0000", 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4350000000000003e-05 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.138729+0000", 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00060175599999999995 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.141484+0000", 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027543929999999999 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.141542+0000", 2024-09-12T18:03:03.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8106999999999998e-05 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.141591+0000", 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9357999999999997e-05 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:2131 4.7 4:e1fee374:::10000000b82.00000000:head [write 0~3505] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:03.513 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:03.268882+0000", 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.130643974, 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040689489999999997, 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 2131 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:03.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.268882+0000", 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.268882+0000", 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.268892+0000", 2024-09-12T18:03:03.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7799999999999995e-06 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.268904+0000", 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2816000000000001e-05 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.268935+0000", 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0660000000000001e-05 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.516 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.268949+0000", 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4319e-05 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.269091+0000", 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014158700000000001 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.269467+0000", 2024-09-12T18:03:03.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00037653699999999998 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.269835+0000", 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000367253 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.272571+0000", 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027367770000000001 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:03.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.272677+0000", 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010532299999999999 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.272824+0000", 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000146997 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.272951+0000", 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012689999999999999 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.519 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:03.520 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:03.520 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:03.521 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:03.522 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:03.518+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:03.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:03.622 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:03.622+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:2254 4.1e e44/17 4:7b4befbb:::10000000c1a.00000000:head v 44'33, mlcod=44'31)", 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:03.657111+0000", 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.00022635600000000001, 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026103200000000002, 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:03.656 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:03.657111+0000", 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:03.657111+0000", 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:03.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:03.657111+0000", 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0299999999999998e-07 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:03.657117+0000", 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6640000000000003e-06 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:03.657128+0000", 2024-09-12T18:03:03.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1479e-05 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:03.657135+0000", 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9500000000000004e-06 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:03.657185+0000", 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9573999999999997e-05 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:03.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:03.657198+0000", 2024-09-12T18:03:03.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2954e-05 2024-09-12T18:03:03.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:03.660 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:03.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:03.660 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:03.660 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:03:03.660 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-09-12T18:03:03.660 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:03.671 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:03.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:03:03.724 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:03.720+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:03.782 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:03.782 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:03.799 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:03.799 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:03.814 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:03.820 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:03.820 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:03.825 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:03.820+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:03.853 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:03.853 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:03.925 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:03.920+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:03.943 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:03.943 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:03.960 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:04.026 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:04.024+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:04.104 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:04.104 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:04.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:04.126 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:04.124+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:04.227 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:04.224+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:04.242 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:04.242 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:04.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:04.328 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:04.324+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:04.385 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:04.385 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:04.400 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:04.429 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:04.428+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:04.530 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:04.528+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:04.543 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:04.544 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:04.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:04.631 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:04.629+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:04.733 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:04.729+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:04.733 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:04.733 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:04.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:04.805 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:03:04.833 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:04.828+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:04.874 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:04.874 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:04.891 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:04.934 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:04.933+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:05.029 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:05.030 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:05.035 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:05.032+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:05.045 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:05.136 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:05.133+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:05.177 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:05.177 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:05.193 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:05.237 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:05.232+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:05.324 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:05.324 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:05.338 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:05.336+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:05.339 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:05.439 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:05.437+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:05.478 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:05.478 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:05.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:05.539 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:05.536+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:05.640 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:05.636+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:05.668 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:05.668 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:05.684 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:05.742 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:05.740+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:05.809 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:05.809 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:05.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:05.870 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:05.868+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:05.875 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:05.944 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:05.940+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:05.965 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:05.965 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:05.981 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:06.043 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:06.043 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:06.069 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:06.070 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:06.068+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:06.092 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:06.092 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:06.146 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:06.140+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:06.156 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:06.156 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:06.157 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:06.157 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:06.157 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:06.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:06.246 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:06.245+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:06.347 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:06.344+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4201.0:1 2.3 e13/12 2:c4c92e5a:::rbd_trash:head v 13'1, mlcod=0'0)", 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 75.811516362000006, 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078197000000000006, 2024-09-12T18:03:06.351 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536799+0000", 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9299999999999998e-07 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536807+0000", 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5399999999999998e-06 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536825+0000", 2024-09-12T18:03:06.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8037e-05 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536857+0000", 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2079999999999998e-05 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.536988+0000", 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000131299 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.537030+0000", 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1825e-05 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544518+0000", 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074880900000000002 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:50.544618+0000", 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100336 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.355 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.658516964, 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0066762050000000002, 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689798+0000", 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689804+0000", 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3840000000000002e-06 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689819+0000", 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4486e-05 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689839+0000", 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0557e-05 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689855+0000", 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6025999999999999e-05 2024-09-12T18:03:06.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690017+0000", 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016137500000000001 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019775200000000001 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690414+0000", 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000199669 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693271+0000", 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028571080000000001 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696333+0000", 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030615389999999998 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696408+0000", 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5248999999999997e-05 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696474+0000", 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6060000000000001e-05 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.658423901000006, 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074554950000000004, 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689891+0000", 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689892+0000", 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1629999999999999e-06 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689897+0000", 2024-09-12T18:03:06.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6630000000000001e-06 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689911+0000", 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4613999999999999e-05 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.689920+0000", 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5830000000000007e-06 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690957+0000", 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001036922 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691145+0000", 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000188455 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691365+0000", 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000219519 2024-09-12T18:03:06.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693997+0000", 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0026317390000000001 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697098+0000", 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003101286 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697245+0000", 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014712500000000001 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697346+0000", 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101426 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:17 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:06.367 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.658241368999995, 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079421549999999994, 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690074+0000", 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690078+0000", 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9600000000000002e-06 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690087+0000", 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1360000000000003e-06 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690095+0000", 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8099999999999998e-06 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691995+0000", 2024-09-12T18:03:06.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001899392 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692269+0000", 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027439199999999998 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692471+0000", 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020243099999999999 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.694498+0000", 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020262370000000002 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697861+0000", 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033632079999999999 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697952+0000", 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1238999999999998e-05 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698016+0000", 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3659999999999997e-05 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.658210350000004, 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070279890000000001, 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.373 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690105+0000", 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000004e-07 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690110+0000", 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0900000000000004e-06 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690125+0000", 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4946999999999999e-05 2024-09-12T18:03:06.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690135+0000", 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5429999999999999e-06 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690249+0000", 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011404900000000001 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690534+0000", 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028515799999999998 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690792+0000", 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025787500000000002 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.692705+0000", 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001912661 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.696894+0000", 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0041892479999999996 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697024+0000", 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000129746 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.697133+0000", 2024-09-12T18:03:06.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109002 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:30 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.658159409999996, 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078627490000000005, 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690155+0000", 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690156+0000", 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5300000000000003e-07 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690159+0000", 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690175+0000", 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6313000000000001e-05 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690198+0000", 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2544e-05 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691395+0000", 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001196917 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.691604+0000", 2024-09-12T18:03:06.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020925800000000001 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698018+0000", 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064140769999999998 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:31 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:06.383 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 70.658104336999997, 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079971179999999992, 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690211+0000", 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7700000000000003e-07 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690215+0000", 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9160000000000003e-06 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690227+0000", 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1756999999999999e-05 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.690234+0000", 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1559999999999998e-06 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693313+0000", 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0030789929999999999 2024-09-12T18:03:06.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.693500+0000", 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018661900000000001 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:01:55.698208+0000", 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047077999999999998 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e24)", 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 52.661212943999999, 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0063814070000000004, 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:06.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687102+0000", 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687105+0000", 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.044e-06 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687119+0000", 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3519999999999999e-05 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687149+0000", 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0491e-05 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687164+0000", 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.449e-05 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687274+0000", 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011034799999999999 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.687283+0000", 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8810000000000002e-06 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691301+0000", 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040179159999999998 2024-09-12T18:03:06.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691377+0000", 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5988999999999994e-05 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.691492+0000", 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011579200000000001 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.692262+0000", 2024-09-12T18:03:06.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00076929600000000004 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693407+0000", 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011457310000000001 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693450+0000", 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2457999999999999e-05 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:02:13.693483+0000", 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3451000000000002e-05 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:1219 4.4 4:23f3088f:::100000007a7.00000000:head [write 0~3290] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:01.672676+0000", 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6756389680000003, 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074249249999999998, 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.394 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 1219 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672676+0000", 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672676+0000", 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672678+0000", 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.827e-06 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672702+0000", 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4369e-05 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672722+0000", 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9743000000000001e-05 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672736+0000", 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3797e-05 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672838+0000", 2024-09-12T18:03:06.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102124 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.672845+0000", 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0709999999999997e-06 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.676297+0000", 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034523190000000001 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.676605+0000", 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030799199999999999 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.676941+0000", 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00033539699999999997 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.678076+0000", 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001135369 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.679994+0000", 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0019177459999999999 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.680060+0000", 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6080000000000004e-05 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.680101+0000", 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1090999999999997e-05 2024-09-12T18:03:06.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.401 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:55 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2024-09-12T18:03:06.401 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:01.699099+0000", 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6492154069999998, 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010270095999999999, 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699099+0000", 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699099+0000", 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699101+0000", 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3689999999999999e-06 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699260+0000", 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015961400000000001 2024-09-12T18:03:06.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699277+0000", 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6494000000000002e-05 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699286+0000", 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6149999999999997e-06 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699332+0000", 2024-09-12T18:03:06.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6477000000000002e-05 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.699383+0000", 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1415000000000002e-05 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.701628+0000", 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022440950000000002 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.703991+0000", 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023632369999999998 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.709215+0000", 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052243400000000001 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.709299+0000", 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3907999999999997e-05 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:01.709370+0000", 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0531999999999995e-05 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:61 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:02.700906+0000", 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.647408832, 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016687460000000001, 2024-09-12T18:03:06.409 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.700906+0000", 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.700906+0000", 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.700909+0000", 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4430000000000002e-06 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701178+0000", 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026976600000000001 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701203+0000", 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4423e-05 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701222+0000", 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9673e-05 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701324+0000", 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101681 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.701472+0000", 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014821600000000001 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.708309+0000", 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0068365570000000001 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.716758+0000", 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0084489500000000002 2024-09-12T18:03:06.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.717307+0000", 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00054947899999999996 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.717449+0000", 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014128599999999999 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:02.717594+0000", 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144986 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:62 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e44)", 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:03.701888+0000", 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 2.6464270069999998, 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0064989030000000003, 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.415 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.701888+0000", 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.701888+0000", 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.701891+0000", 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6740000000000001e-06 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.701948+0000", 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7210999999999998e-05 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.701977+0000", 2024-09-12T18:03:06.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9277000000000001e-05 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.701992+0000", 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5045000000000001e-05 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.702110+0000", 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011764699999999999 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.702246+0000", 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013632100000000001 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.704491+0000", 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002245258 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.707086+0000", 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025947129999999998 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.708231+0000", 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001145191 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.708321+0000", 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9955000000000002e-05 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:03.708387+0000", 2024-09-12T18:03:06.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5611000000000006e-05 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:3804 4.2f 4:f569593f:::10000001253.00000000:head [write 0~501467] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:06.112000+0000", 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.23631538199999999, 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0075822019999999997, 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3804 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.112000+0000", 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.112000+0000", 2024-09-12T18:03:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.112001+0000", 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7719999999999999e-06 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.112448+0000", 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044649300000000001 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.112466+0000", 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8553e-05 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.112476+0000", 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2860000000000005e-06 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.112571+0000", 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5013000000000007e-05 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.112806+0000", 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023578600000000001 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.113019+0000", 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000212628 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.118085+0000", 2024-09-12T18:03:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0050655450000000003 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.119305+0000", 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012204329999999999 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.119444+0000", 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013867299999999999 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.119582+0000", 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013802000000000001 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:3816 4.37 4:eea7faa5:::10000001260.00000000:head [write 0~1579] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:06.124246+0000", 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.22406916900000001, 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00706225, 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3816 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124246+0000", 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124246+0000", 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124247+0000", 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.099e-06 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124252+0000", 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3399999999999997e-06 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124263+0000", 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0735e-05 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124270+0000", 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4279999999999999e-06 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124349+0000", 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8269999999999994e-05 2024-09-12T18:03:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124526+0000", 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000177238 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.124710+0000", 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000184239 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.125863+0000", 2024-09-12T18:03:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001153128 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.131129+0000", 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052661840000000001 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.131235+0000", 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000105831 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.131308+0000", 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2757999999999997e-05 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:3819 4.10 4:09309fd3:::10000001263.00000000:head [write 0~1658] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:06.126938+0000", 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.22137732900000001, 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070713700000000004, 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3819 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.126938+0000", 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.126938+0000", 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.126939+0000", 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.15e-06 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.126944+0000", 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3909999999999997e-06 2024-09-12T18:03:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.126976+0000", 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1612999999999997e-05 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.126985+0000", 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2439999999999999e-06 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.127134+0000", 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014867799999999999 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.127494+0000", 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00036015800000000002 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.127873+0000", 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00037944699999999999 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.129137+0000", 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012633130000000001 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.133783+0000", 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0046466249999999997 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.133915+0000", 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013144 2024-09-12T18:03:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.134009+0000", 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4310999999999999e-05 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:3855 4.21 4:86fdd19c:::10000001287.00000000:head [write 0~1612] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:06.160630+0000", 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.18768494899999999, 2024-09-12T18:03:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073847790000000002, 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3855 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.160630+0000", 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.160630+0000", 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.160632+0000", 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8080000000000001e-06 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.160639+0000", 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9020000000000002e-06 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.160655+0000", 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6175e-05 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.160664+0000", 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6929999999999996e-06 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.160745+0000", 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1453999999999996e-05 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.160961+0000", 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021568800000000001 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.161151+0000", 2024-09-12T18:03:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019031500000000001 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.162099+0000", 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00094802999999999999 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.167802+0000", 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057029230000000004 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.167919+0000", 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0001169 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.168015+0000", 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5890999999999994e-05 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:3861 4.10 4:09a1a803:::1000000128d.00000000:head [write 0~1590] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:06.166405+0000", 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.18190967699999999, 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074999059999999998, 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3861 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166405+0000", 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166405+0000", 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166408+0000", 2024-09-12T18:03:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3429999999999998e-06 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166418+0000", 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0743e-05 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166445+0000", 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6908999999999999e-05 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166459+0000", 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3404000000000001e-05 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166559+0000", 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100344 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166769+0000", 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020993800000000001 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.166972+0000", 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000203461 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.167945+0000", 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00097239600000000005 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.173825+0000", 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058802999999999998 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.173865+0000", 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0394e-05 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.173905+0000", 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9674e-05 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:3872 4.1e 4:7a992fe3:::10000001298.00000000:head [write 0~2775] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:06.177357+0000", 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.17095802500000001, 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0062199430000000003, 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3872 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177357+0000", 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177357+0000", 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177358+0000", 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3099999999999996e-07 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177362+0000", 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2259999999999999e-06 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177371+0000", 2024-09-12T18:03:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1030000000000008e-06 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177375+0000", 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.284e-06 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177415+0000", 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9847e-05 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177505+0000", 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9487999999999994e-05 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.177576+0000", 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1243999999999998e-05 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.178351+0000", 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00077490000000000002 2024-09-12T18:03:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.183489+0000", 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051381049999999996 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.183538+0000", 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8930000000000001e-05 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.183577+0000", 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8985e-05 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:3902 4.2f 4:f6935622:::100000012b7.00000000:head [write 0~1155] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:06.211709+0000", 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.13660566499999999, 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065938159999999997, 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3902 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211709+0000", 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211709+0000", 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211710+0000", 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2500000000000004e-07 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211714+0000", 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3429999999999998e-06 2024-09-12T18:03:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211725+0000", 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0995000000000001e-05 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211734+0000", 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.7579999999999998e-06 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211788+0000", 2024-09-12T18:03:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3625999999999998e-05 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211878+0000", 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0215000000000003e-05 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.211968+0000", 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0001999999999997e-05 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.213019+0000", 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010505250000000001 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.218207+0000", 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051884160000000004 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.218262+0000", 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5325999999999998e-05 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.218303+0000", 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0785000000000003e-05 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:3990 4.11 4:8b94bf74:::10000001316.00000000:head [write 0~567] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:06.327496+0000", 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.020818626, 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079235550000000005, 2024-09-12T18:03:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 3990 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.327496+0000", 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.327496+0000", 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.327498+0000", 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9599999999999999e-06 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.327508+0000", 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3570000000000004e-06 2024-09-12T18:03:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.327529+0000", 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1348999999999998e-05 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.327541+0000", 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2099999999999999e-05 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.327637+0000", 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5540999999999999e-05 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.327824+0000", 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018787200000000001 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.328016+0000", 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019138900000000001 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.329125+0000", 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011093920000000001 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.335247+0000", 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0061219719999999998 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.335327+0000", 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9531999999999997e-05 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:06.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:06.335420+0000", 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3090999999999994e-05 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:06.470 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:06.472 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:06.472 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:06.468+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:06.573 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:06.568+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:06.611 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:06.611 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:06.611 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:03:06.611 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:06.626 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:06.673 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:06.668+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:06.774 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:06.772+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:06.800 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:06.801 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:06.801 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:06.801 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:06.801 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:06.816 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:06.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:03:06.875 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:06.873+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:06.977 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:06.973+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:07.000 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:07.000 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:07.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:07.000 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.353962961999997, 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:03:07.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:03:07.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:03:07.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.353845914000004, 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.007 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:03:07.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:03:07.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.353555846000006, 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014406357, 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.014 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644036+0000", 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644040+0000", 2024-09-12T18:03:07.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.596e-06 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644051+0000", 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1603999999999999e-05 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644056+0000", 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9799999999999998e-06 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645961+0000", 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001904738 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0748000000000002e-05 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646119+0000", 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6961999999999998e-05 2024-09-12T18:03:07.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649149+0000", 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030302720000000001 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658388+0000", 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092384649999999995 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658418+0000", 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0292999999999999e-05 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658442+0000", 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4071999999999999e-05 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.021 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.353373258000005, 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014315906999999999, 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644218+0000", 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644220+0000", 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.316e-06 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644394+0000", 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017432600000000001 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644433+0000", 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9477000000000002e-05 2024-09-12T18:03:07.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644444+0000", 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0652000000000001e-05 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646457+0000", 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020129940000000002 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646517+0000", 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0225e-05 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.646612+0000", 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4955000000000001e-05 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650938+0000", 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043257520000000004 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658482+0000", 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075440940000000003 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658512+0000", 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9669e-05 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658534+0000", 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2447e-05 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.352686391000006, 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.028 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:03:07.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:03:07.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.352539880999998, 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.035 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:03:07.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:03:07.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.352452459000006, 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.041 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:03:07.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.247257009999998, 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.048 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:03:07.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:03:07.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.247173954000004, 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.054 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:03:07.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.247105634999997, 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.061 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:03:07.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:03:07.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.246926595999994, 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:03:07.067 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:03:07.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:03:07.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.142599993000005, 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:03:07.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:03:07.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:03:07.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.142553993999996, 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.080 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:03:07.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:03:07.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.086 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.142436551000003, 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:03:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:03:07.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:03:07.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.038205277000003, 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.093 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:03:07.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:03:07.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.038171664000004, 2024-09-12T18:03:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:07.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:03:07.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:03:07.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.038002262000006, 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.106 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:03:07.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:03:07.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.037963048999998, 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.112 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:03:07.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:03:07.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:07.118 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.037918981999994, 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:03:07.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:03:07.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 82.037800662999999, 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:07.125 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:03:07.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:03:07.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:07.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:03:07.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:03:07.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.131 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.131 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:07.131 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:07.131 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:07.133 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:07.133 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:07.128+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:07.190 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:03:07.191 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:03:07.191 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T18:03:07.191 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:03:07.191 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:03:07.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T18:03:07.233 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:07.232+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:07.278 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:07.278 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:4566 4.24 4:271223bc:::10000001584.00000000:head [write 0~8600 in=8600b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:07.276575+0000", 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0017192450000000001, 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0017782659999999999, 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:07.279 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 4566 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.276575+0000", 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.276575+0000", 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.280 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.276577+0000", 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9759999999999998e-06 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.276600+0000", 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2799999999999999e-05 2024-09-12T18:03:07.281 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.276622+0000", 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2062999999999999e-05 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.276634+0000", 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2393e-05 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.276775+0000", 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014112900000000001 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277134+0000", 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00035877899999999999 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277475+0000", 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00034078500000000002 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.283 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:4567 4.14 4:28bc46eb:::10000001585.00000000:head [write 0~2178 in=2178b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:07.277625+0000", 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00066879299999999999, 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00100606, 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:07.284 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 4567 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277625+0000", 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277625+0000", 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277627+0000", 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.477e-06 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277634+0000", 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2089999999999999e-06 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277647+0000", 2024-09-12T18:03:07.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2587e-05 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277655+0000", 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.0700000000000007e-06 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277730+0000", 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5338000000000003e-05 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.277932+0000", 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000202101 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.278135+0000", 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020330500000000001 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 2 2024-09-12T18:03:07.288 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:07.295 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:07.336 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:07.336 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T18:03:07.336 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:07.342 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:07.341+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:07.434 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:07.434 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:07.434 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:07.434 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:07.434 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:07.435 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:07.433+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:07.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:07.536 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:07.532+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:07.626 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:07.626 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:07.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:07.626 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:07.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.626 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:03:07.626 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.979310025000004, 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:03:07.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.629 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:03:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:03:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:03:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:03:07.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:03:07.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.978636839999993, 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:07.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:03:07.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:07.639 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.978027737999994, 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.640 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:03:07.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.977500425000002, 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.644 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:03:07.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.647 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.648 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.977059389000004, 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.649 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:03:07.650 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:03:07.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.652 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.653 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.976281345000004, 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.654 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:03:07.655 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.656 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.657 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.975789378000002, 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:03:07.658 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.659 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.661 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.662 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.975221820000002, 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.663 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:03:07.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.974717404000003, 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.668 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.670 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:03:07.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:07.672 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.974240129999998, 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.673 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:03:07.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.676 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.973794298000001, 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.677 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.678 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:03:07.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.973253241999998, 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:07.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.683 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:03:07.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 82.972914803999998, 2024-09-12T18:03:07.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:03:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:03:07.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:11 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 71.932831871999994, 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0076283710000000001, 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690248+0000", 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690256+0000", 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3769999999999998e-06 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690267+0000", 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1219999999999999e-05 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690289+0000", 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2345999999999999e-05 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690314+0000", 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5233e-05 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690450+0000", 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013594900000000001 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690693+0000", 2024-09-12T18:03:07.694 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024302199999999999 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.691032+0000", 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033901999999999999 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694249+0000", 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032161389999999998 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.695 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697628+0000", 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033795169999999999 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697767+0000", 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013862499999999999 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.697877+0000", 2024-09-12T18:03:07.696 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109923 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 71.932537183999997, 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.697 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.698 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:03:07.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.701 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.702 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 71.932354652000001, 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.703 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:03:07.704 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.705 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.706 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:03:07.707 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.708 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.8542217050000001, 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085372009999999995, 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 2315 2024-09-12T18:03:07.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.710 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768861+0000", 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.357e-06 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769609+0000", 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00074865299999999995 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769643+0000", 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3145999999999997e-05 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.711 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769658+0000", 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5247e-05 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769786+0000", 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00012775899999999999 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.770000+0000", 2024-09-12T18:03:07.712 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00021481000000000001 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.770207+0000", 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020706699999999999 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.776120+0000", 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0059121479999999999 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.713 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777151+0000", 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001031152 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777294+0000", 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014346500000000001 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777396+0000", 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010139700000000001 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.714 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:3874 4.8 4:111788ea:::1000000129a.00000000:head [write 0~1623] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:06.178900+0000", 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 1.4441804650000001, 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075981599999999996, 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:07.715 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3874 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.178900+0000", 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.178900+0000", 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.178902+0000", 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1399999999999998e-06 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.178913+0000", 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1234e-05 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.178943+0000", 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0142e-05 2024-09-12T18:03:07.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.178961+0000", 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8216e-05 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.179111+0000", 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015000899999999999 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.718 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.179476+0000", 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00036481699999999997 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.179794+0000", 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00031747399999999999 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.181119+0000", 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0013249189999999999 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.186246+0000", 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051271859999999997 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.186397+0000", 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015164599999999999 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.186498+0000", 2024-09-12T18:03:07.720 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100377 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:3900 4.2e 4:758a3fb9:::100000012b5.00000000:head [write 0~1141] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:06.209213+0000", 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 1.413866861, 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0077815100000000002, 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.721 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3900 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209213+0000", 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.722 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209213+0000", 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209216+0000", 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3300000000000001e-06 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209227+0000", 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1059e-05 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.723 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209248+0000", 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1719999999999999e-05 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209260+0000", 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1836e-05 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209374+0000", 2024-09-12T18:03:07.724 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000113373 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209571+0000", 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019786099999999999 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.209768+0000", 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000196715 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.725 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.211471+0000", 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0017030140000000001 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.216787+0000", 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.005316238 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.216934+0000", 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014612199999999999 2024-09-12T18:03:07.726 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.216995+0000", 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1241999999999994e-05 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:3989 4.3 4:c097fc49:::10000001315.00000000:head [write 0~365] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:06.325980+0000", 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 1.297099811, 2024-09-12T18:03:07.727 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0080548749999999995, 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3989 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:07.728 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.325980+0000", 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.325980+0000", 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.325982+0000", 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5969999999999999e-06 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.325988+0000", 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.326048+0000", 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9168e-05 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.326066+0000", 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8428999999999999e-05 2024-09-12T18:03:07.730 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.326689+0000", 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00062295600000000003 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.326934+0000", 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024534300000000003 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.327141+0000", 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000206231 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.328598+0000", 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001457098 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.333880+0000", 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052819850000000003 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.333961+0000", 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1100000000000006e-05 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.334035+0000", 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4385e-05 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:07.733 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:07.734 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:07.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:07.736 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:07.732+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:07.813 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:03:07.837 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:07.831+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:07.864 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:07.864 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:07.880 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:07.938 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:07.933+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:08.041 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:08.036+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:08.065 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:08.065 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:08.065 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:08.065 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:08.065 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:08.080 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:08.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:08.142 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:08.140+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:08.215 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:93 3.1f 3:f83d65d8:::200.00000004:head [write 1993036~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.215 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.54646637499999995, 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035556857999999997, 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.54e-07 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.217 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665603+0000", 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4590000000000004e-06 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665616+0000", 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3447e-05 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665624+0000", 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1930000000000004e-06 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697073+0000", 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03144972 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697136+0000", 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2341999999999994e-05 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697240+0000", 2024-09-12T18:03:08.219 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010446399999999999 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699410+0000", 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002170029 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701031+0000", 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016210409999999999 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.220 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701097+0000", 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5827000000000005e-05 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701150+0000", 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2581999999999999e-05 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.221 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:94 3.1f 3:f83d65d8:::200.00000004:head [write 1994436~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.54642552200000005, 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035802751000000001, 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5000000000000002e-07 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665638+0000", 2024-09-12T18:03:08.223 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7529999999999999e-06 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665647+0000", 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.003e-06 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665654+0000", 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8800000000000002e-06 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.224 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697623+0000", 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031968979000000002 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697798+0000", 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017540200000000001 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698074+0000", 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027552300000000001 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700944+0000", 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002870006 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701246+0000", 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030226599999999998 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701323+0000", 2024-09-12T18:03:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6824999999999997e-05 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701436+0000", 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011336399999999999 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:95 3.1f 3:f83d65d8:::200.00000004:head [write 1995837~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.54639619299999997, 2024-09-12T18:03:08.227 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036764968000000002, 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665664+0000", 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-07 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665673+0000", 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2129999999999997e-06 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.229 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665685+0000", 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1725999999999999e-05 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665691+0000", 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9600000000000003e-06 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699468+0000", 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033776498000000002 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.230 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699539+0000", 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1155000000000006e-05 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699638+0000", 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8911000000000002e-05 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701472+0000", 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001833905 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702256+0000", 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00078429400000000005 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702349+0000", 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2954999999999993e-05 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702428+0000", 2024-09-12T18:03:08.232 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8623999999999998e-05 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.54635751700000001, 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:08.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:08.235 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.236 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:08.237 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.238 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.54632376800000004, 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:08.240 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.241 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.242 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.244 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.245 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.54628239899999997, 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:08.246 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.247 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.249 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:08.250 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:08.251 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 2053189~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51962747399999998, 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037455038000000003, 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.252 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.253 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692453+0000", 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0412e-05 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692463+0000", 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0577000000000001e-05 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.254 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692471+0000", 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4100000000000002e-06 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718677+0000", 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026206521 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718798+0000", 2024-09-12T18:03:08.255 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120538 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.719143+0000", 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000345235 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721718+0000", 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025749420000000002 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.256 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729675+0000", 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079570179999999997 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729785+0000", 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109874 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729887+0000", 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101811 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.257 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 2055638~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51957645200000002, 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03758189, 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.258 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692484+0000", 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.259 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692495+0000", 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.132e-05 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692504+0000", 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4790000000000002e-06 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692511+0000", 2024-09-12T18:03:08.260 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9770000000000003e-06 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720074+0000", 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027562749000000001 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720202+0000", 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012780100000000001 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.261 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720397+0000", 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019465199999999999 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.723964+0000", 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035674280000000001 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729966+0000", 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060025219999999997 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.262 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730010+0000", 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3387999999999999e-05 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730064+0000", 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4620999999999998e-05 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 2058584~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:08.263 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51884318299999999, 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037163372, 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:08.264 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693217+0000", 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.19e-06 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693222+0000", 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.293e-06 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.265 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693236+0000", 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3893000000000001e-05 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693244+0000", 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0369999999999995e-06 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721769+0000", 2024-09-12T18:03:08.266 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028524432999999998 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721917+0000", 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000148166 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722101+0000", 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018448600000000001 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.267 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726372+0000", 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042705319999999996 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730168+0000", 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037962270000000001 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730303+0000", 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134914 2024-09-12T18:03:08.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730379+0000", 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6200999999999998e-05 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 2059984~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.518364661, 2024-09-12T18:03:08.269 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036848286000000001, 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693696+0000", 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693703+0000", 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8900000000000001e-06 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693716+0000", 2024-09-12T18:03:08.271 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3769e-05 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693725+0000", 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8200000000000003e-06 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722712+0000", 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028987022000000001 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.272 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722821+0000", 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108971 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.723078+0000", 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025679099999999997 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.728407+0000", 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053290150000000003 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.273 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730453+0000", 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002046155 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730496+0000", 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2645999999999998e-05 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730543+0000", 2024-09-12T18:03:08.274 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6746999999999998e-05 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 2061389~3454 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51819549200000004, 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036891669000000002, 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693865+0000", 2024-09-12T18:03:08.276 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.147e-06 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693871+0000", 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693886+0000", 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4462e-05 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.277 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693895+0000", 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.85e-06 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724014+0000", 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030119068999999998 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724141+0000", 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127427 2024-09-12T18:03:08.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724367+0000", 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022578799999999999 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729568+0000", 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052010720000000002 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730617+0000", 2024-09-12T18:03:08.279 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010493970000000001 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730696+0000", 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8652000000000005e-05 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730755+0000", 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9104999999999997e-05 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.280 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 2064843~2429 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51604593600000004, 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034886867000000002, 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:08.281 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696015+0000", 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1629999999999999e-06 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.282 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696026+0000", 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1053000000000001e-05 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696061+0000", 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5083000000000003e-05 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696079+0000", 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7759000000000001e-05 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.283 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725217+0000", 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029137526 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725340+0000", 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012282300000000001 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725566+0000", 2024-09-12T18:03:08.284 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000226429 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730087+0000", 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045212760000000003 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730816+0000", 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00072836000000000005 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.285 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730856+0000", 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0021000000000002e-05 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730900+0000", 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4373999999999999e-05 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 2067272~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:08.286 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51590908599999996, 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035065081999999997, 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.287 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696151+0000", 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2100000000000001e-06 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696157+0000", 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7359999999999998e-06 2024-09-12T18:03:08.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696171+0000", 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4453e-05 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696181+0000", 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2439999999999999e-06 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726472+0000", 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030291194 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726654+0000", 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000182029 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726891+0000", 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237455 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730094+0000", 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032026910000000001 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730983+0000", 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00088855599999999998 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731097+0000", 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011485300000000001 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731215+0000", 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117661 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.514210787, 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.292 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:08.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:08.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:08.297 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51414349400000003, 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:08.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:08.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:08.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51410967200000002, 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:08.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51406170299999998, 2024-09-12T18:03:08.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:08.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:08.314 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51402050700000002, 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:08.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.320 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.51058943800000001, 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:08.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:08.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:08.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.510398083, 2024-09-12T18:03:08.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:08.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:08.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.331 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:08.332 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:08.332 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:08.333 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:08.333 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:08.334 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:08.334 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:08.335 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:08.329+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:08.342 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:08.342 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:08.435 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:08.433+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:08.473 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:08.473 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:08.487 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:08.535 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:08.533+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:08.614 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:08.615 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:08.630 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:08.636 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:08.633+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:08.737 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:08.736+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:08.764 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:08.764 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:08.781 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:08.839 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:08.837+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:08.916 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:08.917 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:08.932 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:08.939 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:08.936+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:09.040 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:09.035+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:09.110 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:09.110 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:09.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:09.174 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:09.173+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:09.242 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:09.240+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:09.250 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:09.250 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:09.265 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:09.343 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:09.341+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:09.400 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:09.400 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:09.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:09.444 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:09.440+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:09.543 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:09.544 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:09.545 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:09.541+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:09.559 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:09.646 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:09.641+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:09.681 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:09.681 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:09.697 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:09.746 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:09.744+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:09.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:03:09.843 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:09.843 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:09.847 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:09.843+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:09.859 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:09.949 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:09.945+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:10.037 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:10.037 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:10.050 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:10.045+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:10.053 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:10.151 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:10.147+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:10.173 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:10.174 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:10.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:10.252 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:10.249+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:10.256 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:03:10.335 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:10.335 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:10.350 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:10.353 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:10.347+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:10.362 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:10.453 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:10.449+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:10.529 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:10.530 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:10.530 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:10.531 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:10.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:10.552 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:10.552 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:10.576 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:10.576 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:10.587 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:10.585+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:10.655 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:10.651+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.078440704000002, 2024-09-12T18:03:10.725 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:10.726 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.727 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.728 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.729 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.077767519000005, 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.730 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.731 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:03:10.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.734 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.077158417000007, 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:10.735 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.736 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:03:10.737 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:03:10.738 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:10.739 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.076631104000001, 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.740 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.741 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:03:10.742 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.743 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.076190068000002, 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.744 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.745 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.746 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:03:10.747 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.748 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.075412024000002, 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:10.749 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.750 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.751 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:03:10.752 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.074920057, 2024-09-12T18:03:10.753 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:10.754 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.755 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.756 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:03:10.757 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.074352499, 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.758 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.759 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.760 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.761 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.762 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.073848083000001, 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.763 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.764 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:03:10.765 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.766 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.767 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.073370808999996, 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.769 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:03:10.770 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.771 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:03:10.772 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.072924977, 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.773 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.774 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:03:10.775 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.776 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.072383920999997, 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.777 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.778 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:03:10.779 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.780 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.781 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 86.072045482999997, 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.782 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.783 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:03:10.784 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:03:10.785 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:10.786 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 75.031667862999996, 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083739350000000008, 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690543+0000", 2024-09-12T18:03:10.787 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690545+0000", 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.75e-06 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690552+0000", 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.413e-06 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.788 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690571+0000", 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9147000000000002e-05 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690585+0000", 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4093e-05 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692069+0000", 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001483748 2024-09-12T18:03:10.789 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692342+0000", 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027285800000000001 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.692633+0000", 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029063800000000002 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:10.790 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.694697+0000", 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020642009999999999 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698784+0000", 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040874379999999997 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698860+0000", 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5343e-05 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.791 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.698917+0000", 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7306000000000003e-05 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 75.031485330999999, 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.792 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.793 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:03:10.794 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.795 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.796 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:03:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 6.9533523840000004, 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085372009999999995, 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 2315 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768861+0000", 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.357e-06 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769609+0000", 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00074865299999999995 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.800 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769643+0000", 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3145999999999997e-05 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769658+0000", 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5247e-05 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769786+0000", 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00012775899999999999 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.801 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.770000+0000", 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00021481000000000001 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.770207+0000", 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020706699999999999 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.802 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.776120+0000", 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0059121479999999999 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777151+0000", 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001031152 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777294+0000", 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014346500000000001 2024-09-12T18:03:10.803 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777396+0000", 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010139700000000001 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:3989 4.3 4:c097fc49:::10000001315.00000000:head [write 0~365] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:06.325980+0000", 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 4.3962304899999998, 2024-09-12T18:03:10.804 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0080548749999999995, 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 3989 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.325980+0000", 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.805 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.325980+0000", 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.325982+0000", 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5969999999999999e-06 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.806 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.325988+0000", 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5830000000000003e-06 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.326048+0000", 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9168e-05 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.326066+0000", 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8428999999999999e-05 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.807 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.326689+0000", 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00062295600000000003 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.326934+0000", 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024534300000000003 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.327141+0000", 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000206231 2024-09-12T18:03:10.808 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.328598+0000", 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001457098 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.333880+0000", 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052819850000000003 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.809 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.333961+0000", 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1100000000000006e-05 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:06.334035+0000", 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4385e-05 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:4802 4.1f 4:f9037b1d:::1000000168d.00000000:head [write 0~2722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:07.677864+0000", 2024-09-12T18:03:10.810 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.0443470800000001, 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011592968, 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 4802 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677864+0000", 2024-09-12T18:03:10.811 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677864+0000", 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677865+0000", 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.812 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677869+0000", 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.296e-06 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677878+0000", 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4129999999999995e-06 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677883+0000", 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1100000000000002e-06 2024-09-12T18:03:10.813 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677924+0000", 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0923000000000001e-05 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.678040+0000", 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000115647 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:10.814 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.678135+0000", 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5501999999999995e-05 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.678805+0000", 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00066931599999999999 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.689306+0000", 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010501299 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.815 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.689396+0000", 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9469999999999995e-05 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.689457+0000", 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1111999999999994e-05 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.816 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:4824 4.3f 4:fdfbb8df:::100000016a5.00000000:head [write 0~1667] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:07.735166+0000", 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 2.9870451629999999, 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0081048969999999998, 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 4824 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.817 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735166+0000", 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735166+0000", 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735168+0000", 2024-09-12T18:03:10.818 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.4269999999999998e-06 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735180+0000", 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1602e-05 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735227+0000", 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7719000000000002e-05 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.819 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735242+0000", 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.435e-05 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735400+0000", 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000158469 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735659+0000", 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00025907300000000002 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.820 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.735882+0000", 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000222544 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.737349+0000", 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0014670009999999999 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.743088+0000", 2024-09-12T18:03:10.821 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057391500000000002 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.743181+0000", 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2794000000000006e-05 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.743271+0000", 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9767999999999998e-05 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.822 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:5191 4.36 4:6f9a0cb2:::10000001826.00000000:head [write 0~1525] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:08.302911+0000", 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 2.4193001330000001, 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.008545169, 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 5191 2024-09-12T18:03:10.823 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302911+0000", 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302911+0000", 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.824 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302913+0000", 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.17e-06 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302924+0000", 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.131e-05 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302944+0000", 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9589000000000002e-05 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.825 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302959+0000", 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5474000000000001e-05 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.303086+0000", 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000126456 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.303423+0000", 2024-09-12T18:03:10.826 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033755100000000001 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.303626+0000", 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020306499999999999 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.305224+0000", 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0015973140000000001 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:10.827 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.311192+0000", 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0059679570000000003 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.311347+0000", 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015575300000000001 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.311456+0000", 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010853000000000001 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.828 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.829 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.829 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:10.829 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:10.829 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:10.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:10.831 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:10.825+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:10.931 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:10.929+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:10.991 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:10.991 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:10.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.991 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:6986 4.21 4.ac719821 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:10.991 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:10.991549+0000", 2024-09-12T18:03:10.991 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.7221999999999999e-05, 2024-09-12T18:03:10.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013440699999999999, 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 6986 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:10.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.991549+0000", 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.991549+0000", 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.991551+0000", 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.81e-06 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.991560+0000", 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2940000000000006e-06 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.991580+0000", 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0746000000000001e-05 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.991593+0000", 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2785999999999999e-05 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.991652+0000", 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8748000000000001e-05 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4587.0:6983 4.1b e47/17 4:d80ab75d:::10000001fed.00000000:head v 47'104, mlcod=47'102)", 2024-09-12T18:03:10.995 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:10.989059+0000", 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0025875680000000002, 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0027250849999999999, 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.989059+0000", 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.989059+0000", 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.989061+0000", 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.437e-06 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.989070+0000", 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.577e-06 2024-09-12T18:03:10.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.989090+0000", 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9439000000000001e-05 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.989101+0000", 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1106e-05 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:10.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.989218+0000", 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011724500000000001 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:10.989254+0000", 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5976000000000002e-05 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 2 2024-09-12T18:03:10.999 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:11.007 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:11.032 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:11.028+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:11.133 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:11.127+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:11.137 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:11.137 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:11.137 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:11.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:11.234 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:11.232+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:11.335 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:11.331+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:93 3.1f 3:f83d65d8:::200.00000004:head [write 1993036~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6782310219999999, 2024-09-12T18:03:11.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035556857999999997, 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.54e-07 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665603+0000", 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4590000000000004e-06 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665616+0000", 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3447e-05 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665624+0000", 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1930000000000004e-06 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697073+0000", 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03144972 2024-09-12T18:03:11.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697136+0000", 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2341999999999994e-05 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697240+0000", 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010446399999999999 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699410+0000", 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002170029 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701031+0000", 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016210409999999999 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701097+0000", 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5827000000000005e-05 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701150+0000", 2024-09-12T18:03:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2581999999999999e-05 2024-09-12T18:03:11.353 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:94 3.1f 3:f83d65d8:::200.00000004:head [write 1994436~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6781901690000001, 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035802751000000001, 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.354 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5000000000000002e-07 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665638+0000", 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7529999999999999e-06 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665647+0000", 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.003e-06 2024-09-12T18:03:11.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665654+0000", 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8800000000000002e-06 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697623+0000", 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031968979000000002 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697798+0000", 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017540200000000001 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698074+0000", 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027552300000000001 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700944+0000", 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002870006 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701246+0000", 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030226599999999998 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701323+0000", 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6824999999999997e-05 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701436+0000", 2024-09-12T18:03:11.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011336399999999999 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:95 3.1f 3:f83d65d8:::200.00000004:head [write 1995837~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6781608399999999, 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036764968000000002, 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.360 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665664+0000", 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-07 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665673+0000", 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2129999999999997e-06 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665685+0000", 2024-09-12T18:03:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1725999999999999e-05 2024-09-12T18:03:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665691+0000", 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9600000000000003e-06 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699468+0000", 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033776498000000002 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699539+0000", 2024-09-12T18:03:11.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1155000000000006e-05 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699638+0000", 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8911000000000002e-05 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701472+0000", 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001833905 2024-09-12T18:03:11.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702256+0000", 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00078429400000000005 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702349+0000", 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2954999999999993e-05 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702428+0000", 2024-09-12T18:03:11.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8623999999999998e-05 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6781221639999999, 2024-09-12T18:03:11.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:11.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6780884149999999, 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:11.373 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.376 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:11.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6780470460000001, 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:11.379 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:11.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 2053189~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6513921209999998, 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037455038000000003, 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.385 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692453+0000", 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0412e-05 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692463+0000", 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0577000000000001e-05 2024-09-12T18:03:11.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692471+0000", 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4100000000000002e-06 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718677+0000", 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026206521 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718798+0000", 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120538 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.719143+0000", 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000345235 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721718+0000", 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025749420000000002 2024-09-12T18:03:11.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729675+0000", 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079570179999999997 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729785+0000", 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109874 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729887+0000", 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101811 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 2055638~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6513410990000001, 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03758189, 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.391 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692484+0000", 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692495+0000", 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.132e-05 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692504+0000", 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4790000000000002e-06 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692511+0000", 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9770000000000003e-06 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720074+0000", 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027562749000000001 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720202+0000", 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012780100000000001 2024-09-12T18:03:11.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720397+0000", 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019465199999999999 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.723964+0000", 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035674280000000001 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729966+0000", 2024-09-12T18:03:11.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060025219999999997 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730010+0000", 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3387999999999999e-05 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730064+0000", 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4620999999999998e-05 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 2058584~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6506078300000002, 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037163372, 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:11.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693217+0000", 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.19e-06 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693222+0000", 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.293e-06 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693236+0000", 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3893000000000001e-05 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693244+0000", 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0369999999999995e-06 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721769+0000", 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028524432999999998 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721917+0000", 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000148166 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722101+0000", 2024-09-12T18:03:11.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018448600000000001 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726372+0000", 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042705319999999996 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730168+0000", 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037962270000000001 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.401 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730303+0000", 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134914 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730379+0000", 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6200999999999998e-05 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 2059984~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.402 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6501293079999999, 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036848286000000001, 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693696+0000", 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693703+0000", 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8900000000000001e-06 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693716+0000", 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3769e-05 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693725+0000", 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8200000000000003e-06 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722712+0000", 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028987022000000001 2024-09-12T18:03:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722821+0000", 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108971 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.723078+0000", 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025679099999999997 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.728407+0000", 2024-09-12T18:03:11.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053290150000000003 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730453+0000", 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002046155 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730496+0000", 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2645999999999998e-05 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730543+0000", 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6746999999999998e-05 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 2061389~3454 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.649960139, 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036891669000000002, 2024-09-12T18:03:11.408 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693865+0000", 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.147e-06 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693871+0000", 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693886+0000", 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4462e-05 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693895+0000", 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.85e-06 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724014+0000", 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030119068999999998 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724141+0000", 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127427 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724367+0000", 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022578799999999999 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729568+0000", 2024-09-12T18:03:11.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052010720000000002 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730617+0000", 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010493970000000001 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730696+0000", 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8652000000000005e-05 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730755+0000", 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9104999999999997e-05 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 2064843~2429 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6478105830000001, 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034886867000000002, 2024-09-12T18:03:11.414 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.415 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696015+0000", 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1629999999999999e-06 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696026+0000", 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1053000000000001e-05 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.416 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696061+0000", 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5083000000000003e-05 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696079+0000", 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7759000000000001e-05 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725217+0000", 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029137526 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725340+0000", 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012282300000000001 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725566+0000", 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000226429 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730087+0000", 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045212760000000003 2024-09-12T18:03:11.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730816+0000", 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00072836000000000005 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730856+0000", 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0021000000000002e-05 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.419 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730900+0000", 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4373999999999999e-05 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 2067272~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.647673733, 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035065081999999997, 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.420 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.421 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696151+0000", 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2100000000000001e-06 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696157+0000", 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7359999999999998e-06 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696171+0000", 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4453e-05 2024-09-12T18:03:11.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696181+0000", 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2439999999999999e-06 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726472+0000", 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030291194 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726654+0000", 2024-09-12T18:03:11.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000182029 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726891+0000", 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237455 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730094+0000", 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032026910000000001 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730983+0000", 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00088855599999999998 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731097+0000", 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011485300000000001 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731215+0000", 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117661 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.425 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6459754339999999, 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:11.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.431 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.645908141, 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:11.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:11.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.434 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.435 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:11.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.437 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6458743189999998, 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:11.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6458263500000001, 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:11.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:11.449 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6457851539999999, 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:11.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.642354085, 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:11.455 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:11.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.6421627299999999, 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:11.461 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:11.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:11.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:11.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:11.467 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:11.469 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:11.470 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:11.468+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:11.570 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:11.567+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:7350 4.18 4:1a918510:::1000000218e.00000000:head [write 0~1874 in=1874b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:11.615258+0000", 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.00064440899999999998, 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068786100000000001, 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:11.615 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 7350 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615258+0000", 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615258+0000", 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615260+0000", 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.683e-06 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615275+0000", 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4885999999999999e-05 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615290+0000", 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5569999999999998e-05 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615300+0000", 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0073e-05 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615403+0000", 2024-09-12T18:03:11.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010225000000000001 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615601+0000", 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000198242 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:11.615805+0000", 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020424000000000001 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.620 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:03:11.620 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-09-12T18:03:11.620 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:11.631 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:11.677 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:11.676+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:11.754 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:11.755 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:11.755 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:11.755 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:11.755 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:11.769 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:11.772 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:11.769+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:11.873 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:11.867+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:11.940 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:11.940 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:11.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.296033566000006, 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.941 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:03:11.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:03:11.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:03:11.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.947 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.295916517999999, 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014595729, 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-12T18:03:11.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:11.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643746+0000", 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5600000000000001e-07 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643749+0000", 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643756+0000", 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0759999999999997e-06 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643760+0000", 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645470+0000", 2024-09-12T18:03:11.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017096209999999999 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645525+0000", 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4941999999999997e-05 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645619+0000", 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4232000000000002e-05 2024-09-12T18:03:11.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.648710+0000", 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030915890000000001 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658282+0000", 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095713629999999994 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:11.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658316+0000", 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4221999999999999e-05 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658341+0000", 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5269000000000002e-05 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.954 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.294756995, 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:03:11.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:03:11.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.294610485000007, 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.961 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:11.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:03:11.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:03:11.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:03:11.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:11.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.968 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.294523063, 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:11.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.189327614000007, 2024-09-12T18:03:11.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014511154, 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 73 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.976 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750334+0000", 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750336+0000", 2024-09-12T18:03:11.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.736e-06 2024-09-12T18:03:11.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750347+0000", 2024-09-12T18:03:11.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0907000000000001e-05 2024-09-12T18:03:11.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750366+0000", 2024-09-12T18:03:11.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9210000000000001e-05 2024-09-12T18:03:11.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750385+0000", 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8513e-05 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761322+0000", 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010937079000000001 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761442+0000", 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011982 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.761626+0000", 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000184141 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764676+0000", 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030499469999999999 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764713+0000", 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7412e-05 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:11.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764786+0000", 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2267000000000005e-05 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764846+0000", 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0121999999999998e-05 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.189244557999999, 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.984 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:03:11.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:03:11.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.189176239000005, 2024-09-12T18:03:11.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:11.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:11.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:11.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.996 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.188997200000003, 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:11.997 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:11.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:11.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.003 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.084670596999999, 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:03:12.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:03:12.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.084624598000005, 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.011 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:03:12.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:03:12.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 87.084507154999997, 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.017 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:03:12.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:03:12.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.980275880999997, 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.024 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:03:12.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.030 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.980242267999998, 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.031 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:03:12.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:03:12.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.037 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.980072866, 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:03:12.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:03:12.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.043 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.980033653000007, 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:03:12.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:03:12.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.979989586000002, 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:03:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:03:12.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:03:12.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:03:12.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 86.979871266999993, 2024-09-12T18:03:12.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:12.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:03:12.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:03:12.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:73 3.1f e45/16 3:f83d65d8:::200.00000004:head v 45'5, mlcod=18'3)", 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.272643414, 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016249827000000001, 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667025+0000", 2024-09-12T18:03:12.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2659999999999998e-06 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670696+0000", 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036707939999999998 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670724+0000", 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8572999999999999e-05 2024-09-12T18:03:12.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670738+0000", 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3774999999999999e-05 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670879+0000", 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000140476 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670932+0000", 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3522e-05 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.683166+0000", 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012234386999999999 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.683268+0000", 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010203400000000001 2024-09-12T18:03:12.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:125 3.6 e45/16 3:654134d2:::mds0_openfiles.0:head v 45'12, mlcod=45'10)", 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:07.714137+0000", 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.2255248249999999, 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014572595000000001, 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:12.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.714137+0000", 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.714137+0000", 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.714139+0000", 2024-09-12T18:03:12.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.75e-06 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.714219+0000", 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9686999999999998e-05 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.714247+0000", 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8606e-05 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.714266+0000", 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8589000000000001e-05 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.714443+0000", 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017740799999999999 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.714495+0000", 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1232e-05 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.728627+0000", 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014132242 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.728710+0000", 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3081e-05 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.072 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:12.073 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:12.073 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:12.074 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:12.075 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:12.072+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:12.175 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:12.173+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:12.211 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:12.211 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:12.211 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.211 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4587.0:7572 4.21 e47/17 4:8425202c:::1000000228d.00000000:head v 47'127, mlcod=47'125)", 2024-09-12T18:03:12.211 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.211139+0000", 2024-09-12T18:03:12.211 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00026494300000000001, 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029978600000000002, 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.211139+0000", 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.212 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.211139+0000", 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.211140+0000", 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.246e-06 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.211190+0000", 2024-09-12T18:03:12.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9883000000000003e-05 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.211228+0000", 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7818999999999998e-05 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.211243+0000", 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5276000000000001e-05 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.211311+0000", 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7900999999999999e-05 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.211325+0000", 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3512999999999999e-05 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-12T18:03:12.215 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 1 2024-09-12T18:03:12.216 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:12.226 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:12.276 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:12.271+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:12.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:03:12.352 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:03:12.352 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:03:12.352 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T18:03:12.352 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-09-12T18:03:12.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T18:03:12.377 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:12.376+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:12.396 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:12.396 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:12.396 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:12.396 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:12.396 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:12.411 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:12.478 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:12.476+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:40 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'22, mlcod=10'19)", 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.894466389000002, 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0094495199999999994, 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.541 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643770+0000", 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.542 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643772+0000", 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0499999999999999e-06 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643783+0000", 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1204e-05 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643814+0000", 2024-09-12T18:03:12.543 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0703000000000001e-05 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.643830+0000", 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5763000000000001e-05 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644053+0000", 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022341799999999999 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644098+0000", 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4860000000000001e-05 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653120+0000", 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0090223030000000006 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653220+0000", 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219e-05 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:41 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'23, mlcod=10'19)", 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.893793204000005, 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012757541000000001, 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.546 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644443+0000", 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644445+0000", 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6899999999999999e-06 2024-09-12T18:03:12.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644520+0000", 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4573000000000006e-05 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644539+0000", 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9415999999999998e-05 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.548 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644554+0000", 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5534000000000001e-05 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644691+0000", 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000136219 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.644728+0000", 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7026000000000001e-05 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.549 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657128+0000", 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012400611000000001 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657201+0000", 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2471999999999993e-05 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:42 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'24, mlcod=10'19)", 2024-09-12T18:03:12.551 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:12.552 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.893184102000006, 2024-09-12T18:03:12.552 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.012240015, 2024-09-12T18:03:12.552 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.552 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.552 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.552 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.552 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.552 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645054+0000", 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.637e-06 2024-09-12T18:03:12.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645066+0000", 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1656e-05 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645084+0000", 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8817e-05 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.554 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645098+0000", 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3767e-05 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645687+0000", 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058905800000000005 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645747+0000", 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9599999999999999e-05 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.555 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657206+0000", 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011459143999999999 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657292+0000", 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6335999999999995e-05 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:43 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'25, mlcod=10'19)", 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.892656789, 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011796312, 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.557 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645580+0000", 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645582+0000", 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9999999999999999e-06 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.558 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645612+0000", 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0756000000000002e-05 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645636+0000", 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3836999999999999e-05 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.645650+0000", 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3709e-05 2024-09-12T18:03:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646474+0000", 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00082448099999999996 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646509+0000", 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4042999999999999e-05 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.560 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657299+0000", 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010790489 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657376+0000", 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6996999999999995e-05 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.561 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:44 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'26, mlcod=10'19)", 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.892215753000002, 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011401049, 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.562 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646021+0000", 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646022+0000", 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.28e-06 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646123+0000", 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101203 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.563 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646140+0000", 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6310000000000001e-05 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646150+0000", 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.012e-05 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647142+0000", 2024-09-12T18:03:12.564 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00099252900000000002 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647213+0000", 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1231999999999998e-05 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657385+0000", 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010171685 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.565 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657422+0000", 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6690000000000003e-05 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:45 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'27, mlcod=10'19)", 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.891437709000002, 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010662524, 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646799+0000", 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646801+0000", 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0640000000000001e-06 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646812+0000", 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1049e-05 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646835+0000", 2024-09-12T18:03:12.568 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3260000000000001e-05 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.646872+0000", 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6900000000000002e-05 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649879+0000", 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003006543 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.569 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649931+0000", 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2015999999999998e-05 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657426+0000", 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.007495186 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657461+0000", 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5506000000000002e-05 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.570 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:46 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'28, mlcod=10'20)", 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.890945742, 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010205927, 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.571 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647291+0000", 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647293+0000", 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9300000000000002e-06 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647304+0000", 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0869e-05 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647335+0000", 2024-09-12T18:03:12.573 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1199999999999999e-05 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647352+0000", 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7410000000000001e-05 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650534+0000", 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0031815789999999999 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.574 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650590+0000", 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6356e-05 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657465+0000", 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068751569999999998 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657497+0000", 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1426e-05 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.575 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:47 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'29, mlcod=10'20)", 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.890378183999999, 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0097088350000000007, 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.576 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647858+0000", 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647860+0000", 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0030000000000001e-06 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647916+0000", 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5216999999999997e-05 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647943+0000", 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.796e-05 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.647957+0000", 2024-09-12T18:03:12.578 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.348e-05 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651308+0000", 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00335126 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.651340+0000", 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2016e-05 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.579 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657501+0000", 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061604199999999998 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657567+0000", 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6478999999999998e-05 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.580 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:48 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'30, mlcod=10'20)", 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.889873768000001, 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092479120000000005, 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.581 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648363+0000", 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648365+0000", 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9400000000000001e-06 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.582 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648375+0000", 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0777e-05 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648403+0000", 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7800000000000001e-05 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648418+0000", 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.434e-05 2024-09-12T18:03:12.583 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653326+0000", 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004908562 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.653381+0000", 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5305e-05 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.584 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657571+0000", 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041896549999999996 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657611+0000", 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9533000000000002e-05 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:49 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'31, mlcod=10'20)", 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:12.585 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.889396493999996, 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0088055679999999997, 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.586 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648840+0000", 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648842+0000", 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.956e-06 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648853+0000", 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0997e-05 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.587 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648881+0000", 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7903e-05 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.648894+0000", 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3276e-05 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654159+0000", 2024-09-12T18:03:12.588 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052650120000000003 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654208+0000", 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9209999999999998e-05 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657615+0000", 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0034062939999999998 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657646+0000", 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0920000000000002e-05 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:50 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'32, mlcod=10'20)", 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.888950661999999, 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011483392, 2024-09-12T18:03:12.590 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649286+0000", 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.591 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649287+0000", 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.654e-06 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649361+0000", 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3172999999999999e-05 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.592 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649380+0000", 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9732999999999999e-05 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649391+0000", 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0793e-05 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654868+0000", 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0054768910000000002 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.593 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.654917+0000", 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8888999999999999e-05 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660667+0000", 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057503099999999998 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660769+0000", 2024-09-12T18:03:12.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101949 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:51 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'33, mlcod=10'20)", 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.888409605999996, 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011050412000000001, 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649827+0000", 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649829+0000", 2024-09-12T18:03:12.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8199999999999999e-06 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649863+0000", 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3994e-05 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649885+0000", 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.2796e-05 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.649923+0000", 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7892999999999998e-05 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656550+0000", 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066265250000000003 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.656590+0000", 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9789999999999997e-05 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660773+0000", 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041829550000000004 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.660877+0000", 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104639 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4150.0:52 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'34, mlcod=10'20)", 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 87.888071167999996, 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011028771, 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650165+0000", 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650167+0000", 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.426e-06 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.601 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650175+0000", 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4600000000000003e-06 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650191+0000", 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5642999999999999e-05 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.650200+0000", 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6369999999999994e-06 2024-09-12T18:03:12.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657721+0000", 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0075202790000000004 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.657772+0000", 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1136e-05 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661139+0000", 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033675609999999998 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:44.661194+0000", 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4629000000000002e-05 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:20 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-09-12T18:03:12.604 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 76.847511015999999, 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085927499999999997, 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690725+0000", 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690727+0000", 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3230000000000001e-06 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690741+0000", 2024-09-12T18:03:12.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3903999999999999e-05 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690759+0000", 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8315999999999999e-05 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.690773+0000", 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3736e-05 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693192+0000", 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024193550000000002 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693441+0000", 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024896500000000003 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.693667+0000", 2024-09-12T18:03:12.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00022578799999999999 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.695841+0000", 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0021737100000000001 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699041+0000", 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003200151 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699190+0000", 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000149133 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:01:55.699318+0000", 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128369 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.610 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:2315 4.1f 4:f84a2a2d:::10000000c60.00000000:head [write 0~648229] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 8.7693780690000001, 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085372009999999995, 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 2315 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768858+0000", 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.768861+0000", 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.357e-06 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769609+0000", 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00074865299999999995 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769643+0000", 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3145999999999997e-05 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769658+0000", 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5247e-05 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.769786+0000", 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00012775899999999999 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.770000+0000", 2024-09-12T18:03:12.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00021481000000000001 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.770207+0000", 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020706699999999999 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.776120+0000", 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0059121479999999999 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777151+0000", 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001031152 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777294+0000", 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014346500000000001 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:03.777396+0000", 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010139700000000001 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.616 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:4802 4.1f 4:f9037b1d:::1000000168d.00000000:head [write 0~2722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:07.677864+0000", 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 4.8603727650000002, 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.011592968, 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:12.617 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 4802 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677864+0000", 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677864+0000", 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677865+0000", 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677869+0000", 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.296e-06 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677878+0000", 2024-09-12T18:03:12.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4129999999999995e-06 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677883+0000", 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1100000000000002e-06 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.677924+0000", 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0923000000000001e-05 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.678040+0000", 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000115647 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.678135+0000", 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5501999999999995e-05 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.678805+0000", 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00066931599999999999 2024-09-12T18:03:12.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.689306+0000", 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010501299 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.689396+0000", 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9469999999999995e-05 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:07.689457+0000", 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1111999999999994e-05 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:5191 4.36 4:6f9a0cb2:::10000001826.00000000:head [write 0~1525] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:08.302911+0000", 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 4.2353258179999997, 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.008545169, 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.623 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 5191 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302911+0000", 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302911+0000", 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302913+0000", 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.17e-06 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302924+0000", 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.131e-05 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302944+0000", 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9589000000000002e-05 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.302959+0000", 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5474000000000001e-05 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.303086+0000", 2024-09-12T18:03:12.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000126456 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.303423+0000", 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033755100000000001 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.303626+0000", 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020306499999999999 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:12.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.305224+0000", 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0015973140000000001 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.311192+0000", 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0059679570000000003 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.311347+0000", 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015575300000000001 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:08.311456+0000", 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010853000000000001 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(mds.0.3:147 3.1e e47/16 3:7bf7e7b5:::200.00000006:head v 47'2, mlcod=0'0)", 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:11.457065+0000", 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 1.0811718850000001, 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.014303155999999999, 2024-09-12T18:03:12.629 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.457065+0000", 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.457065+0000", 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.457067+0000", 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9539999999999998e-06 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.460463+0000", 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003396062 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.460498+0000", 2024-09-12T18:03:12.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5132999999999997e-05 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.460513+0000", 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4813e-05 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.460672+0000", 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015938899999999999 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.460711+0000", 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8998999999999997e-05 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.471262+0000", 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010551243 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.471368+0000", 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010556300000000001 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4587.0:7305 4.7 e47/17 4:e2393c8d:::10000002156.00000000:head v 47'117, mlcod=47'115)", 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:11.522131+0000", 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 1.01610545, 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.008641447, 2024-09-12T18:03:12.634 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.522131+0000", 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.522131+0000", 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.522133+0000", 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.897e-06 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.522144+0000", 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1306e-05 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.636 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.522175+0000", 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0936000000000003e-05 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.522188+0000", 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3093e-05 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.522306+0000", 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000117897 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.522365+0000", 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9162e-05 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.530691+0000", 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0083256140000000003 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:11.530772+0000", 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1542e-05 2024-09-12T18:03:12.638 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.639 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.639 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.639 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7696 4.36 4:6cc1920a:::10000002309.00000000:head [write 0~564] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:12.639 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.473637+0000", 2024-09-12T18:03:12.639 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.064599614, 2024-09-12T18:03:12.639 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0085607019999999999, 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7696 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.473637+0000", 2024-09-12T18:03:12.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.473637+0000", 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.473638+0000", 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0200000000000001e-07 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:12.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.473642+0000", 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.233e-06 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.473651+0000", 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2820000000000002e-06 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.473657+0000", 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7479999999999999e-06 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.473720+0000", 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3631000000000001e-05 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.473902+0000", 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018169400000000001 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.474090+0000", 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018754000000000001 2024-09-12T18:03:12.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.475247+0000", 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001157007 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.482070+0000", 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068233019999999998 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:12.644 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.482148+0000", 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8149e-05 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.482198+0000", 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9413999999999998e-05 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:12.645 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:12.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:12.648 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:12.648 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:12.645+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:12.748 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:12.745+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:12.784 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:12.784 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:12.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:7876 4.29 4:96bc3923:::100000023e2.00000000:head [write 0~10864 in=10864b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:12.781033+0000", 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0035533930000000002, 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036005519999999999, 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:12.785 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 7876 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781033+0000", 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781033+0000", 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781034+0000", 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.328e-06 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781048+0000", 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4564e-05 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781063+0000", 2024-09-12T18:03:12.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4099e-05 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781071+0000", 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5099999999999998e-06 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781184+0000", 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011278800000000001 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781436+0000", 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025186799999999998 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.781633+0000", 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019704999999999999 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784047+0000", 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002414593 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4587.0:7877 4.3b e47/17 4:df7aa0f1:::100000023e3.00000000:head v 47'135, mlcod=47'133)", 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:12.783241+0000", 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.001345197, 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001548855, 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:12.790 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.783241+0000", 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.783241+0000", 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:12.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.783242+0000", 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1399999999999995e-07 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.783248+0000", 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9479999999999996e-06 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.783261+0000", 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3207000000000001e-05 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.783268+0000", 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0899999999999999e-06 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.783338+0000", 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9914999999999997e-05 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.783369+0000", 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1049e-05 2024-09-12T18:03:12.793 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4587.0:7878 4.18 e47/17 4:1a4479ac:::100000023e4.00000000:head v 47'145, mlcod=47'143)", 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:12.784318+0000", 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.000268041, 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00055526399999999997, 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:12.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784318+0000", 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784318+0000", 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784320+0000", 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9259999999999999e-06 2024-09-12T18:03:12.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784354+0000", 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4449999999999997e-05 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784375+0000", 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1135999999999999e-05 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784400+0000", 2024-09-12T18:03:12.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4663000000000001e-05 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784486+0000", 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6384000000000005e-05 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:12.784498+0000", 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1681999999999999e-05 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:12.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:12.798 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-12T18:03:12.798 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 3 2024-09-12T18:03:12.798 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:12.800 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:12.814 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:12.814 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:12.838 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:12.838 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:12.848 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:12.843+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:12.858 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:12.859 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:12.937 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:12.938 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:12.949 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:12.945+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:12.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:13.049 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:13.048+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:13.128 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:13.128 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:13.144 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:13.189 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:13.188+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:13.252 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:13.247+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:13.281 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:13.282 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:13.297 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:13.353 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:13.349+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:13.454 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:13.449+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:13.464 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:13.464 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:13.478 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:13.555 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:13.551+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:13.602 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:13.602 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:13.616 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:13.645 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T18:03:13.649 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:03:13.656 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:13.652+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:13.756 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:13.753+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:13.762 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:13.762 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:13.781 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:13.857 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:13.851+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:13.955 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:13.955 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:13.957 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:13.953+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:13.970 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:14.058 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:14.055+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:14.150 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:14.150 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:14.159 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:14.155+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:14.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:14.260 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:14.256+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:14.315 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:14.315 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:14.331 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:14.361 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:14.357+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:14.462 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:14.457+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:14.468 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:14.468 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:14.483 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:14.564 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:14.560+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:14.602 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:14.602 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:14.616 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:14.665 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:14.664+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:14.753 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:14.754 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:14.766 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:14.764+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:14.768 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:14.867 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:14.864+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:14.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:14.940 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:14.940 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:14.955 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:14.968 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:14.965+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:15.057 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:15.058 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:15.069 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:15.068+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:15.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:15.081 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:15.105 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:15.105 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:15.137 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:15.137 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:15.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:15.137 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:15.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.137 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.490960779999995, 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014603929, 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643629+0000", 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643637+0000", 2024-09-12T18:03:15.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9460000000000004e-06 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643719+0000", 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1200999999999997e-05 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643728+0000", 2024-09-12T18:03:15.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7049999999999994e-06 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.643734+0000", 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3319999999999999e-06 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644756+0000", 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001021826 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644811+0000", 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5630000000000001e-05 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3987000000000007e-05 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.647694+0000", 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027891600000000002 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658158+0000", 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010463828 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658200+0000", 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2162000000000001e-05 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.658232+0000", 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2152e-05 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.489684209000004, 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:03:15.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:03:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.151 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.489537698999996, 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:15.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:03:15.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.489450277000003, 2024-09-12T18:03:15.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:03:15.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.384171772000002, 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.165 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:03:15.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:03:15.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.384103452999994, 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.172 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:03:15.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:03:15.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.383924414000006, 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.179 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:03:15.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:03:15.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.279597811000002, 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015134612, 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.186 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854991+0000", 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.854992+0000", 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7300000000000005e-07 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855006+0000", 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3833e-05 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855017+0000", 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855025+0000", 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2600000000000005e-06 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866415+0000", 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011389859 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866525+0000", 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110695 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.866702+0000", 2024-09-12T18:03:15.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017660199999999999 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869915+0000", 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032131320000000001 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869998+0000", 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2379000000000005e-05 2024-09-12T18:03:15.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870071+0000", 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2979999999999996e-05 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870126+0000", 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5566000000000003e-05 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.279551811999994, 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:15.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:03:15.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:03:15.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:03:15.199 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.279434369000001, 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.200 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:03:15.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:03:15.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.175203095000001, 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.207 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:03:15.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:03:15.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.175169482000001, 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:15.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:03:15.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:03:15.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.175000080000004, 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.221 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:15.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:03:15.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:03:15.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:03:15.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.227 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.174960866999996, 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.228 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.174916800000005, 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.235 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:03:15.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:03:15.241 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 90.174798480999996, 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.242 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:03:15.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:73 3.1f e45/16 3:f83d65d8:::200.00000004:head v 45'5, mlcod=18'3)", 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.4675706279999998, 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016249827000000001, 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:15.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667025+0000", 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2659999999999998e-06 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670696+0000", 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036707939999999998 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670724+0000", 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8572999999999999e-05 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670738+0000", 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3774999999999999e-05 2024-09-12T18:03:15.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670879+0000", 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000140476 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670932+0000", 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3522e-05 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.683166+0000", 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012234386999999999 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.683268+0000", 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010203400000000001 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:7811 4.25 4:a4ff7c9e:::10000002394.00000000:head [write 0~98189] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.4658078460000001, 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018891185000000001, 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 7811 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.254 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668791+0000", 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7229999999999999e-06 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668957+0000", 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016580499999999999 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668999+0000", 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2506000000000003e-05 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669022+0000", 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2509000000000001e-05 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669117+0000", 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5293999999999999e-05 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669309+0000", 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019157500000000001 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669501+0000", 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019174799999999999 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.683171+0000", 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013670488999999999 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687373+0000", 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042023199999999998 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687559+0000", 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018587899999999999 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687673+0000", 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113337 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:151 3.1d e47/16 3:bec1251c:::200.00000007:head v 47'5, mlcod=44'3)", 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.4656280280000002, 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016128601999999999, 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668963+0000", 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.593e-06 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672011+0000", 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003047995 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672032+0000", 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0820000000000001e-05 2024-09-12T18:03:15.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672044+0000", 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.278e-05 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672166+0000", 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121583 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672199+0000", 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3318999999999997e-05 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.685001+0000", 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012801472 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.685090+0000", 2024-09-12T18:03:15.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9040000000000001e-05 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:188 3.1d e47/16 3:bec1251c:::200.00000007:head v 47'42, mlcod=47'30)", 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:12.726550+0000", 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.408039724, 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014976913999999999, 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.266 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.726550+0000", 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.726550+0000", 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.726551+0000", 2024-09-12T18:03:15.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9069999999999999e-06 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.726563+0000", 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.148e-05 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.726582+0000", 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9126e-05 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.726594+0000", 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1986e-05 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.730397+0000", 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038027780000000001 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.730451+0000", 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4592999999999997e-05 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.741412+0000", 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010960620000000001 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.741526+0000", 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114424 2024-09-12T18:03:15.270 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.271 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.271 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.271 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:15.271 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:15.271 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:15.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:15.273 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:15.268+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:15.373 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:15.369+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:15.411 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:15.433 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:15.433 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:03:15.433 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:15.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:15.479 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:15.477+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:15.575 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:15.573+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:15.606 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:15.606 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:15.607 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:15.607 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:15.607 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:15.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:15.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:03:15.675 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:15.671+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:15.776 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:15.772+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1265171650000001, 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.797 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.798 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.799 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.800 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.801 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:15.802 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1264801590000002, 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.803 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.804 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.805 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:15.806 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.807 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:15.808 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1264368170000001, 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.809 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:15.810 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:15.811 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.812 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:15.813 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.814 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1263991679999998, 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.815 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:15.817 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.818 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:15.819 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.820 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.821 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.821 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.821 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:15.821 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1263594590000001, 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.824 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:15.825 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.826 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.826 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.826 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:15.826 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:15.826 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.826 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.826 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:15.827 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.828 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:15.829 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1263216630000001, 2024-09-12T18:03:15.830 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:15.831 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.832 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:15.833 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.834 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.835 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.126261671, 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:15.836 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.837 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.838 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.839 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.840 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.841 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1261665870000002, 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:15.842 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.843 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.844 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:15.845 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.846 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.847 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1261002590000002, 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:15.848 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.849 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:15.850 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.851 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:15.852 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.853 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.12604338, 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.854 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.855 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.857 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.858 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:15.859 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1259873750000002, 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.860 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.861 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.862 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:15.863 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.864 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.865 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1259221930000001, 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.866 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.867 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:15.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.869 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.870 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:15.871 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1258814109999999, 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.872 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.873 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.874 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:15.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.876 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:15.877 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1258457549999998, 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.878 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.879 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:15.880 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.881 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.883 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1257997130000001, 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.884 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.885 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:15.886 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.887 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:15.888 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.889 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1257615369999998, 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.890 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.891 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:15.892 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.893 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:15.894 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.895 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.1257150810000001, 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.896 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.897 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:15.898 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.899 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:15.900 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.085091035, 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.902 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:15.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.0850753320000002, 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:15.908 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:15.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.0773450100000002, 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:15.914 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:15.920 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:15.922 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:15.922 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:15.917+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:16.023 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:16.021+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:16.054 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:16.054 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:16.054 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:16.054 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:16.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:16.123 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:16.119+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:16.204 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:16.204 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:16.205 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:16.205 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:16.221 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:16.224 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:16.220+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:16.325 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:16.319+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:16.421 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.421 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:93 3.1f 3:f83d65d8:::200.00000004:head [write 1993036~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7523371470000004, 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035556857999999997, 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665593+0000", 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.54e-07 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.423 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665603+0000", 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4590000000000004e-06 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665616+0000", 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3447e-05 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665624+0000", 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1930000000000004e-06 2024-09-12T18:03:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697073+0000", 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03144972 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697136+0000", 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2341999999999994e-05 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.425 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697240+0000", 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010446399999999999 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699410+0000", 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002170029 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701031+0000", 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0016210409999999999 2024-09-12T18:03:16.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701097+0000", 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5827000000000005e-05 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701150+0000", 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2581999999999999e-05 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:94 3.1f 3:f83d65d8:::200.00000004:head [write 1994436~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7522962940000006, 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035802751000000001, 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:16.428 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665634+0000", 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.5000000000000002e-07 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.429 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665638+0000", 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7529999999999999e-06 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665647+0000", 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.003e-06 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.430 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665654+0000", 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8800000000000002e-06 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697623+0000", 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.031968979000000002 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697798+0000", 2024-09-12T18:03:16.431 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017540200000000001 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698074+0000", 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027552300000000001 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700944+0000", 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002870006 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.432 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701246+0000", 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030226599999999998 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701323+0000", 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6824999999999997e-05 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701436+0000", 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011336399999999999 2024-09-12T18:03:16.433 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:95 3.1f 3:f83d65d8:::200.00000004:head [write 1995837~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:16.434 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7522669650000005, 2024-09-12T18:03:16.436 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036764968000000002, 2024-09-12T18:03:16.436 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.436 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.436 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.436 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.436 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.436 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.436 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665663+0000", 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665664+0000", 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.2699999999999999e-07 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.437 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665673+0000", 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2129999999999997e-06 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665685+0000", 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1725999999999999e-05 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665691+0000", 2024-09-12T18:03:16.438 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9600000000000003e-06 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699468+0000", 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033776498000000002 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699539+0000", 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1155000000000006e-05 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.439 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.699638+0000", 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.8911000000000002e-05 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701472+0000", 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001833905 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702256+0000", 2024-09-12T18:03:16.440 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00078429400000000005 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702349+0000", 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2954999999999993e-05 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702428+0000", 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8623999999999998e-05 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.441 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7522282889999996, 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.442 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.443 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:16.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.445 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.446 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.447 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7521945399999996, 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.448 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.450 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:16.451 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.452 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.452 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.452 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:16.452 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:16.453 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.453 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.453 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.453 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:16.453 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.454 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.455 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7521531709999998, 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.456 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.457 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:16.458 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.459 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.460 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.461 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 2053189~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7254982460000008, 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037455038000000003, 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:16.463 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692453+0000", 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0412e-05 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692463+0000", 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0577000000000001e-05 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692471+0000", 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4100000000000002e-06 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718677+0000", 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026206521 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718798+0000", 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120538 2024-09-12T18:03:16.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.719143+0000", 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000345235 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721718+0000", 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025749420000000002 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.466 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729675+0000", 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079570179999999997 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729785+0000", 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109874 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729887+0000", 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101811 2024-09-12T18:03:16.467 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 2055638~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7254472239999998, 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03758189, 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.468 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.469 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692484+0000", 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692495+0000", 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.132e-05 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692504+0000", 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4790000000000002e-06 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.470 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692511+0000", 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9770000000000003e-06 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720074+0000", 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027562749000000001 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.471 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720202+0000", 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012780100000000001 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720397+0000", 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019465199999999999 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.723964+0000", 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035674280000000001 2024-09-12T18:03:16.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729966+0000", 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060025219999999997 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730010+0000", 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3387999999999999e-05 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.473 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730064+0000", 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4620999999999998e-05 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 2058584~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7247139550000004, 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037163372, 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.474 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693216+0000", 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.475 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693217+0000", 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.19e-06 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693222+0000", 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.293e-06 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.476 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693236+0000", 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3893000000000001e-05 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693244+0000", 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0369999999999995e-06 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721769+0000", 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028524432999999998 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721917+0000", 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000148166 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722101+0000", 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018448600000000001 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726372+0000", 2024-09-12T18:03:16.478 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042705319999999996 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730168+0000", 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037962270000000001 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730303+0000", 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000134914 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.479 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730379+0000", 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6200999999999998e-05 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 2059984~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7242354330000005, 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036848286000000001, 2024-09-12T18:03:16.480 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693694+0000", 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693696+0000", 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.46e-06 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693703+0000", 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8900000000000001e-06 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693716+0000", 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3769e-05 2024-09-12T18:03:16.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693725+0000", 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8200000000000003e-06 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722712+0000", 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.028987022000000001 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.722821+0000", 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000108971 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.723078+0000", 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025679099999999997 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.728407+0000", 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0053290150000000003 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.484 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730453+0000", 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002046155 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730496+0000", 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2645999999999998e-05 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.485 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730543+0000", 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6746999999999998e-05 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 2061389~3454 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7240662639999993, 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036891669000000002, 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.486 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693864+0000", 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.487 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693865+0000", 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.147e-06 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693871+0000", 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7000000000000002e-06 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693886+0000", 2024-09-12T18:03:16.488 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4462e-05 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.693895+0000", 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.85e-06 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724014+0000", 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030119068999999998 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.489 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724141+0000", 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000127427 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.724367+0000", 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022578799999999999 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729568+0000", 2024-09-12T18:03:16.490 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052010720000000002 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730617+0000", 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0010493970000000001 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730696+0000", 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8652000000000005e-05 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.491 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730755+0000", 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9104999999999997e-05 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 2064843~2429 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7219167080000002, 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034886867000000002, 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.492 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696013+0000", 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.493 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696015+0000", 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1629999999999999e-06 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696026+0000", 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1053000000000001e-05 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696061+0000", 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5083000000000003e-05 2024-09-12T18:03:16.494 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696079+0000", 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7759000000000001e-05 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725217+0000", 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.029137526 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.495 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725340+0000", 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012282300000000001 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.725566+0000", 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000226429 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730087+0000", 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045212760000000003 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.496 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730816+0000", 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00072836000000000005 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730856+0000", 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0021000000000002e-05 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730900+0000", 2024-09-12T18:03:16.497 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.4373999999999999e-05 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 2067272~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7217798579999997, 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035065081999999997, 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.498 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696150+0000", 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.499 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696151+0000", 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2100000000000001e-06 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696157+0000", 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7359999999999998e-06 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696171+0000", 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4453e-05 2024-09-12T18:03:16.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.696181+0000", 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2439999999999999e-06 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726472+0000", 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.030291194 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.501 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726654+0000", 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000182029 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.726891+0000", 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000237455 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730094+0000", 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032026910000000001 2024-09-12T18:03:16.502 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730983+0000", 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00088855599999999998 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731097+0000", 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011485300000000001 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.503 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731215+0000", 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000117661 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7200815590000005, 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:16.504 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.505 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:16.506 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.507 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:16.508 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.509 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7200142659999997, 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.510 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.511 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:16.512 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.513 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:16.514 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.515 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7199804440000008, 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.517 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.518 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.519 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.520 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:16.521 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7199324750000002, 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.522 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.523 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:16.524 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.525 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.526 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:16.527 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7198912790000005, 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.528 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.529 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.531 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.532 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:16.533 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7164602099999993, 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.534 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.535 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:16.537 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.538 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:16.539 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.7162688549999991, 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:16.540 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:16.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:16.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:16.545 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:16.546 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:16.546 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:16.547 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:16.548 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:16.545+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:16.648 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:16.644+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:16.662 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:03:16.689 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:16.689 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:16.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.689 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10323 4.a 4:50a3f94c:::10000002f50.00000000:head [write 0~1469 in=1469b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:16.689 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.688850+0000", 2024-09-12T18:03:16.689 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0011235819999999999, 2024-09-12T18:03:16.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011679380000000001, 2024-09-12T18:03:16.689 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10323 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688850+0000", 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:16.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688850+0000", 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688852+0000", 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1900000000000002e-06 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:16.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688864+0000", 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1446e-05 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688893+0000", 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9682000000000001e-05 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688907+0000", 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4027e-05 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688971+0000", 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3294999999999996e-05 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.689062+0000", 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1411999999999998e-05 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.689160+0000", 2024-09-12T18:03:16.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8115999999999994e-05 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10318 4.1a 4:58b65d8a:::10000002f4b.00000000:head [write 0~18864 in=18864b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.685168+0000", 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0048055679999999996, 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049721210000000004, 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:16.694 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10318 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685168+0000", 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:16.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685168+0000", 2024-09-12T18:03:16.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:16.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:16.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685170+0000", 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260000000000001e-06 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685204+0000", 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3803000000000001e-05 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:16.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685229+0000", 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4566000000000002e-05 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685257+0000", 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8529000000000001e-05 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685328+0000", 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0685999999999994e-05 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685426+0000", 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7949999999999996e-05 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685520+0000", 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4388999999999994e-05 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.687764+0000", 2024-09-12T18:03:16.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022440149999999998 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10319 4.3a 4:5c32ecc3:::10000002f4c.00000000:head [write 0~93 in=93b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.685887+0000", 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0040868290000000002, 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043864109999999998, 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:16.700 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10319 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685887+0000", 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685887+0000", 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685888+0000", 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6330000000000001e-06 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685896+0000", 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.96e-06 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685915+0000", 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8726e-05 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685926+0000", 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0433e-05 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.685991+0000", 2024-09-12T18:03:16.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5502999999999999e-05 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686110+0000", 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118789 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686238+0000", 2024-09-12T18:03:16.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012831799999999999 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688322+0000", 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020834059999999999 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10320 4.20 4:071974ea:::10000002f4d.00000000:head [write 0~85 in=85b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.686572+0000", 2024-09-12T18:03:16.705 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0034011190000000002, 2024-09-12T18:03:16.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038665800000000001, 2024-09-12T18:03:16.706 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:16.706 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:16.706 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:16.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:16.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:16.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:16.706 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10320 2024-09-12T18:03:16.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.707 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:16.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:16.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686572+0000", 2024-09-12T18:03:16.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:16.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686572+0000", 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686574+0000", 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4959999999999999e-06 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:16.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686581+0000", 2024-09-12T18:03:16.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1069999999999999e-06 2024-09-12T18:03:16.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686595+0000", 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3929e-05 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686604+0000", 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1370000000000008e-06 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:16.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686662+0000", 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7834999999999998e-05 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686773+0000", 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000110578 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.686919+0000", 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014684999999999999 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:16.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.688349+0000", 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001429643 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 4 2024-09-12T18:03:16.712 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:16.713 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:16.750 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:16.747+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:16.851 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:16.849+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:16.907 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:16.907 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:16.907 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:16.907 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:16.907 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:16.925 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:16.952 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:16.947+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:17.012 INFO:tasks.workunit.client.0.smithi052.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-12T18:03:17.015 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T18:03:17.015 INFO:tasks.workunit.client.0.smithi052.stderr:+ make 2024-09-12T18:03:17.053 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:17.052+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:17.060 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.411924244999994, 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:03:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:03:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.411777735000001, 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:03:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:03:17.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.411690312999994, 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:03:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:03:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:03:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.306411808000007, 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015616226, 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 74 2024-09-12T18:03:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750418+0000", 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750419+0000", 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599999999999999e-06 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750429+0000", 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9199999999999999e-06 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750447+0000", 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750460+0000", 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.288e-05 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762273+0000", 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011812982 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762397+0000", 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012375299999999999 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.762577+0000", 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018003499999999999 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764874+0000", 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022969190000000001 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765899+0000", 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001025439 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765975+0000", 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6108999999999999e-05 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766034+0000", 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8343e-05 2024-09-12T18:03:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.306343489, 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:03:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:03:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.306164449999997, 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:03:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.201791847999999, 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:03:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.201674405000006, 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:03:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:119 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.097443131000006, 2024-09-12T18:03:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015620593, 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 119 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959386+0000", 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959387+0000", 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6700000000000003e-07 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959392+0000", 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8600000000000001e-06 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959401+0000", 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4399999999999994e-06 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959408+0000", 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9929999999999998e-06 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966353+0000", 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069452699999999999 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966466+0000", 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000112916 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.966655+0000", 2024-09-12T18:03:17.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000188455 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971184+0000", 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045295520000000001 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974844+0000", 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003659724 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974926+0000", 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1632999999999996e-05 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975007+0000", 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1082999999999996e-05 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.097409518000006, 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:03:17.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:03:17.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.123 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.097240115999995, 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:03:17.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.097200903000001, 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.130 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:03:17.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.136 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.097156835999996, 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:03:17.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:03:17.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 92.097038517000001, 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:03:17.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:03:17.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:03:17.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:03:17.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:73 3.1f e45/16 3:f83d65d8:::200.00000004:head v 45'5, mlcod=18'3)", 2024-09-12T18:03:17.153 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.3898106640000005, 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016249827000000001, 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667025+0000", 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2659999999999998e-06 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670696+0000", 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036707939999999998 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670724+0000", 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8572999999999999e-05 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670738+0000", 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3774999999999999e-05 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670879+0000", 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000140476 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670932+0000", 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3522e-05 2024-09-12T18:03:17.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.683166+0000", 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012234386999999999 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.683268+0000", 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010203400000000001 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:7811 4.25 4:a4ff7c9e:::10000002394.00000000:head [write 0~98189] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3880478820000004, 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018891185000000001, 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:17.159 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 7811 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668791+0000", 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7229999999999999e-06 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668957+0000", 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016580499999999999 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668999+0000", 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2506000000000003e-05 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669022+0000", 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2509000000000001e-05 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669117+0000", 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5293999999999999e-05 2024-09-12T18:03:17.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669309+0000", 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019157500000000001 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669501+0000", 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019174799999999999 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.683171+0000", 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013670488999999999 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687373+0000", 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042023199999999998 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687559+0000", 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018587899999999999 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687673+0000", 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113337 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:151 3.1d e47/16 3:bec1251c:::200.00000007:head v 47'5, mlcod=44'3)", 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3878680640000001, 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016128601999999999, 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668963+0000", 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.593e-06 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672011+0000", 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003047995 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672032+0000", 2024-09-12T18:03:17.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0820000000000001e-05 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672044+0000", 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.278e-05 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672166+0000", 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121583 2024-09-12T18:03:17.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672199+0000", 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3318999999999997e-05 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.685001+0000", 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012801472 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.685090+0000", 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9040000000000001e-05 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:228 3.0 e48/16 3:02ac1934:::200.00000009:head v 48'3, mlcod=45'1)", 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.049519+0000", 2024-09-12T18:03:17.171 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.007310578, 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025632604, 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.049519+0000", 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.049519+0000", 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.049521+0000", 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-06 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055650+0000", 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061294590000000003 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055696+0000", 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6072000000000002e-05 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055720+0000", 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3343e-05 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055906+0000", 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018627499999999999 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055945+0000", 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8859000000000002e-05 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.075122+0000", 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019177389999999999 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.075151+0000", 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9130000000000001e-05 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.002077364, 2024-09-12T18:03:17.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:17.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:17.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.185 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.185 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:232 3.13 3:ceffbd45:::200.0000000a:head [write 0~2144049 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:17.021585+0000", 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.035244642, 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016694856000000001, 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.021585+0000", 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.021585+0000", 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.021587+0000", 2024-09-12T18:03:17.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.165e-06 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024143+0000", 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025562940000000002 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024175+0000", 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2058999999999999e-05 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024189+0000", 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4228e-05 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024273+0000", 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3163000000000003e-05 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024342+0000", 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9274000000000001e-05 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024447+0000", 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105419 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.030090+0000", 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056428770000000001 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.038197+0000", 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081066220000000008 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.038239+0000", 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1785000000000001e-05 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:17.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.038280+0000", 2024-09-12T18:03:17.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0970000000000002e-05 2024-09-12T18:03:17.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.192 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:17.192 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:17.192 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:17.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:17.194 INFO:tasks.workunit.client.0.smithi052.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-12T18:03:17.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:17.196 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:17.191+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:17.295 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:17.291+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:17.328 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:17.328 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:17.328 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:03:17.328 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:17.340 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:17.340 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:17.342 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:17.373 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:17.373 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:17.396 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:17.395+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:17.409 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:17.409 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:17.463 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:17.464 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:17.478 INFO:tasks.workunit.client.0.smithi052.stderr:++ readlink -f fsstress 2024-09-12T18:03:17.479 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:17.479 INFO:tasks.workunit.client.0.smithi052.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-12T18:03:17.479 INFO:tasks.workunit.client.0.smithi052.stderr:+ popd 2024-09-12T18:03:17.480 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T18:03:17.480 INFO:tasks.workunit.client.0.smithi052.stderr:+ popd 2024-09-12T18:03:17.481 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-12T18:03:17.481 INFO:tasks.workunit.client.0.smithi052.stderr:++ mktemp -d -p . 2024-09-12T18:03:17.482 INFO:tasks.workunit.client.0.smithi052.stderr:+ T=./tmp.rHXaLPNaoG 2024-09-12T18:03:17.482 INFO:tasks.workunit.client.0.smithi052.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.rHXaLPNaoG -l 1 -n 1000 -p 10 -v 2024-09-12T18:03:17.484 INFO:tasks.workunit.client.0.smithi052.stdout:seed = 1726238559 2024-09-12T18:03:17.486 INFO:tasks.workunit.client.0.smithi052.stdout:1/0: dwrite - no filename 2024-09-12T18:03:17.486 INFO:tasks.workunit.client.0.smithi052.stdout:1/1: dread - no filename 2024-09-12T18:03:17.486 INFO:tasks.workunit.client.0.smithi052.stdout:1/2: dwrite - no filename 2024-09-12T18:03:17.486 INFO:tasks.workunit.client.0.smithi052.stdout:1/3: dwrite - no filename 2024-09-12T18:03:17.486 INFO:tasks.workunit.client.0.smithi052.stdout:0/0: mknod c0 0 2024-09-12T18:03:17.486 INFO:tasks.workunit.client.0.smithi052.stdout:0/1: fsync - no filename 2024-09-12T18:03:17.486 INFO:tasks.workunit.client.0.smithi052.stdout:0/2: write - no filename 2024-09-12T18:03:17.486 INFO:tasks.workunit.client.0.smithi052.stdout:0/3: rmdir - no directory 2024-09-12T18:03:17.487 INFO:tasks.workunit.client.0.smithi052.stdout:2/0: chown . 1547 1 2024-09-12T18:03:17.487 INFO:tasks.workunit.client.0.smithi052.stdout:2/1: chown . 10 1 2024-09-12T18:03:17.487 INFO:tasks.workunit.client.0.smithi052.stdout:0/4: symlink l1 0 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:0/5: write - no filename 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:0/6: dwrite - no filename 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:0/7: write - no filename 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/4: symlink l0 0 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/5: truncate - no filename 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/6: truncate - no filename 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/7: fdatasync - no filename 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/8: fsync - no filename 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:0/8: mkdir d2 0 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:2/2: creat f0 x:0 0 0 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:4/0: dread - no filename 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:4/1: stat - no entries 2024-09-12T18:03:17.488 INFO:tasks.workunit.client.0.smithi052.stdout:4/2: write - no filename 2024-09-12T18:03:17.489 INFO:tasks.workunit.client.0.smithi052.stdout:1/9: rename l0 to l1 0 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:3/0: mkdir d0 0 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:2/3: write f0 [414991,85347] 0 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:3/1: chown d0 60902989 1 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:3/2: write - no filename 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:3/3: dread - no filename 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:1/10: symlink l2 0 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:5/0: chown . 55 1 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:5/1: write - no filename 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:5/2: write - no filename 2024-09-12T18:03:17.490 INFO:tasks.workunit.client.0.smithi052.stdout:5/3: dwrite - no filename 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/4: write - no filename 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/5: readlink - no filename 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/6: write - no filename 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/7: fsync - no filename 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/8: fsync - no filename 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/9: dread - no filename 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:0/9: getdents d2 0 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:0/10: write - no filename 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:3/4: rename d0 to d0/d1 22 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:2/4: truncate f0 607937 0 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:6/0: chown . 499756 1 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:4/3: mknod c0 0 2024-09-12T18:03:17.491 INFO:tasks.workunit.client.0.smithi052.stdout:4/4: dwrite - no filename 2024-09-12T18:03:17.492 INFO:tasks.workunit.client.0.smithi052.stdout:5/10: getdents . 0 2024-09-12T18:03:17.492 INFO:tasks.workunit.client.0.smithi052.stdout:0/11: rename l1 to d2/l3 0 2024-09-12T18:03:17.492 INFO:tasks.workunit.client.0.smithi052.stdout:2/5: creat f1 x:0 0 0 2024-09-12T18:03:17.492 INFO:tasks.workunit.client.0.smithi052.stdout:0/12: chown d2 1497882 1 2024-09-12T18:03:17.492 INFO:tasks.workunit.client.0.smithi052.stdout:0/13: truncate - no filename 2024-09-12T18:03:17.492 INFO:tasks.workunit.client.0.smithi052.stdout:0/14: dwrite - no filename 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:3/5: getdents d0 0 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:4/5: symlink l1 0 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:6/1: mknod c0 0 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:6/2: fdatasync - no filename 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:0/15: mknod d2/c4 0 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:0/16: fsync - no filename 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:0/17: dread - no filename 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:2/6: link f1 f2 0 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:3/6: chown d0 12436 1 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:3/7: write - no filename 2024-09-12T18:03:17.495 INFO:tasks.workunit.client.0.smithi052.stdout:0/18: chown d2 178739294 1 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:0/19: dread - no filename 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:0/20: dread - no filename 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:0/21: fsync - no filename 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:6/3: creat f1 x:0 0 0 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:4/6: chown c0 34463349 1 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:4/7: truncate - no filename 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:3/8: rename d0 to d0/d2 22 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:3/9: link - no file 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:2/7: dread - f1 zero size 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:8/0: chown . 40431 1 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:8/1: rename - no filename 2024-09-12T18:03:17.496 INFO:tasks.workunit.client.0.smithi052.stdout:0/22: stat d2/c4 0 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:0/23: dread - no filename 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:0/24: write - no filename 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:0/25: dwrite - no filename 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:0/26: write - no filename 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:8/2: chown . 2 1 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:8/3: write - no filename 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:6/4: mkdir d2 0 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:4/8: unlink l1 0 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:2/8: unlink f1 0 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:0/27: mknod d2/c5 0 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:0/28: dread - no filename 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:3/10: mkdir d0/d3 0 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:6/5: write f1 [990229,71097] 0 2024-09-12T18:03:17.497 INFO:tasks.workunit.client.0.smithi052.stdout:8/4: symlink l0 0 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:8/5: dwrite - no filename 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/0: mkdir d0 0 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/1: dread - no filename 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/2: fdatasync - no filename 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:4/9: chown c0 17933 1 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:2/9: creat f3 x:0 0 0 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:0/29: mkdir d2/d6 0 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:4/10: creat f2 x:0 0 0 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:8/6: chown l0 139281 1 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:8/7: truncate - no filename 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:3/11: rename d0/d3 to d0/d4 0 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:3/12: unlink - no file 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/3: symlink d0/l1 0 2024-09-12T18:03:17.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/4: dwrite - no filename 2024-09-12T18:03:17.499 INFO:tasks.workunit.client.0.smithi052.stdout:9/5: dread - no filename 2024-09-12T18:03:17.499 INFO:tasks.workunit.client.0.smithi052.stdout:9/6: dread - no filename 2024-09-12T18:03:17.499 INFO:tasks.workunit.client.0.smithi052.stdout:4/11: dread - f2 zero size 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:3/13: mkdir d0/d4/d5 0 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/7: symlink d0/l2 0 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/8: write - no filename 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/9: dwrite - no filename 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/10: dread - no filename 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:4/12: mknod c3 0 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:4/13: stat f2 0 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:3/14: chown d0/d4 0 1 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:3/15: dwrite - no filename 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/11: chown d0/l2 1220117 1 2024-09-12T18:03:17.502 INFO:tasks.workunit.client.0.smithi052.stdout:4/14: symlink l4 0 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:9/12: chown d0/l2 2001174 1 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:9/13: dread - no filename 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:9/14: write - no filename 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:3/16: mkdir d0/d4/d5/d6 0 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:3/17: fdatasync - no filename 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:3/18: dread - no filename 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:3/19: dwrite - no filename 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:3/20: write - no filename 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:4/15: write f2 [286887,85998] 0 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:3/21: chown d0/d4 15955024 1 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:9/15: mknod d0/c3 0 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:9/16: chown d0 4 1 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:9/17: dread - no filename 2024-09-12T18:03:17.503 INFO:tasks.workunit.client.0.smithi052.stdout:9/18: dwrite - no filename 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:2/10: dread f0 [0,4194304] 0 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/11: chown l1 5 1 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/12: dread - no filename 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:9/19: symlink d0/l4 0 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:9/20: fsync - no filename 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/13: mkdir d3 0 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:2/11: fdatasync f0 0 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:0/30: stat d2/l3 0 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:0/31: fsync - no filename 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:4/16: fdatasync f2 0 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:9/21: link d0/l4 d0/l5 0 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:0/32: symlink d2/d6/l7 0 2024-09-12T18:03:17.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/14: creat d3/f4 x:0 0 0 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:0/33: read - no filename 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:9/22: unlink d0/l5 0 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:1/15: creat d3/f5 x:0 0 0 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:0/34: mkdir d2/d8 0 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:9/23: mkdir d0/d6 0 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:9/24: write - no filename 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:9/25: dread - no filename 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:1/16: stat d3/f4 0 2024-09-12T18:03:17.505 INFO:tasks.workunit.client.0.smithi052.stdout:9/26: stat d0 0 2024-09-12T18:03:17.506 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:17.496+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:17.507 INFO:tasks.workunit.client.0.smithi052.stdout:0/35: unlink c0 0 2024-09-12T18:03:17.507 INFO:tasks.workunit.client.0.smithi052.stdout:0/36: write - no filename 2024-09-12T18:03:17.507 INFO:tasks.workunit.client.0.smithi052.stdout:1/17: chown d3/f4 1112 1 2024-09-12T18:03:17.507 INFO:tasks.workunit.client.0.smithi052.stdout:4/17: dread f2 [0,4194304] 0 2024-09-12T18:03:17.507 INFO:tasks.workunit.client.0.smithi052.stdout:9/27: mknod d0/d6/c7 0 2024-09-12T18:03:17.507 INFO:tasks.workunit.client.0.smithi052.stdout:0/37: mkdir d2/d8/d9 0 2024-09-12T18:03:17.507 INFO:tasks.workunit.client.0.smithi052.stdout:0/38: dwrite - no filename 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:6/6: dread f1 [0,4194304] 0 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:4/18: chown c0 1 1 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:9/28: rmdir d0/d6 39 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:9/29: truncate - no filename 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:0/39: creat d2/d8/fa x:0 0 0 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:4/19: write f2 [768423,60008] 0 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:9/30: creat d0/f8 x:0 0 0 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:0/40: creat d2/d6/fb x:0 0 0 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:4/20: rename f2 to f5 0 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:0/41: creat d2/fc x:0 0 0 2024-09-12T18:03:17.508 INFO:tasks.workunit.client.0.smithi052.stdout:0/42: fdatasync d2/d6/fb 0 2024-09-12T18:03:17.509 INFO:tasks.workunit.client.0.smithi052.stdout:0/43: chown d2/fc 0 1 2024-09-12T18:03:17.509 INFO:tasks.workunit.client.0.smithi052.stdout:2/12: symlink l4 0 2024-09-12T18:03:17.510 INFO:tasks.workunit.client.0.smithi052.stdout:4/21: dread f5 [0,4194304] 0 2024-09-12T18:03:17.511 INFO:tasks.workunit.client.0.smithi052.stdout:0/44: mkdir d2/d6/dd 0 2024-09-12T18:03:17.511 INFO:tasks.workunit.client.0.smithi052.stdout:9/31: mknod d0/d6/c9 0 2024-09-12T18:03:17.513 INFO:tasks.workunit.client.0.smithi052.stdout:4/22: write f5 [19108,62317] 0 2024-09-12T18:03:17.513 INFO:tasks.workunit.client.0.smithi052.stdout:1/18: dwrite d3/f4 [0,4194304] 0 2024-09-12T18:03:17.514 INFO:tasks.workunit.client.0.smithi052.stdout:9/32: creat d0/d6/fa x:0 0 0 2024-09-12T18:03:17.514 INFO:tasks.workunit.client.0.smithi052.stdout:6/7: dwrite f1 [0,4194304] 0 2024-09-12T18:03:17.514 INFO:tasks.workunit.client.0.smithi052.stdout:0/45: rename d2/d8 to d2/d8/d9/de 22 2024-09-12T18:03:17.514 INFO:tasks.workunit.client.0.smithi052.stdout:1/19: write d3/f5 [858345,81097] 0 2024-09-12T18:03:17.515 INFO:tasks.workunit.client.0.smithi052.stdout:0/46: creat d2/d8/d9/ff x:0 0 0 2024-09-12T18:03:17.516 INFO:tasks.workunit.client.0.smithi052.stdout:9/33: creat d0/fb x:0 0 0 2024-09-12T18:03:17.516 INFO:tasks.workunit.client.0.smithi052.stdout:0/47: truncate d2/d6/fb 322052 0 2024-09-12T18:03:17.517 INFO:tasks.workunit.client.0.smithi052.stdout:4/23: fdatasync f5 0 2024-09-12T18:03:17.517 INFO:tasks.workunit.client.0.smithi052.stdout:0/48: creat d2/d6/f10 x:0 0 0 2024-09-12T18:03:17.518 INFO:tasks.workunit.client.0.smithi052.stdout:4/24: unlink l4 0 2024-09-12T18:03:17.518 INFO:tasks.workunit.client.0.smithi052.stdout:9/34: write d0/d6/fa [299027,102974] 0 2024-09-12T18:03:17.519 INFO:tasks.workunit.client.0.smithi052.stdout:4/25: fsync f5 0 2024-09-12T18:03:17.519 INFO:tasks.workunit.client.0.smithi052.stdout:0/49: stat d2/d8/d9 0 2024-09-12T18:03:17.519 INFO:tasks.workunit.client.0.smithi052.stdout:9/35: read - d0/f8 zero size 2024-09-12T18:03:17.520 INFO:tasks.workunit.client.0.smithi052.stdout:4/26: rename c3 to c6 0 2024-09-12T18:03:17.521 INFO:tasks.workunit.client.0.smithi052.stdout:0/50: dread - d2/d6/f10 zero size 2024-09-12T18:03:17.523 INFO:tasks.workunit.client.0.smithi052.stdout:0/51: mkdir d2/d8/d11 0 2024-09-12T18:03:17.526 INFO:tasks.workunit.client.0.smithi052.stdout:6/8: dwrite f1 [0,4194304] 0 2024-09-12T18:03:17.526 INFO:tasks.workunit.client.0.smithi052.stdout:2/13: dwrite f2 [0,4194304] 0 2024-09-12T18:03:17.528 INFO:tasks.workunit.client.0.smithi052.stdout:2/14: write f2 [4134840,23023] 0 2024-09-12T18:03:17.529 INFO:tasks.workunit.client.0.smithi052.stdout:6/9: mknod d2/c3 0 2024-09-12T18:03:17.529 INFO:tasks.workunit.client.0.smithi052.stdout:2/15: symlink l5 0 2024-09-12T18:03:17.530 INFO:tasks.workunit.client.0.smithi052.stdout:6/10: rmdir d2 39 2024-09-12T18:03:17.530 INFO:tasks.workunit.client.0.smithi052.stdout:9/36: dwrite d0/fb [0,4194304] 0 2024-09-12T18:03:17.530 INFO:tasks.workunit.client.0.smithi052.stdout:2/16: write f0 [1505333,9253] 0 2024-09-12T18:03:17.531 INFO:tasks.workunit.client.0.smithi052.stdout:6/11: rmdir d2 39 2024-09-12T18:03:17.532 INFO:tasks.workunit.client.0.smithi052.stdout:9/37: chown d0/l4 29231858 1 2024-09-12T18:03:17.532 INFO:tasks.workunit.client.0.smithi052.stdout:9/38: stat d0/l4 0 2024-09-12T18:03:17.532 INFO:tasks.workunit.client.0.smithi052.stdout:6/12: rename d2/c3 to d2/c4 0 2024-09-12T18:03:17.533 INFO:tasks.workunit.client.0.smithi052.stdout:6/13: creat d2/f5 x:0 0 0 2024-09-12T18:03:17.534 INFO:tasks.workunit.client.0.smithi052.stdout:9/39: creat d0/fc x:0 0 0 2024-09-12T18:03:17.534 INFO:tasks.workunit.client.0.smithi052.stdout:9/40: creat d0/d6/fd x:0 0 0 2024-09-12T18:03:17.535 INFO:tasks.workunit.client.0.smithi052.stdout:9/41: mknod d0/d6/ce 0 2024-09-12T18:03:17.535 INFO:tasks.workunit.client.0.smithi052.stdout:4/27: getdents . 0 2024-09-12T18:03:17.538 INFO:tasks.workunit.client.0.smithi052.stdout:4/28: getdents . 0 2024-09-12T18:03:17.538 INFO:tasks.workunit.client.0.smithi052.stdout:9/42: truncate d0/fc 529483 0 2024-09-12T18:03:17.538 INFO:tasks.workunit.client.0.smithi052.stdout:4/29: chown c0 592 1 2024-09-12T18:03:17.539 INFO:tasks.workunit.client.0.smithi052.stdout:4/30: write f5 [1834937,116341] 0 2024-09-12T18:03:17.546 INFO:tasks.workunit.client.0.smithi052.stdout:4/31: dwrite f5 [0,4194304] 0 2024-09-12T18:03:17.546 INFO:tasks.workunit.client.0.smithi052.stdout:4/32: mknod c7 0 2024-09-12T18:03:17.547 INFO:tasks.workunit.client.0.smithi052.stdout:4/33: creat f8 x:0 0 0 2024-09-12T18:03:17.547 INFO:tasks.workunit.client.0.smithi052.stdout:4/34: dread - f8 zero size 2024-09-12T18:03:17.548 INFO:tasks.workunit.client.0.smithi052.stdout:4/35: rename c0 to c9 0 2024-09-12T18:03:17.548 INFO:tasks.workunit.client.0.smithi052.stdout:4/36: fdatasync f8 0 2024-09-12T18:03:17.548 INFO:tasks.workunit.client.0.smithi052.stdout:4/37: creat fa x:0 0 0 2024-09-12T18:03:17.558 INFO:tasks.workunit.client.0.smithi052.stdout:6/14: fsync f1 0 2024-09-12T18:03:17.559 INFO:tasks.workunit.client.0.smithi052.stdout:6/15: creat d2/f6 x:0 0 0 2024-09-12T18:03:17.559 INFO:tasks.workunit.client.0.smithi052.stdout:6/16: chown d2 228 1 2024-09-12T18:03:17.559 INFO:tasks.workunit.client.0.smithi052.stdout:6/17: creat d2/f7 x:0 0 0 2024-09-12T18:03:17.564 INFO:tasks.workunit.client.0.smithi052.stdout:2/17: dread f0 [0,4194304] 0 2024-09-12T18:03:17.565 INFO:tasks.workunit.client.0.smithi052.stdout:6/18: dwrite d2/f5 [0,4194304] 0 2024-09-12T18:03:17.565 INFO:tasks.workunit.client.0.smithi052.stdout:6/19: chown c0 14243629 1 2024-09-12T18:03:17.567 INFO:tasks.workunit.client.0.smithi052.stdout:6/20: rename f1 to d2/f8 0 2024-09-12T18:03:17.572 INFO:tasks.workunit.client.0.smithi052.stdout:2/18: dwrite f2 [0,4194304] 0 2024-09-12T18:03:17.578 INFO:tasks.workunit.client.0.smithi052.stdout:2/19: creat f6 x:0 0 0 2024-09-12T18:03:17.578 INFO:tasks.workunit.client.0.smithi052.stdout:4/38: link c9 cb 0 2024-09-12T18:03:17.579 INFO:tasks.workunit.client.0.smithi052.stdout:4/39: dread - f8 zero size 2024-09-12T18:03:17.579 INFO:tasks.workunit.client.0.smithi052.stdout:6/21: dwrite d2/f5 [0,4194304] 0 2024-09-12T18:03:17.579 INFO:tasks.workunit.client.0.smithi052.stdout:2/20: creat f7 x:0 0 0 2024-09-12T18:03:17.580 INFO:tasks.workunit.client.0.smithi052.stdout:4/40: write fa [391751,9846] 0 2024-09-12T18:03:17.580 INFO:tasks.workunit.client.0.smithi052.stdout:4/41: symlink lc 0 2024-09-12T18:03:17.580 INFO:tasks.workunit.client.0.smithi052.stdout:2/21: link f6 f8 0 2024-09-12T18:03:17.580 INFO:tasks.workunit.client.0.smithi052.stdout:4/42: creat fd x:0 0 0 2024-09-12T18:03:17.581 INFO:tasks.workunit.client.0.smithi052.stdout:4/43: truncate fd 926106 0 2024-09-12T18:03:17.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/22: mknod c9 0 2024-09-12T18:03:17.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/23: chown f8 0 1 2024-09-12T18:03:17.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/24: rmdir - no directory 2024-09-12T18:03:17.582 INFO:tasks.workunit.client.0.smithi052.stdout:4/44: rename fd to fe 0 2024-09-12T18:03:17.582 INFO:tasks.workunit.client.0.smithi052.stdout:4/45: unlink c6 0 2024-09-12T18:03:17.582 INFO:tasks.workunit.client.0.smithi052.stdout:4/46: mknod cf 0 2024-09-12T18:03:17.583 INFO:tasks.workunit.client.0.smithi052.stdout:4/47: creat f10 x:0 0 0 2024-09-12T18:03:17.584 INFO:tasks.workunit.client.0.smithi052.stdout:4/48: read fe [338505,38727] 0 2024-09-12T18:03:17.585 INFO:tasks.workunit.client.0.smithi052.stdout:4/49: mkdir d11 0 2024-09-12T18:03:17.587 INFO:tasks.workunit.client.0.smithi052.stdout:2/25: dwrite f2 [0,4194304] 0 2024-09-12T18:03:17.594 INFO:tasks.workunit.client.0.smithi052.stdout:6/22: truncate d2/f5 3807336 0 2024-09-12T18:03:17.594 INFO:tasks.workunit.client.0.smithi052.stdout:4/50: truncate f5 1542587 0 2024-09-12T18:03:17.594 INFO:tasks.workunit.client.0.smithi052.stdout:6/23: chown c0 17852898 1 2024-09-12T18:03:17.595 INFO:tasks.workunit.client.0.smithi052.stdout:6/24: creat d2/f9 x:0 0 0 2024-09-12T18:03:17.595 INFO:tasks.workunit.client.0.smithi052.stdout:6/25: write d2/f9 [642196,104688] 0 2024-09-12T18:03:17.596 INFO:tasks.workunit.client.0.smithi052.stdout:6/26: chown d2/f9 88534890 1 2024-09-12T18:03:17.601 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:17.597+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:17.601 INFO:tasks.workunit.client.0.smithi052.stdout:6/27: dwrite d2/f6 [0,4194304] 0 2024-09-12T18:03:17.602 INFO:tasks.workunit.client.0.smithi052.stdout:6/28: read d2/f6 [414741,22948] 0 2024-09-12T18:03:17.602 INFO:tasks.workunit.client.0.smithi052.stdout:6/29: rename d2/f8 to d2/fa 0 2024-09-12T18:03:17.603 INFO:tasks.workunit.client.0.smithi052.stdout:6/30: write d2/fa [3136225,115370] 0 2024-09-12T18:03:17.607 INFO:tasks.workunit.client.0.smithi052.stdout:6/31: write d2/f5 [446093,30717] 0 2024-09-12T18:03:17.611 INFO:tasks.workunit.client.0.smithi052.stdout:6/32: dread d2/fa [0,4194304] 0 2024-09-12T18:03:17.611 INFO:tasks.workunit.client.0.smithi052.stdout:6/33: rename d2/f6 to d2/fb 0 2024-09-12T18:03:17.612 INFO:tasks.workunit.client.0.smithi052.stdout:6/34: rename d2/f9 to d2/fc 0 2024-09-12T18:03:17.612 INFO:tasks.workunit.client.0.smithi052.stdout:6/35: write d2/fb [2084354,55961] 0 2024-09-12T18:03:17.613 INFO:tasks.workunit.client.0.smithi052.stdout:6/36: mkdir d2/dd 0 2024-09-12T18:03:17.614 INFO:tasks.workunit.client.0.smithi052.stdout:6/37: write d2/fa [4133754,64427] 0 2024-09-12T18:03:17.614 INFO:tasks.workunit.client.0.smithi052.stdout:6/38: rmdir d2/dd 0 2024-09-12T18:03:17.618 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:17.618 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:17.618 INFO:tasks.workunit.client.0.smithi052.stdout:4/51: truncate f5 484065 0 2024-09-12T18:03:17.618 INFO:tasks.workunit.client.0.smithi052.stdout:4/52: dread - f10 zero size 2024-09-12T18:03:17.619 INFO:tasks.workunit.client.0.smithi052.stdout:4/53: truncate f8 940380 0 2024-09-12T18:03:17.619 INFO:tasks.workunit.client.0.smithi052.stdout:4/54: dread - f10 zero size 2024-09-12T18:03:17.619 INFO:tasks.workunit.client.0.smithi052.stdout:6/39: dwrite d2/fc [0,4194304] 0 2024-09-12T18:03:17.620 INFO:tasks.workunit.client.0.smithi052.stdout:4/55: symlink d11/l12 0 2024-09-12T18:03:17.620 INFO:tasks.workunit.client.0.smithi052.stdout:6/40: truncate d2/f7 426853 0 2024-09-12T18:03:17.621 INFO:tasks.workunit.client.0.smithi052.stdout:6/41: unlink d2/f5 0 2024-09-12T18:03:17.621 INFO:tasks.workunit.client.0.smithi052.stdout:4/56: dread fe [0,4194304] 0 2024-09-12T18:03:17.622 INFO:tasks.workunit.client.0.smithi052.stdout:4/57: unlink fa 0 2024-09-12T18:03:17.622 INFO:tasks.workunit.client.0.smithi052.stdout:6/42: write d2/fb [3171469,83232] 0 2024-09-12T18:03:17.622 INFO:tasks.workunit.client.0.smithi052.stdout:4/58: write f8 [1870273,61734] 0 2024-09-12T18:03:17.623 INFO:tasks.workunit.client.0.smithi052.stdout:4/59: write f10 [156397,112824] 0 2024-09-12T18:03:17.623 INFO:tasks.workunit.client.0.smithi052.stdout:4/60: creat d11/f13 x:0 0 0 2024-09-12T18:03:17.624 INFO:tasks.workunit.client.0.smithi052.stdout:4/61: rename d11/l12 to d11/l14 0 2024-09-12T18:03:17.632 INFO:tasks.workunit.client.0.smithi052.stdout:4/62: dread f8 [0,4194304] 0 2024-09-12T18:03:17.633 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:17.642 INFO:tasks.workunit.client.0.smithi052.stdout:6/43: fdatasync d2/fc 0 2024-09-12T18:03:17.642 INFO:tasks.workunit.client.0.smithi052.stdout:6/44: creat d2/fe x:0 0 0 2024-09-12T18:03:17.643 INFO:tasks.workunit.client.0.smithi052.stdout:6/45: rmdir d2 39 2024-09-12T18:03:17.643 INFO:tasks.workunit.client.0.smithi052.stdout:6/46: creat d2/ff x:0 0 0 2024-09-12T18:03:17.643 INFO:tasks.workunit.client.0.smithi052.stdout:6/47: chown d2/f7 12089 1 2024-09-12T18:03:17.649 INFO:tasks.workunit.client.0.smithi052.stdout:6/48: dwrite d2/f7 [0,4194304] 0 2024-09-12T18:03:17.651 INFO:tasks.workunit.client.0.smithi052.stdout:6/49: creat d2/f10 x:0 0 0 2024-09-12T18:03:17.652 INFO:tasks.workunit.client.0.smithi052.stdout:6/50: fsync d2/fa 0 2024-09-12T18:03:17.652 INFO:tasks.workunit.client.0.smithi052.stdout:4/63: dwrite f5 [0,4194304] 0 2024-09-12T18:03:17.653 INFO:tasks.workunit.client.0.smithi052.stdout:6/51: mkdir d2/d11 0 2024-09-12T18:03:17.653 INFO:tasks.workunit.client.0.smithi052.stdout:4/64: creat d11/f15 x:0 0 0 2024-09-12T18:03:17.654 INFO:tasks.workunit.client.0.smithi052.stdout:6/52: write d2/ff [53861,38616] 0 2024-09-12T18:03:17.654 INFO:tasks.workunit.client.0.smithi052.stdout:6/53: fsync d2/fb 0 2024-09-12T18:03:17.654 INFO:tasks.workunit.client.0.smithi052.stdout:4/65: creat d11/f16 x:0 0 0 2024-09-12T18:03:17.655 INFO:tasks.workunit.client.0.smithi052.stdout:4/66: readlink d11/l14 0 2024-09-12T18:03:17.655 INFO:tasks.workunit.client.0.smithi052.stdout:4/67: fdatasync fe 0 2024-09-12T18:03:17.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/68: mkdir d11/d17 0 2024-09-12T18:03:17.657 INFO:tasks.workunit.client.0.smithi052.stdout:4/69: write d11/f16 [530840,14836] 0 2024-09-12T18:03:17.658 INFO:tasks.workunit.client.0.smithi052.stdout:4/70: creat d11/d17/f18 x:0 0 0 2024-09-12T18:03:17.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/71: mkdir d11/d17/d19 0 2024-09-12T18:03:17.660 INFO:tasks.workunit.client.0.smithi052.stdout:4/72: write f5 [5235555,115802] 0 2024-09-12T18:03:17.665 INFO:tasks.workunit.client.0.smithi052.stdout:6/54: dwrite d2/f10 [0,4194304] 0 2024-09-12T18:03:17.665 INFO:tasks.workunit.client.0.smithi052.stdout:6/55: symlink d2/d11/l12 0 2024-09-12T18:03:17.665 INFO:tasks.workunit.client.0.smithi052.stdout:6/56: rmdir d2 39 2024-09-12T18:03:17.668 INFO:tasks.workunit.client.0.smithi052.stdout:4/73: dwrite fe [0,4194304] 0 2024-09-12T18:03:17.668 INFO:tasks.workunit.client.0.smithi052.stdout:4/74: stat f8 0 2024-09-12T18:03:17.670 INFO:tasks.workunit.client.0.smithi052.stdout:6/57: dread d2/fa [0,4194304] 0 2024-09-12T18:03:17.670 INFO:tasks.workunit.client.0.smithi052.stdout:6/58: write d2/fe [836019,123561] 0 2024-09-12T18:03:17.670 INFO:tasks.workunit.client.0.smithi052.stdout:4/75: chown cb 1206 1 2024-09-12T18:03:17.677 INFO:tasks.workunit.client.0.smithi052.stdout:6/59: dwrite d2/fa [4194304,4194304] 0 2024-09-12T18:03:17.678 INFO:tasks.workunit.client.0.smithi052.stdout:4/76: dwrite fe [0,4194304] 0 2024-09-12T18:03:17.681 INFO:tasks.workunit.client.0.smithi052.stdout:6/60: symlink d2/l13 0 2024-09-12T18:03:17.681 INFO:tasks.workunit.client.0.smithi052.stdout:4/77: creat d11/f1a x:0 0 0 2024-09-12T18:03:17.681 INFO:tasks.workunit.client.0.smithi052.stdout:4/78: mkdir d11/d17/d1b 0 2024-09-12T18:03:17.682 INFO:tasks.workunit.client.0.smithi052.stdout:4/79: truncate fe 4312746 0 2024-09-12T18:03:17.686 INFO:tasks.workunit.client.0.smithi052.stdout:4/80: dread fe [0,4194304] 0 2024-09-12T18:03:17.687 INFO:tasks.workunit.client.0.smithi052.stdout:4/81: mknod d11/d17/d1b/c1c 0 2024-09-12T18:03:17.687 INFO:tasks.workunit.client.0.smithi052.stdout:6/61: dwrite d2/f7 [4194304,4194304] 0 2024-09-12T18:03:17.688 INFO:tasks.workunit.client.0.smithi052.stdout:4/82: dread fe [4194304,4194304] 0 2024-09-12T18:03:17.688 INFO:tasks.workunit.client.0.smithi052.stdout:6/62: write d2/fc [3479442,11589] 0 2024-09-12T18:03:17.688 INFO:tasks.workunit.client.0.smithi052.stdout:4/83: mknod d11/d17/d19/c1d 0 2024-09-12T18:03:17.688 INFO:tasks.workunit.client.0.smithi052.stdout:6/63: write d2/fa [3763226,112292] 0 2024-09-12T18:03:17.689 INFO:tasks.workunit.client.0.smithi052.stdout:4/84: rename c9 to d11/c1e 0 2024-09-12T18:03:17.689 INFO:tasks.workunit.client.0.smithi052.stdout:6/64: rename d2/f7 to d2/f14 0 2024-09-12T18:03:17.689 INFO:tasks.workunit.client.0.smithi052.stdout:4/85: creat d11/f1f x:0 0 0 2024-09-12T18:03:17.690 INFO:tasks.workunit.client.0.smithi052.stdout:4/86: creat d11/d17/d1b/f20 x:0 0 0 2024-09-12T18:03:17.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/87: rmdir d11/d17/d1b 39 2024-09-12T18:03:17.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/88: stat cf 0 2024-09-12T18:03:17.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/89: write d11/d17/f18 [534434,13607] 0 2024-09-12T18:03:17.692 INFO:tasks.workunit.client.0.smithi052.stdout:6/65: read d2/fe [813868,112149] 0 2024-09-12T18:03:17.692 INFO:tasks.workunit.client.0.smithi052.stdout:4/90: stat c7 0 2024-09-12T18:03:17.692 INFO:tasks.workunit.client.0.smithi052.stdout:4/91: creat d11/f21 x:0 0 0 2024-09-12T18:03:17.692 INFO:tasks.workunit.client.0.smithi052.stdout:4/92: symlink d11/d17/l22 0 2024-09-12T18:03:17.693 INFO:tasks.workunit.client.0.smithi052.stdout:4/93: write f10 [454477,75623] 0 2024-09-12T18:03:17.694 INFO:tasks.workunit.client.0.smithi052.stdout:4/94: chown f8 8 1 2024-09-12T18:03:17.694 INFO:tasks.workunit.client.0.smithi052.stdout:4/95: write d11/f13 [529832,126813] 0 2024-09-12T18:03:17.698 INFO:tasks.workunit.client.0.smithi052.stdout:6/66: dwrite d2/fe [0,4194304] 0 2024-09-12T18:03:17.702 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:17.699+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:17.792 INFO:tasks.workunit.client.0.smithi052.stdout:6/67: truncate d2/fc 982211 0 2024-09-12T18:03:17.793 INFO:tasks.workunit.client.0.smithi052.stdout:6/68: mkdir d2/d15 0 2024-09-12T18:03:17.800 INFO:tasks.workunit.client.0.smithi052.stdout:6/69: dread d2/f14 [0,4194304] 0 2024-09-12T18:03:17.802 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:17.802 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:17.803 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:17.799+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:17.810 INFO:tasks.workunit.client.0.smithi052.stdout:6/70: dwrite d2/fa [0,4194304] 0 2024-09-12T18:03:17.811 INFO:tasks.workunit.client.0.smithi052.stdout:6/71: unlink d2/fe 0 2024-09-12T18:03:17.812 INFO:tasks.workunit.client.0.smithi052.stdout:6/72: creat d2/d11/f16 x:0 0 0 2024-09-12T18:03:17.813 INFO:tasks.workunit.client.0.smithi052.stdout:6/73: creat d2/d11/f17 x:0 0 0 2024-09-12T18:03:17.814 INFO:tasks.workunit.client.0.smithi052.stdout:6/74: rmdir d2/d11 39 2024-09-12T18:03:17.816 INFO:tasks.workunit.client.0.smithi052.stdout:6/75: mknod d2/c18 0 2024-09-12T18:03:17.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:17.818 INFO:tasks.workunit.client.0.smithi052.stdout:6/76: creat d2/f19 x:0 0 0 2024-09-12T18:03:17.824 INFO:tasks.workunit.client.0.smithi052.stdout:6/77: dread d2/fc [0,4194304] 0 2024-09-12T18:03:17.825 INFO:tasks.workunit.client.0.smithi052.stdout:6/78: mkdir d2/d15/d1a 0 2024-09-12T18:03:17.827 INFO:tasks.workunit.client.0.smithi052.stdout:6/79: creat d2/d15/d1a/f1b x:0 0 0 2024-09-12T18:03:17.827 INFO:tasks.workunit.client.0.smithi052.stdout:6/80: stat d2/f10 0 2024-09-12T18:03:17.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/81: getdents d2/d15 0 2024-09-12T18:03:17.834 INFO:tasks.workunit.client.0.smithi052.stdout:6/82: chown d2/fb 438637 1 2024-09-12T18:03:17.836 INFO:tasks.workunit.client.0.smithi052.stdout:6/83: getdents d2/d11 0 2024-09-12T18:03:17.837 INFO:tasks.workunit.client.0.smithi052.stdout:6/84: write d2/fa [9269282,82050] 0 2024-09-12T18:03:17.839 INFO:tasks.workunit.client.0.smithi052.stdout:6/85: creat d2/d15/f1c x:0 0 0 2024-09-12T18:03:17.840 INFO:tasks.workunit.client.0.smithi052.stdout:6/86: truncate d2/d15/f1c 570832 0 2024-09-12T18:03:17.841 INFO:tasks.workunit.client.0.smithi052.stdout:6/87: rename d2/f14 to d2/d15/f1d 0 2024-09-12T18:03:17.842 INFO:tasks.workunit.client.0.smithi052.stdout:6/88: chown d2/d15/f1c 3 1 2024-09-12T18:03:17.844 INFO:tasks.workunit.client.0.smithi052.stdout:6/89: mkdir d2/d1e 0 2024-09-12T18:03:17.844 INFO:tasks.workunit.client.0.smithi052.stdout:6/90: chown d2/d11 110029 1 2024-09-12T18:03:17.845 INFO:tasks.workunit.client.0.smithi052.stdout:6/91: readlink d2/l13 0 2024-09-12T18:03:17.845 INFO:tasks.workunit.client.0.smithi052.stdout:6/92: fdatasync d2/f19 0 2024-09-12T18:03:17.904 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:17.901+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:17.986 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:17.987 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:18.001 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:18.005 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:18.004+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:18.107 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:18.103+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:18.118 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:18.119 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:18.133 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:18.208 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:18.203+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:18.266 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:18.266 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:18.281 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:18.309 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:18.307+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:18.403 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:18.403 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:18.410 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:18.409+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:18.417 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:18.511 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:18.511+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:18.540 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:18.540 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:18.555 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:18.612 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:18.609+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:18.671 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:03:18.671 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:03:18.672 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T18:03:18.672 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:03:18.672 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:03:18.672 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T18:03:18.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:03:18.685 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:18.685 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:18.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:18.722 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:18.719+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:18.804 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:18.804 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "" 2024-09-12T18:03:18.805 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:18.813 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:18.807+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:18.864 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:18.864 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:18.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:18.923 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:18.921+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:19.000 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:19.000 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:19.014 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:19.015 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:19.009+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:19.115 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:19.112+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:19.141 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:19.141 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:19.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:19.216 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:19.212+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:19.271 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:19.271 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:19.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:19.316 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:19.312+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:19.403 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:19.403 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:19.417 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:19.411+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:19.418 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:19.430 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:19.518 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:19.516+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:19.550 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:19.551 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:19.566 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:19.590 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:19.591 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:19.598 INFO:tasks.workunit.client.0.smithi052.stdout:5/11: sync 2024-09-12T18:03:19.599 INFO:tasks.workunit.client.0.smithi052.stdout:5/12: creat f0 x:0 0 0 2024-09-12T18:03:19.611 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:19.612 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:19.618 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:19.613+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:19.632 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:9/43: sync 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:2/26: sync 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:1/20: sync 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:8/8: sync 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:0/52: sync 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:6/93: sync 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:3/22: sync 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:3/23: dwrite - no filename 2024-09-12T18:03:19.654 INFO:tasks.workunit.client.0.smithi052.stdout:3/24: truncate - no filename 2024-09-12T18:03:19.655 INFO:tasks.workunit.client.0.smithi052.stdout:3/25: fsync - no filename 2024-09-12T18:03:19.655 INFO:tasks.workunit.client.0.smithi052.stdout:3/26: read - no filename 2024-09-12T18:03:19.655 INFO:tasks.workunit.client.0.smithi052.stdout:4/96: sync 2024-09-12T18:03:19.655 INFO:tasks.workunit.client.0.smithi052.stdout:7/0: sync 2024-09-12T18:03:19.655 INFO:tasks.workunit.client.0.smithi052.stdout:4/97: readlink lc 0 2024-09-12T18:03:19.656 INFO:tasks.workunit.client.0.smithi052.stdout:2/27: fdatasync f2 0 2024-09-12T18:03:19.656 INFO:tasks.workunit.client.0.smithi052.stdout:8/9: creat f1 x:0 0 0 2024-09-12T18:03:19.656 INFO:tasks.workunit.client.0.smithi052.stdout:0/53: write d2/fc [449415,12401] 0 2024-09-12T18:03:19.656 INFO:tasks.workunit.client.0.smithi052.stdout:2/28: dread - f8 zero size 2024-09-12T18:03:19.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/1: creat f0 x:0 0 0 2024-09-12T18:03:19.657 INFO:tasks.workunit.client.0.smithi052.stdout:9/44: mknod d0/cf 0 2024-09-12T18:03:19.657 INFO:tasks.workunit.client.0.smithi052.stdout:6/94: write d2/d15/f1d [5407869,74821] 0 2024-09-12T18:03:19.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/27: mkdir d0/d4/d5/d6/d7 0 2024-09-12T18:03:19.657 INFO:tasks.workunit.client.0.smithi052.stdout:0/54: unlink d2/fc 0 2024-09-12T18:03:19.658 INFO:tasks.workunit.client.0.smithi052.stdout:8/10: creat f2 x:0 0 0 2024-09-12T18:03:19.658 INFO:tasks.workunit.client.0.smithi052.stdout:2/29: mkdir da 0 2024-09-12T18:03:19.658 INFO:tasks.workunit.client.0.smithi052.stdout:4/98: mkdir d11/d17/d23 0 2024-09-12T18:03:19.658 INFO:tasks.workunit.client.0.smithi052.stdout:3/28: chown d0/d4/d5 17972675 1 2024-09-12T18:03:19.658 INFO:tasks.workunit.client.0.smithi052.stdout:2/30: dread - f7 zero size 2024-09-12T18:03:19.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/99: chown lc 120099 1 2024-09-12T18:03:19.659 INFO:tasks.workunit.client.0.smithi052.stdout:6/95: creat d2/d15/d1a/f1f x:0 0 0 2024-09-12T18:03:19.659 INFO:tasks.workunit.client.0.smithi052.stdout:6/96: fsync d2/fb 0 2024-09-12T18:03:19.659 INFO:tasks.workunit.client.0.smithi052.stdout:2/31: creat da/fb x:0 0 0 2024-09-12T18:03:19.660 INFO:tasks.workunit.client.0.smithi052.stdout:4/100: mkdir d11/d17/d1b/d24 0 2024-09-12T18:03:19.660 INFO:tasks.workunit.client.0.smithi052.stdout:2/32: write f7 [850544,68359] 0 2024-09-12T18:03:19.660 INFO:tasks.workunit.client.0.smithi052.stdout:1/21: dread d3/f4 [0,4194304] 0 2024-09-12T18:03:19.661 INFO:tasks.workunit.client.0.smithi052.stdout:2/33: fdatasync f2 0 2024-09-12T18:03:19.661 INFO:tasks.workunit.client.0.smithi052.stdout:6/97: write d2/fc [491911,61195] 0 2024-09-12T18:03:19.661 INFO:tasks.workunit.client.0.smithi052.stdout:4/101: creat d11/f25 x:0 0 0 2024-09-12T18:03:19.661 INFO:tasks.workunit.client.0.smithi052.stdout:4/102: symlink d11/d17/d19/l26 0 2024-09-12T18:03:19.662 INFO:tasks.workunit.client.0.smithi052.stdout:6/98: creat d2/d1e/f20 x:0 0 0 2024-09-12T18:03:19.662 INFO:tasks.workunit.client.0.smithi052.stdout:4/103: fdatasync d11/f25 0 2024-09-12T18:03:19.663 INFO:tasks.workunit.client.0.smithi052.stdout:4/104: rename d11/f1a to d11/d17/d23/f27 0 2024-09-12T18:03:19.663 INFO:tasks.workunit.client.0.smithi052.stdout:4/105: fdatasync d11/d17/f18 0 2024-09-12T18:03:19.668 INFO:tasks.workunit.client.0.smithi052.stdout:2/34: dwrite f0 [0,4194304] 0 2024-09-12T18:03:19.669 INFO:tasks.workunit.client.0.smithi052.stdout:2/35: chown f8 1243683 1 2024-09-12T18:03:19.669 INFO:tasks.workunit.client.0.smithi052.stdout:6/99: dwrite d2/d15/f1d [4194304,4194304] 0 2024-09-12T18:03:19.670 INFO:tasks.workunit.client.0.smithi052.stdout:2/36: dread - f3 zero size 2024-09-12T18:03:19.670 INFO:tasks.workunit.client.0.smithi052.stdout:2/37: mkdir da/dc 0 2024-09-12T18:03:19.670 INFO:tasks.workunit.client.0.smithi052.stdout:6/100: mkdir d2/d21 0 2024-09-12T18:03:19.671 INFO:tasks.workunit.client.0.smithi052.stdout:4/106: dwrite d11/f15 [0,4194304] 0 2024-09-12T18:03:19.671 INFO:tasks.workunit.client.0.smithi052.stdout:6/101: write d2/fc [1628620,113820] 0 2024-09-12T18:03:19.673 INFO:tasks.workunit.client.0.smithi052.stdout:6/102: write d2/d11/f17 [435387,103459] 0 2024-09-12T18:03:19.674 INFO:tasks.workunit.client.0.smithi052.stdout:4/107: mknod d11/d17/c28 0 2024-09-12T18:03:19.674 INFO:tasks.workunit.client.0.smithi052.stdout:6/103: creat d2/d15/f22 x:0 0 0 2024-09-12T18:03:19.674 INFO:tasks.workunit.client.0.smithi052.stdout:6/104: chown d2/fc 1452 1 2024-09-12T18:03:19.675 INFO:tasks.workunit.client.0.smithi052.stdout:6/105: write d2/d15/d1a/f1b [719513,89443] 0 2024-09-12T18:03:19.676 INFO:tasks.workunit.client.0.smithi052.stdout:6/106: creat d2/d15/f23 x:0 0 0 2024-09-12T18:03:19.678 INFO:tasks.workunit.client.0.smithi052.stdout:6/107: rmdir d2/d15/d1a 39 2024-09-12T18:03:19.679 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:03:19.684 INFO:tasks.workunit.client.0.smithi052.stdout:6/108: dwrite d2/f10 [0,4194304] 0 2024-09-12T18:03:19.685 INFO:tasks.workunit.client.0.smithi052.stdout:6/109: truncate d2/d15/f23 548916 0 2024-09-12T18:03:19.686 INFO:tasks.workunit.client.0.smithi052.stdout:6/110: rename d2/d15/f1c to d2/d21/f24 0 2024-09-12T18:03:19.687 INFO:tasks.workunit.client.0.smithi052.stdout:6/111: truncate d2/fa 9764162 0 2024-09-12T18:03:19.688 INFO:tasks.workunit.client.0.smithi052.stdout:6/112: creat d2/d15/f25 x:0 0 0 2024-09-12T18:03:19.688 INFO:tasks.workunit.client.0.smithi052.stdout:6/113: read - d2/f19 zero size 2024-09-12T18:03:19.689 INFO:tasks.workunit.client.0.smithi052.stdout:6/114: mkdir d2/d11/d26 0 2024-09-12T18:03:19.689 INFO:tasks.workunit.client.0.smithi052.stdout:6/115: chown d2/f19 2524888 1 2024-09-12T18:03:19.690 INFO:tasks.workunit.client.0.smithi052.stdout:6/116: chown d2/d15/d1a/f1b 2355 1 2024-09-12T18:03:19.691 INFO:tasks.workunit.client.0.smithi052.stdout:6/117: mknod d2/d11/d26/c27 0 2024-09-12T18:03:19.692 INFO:tasks.workunit.client.0.smithi052.stdout:6/118: write d2/ff [1043167,29156] 0 2024-09-12T18:03:19.692 INFO:tasks.workunit.client.0.smithi052.stdout:6/119: chown d2/d1e 535 1 2024-09-12T18:03:19.692 INFO:tasks.workunit.client.0.smithi052.stdout:6/120: creat d2/d11/d26/f28 x:0 0 0 2024-09-12T18:03:19.693 INFO:tasks.workunit.client.0.smithi052.stdout:6/121: write d2/d15/f22 [10836,63409] 0 2024-09-12T18:03:19.694 INFO:tasks.workunit.client.0.smithi052.stdout:6/122: symlink d2/d21/l29 0 2024-09-12T18:03:19.716 INFO:tasks.workunit.client.0.smithi052.stdout:6/123: dread d2/d15/f22 [0,4194304] 0 2024-09-12T18:03:19.718 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:19.715+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:19.719 INFO:tasks.workunit.client.0.smithi052.stdout:8/11: fsync f2 0 2024-09-12T18:03:19.719 INFO:tasks.workunit.client.0.smithi052.stdout:2/38: truncate f6 669742 0 2024-09-12T18:03:19.719 INFO:tasks.workunit.client.0.smithi052.stdout:1/22: truncate d3/f5 134283 0 2024-09-12T18:03:19.720 INFO:tasks.workunit.client.0.smithi052.stdout:6/124: stat d2/c4 0 2024-09-12T18:03:19.720 INFO:tasks.workunit.client.0.smithi052.stdout:8/12: truncate f1 985322 0 2024-09-12T18:03:19.720 INFO:tasks.workunit.client.0.smithi052.stdout:2/39: mkdir da/dc/dd 0 2024-09-12T18:03:19.720 INFO:tasks.workunit.client.0.smithi052.stdout:8/13: rename f1 to f3 0 2024-09-12T18:03:19.721 INFO:tasks.workunit.client.0.smithi052.stdout:8/14: symlink l4 0 2024-09-12T18:03:19.721 INFO:tasks.workunit.client.0.smithi052.stdout:6/125: getdents d2 0 2024-09-12T18:03:19.721 INFO:tasks.workunit.client.0.smithi052.stdout:2/40: rename f2 to da/dc/dd/fe 0 2024-09-12T18:03:19.722 INFO:tasks.workunit.client.0.smithi052.stdout:8/15: rename l0 to l5 0 2024-09-12T18:03:19.722 INFO:tasks.workunit.client.0.smithi052.stdout:6/126: creat d2/d21/f2a x:0 0 0 2024-09-12T18:03:19.722 INFO:tasks.workunit.client.0.smithi052.stdout:2/41: mknod da/cf 0 2024-09-12T18:03:19.722 INFO:tasks.workunit.client.0.smithi052.stdout:8/16: mknod c6 0 2024-09-12T18:03:19.722 INFO:tasks.workunit.client.0.smithi052.stdout:6/127: stat d2/d1e/f20 0 2024-09-12T18:03:19.722 INFO:tasks.workunit.client.0.smithi052.stdout:6/128: creat d2/f2b x:0 0 0 2024-09-12T18:03:19.724 INFO:tasks.workunit.client.0.smithi052.stdout:8/17: dread f3 [0,4194304] 0 2024-09-12T18:03:19.724 INFO:tasks.workunit.client.0.smithi052.stdout:8/18: rmdir - no directory 2024-09-12T18:03:19.726 INFO:tasks.workunit.client.0.smithi052.stdout:8/19: fsync f3 0 2024-09-12T18:03:19.726 INFO:tasks.workunit.client.0.smithi052.stdout:8/20: truncate f2 129 0 2024-09-12T18:03:19.728 INFO:tasks.workunit.client.0.smithi052.stdout:8/21: chown l5 86228418 1 2024-09-12T18:03:19.728 INFO:tasks.workunit.client.0.smithi052.stdout:8/22: truncate f2 135918 0 2024-09-12T18:03:19.728 INFO:tasks.workunit.client.0.smithi052.stdout:6/129: chown d2 4876217 1 2024-09-12T18:03:19.729 INFO:tasks.workunit.client.0.smithi052.stdout:6/130: stat d2/ff 0 2024-09-12T18:03:19.729 INFO:tasks.workunit.client.0.smithi052.stdout:8/23: dread f2 [0,4194304] 0 2024-09-12T18:03:19.730 INFO:tasks.workunit.client.0.smithi052.stdout:6/131: write d2/f19 [727699,129272] 0 2024-09-12T18:03:19.730 INFO:tasks.workunit.client.0.smithi052.stdout:8/24: rename f2 to f7 0 2024-09-12T18:03:19.731 INFO:tasks.workunit.client.0.smithi052.stdout:8/25: write f3 [890012,5318] 0 2024-09-12T18:03:19.731 INFO:tasks.workunit.client.0.smithi052.stdout:6/132: chown d2/d15/d1a/f1b 159 1 2024-09-12T18:03:19.732 INFO:tasks.workunit.client.0.smithi052.stdout:1/23: dread d3/f5 [0,4194304] 0 2024-09-12T18:03:19.733 INFO:tasks.workunit.client.0.smithi052.stdout:6/133: creat d2/d15/f2c x:0 0 0 2024-09-12T18:03:19.733 INFO:tasks.workunit.client.0.smithi052.stdout:1/24: mkdir d3/d6 0 2024-09-12T18:03:19.734 INFO:tasks.workunit.client.0.smithi052.stdout:1/25: fdatasync d3/f5 0 2024-09-12T18:03:19.734 INFO:tasks.workunit.client.0.smithi052.stdout:1/26: stat d3/f5 0 2024-09-12T18:03:19.735 INFO:tasks.workunit.client.0.smithi052.stdout:1/27: symlink d3/l7 0 2024-09-12T18:03:19.735 INFO:tasks.workunit.client.0.smithi052.stdout:6/134: link d2/d1e/f20 d2/d11/d26/f2d 0 2024-09-12T18:03:19.735 INFO:tasks.workunit.client.0.smithi052.stdout:2/42: dwrite f8 [0,4194304] 0 2024-09-12T18:03:19.736 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:19.737 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:19.737 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:19.737 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:19.737 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:19.737 INFO:tasks.workunit.client.0.smithi052.stdout:2/43: rename f7 to da/f10 0 2024-09-12T18:03:19.738 INFO:tasks.workunit.client.0.smithi052.stdout:1/28: rmdir d3/d6 0 2024-09-12T18:03:19.738 INFO:tasks.workunit.client.0.smithi052.stdout:6/135: getdents d2/d21 0 2024-09-12T18:03:19.738 INFO:tasks.workunit.client.0.smithi052.stdout:2/44: truncate f3 603177 0 2024-09-12T18:03:19.739 INFO:tasks.workunit.client.0.smithi052.stdout:8/26: truncate f7 73161 0 2024-09-12T18:03:19.739 INFO:tasks.workunit.client.0.smithi052.stdout:1/29: write d3/f4 [1540923,19588] 0 2024-09-12T18:03:19.740 INFO:tasks.workunit.client.0.smithi052.stdout:1/30: dread d3/f5 [0,4194304] 0 2024-09-12T18:03:19.740 INFO:tasks.workunit.client.0.smithi052.stdout:8/27: link l4 l8 0 2024-09-12T18:03:19.740 INFO:tasks.workunit.client.0.smithi052.stdout:8/28: chown l5 66 1 2024-09-12T18:03:19.741 INFO:tasks.workunit.client.0.smithi052.stdout:1/31: write d3/f5 [110042,54601] 0 2024-09-12T18:03:19.741 INFO:tasks.workunit.client.0.smithi052.stdout:6/136: dread d2/d15/f23 [0,4194304] 0 2024-09-12T18:03:19.741 INFO:tasks.workunit.client.0.smithi052.stdout:8/29: write f3 [393209,42744] 0 2024-09-12T18:03:19.742 INFO:tasks.workunit.client.0.smithi052.stdout:8/30: chown c6 74 1 2024-09-12T18:03:19.742 INFO:tasks.workunit.client.0.smithi052.stdout:6/137: unlink d2/d15/d1a/f1b 0 2024-09-12T18:03:19.742 INFO:tasks.workunit.client.0.smithi052.stdout:8/31: rename f3 to f9 0 2024-09-12T18:03:19.742 INFO:tasks.workunit.client.0.smithi052.stdout:6/138: symlink d2/d11/l2e 0 2024-09-12T18:03:19.743 INFO:tasks.workunit.client.0.smithi052.stdout:8/32: chown l8 3244 1 2024-09-12T18:03:19.743 INFO:tasks.workunit.client.0.smithi052.stdout:8/33: mknod ca 0 2024-09-12T18:03:19.744 INFO:tasks.workunit.client.0.smithi052.stdout:8/34: creat fb x:0 0 0 2024-09-12T18:03:19.746 INFO:tasks.workunit.client.0.smithi052.stdout:2/45: unlink da/f10 0 2024-09-12T18:03:19.746 INFO:tasks.workunit.client.0.smithi052.stdout:8/35: dread f9 [0,4194304] 0 2024-09-12T18:03:19.746 INFO:tasks.workunit.client.0.smithi052.stdout:8/36: rmdir - no directory 2024-09-12T18:03:19.747 INFO:tasks.workunit.client.0.smithi052.stdout:2/46: mknod da/c11 0 2024-09-12T18:03:19.749 INFO:tasks.workunit.client.0.smithi052.stdout:1/32: dwrite d3/f4 [0,4194304] 0 2024-09-12T18:03:19.751 INFO:tasks.workunit.client.0.smithi052.stdout:6/139: dwrite d2/f19 [0,4194304] 0 2024-09-12T18:03:19.751 INFO:tasks.workunit.client.0.smithi052.stdout:1/33: write d3/f4 [3137383,14782] 0 2024-09-12T18:03:19.754 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:19.754 INFO:tasks.workunit.client.0.smithi052.stdout:6/140: rename d2/c4 to d2/d1e/c2f 0 2024-09-12T18:03:19.755 INFO:tasks.workunit.client.0.smithi052.stdout:8/37: dwrite fb [0,4194304] 0 2024-09-12T18:03:19.755 INFO:tasks.workunit.client.0.smithi052.stdout:8/38: rmdir - no directory 2024-09-12T18:03:19.756 INFO:tasks.workunit.client.0.smithi052.stdout:8/39: creat fc x:0 0 0 2024-09-12T18:03:19.761 INFO:tasks.workunit.client.0.smithi052.stdout:1/34: dwrite d3/f5 [0,4194304] 0 2024-09-12T18:03:19.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/35: rename d3/f4 to d3/f8 0 2024-09-12T18:03:19.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/36: truncate d3/f5 4817045 0 2024-09-12T18:03:19.765 INFO:tasks.workunit.client.0.smithi052.stdout:8/40: dread f7 [0,4194304] 0 2024-09-12T18:03:19.766 INFO:tasks.workunit.client.0.smithi052.stdout:8/41: write fc [1028968,1561] 0 2024-09-12T18:03:19.766 INFO:tasks.workunit.client.0.smithi052.stdout:6/141: creat d2/d15/f30 x:0 0 0 2024-09-12T18:03:19.766 INFO:tasks.workunit.client.0.smithi052.stdout:1/37: dread d3/f5 [0,4194304] 0 2024-09-12T18:03:19.767 INFO:tasks.workunit.client.0.smithi052.stdout:6/142: chown d2/d11/l2e 120443 1 2024-09-12T18:03:19.767 INFO:tasks.workunit.client.0.smithi052.stdout:1/38: rename l2 to d3/l9 0 2024-09-12T18:03:19.767 INFO:tasks.workunit.client.0.smithi052.stdout:6/143: creat d2/d11/f31 x:0 0 0 2024-09-12T18:03:19.768 INFO:tasks.workunit.client.0.smithi052.stdout:6/144: chown d2/d15/f2c 15433912 1 2024-09-12T18:03:19.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/145: truncate d2/d15/f22 687332 0 2024-09-12T18:03:19.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/146: readlink d2/d11/l2e 0 2024-09-12T18:03:19.770 INFO:tasks.workunit.client.0.smithi052.stdout:1/39: dread d3/f5 [0,4194304] 0 2024-09-12T18:03:19.771 INFO:tasks.workunit.client.0.smithi052.stdout:6/147: mknod d2/d15/c32 0 2024-09-12T18:03:19.771 INFO:tasks.workunit.client.0.smithi052.stdout:1/40: chown d3 10 1 2024-09-12T18:03:19.771 INFO:tasks.workunit.client.0.smithi052.stdout:6/148: rmdir d2/d1e 39 2024-09-12T18:03:19.772 INFO:tasks.workunit.client.0.smithi052.stdout:6/149: stat d2/d21/f24 0 2024-09-12T18:03:19.773 INFO:tasks.workunit.client.0.smithi052.stdout:6/150: truncate d2/d21/f24 581764 0 2024-09-12T18:03:19.773 INFO:tasks.workunit.client.0.smithi052.stdout:6/151: chown d2/f2b 15752 1 2024-09-12T18:03:19.774 INFO:tasks.workunit.client.0.smithi052.stdout:6/152: rmdir d2 39 2024-09-12T18:03:19.775 INFO:tasks.workunit.client.0.smithi052.stdout:1/41: dread d3/f8 [0,4194304] 0 2024-09-12T18:03:19.775 INFO:tasks.workunit.client.0.smithi052.stdout:1/42: rename d3/f5 to d3/fa 0 2024-09-12T18:03:19.776 INFO:tasks.workunit.client.0.smithi052.stdout:1/43: symlink d3/lb 0 2024-09-12T18:03:19.776 INFO:tasks.workunit.client.0.smithi052.stdout:8/42: write f7 [808596,89230] 0 2024-09-12T18:03:19.777 INFO:tasks.workunit.client.0.smithi052.stdout:1/44: creat d3/fc x:0 0 0 2024-09-12T18:03:19.777 INFO:tasks.workunit.client.0.smithi052.stdout:1/45: rmdir d3 39 2024-09-12T18:03:19.778 INFO:tasks.workunit.client.0.smithi052.stdout:1/46: rename l1 to d3/ld 0 2024-09-12T18:03:19.785 INFO:tasks.workunit.client.0.smithi052.stdout:1/47: dwrite d3/fc [0,4194304] 0 2024-09-12T18:03:19.786 INFO:tasks.workunit.client.0.smithi052.stdout:6/153: dread d2/ff [0,4194304] 0 2024-09-12T18:03:19.786 INFO:tasks.workunit.client.0.smithi052.stdout:1/48: write d3/fc [1791222,85111] 0 2024-09-12T18:03:19.786 INFO:tasks.workunit.client.0.smithi052.stdout:6/154: mknod d2/c33 0 2024-09-12T18:03:19.787 INFO:tasks.workunit.client.0.smithi052.stdout:6/155: read - d2/d11/d26/f2d zero size 2024-09-12T18:03:19.789 INFO:tasks.workunit.client.0.smithi052.stdout:6/156: rename d2/d1e/c2f to d2/c34 0 2024-09-12T18:03:19.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/157: rename d2/d21/f24 to d2/d1e/f35 0 2024-09-12T18:03:19.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/158: dread - d2/d11/f31 zero size 2024-09-12T18:03:19.791 INFO:tasks.workunit.client.0.smithi052.stdout:6/159: creat d2/d11/d26/f36 x:0 0 0 2024-09-12T18:03:19.792 INFO:tasks.workunit.client.0.smithi052.stdout:6/160: rename d2/d15/c32 to d2/d1e/c37 0 2024-09-12T18:03:19.793 INFO:tasks.workunit.client.0.smithi052.stdout:6/161: symlink d2/d21/l38 0 2024-09-12T18:03:19.793 INFO:tasks.workunit.client.0.smithi052.stdout:6/162: mknod d2/d1e/c39 0 2024-09-12T18:03:19.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/49: write d3/fc [4390074,44745] 0 2024-09-12T18:03:19.794 INFO:tasks.workunit.client.0.smithi052.stdout:6/163: rename d2/d11/f16 to d2/f3a 0 2024-09-12T18:03:19.795 INFO:tasks.workunit.client.0.smithi052.stdout:6/164: rename d2/d15 to d2/d15/d3b 22 2024-09-12T18:03:19.795 INFO:tasks.workunit.client.0.smithi052.stdout:6/165: dread - d2/d15/f2c zero size 2024-09-12T18:03:19.797 INFO:tasks.workunit.client.0.smithi052.stdout:1/50: dread d3/fa [0,4194304] 0 2024-09-12T18:03:19.799 INFO:tasks.workunit.client.0.smithi052.stdout:8/43: dread f7 [0,4194304] 0 2024-09-12T18:03:19.799 INFO:tasks.workunit.client.0.smithi052.stdout:8/44: mknod cd 0 2024-09-12T18:03:19.801 INFO:tasks.workunit.client.0.smithi052.stdout:1/51: fsync d3/fa 0 2024-09-12T18:03:19.801 INFO:tasks.workunit.client.0.smithi052.stdout:1/52: rename d3/l7 to d3/le 0 2024-09-12T18:03:19.804 INFO:tasks.workunit.client.0.smithi052.stdout:8/45: getdents . 0 2024-09-12T18:03:19.804 INFO:tasks.workunit.client.0.smithi052.stdout:8/46: mknod ce 0 2024-09-12T18:03:19.805 INFO:tasks.workunit.client.0.smithi052.stdout:8/47: rename f9 to ff 0 2024-09-12T18:03:19.806 INFO:tasks.workunit.client.0.smithi052.stdout:8/48: link l4 l10 0 2024-09-12T18:03:19.809 INFO:tasks.workunit.client.0.smithi052.stdout:1/53: dwrite d3/f8 [4194304,4194304] 0 2024-09-12T18:03:19.810 INFO:tasks.workunit.client.0.smithi052.stdout:1/54: stat d3/f8 0 2024-09-12T18:03:19.812 INFO:tasks.workunit.client.0.smithi052.stdout:1/55: creat d3/ff x:0 0 0 2024-09-12T18:03:19.814 INFO:tasks.workunit.client.0.smithi052.stdout:8/49: dread fc [0,4194304] 0 2024-09-12T18:03:19.814 INFO:tasks.workunit.client.0.smithi052.stdout:8/50: chown l5 57 1 2024-09-12T18:03:19.815 INFO:tasks.workunit.client.0.smithi052.stdout:8/51: chown ca 6383695 1 2024-09-12T18:03:19.815 INFO:tasks.workunit.client.0.smithi052.stdout:8/52: creat f11 x:0 0 0 2024-09-12T18:03:19.816 INFO:tasks.workunit.client.0.smithi052.stdout:1/56: dread d3/f8 [0,4194304] 0 2024-09-12T18:03:19.816 INFO:tasks.workunit.client.0.smithi052.stdout:8/53: symlink l12 0 2024-09-12T18:03:19.817 INFO:tasks.workunit.client.0.smithi052.stdout:8/54: truncate f11 616650 0 2024-09-12T18:03:19.817 INFO:tasks.workunit.client.0.smithi052.stdout:8/55: mkdir d13 0 2024-09-12T18:03:19.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/57: truncate d3/fa 3491360 0 2024-09-12T18:03:19.818 INFO:tasks.workunit.client.0.smithi052.stdout:8/56: mknod d13/c14 0 2024-09-12T18:03:19.819 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:19.817+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:19.825 INFO:tasks.workunit.client.0.smithi052.stdout:8/57: dwrite f7 [0,4194304] 0 2024-09-12T18:03:19.825 INFO:tasks.workunit.client.0.smithi052.stdout:8/58: read f7 [2537613,107568] 0 2024-09-12T18:03:19.826 INFO:tasks.workunit.client.0.smithi052.stdout:8/59: write ff [874465,2498] 0 2024-09-12T18:03:19.826 INFO:tasks.workunit.client.0.smithi052.stdout:8/60: readlink l8 0 2024-09-12T18:03:19.827 INFO:tasks.workunit.client.0.smithi052.stdout:8/61: read ff [102810,72605] 0 2024-09-12T18:03:19.827 INFO:tasks.workunit.client.0.smithi052.stdout:8/62: symlink d13/l15 0 2024-09-12T18:03:19.828 INFO:tasks.workunit.client.0.smithi052.stdout:8/63: mknod d13/c16 0 2024-09-12T18:03:19.834 INFO:tasks.workunit.client.0.smithi052.stdout:8/64: dwrite fb [0,4194304] 0 2024-09-12T18:03:19.838 INFO:tasks.workunit.client.0.smithi052.stdout:8/65: dread fb [0,4194304] 0 2024-09-12T18:03:19.839 INFO:tasks.workunit.client.0.smithi052.stdout:8/66: write fb [1219464,11045] 0 2024-09-12T18:03:19.845 INFO:tasks.workunit.client.0.smithi052.stdout:8/67: dwrite f7 [0,4194304] 0 2024-09-12T18:03:19.847 INFO:tasks.workunit.client.0.smithi052.stdout:8/68: dread fc [0,4194304] 0 2024-09-12T18:03:19.847 INFO:tasks.workunit.client.0.smithi052.stdout:8/69: stat ff 0 2024-09-12T18:03:19.848 INFO:tasks.workunit.client.0.smithi052.stdout:8/70: creat d13/f17 x:0 0 0 2024-09-12T18:03:19.848 INFO:tasks.workunit.client.0.smithi052.stdout:8/71: mkdir d13/d18 0 2024-09-12T18:03:19.851 INFO:tasks.workunit.client.0.smithi052.stdout:8/72: dread ff [0,4194304] 0 2024-09-12T18:03:19.852 INFO:tasks.workunit.client.0.smithi052.stdout:8/73: readlink l8 0 2024-09-12T18:03:19.852 INFO:tasks.workunit.client.0.smithi052.stdout:8/74: stat f11 0 2024-09-12T18:03:19.852 INFO:tasks.workunit.client.0.smithi052.stdout:8/75: write d13/f17 [958624,3816] 0 2024-09-12T18:03:19.857 INFO:tasks.workunit.client.0.smithi052.stdout:8/76: dwrite f11 [0,4194304] 0 2024-09-12T18:03:19.866 INFO:tasks.workunit.client.0.smithi052.stdout:8/77: dwrite fc [0,4194304] 0 2024-09-12T18:03:19.868 INFO:tasks.workunit.client.0.smithi052.stdout:8/78: creat d13/d18/f19 x:0 0 0 2024-09-12T18:03:19.868 INFO:tasks.workunit.client.0.smithi052.stdout:8/79: chown d13/d18/f19 1017519754 1 2024-09-12T18:03:19.872 INFO:tasks.workunit.client.0.smithi052.stdout:8/80: dread fb [0,4194304] 0 2024-09-12T18:03:19.873 INFO:tasks.workunit.client.0.smithi052.stdout:8/81: chown l8 0 1 2024-09-12T18:03:19.873 INFO:tasks.workunit.client.0.smithi052.stdout:8/82: mknod d13/c1a 0 2024-09-12T18:03:19.874 INFO:tasks.workunit.client.0.smithi052.stdout:8/83: creat d13/f1b x:0 0 0 2024-09-12T18:03:19.881 INFO:tasks.workunit.client.0.smithi052.stdout:8/84: dwrite d13/f1b [0,4194304] 0 2024-09-12T18:03:19.884 INFO:tasks.workunit.client.0.smithi052.stdout:8/85: getdents d13 0 2024-09-12T18:03:19.884 INFO:tasks.workunit.client.0.smithi052.stdout:8/86: fdatasync f7 0 2024-09-12T18:03:19.885 INFO:tasks.workunit.client.0.smithi052.stdout:8/87: rename fc to d13/f1c 0 2024-09-12T18:03:19.885 INFO:tasks.workunit.client.0.smithi052.stdout:3/29: sync 2024-09-12T18:03:19.885 INFO:tasks.workunit.client.0.smithi052.stdout:7/2: sync 2024-09-12T18:03:19.885 INFO:tasks.workunit.client.0.smithi052.stdout:5/13: sync 2024-09-12T18:03:19.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/45: sync 2024-09-12T18:03:19.885 INFO:tasks.workunit.client.0.smithi052.stdout:0/55: sync 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:5/14: dread - f0 zero size 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:5/15: rmdir - no directory 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:7/3: unlink f0 0 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:8/88: symlink d13/d18/l1d 0 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:3/30: symlink d0/d4/l8 0 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:0/56: symlink d2/d8/d9/l12 0 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:9/46: truncate d0/d6/fa 824999 0 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:8/89: rmdir d13/d18 39 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:3/31: stat d0/d4/d5 0 2024-09-12T18:03:19.887 INFO:tasks.workunit.client.0.smithi052.stdout:8/90: stat ce 0 2024-09-12T18:03:19.888 INFO:tasks.workunit.client.0.smithi052.stdout:0/57: fdatasync d2/d8/d9/ff 0 2024-09-12T18:03:19.888 INFO:tasks.workunit.client.0.smithi052.stdout:8/91: unlink l4 0 2024-09-12T18:03:19.888 INFO:tasks.workunit.client.0.smithi052.stdout:0/58: fdatasync d2/d6/fb 0 2024-09-12T18:03:19.889 INFO:tasks.workunit.client.0.smithi052.stdout:9/47: rename d0/d6/fa to d0/f10 0 2024-09-12T18:03:19.889 INFO:tasks.workunit.client.0.smithi052.stdout:0/59: stat d2/d6/fb 0 2024-09-12T18:03:19.889 INFO:tasks.workunit.client.0.smithi052.stdout:3/32: rename d0/d4/d5 to d0/d9 0 2024-09-12T18:03:19.890 INFO:tasks.workunit.client.0.smithi052.stdout:0/60: rename d2/d8/d9 to d2/d8/d9/d13 22 2024-09-12T18:03:19.891 INFO:tasks.workunit.client.0.smithi052.stdout:3/33: mknod d0/d9/d6/ca 0 2024-09-12T18:03:19.891 INFO:tasks.workunit.client.0.smithi052.stdout:3/34: dwrite - no filename 2024-09-12T18:03:19.891 INFO:tasks.workunit.client.0.smithi052.stdout:0/61: symlink d2/d8/l14 0 2024-09-12T18:03:19.894 INFO:tasks.workunit.client.0.smithi052.stdout:0/62: rename d2/d8/d9/l12 to d2/d8/d9/l15 0 2024-09-12T18:03:19.894 INFO:tasks.workunit.client.0.smithi052.stdout:8/92: dread f7 [0,4194304] 0 2024-09-12T18:03:19.895 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:19.895 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:19.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.248320657999997, 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016863248000000001, 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.896 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644905+0000", 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.644906+0000", 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7199999999999999e-07 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645008+0000", 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102321 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645020+0000", 2024-09-12T18:03:19.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2153e-05 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645033+0000", 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3283e-05 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649652+0000", 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0046185690000000003 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649717+0000", 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4852999999999997e-05 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.649806+0000", 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8892000000000002e-05 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652630+0000", 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028242279999999998 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661697+0000", 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090668880000000004 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661740+0000", 2024-09-12T18:03:19.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2716000000000002e-05 2024-09-12T18:03:19.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661768+0000", 2024-09-12T18:03:19.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8773e-05 2024-09-12T18:03:19.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.902 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.902 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.248174148000004, 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016823050999999999, 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645052+0000", 2024-09-12T18:03:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645077+0000", 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4919999999999999e-05 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645107+0000", 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9807000000000001e-05 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645120+0000", 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3040000000000001e-05 2024-09-12T18:03:19.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650201+0000", 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050811859999999997 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650264+0000", 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2286999999999995e-05 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.907 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650351+0000", 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7398999999999994e-05 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652636+0000", 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022853309999999998 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661814+0000", 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091775929999999995 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661849+0000", 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4477999999999998e-05 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.661875+0000", 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6120000000000001e-05 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.909 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.248086725999997, 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016942005999999999, 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.910 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645139+0000", 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645140+0000", 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0299999999999997e-07 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645149+0000", 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2469999999999997e-06 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645161+0000", 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2072999999999999e-05 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.645167+0000", 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650614+0000", 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054472289999999996 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650670+0000", 2024-09-12T18:03:19.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6118e-05 2024-09-12T18:03:19.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.650767+0000", 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6736000000000004e-05 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.652642+0000", 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018750889999999999 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662027+0000", 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093851950000000007 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662060+0000", 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2125000000000002e-05 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.662081+0000", 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1418000000000001e-05 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.142739902000002, 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016315357999999999, 2024-09-12T18:03:19.917 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750486+0000", 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750487+0000", 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-06 2024-09-12T18:03:19.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750599+0000", 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111906 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750621+0000", 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1647000000000001e-05 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750636+0000", 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.503e-05 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763216+0000", 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012580312999999999 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763337+0000", 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121085 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.763551+0000", 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021427499999999999 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765834+0000", 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022831629999999999 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766675+0000", 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00084040000000000004 2024-09-12T18:03:19.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766748+0000", 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3678999999999997e-05 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766801+0000", 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2760000000000003e-05 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.923 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.142560863, 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016896793, 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.924 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750665+0000", 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750666+0000", 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1969999999999999e-06 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750678+0000", 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.239e-05 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750696+0000", 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7598999999999999e-05 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.750709+0000", 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2553e-05 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.764927+0000", 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014218338000000001 2024-09-12T18:03:19.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765041+0000", 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114369 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.765266+0000", 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224358 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.766459+0000", 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001192984 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767416+0000", 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095698199999999999 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767502+0000", 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5866999999999996e-05 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.767562+0000", 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0155999999999998e-05 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.038188261000002, 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016018319, 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855037+0000", 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855038+0000", 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:19.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855120+0000", 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.153e-05 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855133+0000", 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3417e-05 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855141+0000", 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867297+0000", 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012155466 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867406+0000", 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109412 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.867580+0000", 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017386600000000001 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870161+0000", 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025809829999999998 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870888+0000", 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072707700000000002 2024-09-12T18:03:19.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.870987+0000", 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8523000000000005e-05 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871056+0000", 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9295999999999995e-05 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 95.038070817999994, 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016570871000000001, 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.937 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855155+0000", 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855156+0000", 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855165+0000", 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1730000000000001e-06 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855175+0000", 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5659999999999996e-06 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.855183+0000", 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0339999999999997e-06 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869085+0000", 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013902815000000001 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869193+0000", 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107576 2024-09-12T18:03:19.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.869396+0000", 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020299200000000001 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871104+0000", 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001707936 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871577+0000", 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047274399999999999 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871661+0000", 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4449000000000004e-05 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.871726+0000", 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4655999999999999e-05 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.942 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:120 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.933805930999995, 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015827178000000001, 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.943 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 120 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959420+0000", 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2699999999999999e-07 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959552+0000", 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000131822 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959564+0000", 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1827e-05 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959574+0000", 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0159999999999999e-05 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967531+0000", 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079566819999999996 2024-09-12T18:03:19.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967655+0000", 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123569 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.967867+0000", 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021296499999999999 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971623+0000", 2024-09-12T18:03:19.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00375574 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975119+0000", 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034961900000000001 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975191+0000", 2024-09-12T18:03:19.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2086000000000001e-05 2024-09-12T18:03:19.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975247+0000", 2024-09-12T18:03:19.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5510000000000002e-05 2024-09-12T18:03:19.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:121 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.933636528999997, 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016527022999999998, 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.950 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 121 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959589+0000", 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959590+0000", 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0529999999999999e-06 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959598+0000", 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000007e-06 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959608+0000", 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8169999999999994e-06 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959617+0000", 2024-09-12T18:03:19.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0429999999999996e-06 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969809+0000", 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010192268000000001 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.969919+0000", 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000109936 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.970096+0000", 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017661900000000001 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973903+0000", 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038074440000000001 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975963+0000", 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020602469999999999 2024-09-12T18:03:19.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976049+0000", 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5506000000000004e-05 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.976116+0000", 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7379999999999995e-05 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:122 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.933597316000004, 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018284173000000001, 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 122 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.957 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959628+0000", 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959629+0000", 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959639+0000", 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5529999999999998e-06 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959653+0000", 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4837e-05 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959661+0000", 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971688+0000", 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012026933 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.971818+0000", 2024-09-12T18:03:19.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013003600000000001 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972000+0000", 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000182578 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975034+0000", 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030335969999999999 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977779+0000", 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027449319999999998 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977857+0000", 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8802999999999998e-05 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.977913+0000", 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5149999999999999e-05 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:123 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.963 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:19.964 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.933553248999999, 2024-09-12T18:03:19.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019102556, 2024-09-12T18:03:19.964 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.964 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.964 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 123 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959673+0000", 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959754+0000", 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0822999999999995e-05 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959765+0000", 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.146e-05 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959773+0000", 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6000000000000001e-06 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972630+0000", 2024-09-12T18:03:19.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012857403999999999 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972740+0000", 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010909200000000001 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.972917+0000", 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017784800000000001 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975060+0000", 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021421669999999999 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978621+0000", 2024-09-12T18:03:19.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035610669999999998 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978708+0000", 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7779000000000001e-05 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978775+0000", 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6653e-05 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.971 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4150.0:124 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-09-12T18:03:19.971 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:19.971 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 94.933434930000004, 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019220655, 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4150", 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.52:0/810438904", 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 124 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959791+0000", 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959792+0000", 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6300000000000004e-07 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959800+0000", 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2470000000000008e-06 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959809+0000", 2024-09-12T18:03:19.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5599999999999999e-06 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.959816+0000", 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8600000000000004e-06 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.973983+0000", 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014167127 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974095+0000", 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011185500000000001 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.974270+0000", 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017519899999999999 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.975745+0000", 2024-09-12T18:03:19.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001474469 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978855+0000", 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031098800000000002 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.978931+0000", 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6005000000000002e-05 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:01:44.979011+0000", 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-05 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:73 3.1f e45/16 3:f83d65d8:::200.00000004:head v 45'5, mlcod=18'3)", 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.226207077, 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016249827000000001, 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.978 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667019+0000", 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.667025+0000", 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2659999999999998e-06 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670696+0000", 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036707939999999998 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670724+0000", 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8572999999999999e-05 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670738+0000", 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3774999999999999e-05 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670879+0000", 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000140476 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.670932+0000", 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3522e-05 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.683166+0000", 2024-09-12T18:03:19.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012234386999999999 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:07.683268+0000", 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010203400000000001 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:7811 4.25 4:a4ff7c9e:::10000002394.00000000:head [write 0~98189] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.2244442949999996, 2024-09-12T18:03:19.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018891185000000001, 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 7811 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668781+0000", 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668791+0000", 2024-09-12T18:03:19.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7229999999999999e-06 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668957+0000", 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016580499999999999 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668999+0000", 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2506000000000003e-05 2024-09-12T18:03:19.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669022+0000", 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2509000000000001e-05 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669117+0000", 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5293999999999999e-05 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669309+0000", 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019157500000000001 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.669501+0000", 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019174799999999999 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.683171+0000", 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013670488999999999 2024-09-12T18:03:19.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687373+0000", 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042023199999999998 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687559+0000", 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018587899999999999 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.687673+0000", 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000113337 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:151 3.1d e47/16 3:bec1251c:::200.00000007:head v 47'5, mlcod=44'3)", 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.2242644770000002, 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016128601999999999, 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.990 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668961+0000", 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.668963+0000", 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.593e-06 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672011+0000", 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003047995 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672032+0000", 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0820000000000001e-05 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672044+0000", 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.278e-05 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672166+0000", 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000121583 2024-09-12T18:03:19.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.672199+0000", 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3318999999999997e-05 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.685001+0000", 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012801472 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:19.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:12.685090+0000", 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9040000000000001e-05 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(mds.0.3:228 3.0 e48/16 3:02ac1934:::200.00000009:head v 48'3, mlcod=45'1)", 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.049519+0000", 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.8437069909999999, 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.025632604, 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:19.995 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.049519+0000", 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.049519+0000", 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.049521+0000", 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-06 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055650+0000", 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061294590000000003 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055696+0000", 2024-09-12T18:03:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6072000000000002e-05 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055720+0000", 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3343e-05 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055906+0000", 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018627499999999999 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:19.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.055945+0000", 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8859000000000002e-05 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.075122+0000", 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019177389999999999 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:19.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.075151+0000", 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9130000000000001e-05 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.8384737769999999, 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:20.000 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:20.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:20.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:20.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:20.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.007 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:232 3.13 3:ceffbd45:::200.0000000a:head [write 0~2144049 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:17.021585+0000", 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.871641055, 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016694856000000001, 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:20.008 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.009 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:20.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:20.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.021585+0000", 2024-09-12T18:03:20.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:20.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:20.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.021585+0000", 2024-09-12T18:03:20.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:20.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.021587+0000", 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.165e-06 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024143+0000", 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025562940000000002 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024175+0000", 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2058999999999999e-05 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024189+0000", 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4228e-05 2024-09-12T18:03:20.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024273+0000", 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3163000000000003e-05 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024342+0000", 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9274000000000001e-05 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.024447+0000", 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105419 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.030090+0000", 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056428770000000001 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.038197+0000", 2024-09-12T18:03:20.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081066220000000008 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.038239+0000", 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1785000000000001e-05 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:17.038280+0000", 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0970000000000002e-05 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:20.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10726 4.22 4:459d1d7e:::100000030fc.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.687094+0000", 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.206131644, 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022397459000000002, 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:20.016 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10726 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.687094+0000", 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.687094+0000", 2024-09-12T18:03:20.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.687097+0000", 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7300000000000001e-06 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.692631+0000", 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0055342589999999997 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.692663+0000", 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2141999999999998e-05 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.692679+0000", 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5469999999999999e-05 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:20.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.692880+0000", 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000201032 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.693123+0000", 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0002431 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.693478+0000", 2024-09-12T18:03:20.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035495900000000001 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.707964+0000", 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014485869 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.709213+0000", 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012498279999999999 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.709372+0000", 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000158383 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.709492+0000", 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011968699999999999 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.022 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:10721 4.3 e50/17 4:c143cd71:::100000030ed.00000001:head v 50'158, mlcod=49'156)", 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.713019+0000", 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.18020704900000001, 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016236922000000001, 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.713019+0000", 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.713019+0000", 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.713020+0000", 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1069999999999999e-06 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:20.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.718683+0000", 2024-09-12T18:03:20.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056628989999999999 2024-09-12T18:03:20.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:20.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.718713+0000", 2024-09-12T18:03:20.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0589000000000001e-05 2024-09-12T18:03:20.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.718729+0000", 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5443000000000001e-05 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.718933+0000", 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020412800000000001 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.719023+0000", 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0308000000000003e-05 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.729139+0000", 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010115617 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:20.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:20.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.729256+0000", 2024-09-12T18:03:20.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011683099999999999 2024-09-12T18:03:20.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.028 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:20.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:20.028 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:20.028 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:20.031 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:20.032 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:20.028+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:20.053 INFO:tasks.workunit.client.0.smithi052.stdout:5/16: dwrite f0 [0,4194304] 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/63: creat d2/d6/dd/f16 x:0 0 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/64: dread d2/d6/fb [0,4194304] 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:8/93: dread f7 [0,4194304] 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/65: write d2/d6/dd/f16 [924420,43893] 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:3/35: getdents d0 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:3/36: chown d0/d9/d6/d7 90321320 1 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/66: creat d2/d6/dd/f17 x:0 0 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/67: symlink d2/d8/d9/l18 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:3/37: creat d0/d9/d6/d7/fb x:0 0 0 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/68: chown d2/c5 55593 1 2024-09-12T18:03:20.054 INFO:tasks.workunit.client.0.smithi052.stdout:3/38: dread - d0/d9/d6/d7/fb zero size 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/69: fdatasync d2/d8/d9/ff 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/70: creat d2/d6/dd/f19 x:0 0 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:3/39: truncate d0/d9/d6/d7/fb 8346 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/71: creat d2/d8/d11/f1a x:0 0 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:3/40: fdatasync d0/d9/d6/d7/fb 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/72: truncate d2/d6/dd/f17 497784 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:3/41: dwrite d0/d9/d6/d7/fb [0,4194304] 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/73: rename d2/d8/d11 to d2/d1b 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/74: dread - d2/d8/d9/ff zero size 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:3/42: rename d0/d9/d6/d7/fb to d0/fc 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:5/17: fsync f0 0 2024-09-12T18:03:20.055 INFO:tasks.workunit.client.0.smithi052.stdout:5/18: chown f0 1 1 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:5/19: chown f0 19 1 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:3/43: dwrite d0/fc [0,4194304] 0 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:0/75: dwrite d2/d1b/f1a [0,4194304] 0 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:5/20: dwrite f0 [0,4194304] 0 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:3/44: write d0/fc [755739,116173] 0 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:5/21: chown f0 1740067 1 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:0/76: write d2/d8/d9/ff [494207,78361] 0 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:3/45: mkdir d0/d9/d6/dd 0 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:3/46: stat d0/d9/d6/d7 0 2024-09-12T18:03:20.056 INFO:tasks.workunit.client.0.smithi052.stdout:0/77: write d2/d1b/f1a [1803406,125073] 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/47: write d0/fc [2088795,12260] 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:0/78: chown d2/d6/dd 583 1 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:0/79: readlink d2/d8/l14 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/48: write d0/fc [4859726,12428] 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/49: mkdir d0/d9/d6/d7/de 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:0/80: link d2/d1b/f1a d2/d8/f1c 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:0/81: unlink d2/d8/d9/l18 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/50: mknod d0/d9/d6/cf 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:0/82: unlink d2/d6/dd/f19 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/51: truncate d0/fc 5449456 0 2024-09-12T18:03:20.057 INFO:tasks.workunit.client.0.smithi052.stdout:5/22: dwrite f0 [4194304,4194304] 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:0/83: write d2/d8/f1c [3256019,37726] 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/52: rename d0/d9/d6/cf to d0/d9/d6/dd/c10 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:0/84: readlink d2/d6/l7 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/53: mknod d0/d4/c11 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:4/108: sync 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/54: readlink d0/d4/l8 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:4/109: fsync f8 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/55: creat d0/f12 x:0 0 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/56: creat d0/f13 x:0 0 0 2024-09-12T18:03:20.058 INFO:tasks.workunit.client.0.smithi052.stdout:3/57: dread - d0/f12 zero size 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:3/58: symlink d0/l14 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:3/59: dread - d0/f12 zero size 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:4/110: dread f10 [0,4194304] 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:0/85: dwrite d2/d6/dd/f16 [0,4194304] 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:4/111: truncate d11/d17/d1b/f20 457145 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:0/86: chown d2/d8/d9 3 1 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:5/23: truncate f0 8186289 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:3/60: dwrite d0/fc [0,4194304] 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:3/61: stat d0/f12 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:3/62: chown d0/d9/d6/ca 168003 1 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:3/63: creat d0/d9/d6/f15 x:0 0 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:3/64: mkdir d0/d16 0 2024-09-12T18:03:20.059 INFO:tasks.workunit.client.0.smithi052.stdout:4/112: dwrite d11/d17/d1b/f20 [0,4194304] 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:4/113: creat d11/d17/d1b/f29 x:0 0 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:3/65: rename d0/d9/d6/dd to d0/d9/d17 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:4/114: unlink d11/d17/l22 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:4/115: readlink d11/l14 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/24: link f0 f1 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/25: unlink f0 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/26: mknod c2 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/27: chown c2 800881 1 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:3/66: dwrite d0/f12 [0,4194304] 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/28: dread f1 [4194304,4194304] 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/29: creat f3 x:0 0 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/30: dwrite f3 [0,4194304] 0 2024-09-12T18:03:20.060 INFO:tasks.workunit.client.0.smithi052.stdout:3/67: truncate d0/f12 203587 0 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:5/31: creat f4 x:0 0 0 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:5/32: truncate f4 38173 0 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:3/68: fdatasync d0/f13 0 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:3/69: mknod d0/c18 0 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:3/70: readlink d0/l14 0 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:6/166: sync 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:2/47: sync 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:8/94: sync 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:1/58: sync 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/4: sync 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/5: dwrite - no filename 2024-09-12T18:03:20.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/6: truncate - no filename 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:7/7: readlink - no filename 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:9/48: sync 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:4/116: sync 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:0/87: sync 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:3/71: link d0/f13 d0/d4/f19 0 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:7/8: creat f1 x:0 0 0 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:9/49: symlink d0/d6/l11 0 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:8/95: unlink c6 0 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:6/167: mknod d2/c3c 0 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:4/117: write d11/f13 [212711,84244] 0 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:2/48: link f6 da/f12 0 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:1/59: read d3/fc [4170644,86867] 0 2024-09-12T18:03:20.062 INFO:tasks.workunit.client.0.smithi052.stdout:3/72: dread - d0/d9/d6/f15 zero size 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:9/50: mknod d0/c12 0 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:9/51: readlink d0/l2 0 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:4/118: write d11/f13 [662153,1285] 0 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:6/168: mknod d2/d21/c3d 0 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:5/33: read f1 [5216163,1112] 0 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:8/96: mknod d13/d18/c1e 0 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:9/52: chown d0/d6/ce 23458 1 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:3/73: link d0/l14 d0/d9/d17/l1a 0 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:6/169: chown d2/d11/f17 2024 1 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:9/53: symlink d0/d6/l13 0 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:8/97: dread - d13/d18/f19 zero size 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:5/34: chown f3 3 1 2024-09-12T18:03:20.063 INFO:tasks.workunit.client.0.smithi052.stdout:4/119: truncate d11/d17/f18 325209 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:8/98: chown d13 14 1 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:5/35: write f3 [974218,102207] 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/54: truncate d0/f8 199758 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:8/99: fdatasync ff 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/55: mknod d0/d6/c14 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:0/88: dwrite d2/d1b/f1a [0,4194304] 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/56: mknod d0/c15 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/57: rmdir d0/d6 39 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:1/60: dwrite d3/fc [4194304,4194304] 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:0/89: rename d2/d1b/f1a to d2/d6/dd/f1d 0 2024-09-12T18:03:20.064 INFO:tasks.workunit.client.0.smithi052.stdout:1/61: mkdir d3/d10 0 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:3/74: dwrite d0/d9/d6/f15 [0,4194304] 0 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:0/90: write d2/d6/dd/f1d [3269205,92331] 0 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:7/9: getdents . 0 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:2/49: truncate f6 3518182 0 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:4/120: dwrite d11/d17/d1b/f20 [0,4194304] 0 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:8/100: dwrite d13/f1c [4194304,4194304] 0 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:7/10: unlink f1 0 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:7/11: read - no filename 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:7/12: dwrite - no filename 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:7/13: dwrite - no filename 2024-09-12T18:03:20.065 INFO:tasks.workunit.client.0.smithi052.stdout:2/50: rmdir da/dc 39 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:3/75: mknod d0/d4/c1b 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:0/91: readlink d2/d8/d9/l15 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:4/121: mkdir d11/d17/d1b/d2a 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/14: mknod c2 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/15: creat f3 x:0 0 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:9/58: dwrite d0/fb [0,4194304] 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:4/122: truncate fe 5241530 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:0/92: write d2/d8/d9/ff [332174,13734] 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:3/76: rmdir d0/d9/d6/d7 39 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:8/101: dread ff [0,4194304] 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/16: creat f4 x:0 0 0 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/17: chown c2 1643050 1 2024-09-12T18:03:20.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/18: readlink - no filename 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:8/102: stat d13/d18 0 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:8/103: dread - d13/d18/f19 zero size 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:1/62: dread d3/fa [0,4194304] 0 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:0/93: mknod d2/d8/d9/c1e 0 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:6/170: sync 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/19: rename f3 to f5 0 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:2/51: sync 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:9/59: chown d0/d6/c14 1501 1 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:4/123: getdents d11/d17/d1b/d24 0 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/20: mkdir d6 0 2024-09-12T18:03:20.067 INFO:tasks.workunit.client.0.smithi052.stdout:6/171: dread - d2/d21/f2a zero size 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:0/94: write d2/d8/d9/ff [1385310,18912] 0 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:1/63: creat d3/d10/f11 x:0 0 0 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:4/124: rmdir d11/d17/d1b/d24 0 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:9/60: creat d0/f16 x:0 0 0 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:6/172: fdatasync d2/d15/f2c 0 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:7/21: mknod d6/c7 0 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:5/36: truncate f3 995020 0 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:4/125: chown lc 439351 1 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:3/77: dwrite d0/f12 [0,4194304] 0 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:3/78: sync 2024-09-12T18:03:20.068 INFO:tasks.workunit.client.0.smithi052.stdout:1/64: symlink d3/d10/l12 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:0/95: truncate d2/d6/dd/f16 4298454 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:9/61: symlink d0/l17 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:4/126: write f5 [5048952,2957] 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:8/104: dwrite d13/f1b [0,4194304] 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:3/79: read d0/f12 [1394545,116202] 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:7/22: rmdir d6 39 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:8/105: sync 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:1/65: write d3/d10/f11 [758551,88633] 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:9/62: mkdir d0/d18 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:2/52: dwrite da/fb [0,4194304] 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:0/96: rename d2/c4 to d2/d8/c1f 0 2024-09-12T18:03:20.069 INFO:tasks.workunit.client.0.smithi052.stdout:9/63: mknod d0/d6/c19 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:4/127: dread f8 [0,4194304] 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:0/97: write d2/d8/fa [214047,105933] 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:9/64: getdents d0/d18 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:6/173: dwrite d2/d21/f2a [0,4194304] 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:4/128: rename fe to d11/d17/d19/f2b 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:6/174: write d2/d15/f2c [277264,89975] 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:4/129: mknod d11/c2c 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:9/65: rename d0/f16 to d0/f1a 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:1/66: dwrite d3/ff [0,4194304] 0 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:6/175: dread - d2/d1e/f20 zero size 2024-09-12T18:03:20.070 INFO:tasks.workunit.client.0.smithi052.stdout:0/98: link d2/d6/dd/f17 d2/d8/f20 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:9/66: read - d0/f1a zero size 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:9/67: truncate d0/fc 864508 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:1/67: readlink d3/l9 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:1/68: read d3/fa [2166437,67803] 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:4/130: dwrite f5 [0,4194304] 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:5/37: write f1 [2761917,92193] 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:8/106: truncate d13/f17 312899 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:0/99: dwrite d2/d6/fb [0,4194304] 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:2/53: truncate f0 217095 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:9/68: dread d0/fc [0,4194304] 0 2024-09-12T18:03:20.071 INFO:tasks.workunit.client.0.smithi052.stdout:8/107: read d13/f1c [44664,40620] 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:6/176: truncate d2/d15/f22 353495 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:1/69: dread d3/ff [0,4194304] 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:4/131: creat d11/d17/d1b/f2d x:0 0 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:7/23: getdents d6 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:4/132: fdatasync d11/f25 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:7/24: truncate f4 783449 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:5/38: creat f5 x:0 0 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:5/39: rmdir - no directory 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:4/133: fdatasync d11/d17/d1b/f29 0 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:8/108: read - d13/d18/f19 zero size 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:1/70: chown d3/d10/l12 449432757 1 2024-09-12T18:03:20.072 INFO:tasks.workunit.client.0.smithi052.stdout:3/80: dwrite d0/f13 [0,4194304] 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:7/25: unlink c2 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:6/177: write d2/f3a [785726,3716] 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:2/54: creat da/f13 x:0 0 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:9/69: creat d0/f1b x:0 0 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:4/134: creat d11/d17/d1b/f2e x:0 0 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:7/26: mknod d6/c8 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:5/40: creat f6 x:0 0 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:8/109: creat d13/f1f x:0 0 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:6/178: mkdir d2/d11/d3e 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:7/27: write f4 [82327,32797] 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:9/70: mkdir d0/d1c 0 2024-09-12T18:03:20.073 INFO:tasks.workunit.client.0.smithi052.stdout:9/71: sync 2024-09-12T18:03:20.074 INFO:tasks.workunit.client.0.smithi052.stdout:0/100: dwrite d2/d6/f10 [0,4194304] 0 2024-09-12T18:03:20.074 INFO:tasks.workunit.client.0.smithi052.stdout:4/135: rename d11/d17/d19 to d11/d17/d23/d2f 0 2024-09-12T18:03:20.074 INFO:tasks.workunit.client.0.smithi052.stdout:7/28: read - f5 zero size 2024-09-12T18:03:20.074 INFO:tasks.workunit.client.0.smithi052.stdout:7/29: readlink - no filename 2024-09-12T18:03:20.079 INFO:tasks.workunit.client.0.smithi052.stdout:8/110: dread ff [0,4194304] 0 2024-09-12T18:03:20.079 INFO:tasks.workunit.client.0.smithi052.stdout:5/41: dread f3 [0,4194304] 0 2024-09-12T18:03:20.079 INFO:tasks.workunit.client.0.smithi052.stdout:4/136: read - d11/d17/d1b/f2d zero size 2024-09-12T18:03:20.079 INFO:tasks.workunit.client.0.smithi052.stdout:7/30: creat d6/f9 x:0 0 0 2024-09-12T18:03:20.079 INFO:tasks.workunit.client.0.smithi052.stdout:0/101: mkdir d2/d6/dd/d21 0 2024-09-12T18:03:20.079 INFO:tasks.workunit.client.0.smithi052.stdout:5/42: write f4 [717931,34059] 0 2024-09-12T18:03:20.079 INFO:tasks.workunit.client.0.smithi052.stdout:6/179: rename d2/d11/d3e to d2/d3f 0 2024-09-12T18:03:20.079 INFO:tasks.workunit.client.0.smithi052.stdout:0/102: stat d2/d6/dd/d21 0 2024-09-12T18:03:20.080 INFO:tasks.workunit.client.0.smithi052.stdout:9/72: link d0/f1a d0/f1d 0 2024-09-12T18:03:20.080 INFO:tasks.workunit.client.0.smithi052.stdout:8/111: unlink f11 0 2024-09-12T18:03:20.080 INFO:tasks.workunit.client.0.smithi052.stdout:7/31: rename d6 to d6/da 22 2024-09-12T18:03:20.080 INFO:tasks.workunit.client.0.smithi052.stdout:0/103: stat d2/d6/fb 0 2024-09-12T18:03:20.080 INFO:tasks.workunit.client.0.smithi052.stdout:4/137: fsync d11/d17/f18 0 2024-09-12T18:03:20.080 INFO:tasks.workunit.client.0.smithi052.stdout:9/73: rename d0/d6/ce to d0/d18/c1e 0 2024-09-12T18:03:20.080 INFO:tasks.workunit.client.0.smithi052.stdout:5/43: mkdir d7 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:1/71: dread d3/d10/f11 [0,4194304] 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:5/44: unlink c2 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:7/32: read f4 [274569,43552] 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:4/138: rename d11/c2c to d11/d17/d1b/d2a/c30 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:5/45: dread - f5 zero size 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:6/180: dread d2/d1e/f35 [0,4194304] 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:2/55: dread f0 [0,4194304] 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:1/72: link d3/d10/l12 d3/d10/l13 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:3/81: truncate d0/f13 356265 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:8/112: dread d13/f17 [0,4194304] 0 2024-09-12T18:03:20.081 INFO:tasks.workunit.client.0.smithi052.stdout:6/181: mknod d2/d21/c40 0 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/139: creat d11/d17/d23/d2f/f31 x:0 0 0 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:3/82: chown d0/d4/f19 13 1 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:7/33: dread f4 [0,4194304] 0 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/140: chown d11/d17 10605 1 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:8/113: truncate d13/f17 761190 0 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:5/46: getdents d7 0 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:3/83: readlink d0/l14 0 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:9/74: dwrite d0/fc [0,4194304] 0 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:7/34: fsync f5 0 2024-09-12T18:03:20.082 INFO:tasks.workunit.client.0.smithi052.stdout:5/47: stat f5 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:4/141: chown d11/d17/d23/d2f 625 1 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:0/104: dwrite d2/d6/dd/f1d [0,4194304] 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:6/182: truncate d2/d11/d26/f36 66045 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:5/48: truncate f6 889667 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:3/84: mkdir d0/d16/d1c 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:1/73: dread d3/f8 [4194304,4194304] 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:7/35: creat d6/fb x:0 0 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:9/75: mknod d0/c1f 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:0/105: creat d2/d6/dd/f22 x:0 0 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:4/142: write d11/d17/d23/f27 [485709,61364] 0 2024-09-12T18:03:20.083 INFO:tasks.workunit.client.0.smithi052.stdout:8/114: link d13/c14 d13/c20 0 2024-09-12T18:03:20.085 INFO:tasks.workunit.client.0.smithi052.stdout:9/76: chown d0/l4 5919 1 2024-09-12T18:03:20.085 INFO:tasks.workunit.client.0.smithi052.stdout:7/36: mkdir d6/dc 0 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:2/56: dread f6 [0,4194304] 0 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:3/85: symlink d0/d16/d1c/l1d 0 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:5/49: getdents d7 0 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:8/115: chown l10 178597381 1 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:0/106: chown d2/d8/f20 30049248 1 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:8/116: sync 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:1/74: dread d3/d10/f11 [0,4194304] 0 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:6/183: getdents d2/d1e 0 2024-09-12T18:03:20.086 INFO:tasks.workunit.client.0.smithi052.stdout:8/117: mkdir d13/d18/d21 0 2024-09-12T18:03:20.087 INFO:tasks.workunit.client.0.smithi052.stdout:0/107: write d2/d6/dd/f16 [2517142,1534] 0 2024-09-12T18:03:20.087 INFO:tasks.workunit.client.0.smithi052.stdout:1/75: mknod d3/c14 0 2024-09-12T18:03:20.087 INFO:tasks.workunit.client.0.smithi052.stdout:3/86: write d0/d9/d6/f15 [2876661,66274] 0 2024-09-12T18:03:20.087 INFO:tasks.workunit.client.0.smithi052.stdout:0/108: chown d2/d6/dd/f22 1 1 2024-09-12T18:03:20.087 INFO:tasks.workunit.client.0.smithi052.stdout:8/118: symlink d13/l22 0 2024-09-12T18:03:20.088 INFO:tasks.workunit.client.0.smithi052.stdout:1/76: mknod d3/c15 0 2024-09-12T18:03:20.088 INFO:tasks.workunit.client.0.smithi052.stdout:3/87: stat d0/d9/d17 0 2024-09-12T18:03:20.088 INFO:tasks.workunit.client.0.smithi052.stdout:4/143: dread f5 [0,4194304] 0 2024-09-12T18:03:20.088 INFO:tasks.workunit.client.0.smithi052.stdout:6/184: rename d2/fc to d2/d15/f41 0 2024-09-12T18:03:20.089 INFO:tasks.workunit.client.0.smithi052.stdout:1/77: fsync d3/f8 0 2024-09-12T18:03:20.090 INFO:tasks.workunit.client.0.smithi052.stdout:2/57: dread da/f12 [0,4194304] 0 2024-09-12T18:03:20.090 INFO:tasks.workunit.client.0.smithi052.stdout:4/144: write d11/f16 [436000,59576] 0 2024-09-12T18:03:20.090 INFO:tasks.workunit.client.0.smithi052.stdout:0/109: link d2/d6/dd/f17 d2/d6/f23 0 2024-09-12T18:03:20.090 INFO:tasks.workunit.client.0.smithi052.stdout:2/58: sync 2024-09-12T18:03:20.091 INFO:tasks.workunit.client.0.smithi052.stdout:6/185: dread - d2/d11/d26/f2d zero size 2024-09-12T18:03:20.091 INFO:tasks.workunit.client.0.smithi052.stdout:8/119: write d13/f17 [1603272,127805] 0 2024-09-12T18:03:20.092 INFO:tasks.workunit.client.0.smithi052.stdout:7/37: dwrite f4 [0,4194304] 0 2024-09-12T18:03:20.093 INFO:tasks.workunit.client.0.smithi052.stdout:8/120: chown d13/c1a 190 1 2024-09-12T18:03:20.094 INFO:tasks.workunit.client.0.smithi052.stdout:5/50: dwrite f1 [0,4194304] 0 2024-09-12T18:03:20.094 INFO:tasks.workunit.client.0.smithi052.stdout:0/110: mknod d2/c24 0 2024-09-12T18:03:20.094 INFO:tasks.workunit.client.0.smithi052.stdout:1/78: symlink d3/d10/l16 0 2024-09-12T18:03:20.094 INFO:tasks.workunit.client.0.smithi052.stdout:4/145: rmdir d11/d17/d1b/d2a 39 2024-09-12T18:03:20.094 INFO:tasks.workunit.client.0.smithi052.stdout:6/186: creat d2/d11/d26/f42 x:0 0 0 2024-09-12T18:03:20.094 INFO:tasks.workunit.client.0.smithi052.stdout:9/77: dwrite d0/fb [0,4194304] 0 2024-09-12T18:03:20.097 INFO:tasks.workunit.client.0.smithi052.stdout:2/59: creat da/dc/dd/f14 x:0 0 0 2024-09-12T18:03:20.097 INFO:tasks.workunit.client.0.smithi052.stdout:1/79: mknod d3/c17 0 2024-09-12T18:03:20.098 INFO:tasks.workunit.client.0.smithi052.stdout:0/111: symlink d2/d8/d9/l25 0 2024-09-12T18:03:20.098 INFO:tasks.workunit.client.0.smithi052.stdout:6/187: chown d2/c18 0 1 2024-09-12T18:03:20.098 INFO:tasks.workunit.client.0.smithi052.stdout:7/38: getdents d6/dc 0 2024-09-12T18:03:20.099 INFO:tasks.workunit.client.0.smithi052.stdout:4/146: mkdir d11/d17/d1b/d2a/d32 0 2024-09-12T18:03:20.099 INFO:tasks.workunit.client.0.smithi052.stdout:3/88: truncate d0/d4/f19 326058 0 2024-09-12T18:03:20.099 INFO:tasks.workunit.client.0.smithi052.stdout:2/60: write da/dc/dd/f14 [589464,127272] 0 2024-09-12T18:03:20.100 INFO:tasks.workunit.client.0.smithi052.stdout:6/188: chown d2/d11/f31 331484130 1 2024-09-12T18:03:20.100 INFO:tasks.workunit.client.0.smithi052.stdout:1/80: link d3/c14 d3/d10/c18 0 2024-09-12T18:03:20.100 INFO:tasks.workunit.client.0.smithi052.stdout:6/189: sync 2024-09-12T18:03:20.101 INFO:tasks.workunit.client.0.smithi052.stdout:7/39: link f5 d6/fd 0 2024-09-12T18:03:20.102 INFO:tasks.workunit.client.0.smithi052.stdout:4/147: write d11/d17/d1b/f2e [87834,111149] 0 2024-09-12T18:03:20.102 INFO:tasks.workunit.client.0.smithi052.stdout:6/190: readlink d2/l13 0 2024-09-12T18:03:20.103 INFO:tasks.workunit.client.0.smithi052.stdout:5/51: dread f6 [0,4194304] 0 2024-09-12T18:03:20.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/40: read - d6/f9 zero size 2024-09-12T18:03:20.103 INFO:tasks.workunit.client.0.smithi052.stdout:8/121: dwrite ff [0,4194304] 0 2024-09-12T18:03:20.104 INFO:tasks.workunit.client.0.smithi052.stdout:4/148: stat d11/c1e 0 2024-09-12T18:03:20.105 INFO:tasks.workunit.client.0.smithi052.stdout:7/41: unlink d6/c7 0 2024-09-12T18:03:20.105 INFO:tasks.workunit.client.0.smithi052.stdout:8/122: write d13/d18/f19 [332463,84243] 0 2024-09-12T18:03:20.105 INFO:tasks.workunit.client.0.smithi052.stdout:4/149: fdatasync f8 0 2024-09-12T18:03:20.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/52: rename f3 to d7/f8 0 2024-09-12T18:03:20.106 INFO:tasks.workunit.client.0.smithi052.stdout:6/191: creat d2/f43 x:0 0 0 2024-09-12T18:03:20.106 INFO:tasks.workunit.client.0.smithi052.stdout:7/42: rename f4 to d6/dc/fe 0 2024-09-12T18:03:20.106 INFO:tasks.workunit.client.0.smithi052.stdout:6/192: chown d2/fb 0 1 2024-09-12T18:03:20.106 INFO:tasks.workunit.client.0.smithi052.stdout:2/61: dread da/f12 [0,4194304] 0 2024-09-12T18:03:20.107 INFO:tasks.workunit.client.0.smithi052.stdout:6/193: chown d2/fb 28791055 1 2024-09-12T18:03:20.109 INFO:tasks.workunit.client.0.smithi052.stdout:2/62: write da/fb [2326892,15269] 0 2024-09-12T18:03:20.110 INFO:tasks.workunit.client.0.smithi052.stdout:4/150: mkdir d11/d17/d1b/d2a/d33 0 2024-09-12T18:03:20.110 INFO:tasks.workunit.client.0.smithi052.stdout:0/112: dread d2/d8/f20 [0,4194304] 0 2024-09-12T18:03:20.111 INFO:tasks.workunit.client.0.smithi052.stdout:9/78: write d0/f1a [757482,23739] 0 2024-09-12T18:03:20.111 INFO:tasks.workunit.client.0.smithi052.stdout:7/43: creat d6/ff x:0 0 0 2024-09-12T18:03:20.111 INFO:tasks.workunit.client.0.smithi052.stdout:2/63: chown da/dc/dd 3508 1 2024-09-12T18:03:20.112 INFO:tasks.workunit.client.0.smithi052.stdout:1/81: write d3/fa [2114784,43537] 0 2024-09-12T18:03:20.112 INFO:tasks.workunit.client.0.smithi052.stdout:4/151: chown d11/f21 3130862 1 2024-09-12T18:03:20.112 INFO:tasks.workunit.client.0.smithi052.stdout:0/113: rmdir d2 39 2024-09-12T18:03:20.113 INFO:tasks.workunit.client.0.smithi052.stdout:7/44: mknod d6/c10 0 2024-09-12T18:03:20.114 INFO:tasks.workunit.client.0.smithi052.stdout:6/194: getdents d2/d15/d1a 0 2024-09-12T18:03:20.114 INFO:tasks.workunit.client.0.smithi052.stdout:9/79: creat d0/d1c/f20 x:0 0 0 2024-09-12T18:03:20.114 INFO:tasks.workunit.client.0.smithi052.stdout:1/82: chown d3/d10/l16 1943588 1 2024-09-12T18:03:20.114 INFO:tasks.workunit.client.0.smithi052.stdout:7/45: fsync d6/f9 0 2024-09-12T18:03:20.114 INFO:tasks.workunit.client.0.smithi052.stdout:2/64: write da/dc/dd/f14 [275423,93230] 0 2024-09-12T18:03:20.114 INFO:tasks.workunit.client.0.smithi052.stdout:0/114: readlink d2/d6/l7 0 2024-09-12T18:03:20.115 INFO:tasks.workunit.client.0.smithi052.stdout:4/152: creat d11/d17/f34 x:0 0 0 2024-09-12T18:03:20.116 INFO:tasks.workunit.client.0.smithi052.stdout:7/46: chown d6/f9 2295 1 2024-09-12T18:03:20.118 INFO:tasks.workunit.client.0.smithi052.stdout:2/65: mkdir da/dc/d15 0 2024-09-12T18:03:20.120 INFO:tasks.workunit.client.0.smithi052.stdout:8/123: dwrite d13/f1b [4194304,4194304] 0 2024-09-12T18:03:20.120 INFO:tasks.workunit.client.0.smithi052.stdout:6/195: write d2/d15/d1a/f1f [884105,112968] 0 2024-09-12T18:03:20.120 INFO:tasks.workunit.client.0.smithi052.stdout:1/83: link d3/c14 d3/c19 0 2024-09-12T18:03:20.120 INFO:tasks.workunit.client.0.smithi052.stdout:7/47: unlink d6/fb 0 2024-09-12T18:03:20.121 INFO:tasks.workunit.client.0.smithi052.stdout:5/53: dwrite d7/f8 [0,4194304] 0 2024-09-12T18:03:20.121 INFO:tasks.workunit.client.0.smithi052.stdout:0/115: mkdir d2/d6/dd/d21/d26 0 2024-09-12T18:03:20.123 INFO:tasks.workunit.client.0.smithi052.stdout:6/196: mknod d2/c44 0 2024-09-12T18:03:20.123 INFO:tasks.workunit.client.0.smithi052.stdout:8/124: chown d13/c16 1 1 2024-09-12T18:03:20.123 INFO:tasks.workunit.client.0.smithi052.stdout:2/66: truncate f6 2422623 0 2024-09-12T18:03:20.123 INFO:tasks.workunit.client.0.smithi052.stdout:4/153: creat d11/d17/d1b/f35 x:0 0 0 2024-09-12T18:03:20.123 INFO:tasks.workunit.client.0.smithi052.stdout:2/67: readlink l4 0 2024-09-12T18:03:20.123 INFO:tasks.workunit.client.0.smithi052.stdout:0/116: symlink d2/d6/dd/d21/l27 0 2024-09-12T18:03:20.124 INFO:tasks.workunit.client.0.smithi052.stdout:1/84: rename d3/d10/l13 to d3/l1a 0 2024-09-12T18:03:20.127 INFO:tasks.workunit.client.0.smithi052.stdout:3/89: truncate d0/f13 178830 0 2024-09-12T18:03:20.128 INFO:tasks.workunit.client.0.smithi052.stdout:6/197: write d2/f3a [672383,90480] 0 2024-09-12T18:03:20.128 INFO:tasks.workunit.client.0.smithi052.stdout:4/154: unlink d11/d17/d1b/f29 0 2024-09-12T18:03:20.129 INFO:tasks.workunit.client.0.smithi052.stdout:1/85: rmdir d3/d10 39 2024-09-12T18:03:20.130 INFO:tasks.workunit.client.0.smithi052.stdout:0/117: fdatasync d2/d6/dd/f1d 0 2024-09-12T18:03:20.131 INFO:tasks.workunit.client.0.smithi052.stdout:9/80: dread d0/fc [0,4194304] 0 2024-09-12T18:03:20.131 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:20.128+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:20.132 INFO:tasks.workunit.client.0.smithi052.stdout:6/198: dread - d2/d11/d26/f2d zero size 2024-09-12T18:03:20.132 INFO:tasks.workunit.client.0.smithi052.stdout:3/90: write d0/d9/d6/f15 [379658,125850] 0 2024-09-12T18:03:20.133 INFO:tasks.workunit.client.0.smithi052.stdout:0/118: chown d2/d8/fa 6815 1 2024-09-12T18:03:20.134 INFO:tasks.workunit.client.0.smithi052.stdout:1/86: link d3/c17 d3/c1b 0 2024-09-12T18:03:20.134 INFO:tasks.workunit.client.0.smithi052.stdout:4/155: getdents d11/d17/d23 0 2024-09-12T18:03:20.136 INFO:tasks.workunit.client.0.smithi052.stdout:9/81: getdents d0 0 2024-09-12T18:03:20.136 INFO:tasks.workunit.client.0.smithi052.stdout:6/199: write d2/d11/f17 [1485529,49913] 0 2024-09-12T18:03:20.137 INFO:tasks.workunit.client.0.smithi052.stdout:5/54: dwrite d7/f8 [0,4194304] 0 2024-09-12T18:03:20.137 INFO:tasks.workunit.client.0.smithi052.stdout:7/48: dwrite d6/dc/fe [0,4194304] 0 2024-09-12T18:03:20.137 INFO:tasks.workunit.client.0.smithi052.stdout:2/68: truncate da/fb 1329562 0 2024-09-12T18:03:20.137 INFO:tasks.workunit.client.0.smithi052.stdout:9/82: stat d0/c3 0 2024-09-12T18:03:20.138 INFO:tasks.workunit.client.0.smithi052.stdout:0/119: chown d2/d8/fa 47 1 2024-09-12T18:03:20.138 INFO:tasks.workunit.client.0.smithi052.stdout:3/91: creat d0/d16/f1e x:0 0 0 2024-09-12T18:03:20.138 INFO:tasks.workunit.client.0.smithi052.stdout:8/125: dwrite ff [4194304,4194304] 0 2024-09-12T18:03:20.138 INFO:tasks.workunit.client.0.smithi052.stdout:5/55: chown f6 971495 1 2024-09-12T18:03:20.138 INFO:tasks.workunit.client.0.smithi052.stdout:5/56: readlink - no filename 2024-09-12T18:03:20.139 INFO:tasks.workunit.client.0.smithi052.stdout:3/92: truncate d0/f12 5072157 0 2024-09-12T18:03:20.139 INFO:tasks.workunit.client.0.smithi052.stdout:5/57: chown f5 48486128 1 2024-09-12T18:03:20.139 INFO:tasks.workunit.client.0.smithi052.stdout:1/87: stat d3/c17 0 2024-09-12T18:03:20.140 INFO:tasks.workunit.client.0.smithi052.stdout:9/83: rename d0/d18/c1e to d0/d1c/c21 0 2024-09-12T18:03:20.140 INFO:tasks.workunit.client.0.smithi052.stdout:8/126: creat d13/d18/d21/f23 x:0 0 0 2024-09-12T18:03:20.140 INFO:tasks.workunit.client.0.smithi052.stdout:3/93: chown d0/d16/d1c/l1d 66 1 2024-09-12T18:03:20.141 INFO:tasks.workunit.client.0.smithi052.stdout:3/94: fsync d0/fc 0 2024-09-12T18:03:20.141 INFO:tasks.workunit.client.0.smithi052.stdout:0/120: dread d2/d8/fa [0,4194304] 0 2024-09-12T18:03:20.142 INFO:tasks.workunit.client.0.smithi052.stdout:3/95: write d0/d16/f1e [678581,115196] 0 2024-09-12T18:03:20.142 INFO:tasks.workunit.client.0.smithi052.stdout:6/200: rename d2/d11/f17 to d2/d15/d1a/f45 0 2024-09-12T18:03:20.142 INFO:tasks.workunit.client.0.smithi052.stdout:9/84: creat d0/d1c/f22 x:0 0 0 2024-09-12T18:03:20.142 INFO:tasks.workunit.client.0.smithi052.stdout:8/127: symlink d13/l24 0 2024-09-12T18:03:20.143 INFO:tasks.workunit.client.0.smithi052.stdout:5/58: rename f5 to d7/f9 0 2024-09-12T18:03:20.143 INFO:tasks.workunit.client.0.smithi052.stdout:3/96: write d0/d16/f1e [566700,51139] 0 2024-09-12T18:03:20.143 INFO:tasks.workunit.client.0.smithi052.stdout:7/49: dread d6/dc/fe [0,4194304] 0 2024-09-12T18:03:20.143 INFO:tasks.workunit.client.0.smithi052.stdout:6/201: unlink d2/f2b 0 2024-09-12T18:03:20.144 INFO:tasks.workunit.client.0.smithi052.stdout:9/85: mkdir d0/d23 0 2024-09-12T18:03:20.144 INFO:tasks.workunit.client.0.smithi052.stdout:5/59: unlink f1 0 2024-09-12T18:03:20.144 INFO:tasks.workunit.client.0.smithi052.stdout:3/97: unlink d0/d4/c1b 0 2024-09-12T18:03:20.145 INFO:tasks.workunit.client.0.smithi052.stdout:1/88: rename d3/c19 to d3/d10/c1c 0 2024-09-12T18:03:20.145 INFO:tasks.workunit.client.0.smithi052.stdout:6/202: rmdir d2/d11 39 2024-09-12T18:03:20.145 INFO:tasks.workunit.client.0.smithi052.stdout:3/98: fsync d0/fc 0 2024-09-12T18:03:20.145 INFO:tasks.workunit.client.0.smithi052.stdout:6/203: read d2/fb [995138,103399] 0 2024-09-12T18:03:20.145 INFO:tasks.workunit.client.0.smithi052.stdout:3/99: mknod d0/d16/c1f 0 2024-09-12T18:03:20.146 INFO:tasks.workunit.client.0.smithi052.stdout:7/50: getdents d6/dc 0 2024-09-12T18:03:20.146 INFO:tasks.workunit.client.0.smithi052.stdout:3/100: mknod d0/c20 0 2024-09-12T18:03:20.147 INFO:tasks.workunit.client.0.smithi052.stdout:6/204: creat d2/d11/d26/f46 x:0 0 0 2024-09-12T18:03:20.147 INFO:tasks.workunit.client.0.smithi052.stdout:3/101: unlink d0/d16/d1c/l1d 0 2024-09-12T18:03:20.148 INFO:tasks.workunit.client.0.smithi052.stdout:8/128: dread d13/f1b [0,4194304] 0 2024-09-12T18:03:20.149 INFO:tasks.workunit.client.0.smithi052.stdout:8/129: creat d13/d18/f25 x:0 0 0 2024-09-12T18:03:20.150 INFO:tasks.workunit.client.0.smithi052.stdout:3/102: getdents d0/d9 0 2024-09-12T18:03:20.151 INFO:tasks.workunit.client.0.smithi052.stdout:7/51: dread d6/dc/fe [0,4194304] 0 2024-09-12T18:03:20.151 INFO:tasks.workunit.client.0.smithi052.stdout:4/156: write f8 [345054,69821] 0 2024-09-12T18:03:20.153 INFO:tasks.workunit.client.0.smithi052.stdout:1/89: dwrite d3/fa [0,4194304] 0 2024-09-12T18:03:20.154 INFO:tasks.workunit.client.0.smithi052.stdout:1/90: chown d3/d10 92008 1 2024-09-12T18:03:20.156 INFO:tasks.workunit.client.0.smithi052.stdout:5/60: getdents d7 0 2024-09-12T18:03:20.157 INFO:tasks.workunit.client.0.smithi052.stdout:0/121: truncate d2/d6/fb 2086834 0 2024-09-12T18:03:20.158 INFO:tasks.workunit.client.0.smithi052.stdout:7/52: link d6/f9 d6/f11 0 2024-09-12T18:03:20.158 INFO:tasks.workunit.client.0.smithi052.stdout:6/205: dwrite d2/d15/f41 [0,4194304] 0 2024-09-12T18:03:20.159 INFO:tasks.workunit.client.0.smithi052.stdout:2/69: dwrite f0 [0,4194304] 0 2024-09-12T18:03:20.159 INFO:tasks.workunit.client.0.smithi052.stdout:5/61: creat d7/fa x:0 0 0 2024-09-12T18:03:20.160 INFO:tasks.workunit.client.0.smithi052.stdout:4/157: mknod d11/d17/d1b/d2a/d33/c36 0 2024-09-12T18:03:20.160 INFO:tasks.workunit.client.0.smithi052.stdout:5/62: stat d7 0 2024-09-12T18:03:20.161 INFO:tasks.workunit.client.0.smithi052.stdout:0/122: write d2/d8/d9/ff [2120143,67113] 0 2024-09-12T18:03:20.161 INFO:tasks.workunit.client.0.smithi052.stdout:7/53: mkdir d6/d12 0 2024-09-12T18:03:20.161 INFO:tasks.workunit.client.0.smithi052.stdout:9/86: truncate d0/f1b 753932 0 2024-09-12T18:03:20.161 INFO:tasks.workunit.client.0.smithi052.stdout:3/103: dread d0/d4/f19 [0,4194304] 0 2024-09-12T18:03:20.163 INFO:tasks.workunit.client.0.smithi052.stdout:5/63: unlink d7/fa 0 2024-09-12T18:03:20.163 INFO:tasks.workunit.client.0.smithi052.stdout:4/158: chown d11/f15 6310243 1 2024-09-12T18:03:20.164 INFO:tasks.workunit.client.0.smithi052.stdout:8/130: dwrite d13/d18/f19 [0,4194304] 0 2024-09-12T18:03:20.165 INFO:tasks.workunit.client.0.smithi052.stdout:6/206: dread d2/ff [0,4194304] 0 2024-09-12T18:03:20.165 INFO:tasks.workunit.client.0.smithi052.stdout:5/64: mknod d7/cb 0 2024-09-12T18:03:20.165 INFO:tasks.workunit.client.0.smithi052.stdout:3/104: chown d0/d4/c11 3171841 1 2024-09-12T18:03:20.166 INFO:tasks.workunit.client.0.smithi052.stdout:9/87: write d0/f1d [906823,29909] 0 2024-09-12T18:03:20.166 INFO:tasks.workunit.client.0.smithi052.stdout:0/123: getdents d2/d6/dd 0 2024-09-12T18:03:20.166 INFO:tasks.workunit.client.0.smithi052.stdout:8/131: dread - d13/d18/d21/f23 zero size 2024-09-12T18:03:20.167 INFO:tasks.workunit.client.0.smithi052.stdout:6/207: chown d2/d15/f22 3359 1 2024-09-12T18:03:20.167 INFO:tasks.workunit.client.0.smithi052.stdout:2/70: dread da/f12 [0,4194304] 0 2024-09-12T18:03:20.167 INFO:tasks.workunit.client.0.smithi052.stdout:0/124: symlink d2/d6/l28 0 2024-09-12T18:03:20.168 INFO:tasks.workunit.client.0.smithi052.stdout:8/132: read d13/d18/f19 [1267952,15680] 0 2024-09-12T18:03:20.168 INFO:tasks.workunit.client.0.smithi052.stdout:5/65: fsync d7/f9 0 2024-09-12T18:03:20.169 INFO:tasks.workunit.client.0.smithi052.stdout:9/88: dread d0/f8 [0,4194304] 0 2024-09-12T18:03:20.169 INFO:tasks.workunit.client.0.smithi052.stdout:2/71: creat da/f16 x:0 0 0 2024-09-12T18:03:20.169 INFO:tasks.workunit.client.0.smithi052.stdout:6/208: getdents d2/d11 0 2024-09-12T18:03:20.170 INFO:tasks.workunit.client.0.smithi052.stdout:8/133: write d13/d18/d21/f23 [833335,44744] 0 2024-09-12T18:03:20.170 INFO:tasks.workunit.client.0.smithi052.stdout:5/66: write d7/f8 [3063261,125643] 0 2024-09-12T18:03:20.170 INFO:tasks.workunit.client.0.smithi052.stdout:2/72: write da/f16 [942038,14112] 0 2024-09-12T18:03:20.171 INFO:tasks.workunit.client.0.smithi052.stdout:9/89: write d0/f1a [1670983,33502] 0 2024-09-12T18:03:20.171 INFO:tasks.workunit.client.0.smithi052.stdout:8/134: fdatasync d13/d18/f25 0 2024-09-12T18:03:20.171 INFO:tasks.workunit.client.0.smithi052.stdout:2/73: stat f6 0 2024-09-12T18:03:20.172 INFO:tasks.workunit.client.0.smithi052.stdout:6/209: write d2/d15/f41 [1846320,37091] 0 2024-09-12T18:03:20.173 INFO:tasks.workunit.client.0.smithi052.stdout:5/67: truncate d7/f9 841054 0 2024-09-12T18:03:20.173 INFO:tasks.workunit.client.0.smithi052.stdout:8/135: write d13/d18/f25 [553031,126202] 0 2024-09-12T18:03:20.173 INFO:tasks.workunit.client.0.smithi052.stdout:9/90: write d0/d6/fd [190597,20773] 0 2024-09-12T18:03:20.174 INFO:tasks.workunit.client.0.smithi052.stdout:6/210: read d2/d15/f41 [2076627,70809] 0 2024-09-12T18:03:20.174 INFO:tasks.workunit.client.0.smithi052.stdout:5/68: read d7/f8 [4050399,77766] 0 2024-09-12T18:03:20.174 INFO:tasks.workunit.client.0.smithi052.stdout:1/91: sync 2024-09-12T18:03:20.175 INFO:tasks.workunit.client.0.smithi052.stdout:4/159: dwrite d11/d17/d1b/f2d [0,4194304] 0 2024-09-12T18:03:20.176 INFO:tasks.workunit.client.0.smithi052.stdout:4/160: fsync d11/d17/d23/d2f/f31 0 2024-09-12T18:03:20.177 INFO:tasks.workunit.client.0.smithi052.stdout:8/136: creat d13/d18/f26 x:0 0 0 2024-09-12T18:03:20.177 INFO:tasks.workunit.client.0.smithi052.stdout:6/211: mknod d2/d11/d26/c47 0 2024-09-12T18:03:20.178 INFO:tasks.workunit.client.0.smithi052.stdout:5/69: link d7/f9 d7/fc 0 2024-09-12T18:03:20.180 INFO:tasks.workunit.client.0.smithi052.stdout:7/54: truncate d6/dc/fe 3196660 0 2024-09-12T18:03:20.181 INFO:tasks.workunit.client.0.smithi052.stdout:8/137: chown d13/d18/f25 81246 1 2024-09-12T18:03:20.184 INFO:tasks.workunit.client.0.smithi052.stdout:0/125: truncate d2/d6/dd/f16 2507222 0 2024-09-12T18:03:20.186 INFO:tasks.workunit.client.0.smithi052.stdout:1/92: dread d3/fc [4194304,4194304] 0 2024-09-12T18:03:20.186 INFO:tasks.workunit.client.0.smithi052.stdout:7/55: fdatasync f5 0 2024-09-12T18:03:20.186 INFO:tasks.workunit.client.0.smithi052.stdout:6/212: link d2/d11/d26/f46 d2/d1e/f48 0 2024-09-12T18:03:20.189 INFO:tasks.workunit.client.0.smithi052.stdout:0/126: write d2/d8/f1c [1598766,79210] 0 2024-09-12T18:03:20.189 INFO:tasks.workunit.client.0.smithi052.stdout:9/91: dwrite d0/d6/fd [0,4194304] 0 2024-09-12T18:03:20.190 INFO:tasks.workunit.client.0.smithi052.stdout:2/74: write da/f12 [214138,90256] 0 2024-09-12T18:03:20.194 INFO:tasks.workunit.client.0.smithi052.stdout:3/105: dwrite d0/d4/f19 [0,4194304] 0 2024-09-12T18:03:20.194 INFO:tasks.workunit.client.0.smithi052.stdout:9/92: truncate d0/f1b 1091772 0 2024-09-12T18:03:20.195 INFO:tasks.workunit.client.0.smithi052.stdout:1/93: mkdir d3/d1d 0 2024-09-12T18:03:20.195 INFO:tasks.workunit.client.0.smithi052.stdout:2/75: chown da/dc/dd/f14 6649189 1 2024-09-12T18:03:20.197 INFO:tasks.workunit.client.0.smithi052.stdout:3/106: fdatasync d0/d16/f1e 0 2024-09-12T18:03:20.197 INFO:tasks.workunit.client.0.smithi052.stdout:0/127: dread d2/d8/f20 [0,4194304] 0 2024-09-12T18:03:20.197 INFO:tasks.workunit.client.0.smithi052.stdout:4/161: dwrite d11/d17/d1b/f20 [0,4194304] 0 2024-09-12T18:03:20.197 INFO:tasks.workunit.client.0.smithi052.stdout:5/70: dwrite d7/f8 [0,4194304] 0 2024-09-12T18:03:20.198 INFO:tasks.workunit.client.0.smithi052.stdout:4/162: dread - d11/f25 zero size 2024-09-12T18:03:20.199 INFO:tasks.workunit.client.0.smithi052.stdout:3/107: mknod d0/c21 0 2024-09-12T18:03:20.199 INFO:tasks.workunit.client.0.smithi052.stdout:5/71: symlink d7/ld 0 2024-09-12T18:03:20.200 INFO:tasks.workunit.client.0.smithi052.stdout:2/76: creat da/f17 x:0 0 0 2024-09-12T18:03:20.200 INFO:tasks.workunit.client.0.smithi052.stdout:0/128: chown d2/d6/fb 50273 1 2024-09-12T18:03:20.200 INFO:tasks.workunit.client.0.smithi052.stdout:8/138: dwrite ff [4194304,4194304] 0 2024-09-12T18:03:20.200 INFO:tasks.workunit.client.0.smithi052.stdout:5/72: readlink d7/ld 0 2024-09-12T18:03:20.202 INFO:tasks.workunit.client.0.smithi052.stdout:6/213: truncate d2/fa 1958840 0 2024-09-12T18:03:20.204 INFO:tasks.workunit.client.0.smithi052.stdout:3/108: link d0/d4/c11 d0/d16/d1c/c22 0 2024-09-12T18:03:20.204 INFO:tasks.workunit.client.0.smithi052.stdout:7/56: chown d6/dc/fe 0 1 2024-09-12T18:03:20.204 INFO:tasks.workunit.client.0.smithi052.stdout:0/129: dread d2/d6/fb [0,4194304] 0 2024-09-12T18:03:20.204 INFO:tasks.workunit.client.0.smithi052.stdout:2/77: getdents da/dc/dd 0 2024-09-12T18:03:20.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/57: dread - f5 zero size 2024-09-12T18:03:20.206 INFO:tasks.workunit.client.0.smithi052.stdout:2/78: write da/f12 [833083,427] 0 2024-09-12T18:03:20.207 INFO:tasks.workunit.client.0.smithi052.stdout:0/130: chown d2/l3 192 1 2024-09-12T18:03:20.207 INFO:tasks.workunit.client.0.smithi052.stdout:6/214: getdents d2/d15/d1a 0 2024-09-12T18:03:20.207 INFO:tasks.workunit.client.0.smithi052.stdout:3/109: read d0/d9/d6/f15 [84313,71551] 0 2024-09-12T18:03:20.207 INFO:tasks.workunit.client.0.smithi052.stdout:1/94: dwrite d3/d10/f11 [0,4194304] 0 2024-09-12T18:03:20.208 INFO:tasks.workunit.client.0.smithi052.stdout:7/58: rename d6/f9 to d6/dc/f13 0 2024-09-12T18:03:20.208 INFO:tasks.workunit.client.0.smithi052.stdout:7/59: readlink - no filename 2024-09-12T18:03:20.209 INFO:tasks.workunit.client.0.smithi052.stdout:9/93: dwrite d0/d1c/f22 [0,4194304] 0 2024-09-12T18:03:20.209 INFO:tasks.workunit.client.0.smithi052.stdout:3/110: symlink d0/d4/l23 0 2024-09-12T18:03:20.210 INFO:tasks.workunit.client.0.smithi052.stdout:6/215: mkdir d2/d49 0 2024-09-12T18:03:20.211 INFO:tasks.workunit.client.0.smithi052.stdout:3/111: write d0/d16/f1e [1432634,123550] 0 2024-09-12T18:03:20.211 INFO:tasks.workunit.client.0.smithi052.stdout:2/79: mknod da/c18 0 2024-09-12T18:03:20.211 INFO:tasks.workunit.client.0.smithi052.stdout:9/94: symlink d0/d6/l24 0 2024-09-12T18:03:20.212 INFO:tasks.workunit.client.0.smithi052.stdout:9/95: sync 2024-09-12T18:03:20.212 INFO:tasks.workunit.client.0.smithi052.stdout:7/60: symlink d6/d12/l14 0 2024-09-12T18:03:20.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/95: chown d3/c1b 769 1 2024-09-12T18:03:20.212 INFO:tasks.workunit.client.0.smithi052.stdout:3/112: symlink d0/d16/l24 0 2024-09-12T18:03:20.213 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:20.213 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:20.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.213 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:10910 4.28 4:17d5e0d8:::10000003169.00000000:head [write 0~4194304 [2@995020] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:20.213 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:20.199702+0000", 2024-09-12T18:03:20.213 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.013355103, 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.013388269, 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 10910 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.199702+0000", 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.199702+0000", 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.199704+0000", 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.95e-06 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.208986+0000", 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0092817420000000008 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.209026+0000", 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0187e-05 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.216 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.209035+0000", 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.7590000000000003e-06 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.209142+0000", 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010690499999999999 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.209322+0000", 2024-09-12T18:03:20.217 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018012700000000001 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.209527+0000", 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000205596 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(client.4587.0:10909 4.13 e50/17 4:c88da5ba:::1000000310a.00000000:head v 50'163, mlcod=50'160)", 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:20.210372+0000", 2024-09-12T18:03:20.218 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0026853739999999999, 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027970360000000001, 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.210372+0000", 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.210372+0000", 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.210373+0000", 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1799999999999999e-06 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.212372+0000", 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0019988129999999999 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.212386+0000", 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4521999999999999e-05 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.212398+0000", 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2043e-05 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.212473+0000", 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4697000000000007e-05 2024-09-12T18:03:20.221 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:20.212491+0000", 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7577000000000001e-05 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 2 2024-09-12T18:03:20.222 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:20.224 INFO:tasks.workunit.client.0.smithi052.stdout:7/61: creat d6/d12/f15 x:0 0 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:1/96: creat d3/f1e x:0 0 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:3/113: mkdir d0/d4/d25 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:7/62: dread - d6/dc/f13 zero size 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:6/216: link d2/f19 d2/d11/f4a 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:6/217: creat d2/d49/f4b x:0 0 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:4/163: dread d11/d17/f18 [0,4194304] 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:0/131: dwrite d2/d8/d9/ff [0,4194304] 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:5/73: dread f4 [0,4194304] 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:2/80: dread f3 [0,4194304] 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:4/164: stat d11/d17/d1b/d2a/d32 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:0/132: write d2/d8/fa [644678,95966] 0 2024-09-12T18:03:20.225 INFO:tasks.workunit.client.0.smithi052.stdout:1/97: write d3/d10/f11 [4494898,84448] 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:2/81: creat da/dc/d15/f19 x:0 0 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:4/165: write f10 [928136,45283] 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:5/74: dread f4 [0,4194304] 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:3/114: dread d0/f13 [0,4194304] 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:2/82: write da/f16 [384002,117885] 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:4/166: truncate d11/d17/f34 931221 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:1/98: mknod d3/d1d/c1f 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:5/75: write f4 [582405,33393] 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:3/115: write d0/f12 [4257864,35699] 0 2024-09-12T18:03:20.226 INFO:tasks.workunit.client.0.smithi052.stdout:8/139: fsync ff 0 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi052.stdout:5/76: fsync d7/fc 0 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi052.stdout:8/140: fsync d13/f1f 0 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi052.stdout:2/83: getdents da/dc 0 2024-09-12T18:03:20.227 INFO:tasks.workunit.client.0.smithi052.stdout:1/99: rename d3/d10/f11 to d3/f20 0 2024-09-12T18:03:20.228 INFO:tasks.workunit.client.0.smithi052.stdout:5/77: rename d7/ld to d7/le 0 2024-09-12T18:03:20.228 INFO:tasks.workunit.client.0.smithi052.stdout:4/167: truncate d11/d17/d23/d2f/f31 550238 0 2024-09-12T18:03:20.229 INFO:tasks.workunit.client.0.smithi052.stdout:3/116: creat d0/d9/d6/d7/de/f26 x:0 0 0 2024-09-12T18:03:20.229 INFO:tasks.workunit.client.0.smithi052.stdout:6/218: fsync d2/d49/f4b 0 2024-09-12T18:03:20.229 INFO:tasks.workunit.client.0.smithi052.stdout:9/96: dwrite d0/d6/fd [4194304,4194304] 0 2024-09-12T18:03:20.229 INFO:tasks.workunit.client.0.smithi052.stdout:1/100: creat d3/d1d/f21 x:0 0 0 2024-09-12T18:03:20.230 INFO:tasks.workunit.client.0.smithi052.stdout:8/141: creat d13/d18/d21/f27 x:0 0 0 2024-09-12T18:03:20.231 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:20.229+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:20.231 INFO:tasks.workunit.client.0.smithi052.stdout:0/133: dwrite d2/d6/f10 [0,4194304] 0 2024-09-12T18:03:20.232 INFO:tasks.workunit.client.0.smithi052.stdout:2/84: truncate da/dc/d15/f19 758136 0 2024-09-12T18:03:20.233 INFO:tasks.workunit.client.0.smithi052.stdout:3/117: chown d0/d4/c11 3 1 2024-09-12T18:03:20.233 INFO:tasks.workunit.client.0.smithi052.stdout:1/101: mkdir d3/d1d/d22 0 2024-09-12T18:03:20.234 INFO:tasks.workunit.client.0.smithi052.stdout:9/97: creat d0/d1c/f25 x:0 0 0 2024-09-12T18:03:20.234 INFO:tasks.workunit.client.0.smithi052.stdout:0/134: chown d2/d8/d9 8 1 2024-09-12T18:03:20.234 INFO:tasks.workunit.client.0.smithi052.stdout:4/168: mknod d11/d17/d1b/d2a/d33/c37 0 2024-09-12T18:03:20.234 INFO:tasks.workunit.client.0.smithi052.stdout:8/142: creat d13/d18/d21/f28 x:0 0 0 2024-09-12T18:03:20.235 INFO:tasks.workunit.client.0.smithi052.stdout:4/169: read - d11/f1f zero size 2024-09-12T18:03:20.236 INFO:tasks.workunit.client.0.smithi052.stdout:2/85: symlink da/l1a 0 2024-09-12T18:03:20.236 INFO:tasks.workunit.client.0.smithi052.stdout:1/102: readlink d3/d10/l12 0 2024-09-12T18:03:20.236 INFO:tasks.workunit.client.0.smithi052.stdout:6/219: getdents d2/d21 0 2024-09-12T18:03:20.237 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:20.237 INFO:tasks.workunit.client.0.smithi052.stdout:3/118: write d0/f12 [5347323,60170] 0 2024-09-12T18:03:20.237 INFO:tasks.workunit.client.0.smithi052.stdout:9/98: mkdir d0/d18/d26 0 2024-09-12T18:03:20.238 INFO:tasks.workunit.client.0.smithi052.stdout:1/103: rmdir d3/d10 39 2024-09-12T18:03:20.238 INFO:tasks.workunit.client.0.smithi052.stdout:7/63: dwrite d6/fd [0,4194304] 0 2024-09-12T18:03:20.239 INFO:tasks.workunit.client.0.smithi052.stdout:5/78: truncate d7/f9 1813818 0 2024-09-12T18:03:20.239 INFO:tasks.workunit.client.0.smithi052.stdout:0/135: dread d2/d8/fa [0,4194304] 0 2024-09-12T18:03:20.241 INFO:tasks.workunit.client.0.smithi052.stdout:4/170: dread f10 [0,4194304] 0 2024-09-12T18:03:20.241 INFO:tasks.workunit.client.0.smithi052.stdout:7/64: unlink d6/dc/f13 0 2024-09-12T18:03:20.244 INFO:tasks.workunit.client.0.smithi052.stdout:7/65: creat d6/f16 x:0 0 0 2024-09-12T18:03:20.244 INFO:tasks.workunit.client.0.smithi052.stdout:1/104: rename d3/d10/l16 to d3/d1d/d22/l23 0 2024-09-12T18:03:20.246 INFO:tasks.workunit.client.0.smithi052.stdout:1/105: mknod d3/d1d/c24 0 2024-09-12T18:03:20.247 INFO:tasks.workunit.client.0.smithi052.stdout:7/66: mkdir d6/d12/d17 0 2024-09-12T18:03:20.247 INFO:tasks.workunit.client.0.smithi052.stdout:3/119: dread d0/d16/f1e [0,4194304] 0 2024-09-12T18:03:20.247 INFO:tasks.workunit.client.0.smithi052.stdout:8/143: dwrite f7 [4194304,4194304] 0 2024-09-12T18:03:20.248 INFO:tasks.workunit.client.0.smithi052.stdout:1/106: dread - d3/f1e zero size 2024-09-12T18:03:20.250 INFO:tasks.workunit.client.0.smithi052.stdout:2/86: dwrite da/f13 [0,4194304] 0 2024-09-12T18:03:20.250 INFO:tasks.workunit.client.0.smithi052.stdout:3/120: creat d0/d4/f27 x:0 0 0 2024-09-12T18:03:20.251 INFO:tasks.workunit.client.0.smithi052.stdout:8/144: unlink l8 0 2024-09-12T18:03:20.252 INFO:tasks.workunit.client.0.smithi052.stdout:7/67: rename d6/d12/l14 to d6/d12/l18 0 2024-09-12T18:03:20.252 INFO:tasks.workunit.client.0.smithi052.stdout:5/79: link d7/fc d7/ff 0 2024-09-12T18:03:20.254 INFO:tasks.workunit.client.0.smithi052.stdout:3/121: creat d0/d4/f28 x:0 0 0 2024-09-12T18:03:20.255 INFO:tasks.workunit.client.0.smithi052.stdout:1/107: creat d3/f25 x:0 0 0 2024-09-12T18:03:20.255 INFO:tasks.workunit.client.0.smithi052.stdout:2/87: symlink da/dc/d15/l1b 0 2024-09-12T18:03:20.256 INFO:tasks.workunit.client.0.smithi052.stdout:9/99: dread d0/f1a [0,4194304] 0 2024-09-12T18:03:20.257 INFO:tasks.workunit.client.0.smithi052.stdout:4/171: dwrite d11/f25 [0,4194304] 0 2024-09-12T18:03:20.257 INFO:tasks.workunit.client.0.smithi052.stdout:5/80: fsync d7/f9 0 2024-09-12T18:03:20.259 INFO:tasks.workunit.client.0.smithi052.stdout:2/88: creat da/dc/d15/f1c x:0 0 0 2024-09-12T18:03:20.259 INFO:tasks.workunit.client.0.smithi052.stdout:5/81: mknod d7/c10 0 2024-09-12T18:03:20.260 INFO:tasks.workunit.client.0.smithi052.stdout:0/136: dwrite d2/d6/fb [0,4194304] 0 2024-09-12T18:03:20.261 INFO:tasks.workunit.client.0.smithi052.stdout:6/220: dwrite d2/d15/f23 [0,4194304] 0 2024-09-12T18:03:20.261 INFO:tasks.workunit.client.0.smithi052.stdout:9/100: write d0/f1d [2461438,83480] 0 2024-09-12T18:03:20.264 INFO:tasks.workunit.client.0.smithi052.stdout:2/89: mkdir da/d1d 0 2024-09-12T18:03:20.264 INFO:tasks.workunit.client.0.smithi052.stdout:0/137: creat d2/f29 x:0 0 0 2024-09-12T18:03:20.264 INFO:tasks.workunit.client.0.smithi052.stdout:9/101: creat d0/d6/f27 x:0 0 0 2024-09-12T18:03:20.266 INFO:tasks.workunit.client.0.smithi052.stdout:8/145: truncate d13/d18/f25 116230 0 2024-09-12T18:03:20.267 INFO:tasks.workunit.client.0.smithi052.stdout:8/146: sync 2024-09-12T18:03:20.267 INFO:tasks.workunit.client.0.smithi052.stdout:7/68: write d6/dc/fe [4077130,16965] 0 2024-09-12T18:03:20.268 INFO:tasks.workunit.client.0.smithi052.stdout:0/138: write d2/d6/fb [288134,104509] 0 2024-09-12T18:03:20.268 INFO:tasks.workunit.client.0.smithi052.stdout:6/221: truncate d2/f19 863358 0 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi052.stdout:3/122: dwrite d0/d4/f27 [0,4194304] 0 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi052.stdout:3/123: sync 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi052.stdout:9/102: fsync d0/fc 0 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi052.stdout:8/147: write d13/f17 [1979235,35633] 0 2024-09-12T18:03:20.270 INFO:tasks.workunit.client.0.smithi052.stdout:2/90: truncate da/dc/dd/f14 934363 0 2024-09-12T18:03:20.271 INFO:tasks.workunit.client.0.smithi052.stdout:1/108: dwrite d3/d1d/f21 [0,4194304] 0 2024-09-12T18:03:20.271 INFO:tasks.workunit.client.0.smithi052.stdout:5/82: truncate d7/f8 1002435 0 2024-09-12T18:03:20.272 INFO:tasks.workunit.client.0.smithi052.stdout:6/222: write d2/d15/f2c [334635,129304] 0 2024-09-12T18:03:20.272 INFO:tasks.workunit.client.0.smithi052.stdout:7/69: dread - d6/f16 zero size 2024-09-12T18:03:20.273 INFO:tasks.workunit.client.0.smithi052.stdout:1/109: fsync d3/fa 0 2024-09-12T18:03:20.273 INFO:tasks.workunit.client.0.smithi052.stdout:8/148: write d13/f17 [2714965,115173] 0 2024-09-12T18:03:20.273 INFO:tasks.workunit.client.0.smithi052.stdout:0/139: creat d2/d6/dd/d21/f2a x:0 0 0 2024-09-12T18:03:20.273 INFO:tasks.workunit.client.0.smithi052.stdout:9/103: symlink d0/l28 0 2024-09-12T18:03:20.274 INFO:tasks.workunit.client.0.smithi052.stdout:5/83: fsync d7/f9 0 2024-09-12T18:03:20.274 INFO:tasks.workunit.client.0.smithi052.stdout:3/124: write d0/d4/f28 [530258,114327] 0 2024-09-12T18:03:20.274 INFO:tasks.workunit.client.0.smithi052.stdout:8/149: readlink d13/l24 0 2024-09-12T18:03:20.274 INFO:tasks.workunit.client.0.smithi052.stdout:4/172: dwrite f8 [0,4194304] 0 2024-09-12T18:03:20.274 INFO:tasks.workunit.client.0.smithi052.stdout:7/70: symlink d6/l19 0 2024-09-12T18:03:20.275 INFO:tasks.workunit.client.0.smithi052.stdout:6/223: creat d2/d21/f4c x:0 0 0 2024-09-12T18:03:20.275 INFO:tasks.workunit.client.0.smithi052.stdout:2/91: creat da/d1d/f1e x:0 0 0 2024-09-12T18:03:20.276 INFO:tasks.workunit.client.0.smithi052.stdout:8/150: write f7 [383965,60219] 0 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi052.stdout:4/173: chown cb 647013 1 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi052.stdout:1/110: write d3/f1e [683365,41978] 0 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi052.stdout:3/125: chown d0/d4/f28 2656 1 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi052.stdout:8/151: chown d13 1685 1 2024-09-12T18:03:20.277 INFO:tasks.workunit.client.0.smithi052.stdout:9/104: dread d0/f8 [0,4194304] 0 2024-09-12T18:03:20.278 INFO:tasks.workunit.client.0.smithi052.stdout:5/84: mknod d7/c11 0 2024-09-12T18:03:20.278 INFO:tasks.workunit.client.0.smithi052.stdout:8/152: symlink d13/d18/l29 0 2024-09-12T18:03:20.278 INFO:tasks.workunit.client.0.smithi052.stdout:0/140: rmdir d2/d6/dd/d21 39 2024-09-12T18:03:20.278 INFO:tasks.workunit.client.0.smithi052.stdout:2/92: write da/f12 [229123,119004] 0 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi052.stdout:6/224: getdents d2/d3f 0 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi052.stdout:1/111: creat d3/d10/f26 x:0 0 0 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi052.stdout:3/126: symlink d0/d9/d17/l29 0 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi052.stdout:0/141: chown d2/d8 35237891 1 2024-09-12T18:03:20.279 INFO:tasks.workunit.client.0.smithi052.stdout:4/174: rename d11 to d11/d17/d23/d2f/d38 22 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi052.stdout:9/105: write d0/f1b [1401100,109593] 0 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi052.stdout:4/175: read d11/f25 [1032365,8601] 0 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi052.stdout:9/106: sync 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi052.stdout:2/93: dread f3 [0,4194304] 0 2024-09-12T18:03:20.280 INFO:tasks.workunit.client.0.smithi052.stdout:1/112: mkdir d3/d1d/d22/d27 0 2024-09-12T18:03:20.282 INFO:tasks.workunit.client.0.smithi052.stdout:8/153: mknod d13/c2a 0 2024-09-12T18:03:20.282 INFO:tasks.workunit.client.0.smithi052.stdout:2/94: chown da 19930177 1 2024-09-12T18:03:20.282 INFO:tasks.workunit.client.0.smithi052.stdout:0/142: getdents d2/d1b 0 2024-09-12T18:03:20.282 INFO:tasks.workunit.client.0.smithi052.stdout:4/176: truncate d11/d17/d23/d2f/f31 1569691 0 2024-09-12T18:03:20.284 INFO:tasks.workunit.client.0.smithi052.stdout:9/107: symlink d0/d6/l29 0 2024-09-12T18:03:20.284 INFO:tasks.workunit.client.0.smithi052.stdout:1/113: unlink d3/c14 0 2024-09-12T18:03:20.285 INFO:tasks.workunit.client.0.smithi052.stdout:9/108: readlink d0/d6/l29 0 2024-09-12T18:03:20.287 INFO:tasks.workunit.client.0.smithi052.stdout:7/71: dread d6/dc/fe [0,4194304] 0 2024-09-12T18:03:20.288 INFO:tasks.workunit.client.0.smithi052.stdout:9/109: creat d0/d18/f2a x:0 0 0 2024-09-12T18:03:20.292 INFO:tasks.workunit.client.0.smithi052.stdout:3/127: dwrite d0/f13 [0,4194304] 0 2024-09-12T18:03:20.295 INFO:tasks.workunit.client.0.smithi052.stdout:8/154: dwrite d13/f1b [8388608,4194304] 0 2024-09-12T18:03:20.296 INFO:tasks.workunit.client.0.smithi052.stdout:7/72: readlink d6/d12/l18 0 2024-09-12T18:03:20.296 INFO:tasks.workunit.client.0.smithi052.stdout:5/85: write d7/f8 [920957,27288] 0 2024-09-12T18:03:20.297 INFO:tasks.workunit.client.0.smithi052.stdout:9/110: chown d0/fc 40450481 1 2024-09-12T18:03:20.297 INFO:tasks.workunit.client.0.smithi052.stdout:0/143: dwrite d2/f29 [0,4194304] 0 2024-09-12T18:03:20.298 INFO:tasks.workunit.client.0.smithi052.stdout:3/128: dread - d0/d9/d6/d7/de/f26 zero size 2024-09-12T18:03:20.300 INFO:tasks.workunit.client.0.smithi052.stdout:4/177: dwrite d11/d17/d1b/f2d [0,4194304] 0 2024-09-12T18:03:20.300 INFO:tasks.workunit.client.0.smithi052.stdout:5/86: fdatasync f6 0 2024-09-12T18:03:20.300 INFO:tasks.workunit.client.0.smithi052.stdout:8/155: symlink d13/d18/l2b 0 2024-09-12T18:03:20.300 INFO:tasks.workunit.client.0.smithi052.stdout:5/87: chown d7 62358 1 2024-09-12T18:03:20.301 INFO:tasks.workunit.client.0.smithi052.stdout:7/73: write d6/dc/fe [4618387,20140] 0 2024-09-12T18:03:20.302 INFO:tasks.workunit.client.0.smithi052.stdout:4/178: creat d11/d17/d23/d2f/f39 x:0 0 0 2024-09-12T18:03:20.302 INFO:tasks.workunit.client.0.smithi052.stdout:5/88: readlink d7/le 0 2024-09-12T18:03:20.302 INFO:tasks.workunit.client.0.smithi052.stdout:1/114: dwrite d3/f20 [0,4194304] 0 2024-09-12T18:03:20.302 INFO:tasks.workunit.client.0.smithi052.stdout:8/156: symlink d13/l2c 0 2024-09-12T18:03:20.303 INFO:tasks.workunit.client.0.smithi052.stdout:6/225: dwrite d2/d15/f22 [0,4194304] 0 2024-09-12T18:03:20.303 INFO:tasks.workunit.client.0.smithi052.stdout:7/74: dread - d6/f11 zero size 2024-09-12T18:03:20.308 INFO:tasks.workunit.client.0.smithi052.stdout:9/111: dwrite d0/d6/f27 [0,4194304] 0 2024-09-12T18:03:20.309 INFO:tasks.workunit.client.0.smithi052.stdout:0/144: creat d2/d6/dd/d21/d26/f2b x:0 0 0 2024-09-12T18:03:20.309 INFO:tasks.workunit.client.0.smithi052.stdout:3/129: getdents d0/d4 0 2024-09-12T18:03:20.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/179: creat d11/d17/d23/d2f/f3a x:0 0 0 2024-09-12T18:03:20.311 INFO:tasks.workunit.client.0.smithi052.stdout:8/157: mknod d13/d18/c2d 0 2024-09-12T18:03:20.312 INFO:tasks.workunit.client.0.smithi052.stdout:7/75: dread f5 [0,4194304] 0 2024-09-12T18:03:20.312 INFO:tasks.workunit.client.0.smithi052.stdout:7/76: sync 2024-09-12T18:03:20.312 INFO:tasks.workunit.client.0.smithi052.stdout:1/115: write d3/ff [4544424,103197] 0 2024-09-12T18:03:20.312 INFO:tasks.workunit.client.0.smithi052.stdout:0/145: symlink d2/d6/l2c 0 2024-09-12T18:03:20.313 INFO:tasks.workunit.client.0.smithi052.stdout:4/180: mkdir d11/d17/d23/d2f/d3b 0 2024-09-12T18:03:20.314 INFO:tasks.workunit.client.0.smithi052.stdout:2/95: dread da/dc/dd/fe [0,4194304] 0 2024-09-12T18:03:20.314 INFO:tasks.workunit.client.0.smithi052.stdout:9/112: read d0/d1c/f22 [1686435,101585] 0 2024-09-12T18:03:20.314 INFO:tasks.workunit.client.0.smithi052.stdout:1/116: read - d3/f25 zero size 2024-09-12T18:03:20.315 INFO:tasks.workunit.client.0.smithi052.stdout:9/113: sync 2024-09-12T18:03:20.315 INFO:tasks.workunit.client.0.smithi052.stdout:6/226: dwrite d2/d21/f2a [0,4194304] 0 2024-09-12T18:03:20.315 INFO:tasks.workunit.client.0.smithi052.stdout:5/89: dwrite d7/f8 [0,4194304] 0 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi052.stdout:9/114: chown d0/l28 0 1 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi052.stdout:5/90: sync 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi052.stdout:6/227: fdatasync d2/d15/f1d 0 2024-09-12T18:03:20.316 INFO:tasks.workunit.client.0.smithi052.stdout:9/115: chown d0/d23 608156581 1 2024-09-12T18:03:20.317 INFO:tasks.workunit.client.0.smithi052.stdout:7/77: mkdir d6/dc/d1a 0 2024-09-12T18:03:20.320 INFO:tasks.workunit.client.0.smithi052.stdout:0/146: unlink d2/d8/d9/ff 0 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi052.stdout:6/228: rename d2/d15 to d2/d15/d1a/d4d 22 2024-09-12T18:03:20.321 INFO:tasks.workunit.client.0.smithi052.stdout:2/96: unlink da/fb 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:5/91: creat d7/f12 x:0 0 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:2/97: truncate da/f16 967640 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:4/181: mknod d11/d17/d1b/d2a/d32/c3c 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:8/158: getdents d13/d18 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:1/117: dread d3/ff [0,4194304] 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:9/116: creat d0/f2b x:0 0 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:5/92: creat d7/f13 x:0 0 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:2/98: creat da/dc/d15/f1f x:0 0 0 2024-09-12T18:03:20.322 INFO:tasks.workunit.client.0.smithi052.stdout:4/182: unlink d11/d17/d1b/f35 0 2024-09-12T18:03:20.323 INFO:tasks.workunit.client.0.smithi052.stdout:8/159: fsync d13/f1c 0 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi052.stdout:7/78: dread f5 [0,4194304] 0 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi052.stdout:1/118: mkdir d3/d1d/d22/d27/d28 0 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi052.stdout:9/117: symlink d0/d6/l2c 0 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi052.stdout:8/160: stat d13/d18/d21/f28 0 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi052.stdout:2/99: rename da/dc/dd to da/dc/d15/d20 0 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi052.stdout:1/119: unlink d3/f1e 0 2024-09-12T18:03:20.324 INFO:tasks.workunit.client.0.smithi052.stdout:4/183: write f10 [925121,30345] 0 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi052.stdout:8/161: fsync fb 0 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi052.stdout:2/100: read - da/f17 zero size 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi052.stdout:9/118: mknod d0/d6/c2d 0 2024-09-12T18:03:20.325 INFO:tasks.workunit.client.0.smithi052.stdout:7/79: truncate d6/f16 204701 0 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi052.stdout:1/120: chown d3/c1b 776 1 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi052.stdout:4/184: symlink d11/l3d 0 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi052.stdout:8/162: write d13/d18/f19 [4750562,120296] 0 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi052.stdout:2/101: dread - da/dc/d15/f1f zero size 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi052.stdout:7/80: symlink d6/dc/l1b 0 2024-09-12T18:03:20.326 INFO:tasks.workunit.client.0.smithi052.stdout:9/119: rename d0/d6/l29 to d0/d23/l2e 0 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi052.stdout:5/93: dread d7/f9 [0,4194304] 0 2024-09-12T18:03:20.327 INFO:tasks.workunit.client.0.smithi052.stdout:1/121: creat d3/d1d/d22/d27/d28/f29 x:0 0 0 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi052.stdout:1/122: unlink d3/c17 0 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi052.stdout:9/120: write d0/fb [3968919,82681] 0 2024-09-12T18:03:20.328 INFO:tasks.workunit.client.0.smithi052.stdout:7/81: rename d6/f16 to d6/dc/f1c 0 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi052.stdout:7/82: readlink d6/l19 0 2024-09-12T18:03:20.329 INFO:tasks.workunit.client.0.smithi052.stdout:1/123: chown d3/ld 518623451 1 2024-09-12T18:03:20.330 INFO:tasks.workunit.client.0.smithi052.stdout:9/121: creat d0/d23/f2f x:0 0 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi052.stdout:9/122: fdatasync d0/f1b 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi052.stdout:7/83: symlink d6/d12/d17/l1d 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi052.stdout:2/102: dread da/f12 [0,4194304] 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi052.stdout:1/124: symlink d3/d10/l2a 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi052.stdout:7/84: stat d6/f11 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi052.stdout:2/103: readlink da/l1a 0 2024-09-12T18:03:20.332 INFO:tasks.workunit.client.0.smithi052.stdout:8/163: dread d13/f1b [0,4194304] 0 2024-09-12T18:03:20.333 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:20.327+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi052.stdout:2/104: chown l4 122114960 1 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi052.stdout:8/164: chown d13/f1b 174 1 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi052.stdout:7/85: write f5 [4125561,32585] 0 2024-09-12T18:03:20.334 INFO:tasks.workunit.client.0.smithi052.stdout:1/125: rename d3/d1d/f21 to d3/f2b 0 2024-09-12T18:03:20.335 INFO:tasks.workunit.client.0.smithi052.stdout:4/185: dwrite d11/d17/d23/d2f/f39 [0,4194304] 0 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi052.stdout:2/105: mkdir da/d21 0 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi052.stdout:7/86: mkdir d6/d12/d1e 0 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi052.stdout:1/126: creat d3/d1d/f2c x:0 0 0 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi052.stdout:1/127: chown d3 10 1 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi052.stdout:2/106: write da/dc/d15/f19 [650272,71431] 0 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi052.stdout:2/107: fsync da/f16 0 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi052.stdout:3/130: truncate d0/d4/f28 589534 0 2024-09-12T18:03:20.336 INFO:tasks.workunit.client.0.smithi052.stdout:7/87: write d6/ff [30217,24608] 0 2024-09-12T18:03:20.337 INFO:tasks.workunit.client.0.smithi052.stdout:5/94: write d7/fc [2578565,66034] 0 2024-09-12T18:03:20.339 INFO:tasks.workunit.client.0.smithi052.stdout:2/108: mkdir da/dc/d15/d22 0 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi052.stdout:9/123: fdatasync d0/d6/f27 0 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi052.stdout:3/131: rename d0/d9 to d0/d4/d25/d2a 0 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi052.stdout:8/165: write d13/f1c [6028056,90816] 0 2024-09-12T18:03:20.340 INFO:tasks.workunit.client.0.smithi052.stdout:6/229: dread d2/f19 [0,4194304] 0 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi052.stdout:5/95: rename d7/f12 to d7/f14 0 2024-09-12T18:03:20.341 INFO:tasks.workunit.client.0.smithi052.stdout:1/128: symlink d3/d10/l2d 0 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi052.stdout:7/88: link d6/d12/d17/l1d d6/d12/d17/l1f 0 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi052.stdout:9/124: dread - d0/f2b zero size 2024-09-12T18:03:20.342 INFO:tasks.workunit.client.0.smithi052.stdout:3/132: read d0/f12 [5354249,114164] 0 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi052.stdout:5/96: mknod d7/c15 0 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi052.stdout:6/230: creat d2/d21/f4e x:0 0 0 2024-09-12T18:03:20.343 INFO:tasks.workunit.client.0.smithi052.stdout:2/109: dread f3 [0,4194304] 0 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi052.stdout:9/125: stat d0/fc 0 2024-09-12T18:03:20.344 INFO:tasks.workunit.client.0.smithi052.stdout:8/166: unlink d13/c20 0 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi052.stdout:5/97: creat d7/f16 x:0 0 0 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi052.stdout:0/147: dwrite d2/d6/dd/f17 [0,4194304] 0 2024-09-12T18:03:20.345 INFO:tasks.workunit.client.0.smithi052.stdout:9/126: symlink d0/d23/l30 0 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi052.stdout:4/186: dwrite d11/d17/d1b/f2d [4194304,4194304] 0 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi052.stdout:2/110: write f0 [1548337,56382] 0 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi052.stdout:5/98: rename d7 to d7/d17 22 2024-09-12T18:03:20.346 INFO:tasks.workunit.client.0.smithi052.stdout:8/167: mknod d13/c2e 0 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi052.stdout:3/133: chown d0/d4/d25/d2a/d6/d7/de/f26 1161 1 2024-09-12T18:03:20.347 INFO:tasks.workunit.client.0.smithi052.stdout:9/127: truncate d0/d23/f2f 28263 0 2024-09-12T18:03:20.348 INFO:tasks.workunit.client.0.smithi052.stdout:4/187: write d11/d17/d23/d2f/f39 [1255900,108616] 0 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi052.stdout:0/148: symlink d2/l2d 0 2024-09-12T18:03:20.349 INFO:tasks.workunit.client.0.smithi052.stdout:8/168: write d13/f1b [9575074,1892] 0 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi052.stdout:3/134: creat d0/d4/d25/d2a/d6/d7/f2b x:0 0 0 2024-09-12T18:03:20.350 INFO:tasks.workunit.client.0.smithi052.stdout:2/111: symlink da/l23 0 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi052.stdout:2/112: stat da/l1a 0 2024-09-12T18:03:20.351 INFO:tasks.workunit.client.0.smithi052.stdout:0/149: write d2/d8/fa [1135488,69520] 0 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi052.stdout:4/188: rename d11/f13 to d11/d17/d1b/d2a/d32/f3e 0 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi052.stdout:0/150: sync 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi052.stdout:4/189: sync 2024-09-12T18:03:20.352 INFO:tasks.workunit.client.0.smithi052.stdout:8/169: chown ce 16913210 1 2024-09-12T18:03:20.353 INFO:tasks.workunit.client.0.smithi052.stdout:2/113: chown da/dc/d15/f1f 9826 1 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi052.stdout:3/135: rename d0/d16/d1c to d0/d4/d25/d2a/d2c 0 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi052.stdout:7/89: dwrite d6/fd [4194304,4194304] 0 2024-09-12T18:03:20.354 INFO:tasks.workunit.client.0.smithi052.stdout:6/231: read d2/d15/f1d [5051816,23093] 0 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi052.stdout:0/151: write d2/d8/fa [1425975,41554] 0 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi052.stdout:5/99: write f6 [1825449,20727] 0 2024-09-12T18:03:20.355 INFO:tasks.workunit.client.0.smithi052.stdout:8/170: symlink d13/l2f 0 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi052.stdout:3/136: rename d0/l14 to d0/d4/l2d 0 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi052.stdout:7/90: truncate d6/f11 297042 0 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi052.stdout:4/190: mkdir d11/d17/d23/d2f/d3b/d3f 0 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi052.stdout:0/152: write d2/d8/fa [1423152,76059] 0 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi052.stdout:2/114: link da/f12 da/dc/d15/d20/f24 0 2024-09-12T18:03:20.357 INFO:tasks.workunit.client.0.smithi052.stdout:0/153: sync 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi052.stdout:5/100: rename d7/c15 to d7/c18 0 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi052.stdout:9/128: dwrite d0/fc [0,4194304] 0 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi052.stdout:4/191: stat f5 0 2024-09-12T18:03:20.358 INFO:tasks.workunit.client.0.smithi052.stdout:8/171: creat d13/f30 x:0 0 0 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi052.stdout:9/129: chown d0/d6/l24 139301326 1 2024-09-12T18:03:20.359 INFO:tasks.workunit.client.0.smithi052.stdout:4/192: chown d11/d17/f34 1088332 1 2024-09-12T18:03:20.360 INFO:tasks.workunit.client.0.smithi052.stdout:6/232: link d2/c18 d2/d3f/c4f 0 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi052.stdout:1/129: dread d3/ff [0,4194304] 0 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi052.stdout:8/172: symlink d13/d18/d21/l31 0 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi052.stdout:7/91: symlink d6/d12/d1e/l20 0 2024-09-12T18:03:20.361 INFO:tasks.workunit.client.0.smithi052.stdout:4/193: write d11/d17/d23/d2f/f39 [4991556,65007] 0 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi052.stdout:9/130: creat d0/d23/f31 x:0 0 0 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi052.stdout:5/101: link d7/f9 d7/f19 0 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi052.stdout:8/173: chown d13/l2c 1784 1 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi052.stdout:5/102: stat d7/cb 0 2024-09-12T18:03:20.362 INFO:tasks.workunit.client.0.smithi052.stdout:0/154: getdents d2/d8 0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi052.stdout:7/92: chown d6/l19 9494400 1 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi052.stdout:6/233: truncate d2/d15/f30 571139 0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi052.stdout:1/130: write d3/d1d/f2c [936060,126425] 0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi052.stdout:5/103: readlink d7/le 0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi052.stdout:4/194: creat d11/d17/d1b/d2a/d32/f40 x:0 0 0 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi052.stdout:5/104: chown d7/f8 2033007 1 2024-09-12T18:03:20.363 INFO:tasks.workunit.client.0.smithi052.stdout:7/93: rmdir d6/d12/d17 39 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi052.stdout:7/94: read d6/fd [591906,110158] 0 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi052.stdout:2/115: getdents da 0 2024-09-12T18:03:20.364 INFO:tasks.workunit.client.0.smithi052.stdout:6/234: fdatasync d2/d11/d26/f46 0 2024-09-12T18:03:20.365 INFO:tasks.workunit.client.0.smithi052.stdout:5/105: creat d7/f1a x:0 0 0 2024-09-12T18:03:20.366 INFO:tasks.workunit.client.0.smithi052.stdout:6/235: fdatasync d2/f3a 0 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi052.stdout:2/116: mkdir da/dc/d15/d25 0 2024-09-12T18:03:20.367 INFO:tasks.workunit.client.0.smithi052.stdout:5/106: dread - d7/f1a zero size 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi052.stdout:9/131: dread d0/fc [0,4194304] 0 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi052.stdout:7/95: symlink d6/d12/l21 0 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi052.stdout:3/137: link d0/d4/f28 d0/d4/d25/f2e 0 2024-09-12T18:03:20.368 INFO:tasks.workunit.client.0.smithi052.stdout:6/236: chown d2/c33 1642187476 1 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi052.stdout:9/132: fdatasync d0/d23/f2f 0 2024-09-12T18:03:20.370 INFO:tasks.workunit.client.0.smithi052.stdout:5/107: rename f6 to d7/f1b 0 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi052.stdout:3/138: rmdir d0/d4 39 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi052.stdout:7/96: mknod d6/d12/d1e/c22 0 2024-09-12T18:03:20.371 INFO:tasks.workunit.client.0.smithi052.stdout:0/155: dread d2/d8/f20 [0,4194304] 0 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi052.stdout:5/108: mkdir d7/d1c 0 2024-09-12T18:03:20.372 INFO:tasks.workunit.client.0.smithi052.stdout:1/131: dread d3/fc [4194304,4194304] 0 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi052.stdout:9/133: creat d0/d1c/f32 x:0 0 0 2024-09-12T18:03:20.373 INFO:tasks.workunit.client.0.smithi052.stdout:5/109: chown d7/f14 392 1 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi052.stdout:8/174: dwrite ff [0,4194304] 0 2024-09-12T18:03:20.374 INFO:tasks.workunit.client.0.smithi052.stdout:7/97: readlink d6/d12/d17/l1d 0 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi052.stdout:4/195: dwrite d11/f15 [0,4194304] 0 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi052.stdout:3/139: dread - d0/d4/d25/d2a/d6/d7/f2b zero size 2024-09-12T18:03:20.375 INFO:tasks.workunit.client.0.smithi052.stdout:2/117: dread da/f12 [0,4194304] 0 2024-09-12T18:03:20.377 INFO:tasks.workunit.client.0.smithi052.stdout:9/134: rmdir d0 39 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi052.stdout:5/110: rename d7/f9 to d7/f1d 0 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi052.stdout:3/140: rmdir d0/d4/d25/d2a/d2c 39 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi052.stdout:4/196: rename d11/d17/d1b/d2a/d32/f40 to d11/d17/d23/d2f/f41 0 2024-09-12T18:03:20.378 INFO:tasks.workunit.client.0.smithi052.stdout:8/175: mknod d13/c32 0 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi052.stdout:0/156: link d2/d8/f20 d2/d1b/f2e 0 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi052.stdout:2/118: creat da/d21/f26 x:0 0 0 2024-09-12T18:03:20.379 INFO:tasks.workunit.client.0.smithi052.stdout:5/111: mkdir d7/d1c/d1e 0 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi052.stdout:6/237: truncate d2/d15/d1a/f45 286933 0 2024-09-12T18:03:20.380 INFO:tasks.workunit.client.0.smithi052.stdout:6/238: sync 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi052.stdout:8/176: write d13/f1b [7133960,19405] 0 2024-09-12T18:03:20.381 INFO:tasks.workunit.client.0.smithi052.stdout:7/98: write d6/dc/f1c [1025803,5970] 0 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi052.stdout:2/119: chown da/dc/d15/l1b 62738 1 2024-09-12T18:03:20.382 INFO:tasks.workunit.client.0.smithi052.stdout:3/141: truncate d0/fc 1427784 0 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi052.stdout:0/157: rmdir d2/d6/dd 39 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi052.stdout:9/135: mkdir d0/d18/d26/d33 0 2024-09-12T18:03:20.383 INFO:tasks.workunit.client.0.smithi052.stdout:6/239: mknod d2/d15/c50 0 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi052.stdout:8/177: creat d13/d18/d21/f33 x:0 0 0 2024-09-12T18:03:20.384 INFO:tasks.workunit.client.0.smithi052.stdout:7/99: mknod d6/d12/c23 0 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi052.stdout:1/132: dwrite d3/ff [4194304,4194304] 0 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi052.stdout:3/142: write d0/d16/f1e [2330556,65254] 0 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi052.stdout:9/136: chown d0/d23/f2f 22 1 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi052.stdout:2/120: link da/c11 da/dc/c27 0 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi052.stdout:3/143: sync 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi052.stdout:8/178: chown ce 112 1 2024-09-12T18:03:20.385 INFO:tasks.workunit.client.0.smithi052.stdout:6/240: rmdir d2/d3f 39 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi052.stdout:0/158: mkdir d2/d6/dd/d21/d26/d2f 0 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi052.stdout:7/100: mknod d6/d12/d17/c24 0 2024-09-12T18:03:20.386 INFO:tasks.workunit.client.0.smithi052.stdout:7/101: sync 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi052.stdout:0/159: write d2/d8/fa [1896060,5477] 0 2024-09-12T18:03:20.387 INFO:tasks.workunit.client.0.smithi052.stdout:3/144: write d0/f12 [930175,106817] 0 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi052.stdout:8/179: symlink d13/l34 0 2024-09-12T18:03:20.388 INFO:tasks.workunit.client.0.smithi052.stdout:2/121: write da/dc/d15/d20/f24 [300743,113964] 0 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi052.stdout:7/102: creat d6/dc/f25 x:0 0 0 2024-09-12T18:03:20.389 INFO:tasks.workunit.client.0.smithi052.stdout:4/197: dread d11/d17/d23/f27 [0,4194304] 0 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi052.stdout:1/133: write d3/fa [591368,62493] 0 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi052.stdout:0/160: creat d2/d8/f30 x:0 0 0 2024-09-12T18:03:20.390 INFO:tasks.workunit.client.0.smithi052.stdout:8/180: mkdir d13/d35 0 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi052.stdout:7/103: chown d6/d12/d1e/c22 650 1 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi052.stdout:8/181: dread - d13/f1f zero size 2024-09-12T18:03:20.391 INFO:tasks.workunit.client.0.smithi052.stdout:2/122: write da/dc/d15/d20/f14 [906680,216] 0 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi052.stdout:1/134: symlink d3/d1d/d22/d27/l2e 0 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi052.stdout:0/161: write d2/d6/fb [3403136,124268] 0 2024-09-12T18:03:20.392 INFO:tasks.workunit.client.0.smithi052.stdout:9/137: dread d0/d6/fd [0,4194304] 0 2024-09-12T18:03:20.393 INFO:tasks.workunit.client.0.smithi052.stdout:8/182: mknod d13/d35/c36 0 2024-09-12T18:03:20.394 INFO:tasks.workunit.client.0.smithi052.stdout:6/241: dwrite d2/f3a [0,4194304] 0 2024-09-12T18:03:20.395 INFO:tasks.workunit.client.0.smithi052.stdout:2/123: rename l5 to da/dc/d15/d20/l28 0 2024-09-12T18:03:20.396 INFO:tasks.workunit.client.0.smithi052.stdout:9/138: mkdir d0/d34 0 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi052.stdout:8/183: write d13/f1c [277843,26129] 0 2024-09-12T18:03:20.397 INFO:tasks.workunit.client.0.smithi052.stdout:5/112: write d7/ff [2721542,81415] 0 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi052.stdout:1/135: mkdir d3/d1d/d22/d27/d28/d2f 0 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi052.stdout:0/162: fsync d2/d6/fb 0 2024-09-12T18:03:20.398 INFO:tasks.workunit.client.0.smithi052.stdout:9/139: fsync d0/fb 0 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi052.stdout:4/198: dwrite d11/f15 [0,4194304] 0 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi052.stdout:8/184: write d13/f17 [2244684,19223] 0 2024-09-12T18:03:20.400 INFO:tasks.workunit.client.0.smithi052.stdout:2/124: creat da/d1d/f29 x:0 0 0 2024-09-12T18:03:20.401 INFO:tasks.workunit.client.0.smithi052.stdout:5/113: mkdir d7/d1f 0 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi052.stdout:1/136: dread - d3/f25 zero size 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi052.stdout:3/145: dwrite d0/f12 [4194304,4194304] 0 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi052.stdout:9/140: rmdir d0/d18 39 2024-09-12T18:03:20.402 INFO:tasks.workunit.client.0.smithi052.stdout:0/163: creat d2/f31 x:0 0 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi052.stdout:5/114: mknod d7/d1c/c20 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi052.stdout:1/137: dread - d3/d10/f26 zero size 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi052.stdout:6/242: link d2/f10 d2/f51 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi052.stdout:7/104: dwrite d6/d12/f15 [0,4194304] 0 2024-09-12T18:03:20.403 INFO:tasks.workunit.client.0.smithi052.stdout:4/199: mkdir d11/d17/d1b/d42 0 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi052.stdout:6/243: write d2/fb [3192273,44390] 0 2024-09-12T18:03:20.404 INFO:tasks.workunit.client.0.smithi052.stdout:6/244: dread - d2/f43 zero size 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi052.stdout:6/245: dread - d2/f43 zero size 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi052.stdout:2/125: symlink da/dc/d15/d22/l2a 0 2024-09-12T18:03:20.405 INFO:tasks.workunit.client.0.smithi052.stdout:3/146: mknod d0/d4/d25/c2f 0 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi052.stdout:5/115: rename d7/f1d to d7/f21 0 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi052.stdout:7/105: chown d6/c8 3495 1 2024-09-12T18:03:20.406 INFO:tasks.workunit.client.0.smithi052.stdout:0/164: creat d2/d6/dd/d21/f32 x:0 0 0 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi052.stdout:2/126: fsync f3 0 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi052.stdout:4/200: symlink d11/d17/l43 0 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi052.stdout:1/138: rename d3/f2b to d3/d1d/d22/f30 0 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi052.stdout:2/127: stat da 0 2024-09-12T18:03:20.407 INFO:tasks.workunit.client.0.smithi052.stdout:7/106: stat d6/d12/d1e/l20 0 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi052.stdout:5/116: mknod d7/d1f/c22 0 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi052.stdout:9/141: rename d0/c3 to d0/c35 0 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi052.stdout:2/128: creat da/dc/f2b x:0 0 0 2024-09-12T18:03:20.408 INFO:tasks.workunit.client.0.smithi052.stdout:3/147: mknod d0/d4/d25/d2a/d6/c30 0 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi052.stdout:2/129: sync 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi052.stdout:4/201: mknod d11/d17/d23/d2f/d3b/d3f/c44 0 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi052.stdout:0/165: chown d2/d6/dd/f16 1029952 1 2024-09-12T18:03:20.409 INFO:tasks.workunit.client.0.smithi052.stdout:4/202: fsync d11/f21 0 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi052.stdout:9/142: write d0/d1c/f32 [921379,45049] 0 2024-09-12T18:03:20.410 INFO:tasks.workunit.client.0.smithi052.stdout:0/166: chown d2/d1b/f2e 159147 1 2024-09-12T18:03:20.411 INFO:tasks.workunit.client.0.smithi052.stdout:3/148: mknod d0/d4/d25/d2a/d17/c31 0 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi052.stdout:5/117: dread d7/f1b [0,4194304] 0 2024-09-12T18:03:20.412 INFO:tasks.workunit.client.0.smithi052.stdout:9/143: write d0/d6/f27 [457484,93377] 0 2024-09-12T18:03:20.413 INFO:tasks.workunit.client.0.smithi052.stdout:4/203: rename d11/d17/c28 to d11/d17/d23/d2f/d3b/d3f/c45 0 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi052.stdout:5/118: mknod d7/d1c/c23 0 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi052.stdout:0/167: truncate d2/d6/dd/f17 3981997 0 2024-09-12T18:03:20.414 INFO:tasks.workunit.client.0.smithi052.stdout:9/144: unlink d0/d6/l11 0 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi052.stdout:5/119: write d7/f16 [549709,65595] 0 2024-09-12T18:03:20.415 INFO:tasks.workunit.client.0.smithi052.stdout:4/204: write d11/d17/d23/f27 [289316,17617] 0 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi052.stdout:2/130: truncate f8 1227102 0 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi052.stdout:6/246: write d2/d15/d1a/f45 [717790,79005] 0 2024-09-12T18:03:20.416 INFO:tasks.workunit.client.0.smithi052.stdout:8/185: dwrite d13/d18/f25 [0,4194304] 0 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi052.stdout:9/145: write d0/fc [4078156,44139] 0 2024-09-12T18:03:20.417 INFO:tasks.workunit.client.0.smithi052.stdout:1/139: read d3/ff [5811925,30631] 0 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi052.stdout:3/149: dread d0/d4/f27 [0,4194304] 0 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi052.stdout:0/168: creat d2/d6/dd/d21/d26/d2f/f33 x:0 0 0 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi052.stdout:0/169: chown d2 104639399 1 2024-09-12T18:03:20.418 INFO:tasks.workunit.client.0.smithi052.stdout:9/146: creat d0/d18/f36 x:0 0 0 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi052.stdout:0/170: mknod d2/d8/c34 0 2024-09-12T18:03:20.419 INFO:tasks.workunit.client.0.smithi052.stdout:5/120: truncate d7/f19 3369025 0 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi052.stdout:9/147: chown d0/d1c/f25 72086 1 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi052.stdout:7/107: read d6/f11 [15756,24551] 0 2024-09-12T18:03:20.420 INFO:tasks.workunit.client.0.smithi052.stdout:3/150: creat d0/d4/d25/d2a/f32 x:0 0 0 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi052.stdout:0/171: stat d2/d6/dd/d21 0 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi052.stdout:5/121: fdatasync d7/f8 0 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi052.stdout:1/140: write d3/d1d/d22/d27/d28/f29 [24250,100762] 0 2024-09-12T18:03:20.421 INFO:tasks.workunit.client.0.smithi052.stdout:8/186: creat d13/d18/d21/f37 x:0 0 0 2024-09-12T18:03:20.422 INFO:tasks.workunit.client.0.smithi052.stdout:0/172: stat d2/d8/f1c 0 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi052.stdout:3/151: chown d0/d16/c1f 3953848 1 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi052.stdout:8/187: chown d13/c2e 0 1 2024-09-12T18:03:20.423 INFO:tasks.workunit.client.0.smithi052.stdout:0/173: chown d2/f31 1 1 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi052.stdout:7/108: dread d6/ff [0,4194304] 0 2024-09-12T18:03:20.424 INFO:tasks.workunit.client.0.smithi052.stdout:1/141: mknod d3/d1d/d22/d27/d28/d2f/c31 0 2024-09-12T18:03:20.425 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:20.425 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:20.425 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:20.425 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:20.425 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi052.stdout:0/174: creat d2/d6/dd/d21/f35 x:0 0 0 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi052.stdout:2/131: dwrite f0 [0,4194304] 0 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi052.stdout:7/109: fsync d6/d12/f15 0 2024-09-12T18:03:20.426 INFO:tasks.workunit.client.0.smithi052.stdout:0/175: stat d2/d6/l2c 0 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi052.stdout:1/142: write d3/d1d/f2c [54152,19200] 0 2024-09-12T18:03:20.427 INFO:tasks.workunit.client.0.smithi052.stdout:6/247: dwrite d2/f3a [0,4194304] 0 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi052.stdout:7/110: mkdir d6/d26 0 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi052.stdout:2/132: write f0 [3319891,54328] 0 2024-09-12T18:03:20.428 INFO:tasks.workunit.client.0.smithi052.stdout:7/111: chown d6 2076 1 2024-09-12T18:03:20.429 INFO:tasks.workunit.client.0.smithi052.stdout:0/176: dread - d2/d6/dd/d21/f2a zero size 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi052.stdout:6/248: creat d2/d3f/f52 x:0 0 0 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi052.stdout:4/205: write d11/d17/d23/d2f/f2b [4371715,30178] 0 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi052.stdout:7/112: chown d6/d26 17711605 1 2024-09-12T18:03:20.431 INFO:tasks.workunit.client.0.smithi052.stdout:9/148: getdents d0/d18 0 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi052.stdout:1/143: creat d3/d1d/d22/d27/d28/f32 x:0 0 0 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi052.stdout:2/133: dread f3 [0,4194304] 0 2024-09-12T18:03:20.432 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:20.427+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:20.432 INFO:tasks.workunit.client.0.smithi052.stdout:0/177: symlink d2/d8/l36 0 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi052.stdout:9/149: mkdir d0/d18/d37 0 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi052.stdout:4/206: mkdir d11/d46 0 2024-09-12T18:03:20.433 INFO:tasks.workunit.client.0.smithi052.stdout:8/188: dwrite fb [0,4194304] 0 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi052.stdout:5/122: dwrite d7/ff [0,4194304] 0 2024-09-12T18:03:20.434 INFO:tasks.workunit.client.0.smithi052.stdout:6/249: write d2/fb [329582,52152] 0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi052.stdout:4/207: write d11/f1f [159312,65759] 0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi052.stdout:6/250: write d2/f43 [891920,56712] 0 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi052.stdout:0/178: dread - d2/d6/dd/d21/f32 zero size 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi052.stdout:0/179: chown d2/d8 22 1 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi052.stdout:6/251: chown d2/d11/d26/c47 612343862 1 2024-09-12T18:03:20.436 INFO:tasks.workunit.client.0.smithi052.stdout:5/123: readlink d7/le 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi052.stdout:8/189: mkdir d13/d18/d38 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi052.stdout:3/152: write d0/d4/d25/f2e [711397,109446] 0 2024-09-12T18:03:20.437 INFO:tasks.workunit.client.0.smithi052.stdout:4/208: fdatasync d11/f25 0 2024-09-12T18:03:20.439 INFO:tasks.workunit.client.0.smithi052.stdout:5/124: chown d7/cb 1 1 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi052.stdout:1/144: creat d3/d10/f33 x:0 0 0 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi052.stdout:0/180: fsync d2/d6/f23 0 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi052.stdout:2/134: rmdir da/dc/d15/d25 0 2024-09-12T18:03:20.440 INFO:tasks.workunit.client.0.smithi052.stdout:3/153: write d0/f12 [4552669,30532] 0 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi052.stdout:5/125: truncate d7/f8 5111669 0 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi052.stdout:8/190: creat d13/d18/d21/f39 x:0 0 0 2024-09-12T18:03:20.441 INFO:tasks.workunit.client.0.smithi052.stdout:6/252: rename c0 to d2/d15/c53 0 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:4/209: getdents d11/d17/d23 0 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:0/181: unlink d2/d6/dd/d21/l27 0 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:8/191: fdatasync d13/d18/d21/f39 0 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:5/126: sync 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:2/135: mkdir da/d2c 0 2024-09-12T18:03:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:1/145: creat d3/d10/f34 x:0 0 0 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:8/192: fsync d13/f1c 0 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:0/182: chown d2/d6/dd/d21 171 1 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/127: readlink d7/le 0 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:8/193: mknod d13/d35/c3a 0 2024-09-12T18:03:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:2/136: creat da/d2c/f2d x:0 0 0 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:8/194: chown d13/d35 2820205 1 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:5/128: write d7/f14 [335430,19308] 0 2024-09-12T18:03:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:8/195: chown d13/d18 4 1 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/150: getdents d0/d18 0 2024-09-12T18:03:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:0/183: rename d2/d8/d9 to d2/d6/dd/d21/d26/d37 0 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:6/253: read d2/fa [855431,102895] 0 2024-09-12T18:03:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:2/137: getdents da/d1d 0 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:8/196: link d13/c32 d13/d35/c3b 0 2024-09-12T18:03:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:2/138: chown da 3 1 2024-09-12T18:03:20.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:5/129: rename d7/c18 to d7/d1c/d1e/c24 0 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:8/197: mkdir d13/d3c 0 2024-09-12T18:03:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:3/154: dwrite d0/d4/d25/d2a/f32 [0,4194304] 0 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:2/139: write da/dc/d15/f1f [702029,23655] 0 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:3/155: readlink d0/d4/l8 0 2024-09-12T18:03:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:5/130: mknod d7/d1c/d1e/c25 0 2024-09-12T18:03:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:8/198: creat d13/d3c/f3d x:0 0 0 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/199: fsync ff 0 2024-09-12T18:03:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/113: dwrite d6/f11 [0,4194304] 0 2024-09-12T18:03:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:3/156: truncate d0/d4/d25/d2a/d6/d7/de/f26 342550 0 2024-09-12T18:03:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/140: rmdir da/dc/d15/d20 39 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:4/210: truncate f5 2011043 0 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:0/184: rename d2/d6/dd/d21/d26/d37 to d2/d6/dd/d21/d26/d38 0 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:6/254: dwrite d2/d15/f2c [0,4194304] 0 2024-09-12T18:03:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:9/151: dwrite d0/d23/f31 [0,4194304] 0 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:8/200: rename d13/d18/f25 to d13/d18/f3e 0 2024-09-12T18:03:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:3/157: mkdir d0/d4/d33 0 2024-09-12T18:03:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:0/185: rmdir d2 39 2024-09-12T18:03:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:5/131: link d7/le d7/d1c/d1e/l26 0 2024-09-12T18:03:20.460 INFO:tasks.workunit.client.0.smithi052.stdout:4/211: mkdir d11/d17/d23/d2f/d47 0 2024-09-12T18:03:20.460 INFO:tasks.workunit.client.0.smithi052.stdout:2/141: write da/f13 [578388,41390] 0 2024-09-12T18:03:20.460 INFO:tasks.workunit.client.0.smithi052.stdout:8/201: mkdir d13/d18/d21/d3f 0 2024-09-12T18:03:20.460 INFO:tasks.workunit.client.0.smithi052.stdout:3/158: stat d0/d4/c11 0 2024-09-12T18:03:20.460 INFO:tasks.workunit.client.0.smithi052.stdout:9/152: truncate d0/f10 1363866 0 2024-09-12T18:03:20.461 INFO:tasks.workunit.client.0.smithi052.stdout:8/202: unlink d13/c1a 0 2024-09-12T18:03:20.463 INFO:tasks.workunit.client.0.smithi052.stdout:6/255: getdents d2/d21 0 2024-09-12T18:03:20.463 INFO:tasks.workunit.client.0.smithi052.stdout:7/114: dwrite d6/dc/f25 [0,4194304] 0 2024-09-12T18:03:20.463 INFO:tasks.workunit.client.0.smithi052.stdout:4/212: symlink d11/d17/d1b/d2a/d32/l48 0 2024-09-12T18:03:20.463 INFO:tasks.workunit.client.0.smithi052.stdout:7/115: sync 2024-09-12T18:03:20.463 INFO:tasks.workunit.client.0.smithi052.stdout:5/132: rename d7/d1c/d1e/l26 to d7/d1c/l27 0 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi052.stdout:9/153: dread d0/d23/f2f [0,4194304] 0 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi052.stdout:2/142: getdents da/dc/d15 0 2024-09-12T18:03:20.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/256: mkdir d2/d3f/d54 0 2024-09-12T18:03:20.465 INFO:tasks.workunit.client.0.smithi052.stdout:5/133: fdatasync d7/ff 0 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi052.stdout:9/154: readlink d0/l17 0 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi052.stdout:7/116: mkdir d6/d12/d17/d27 0 2024-09-12T18:03:20.466 INFO:tasks.workunit.client.0.smithi052.stdout:6/257: unlink d2/d15/f41 0 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi052.stdout:2/143: write da/dc/d15/d20/fe [5116342,111096] 0 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi052.stdout:9/155: chown d0/d6/c19 5 1 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi052.stdout:5/134: symlink d7/d1c/d1e/l28 0 2024-09-12T18:03:20.467 INFO:tasks.workunit.client.0.smithi052.stdout:6/258: mknod d2/d1e/c55 0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi052.stdout:6/259: rename d2 to d2/d3f/d54/d56 22 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi052.stdout:8/203: dread fb [0,4194304] 0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi052.stdout:2/144: fdatasync f8 0 2024-09-12T18:03:20.468 INFO:tasks.workunit.client.0.smithi052.stdout:9/156: readlink d0/l4 0 2024-09-12T18:03:20.469 INFO:tasks.workunit.client.0.smithi052.stdout:8/204: read d13/f1b [233052,91243] 0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/205: read fb [1748960,64298] 0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi052.stdout:9/157: write d0/fc [4259269,28509] 0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi052.stdout:5/135: getdents d7 0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi052.stdout:6/260: link d2/c18 d2/d21/c57 0 2024-09-12T18:03:20.470 INFO:tasks.workunit.client.0.smithi052.stdout:5/136: chown d7/f1a 6655 1 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi052.stdout:9/158: symlink d0/d18/d37/l38 0 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi052.stdout:5/137: write d7/f8 [2719479,73691] 0 2024-09-12T18:03:20.471 INFO:tasks.workunit.client.0.smithi052.stdout:3/159: read d0/d4/d25/d2a/d6/d7/de/f26 [152130,46699] 0 2024-09-12T18:03:20.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/159: rename d0/c35 to d0/d18/c39 0 2024-09-12T18:03:20.473 INFO:tasks.workunit.client.0.smithi052.stdout:6/261: mkdir d2/d3f/d58 0 2024-09-12T18:03:20.473 INFO:tasks.workunit.client.0.smithi052.stdout:5/138: dread f4 [0,4194304] 0 2024-09-12T18:03:20.474 INFO:tasks.workunit.client.0.smithi052.stdout:3/160: write d0/d4/d25/d2a/f32 [909773,118452] 0 2024-09-12T18:03:20.474 INFO:tasks.workunit.client.0.smithi052.stdout:9/160: mkdir d0/d6/d3a 0 2024-09-12T18:03:20.474 INFO:tasks.workunit.client.0.smithi052.stdout:4/213: dread d11/f1f [0,4194304] 0 2024-09-12T18:03:20.475 INFO:tasks.workunit.client.0.smithi052.stdout:2/145: dread f0 [0,4194304] 0 2024-09-12T18:03:20.475 INFO:tasks.workunit.client.0.smithi052.stdout:4/214: stat cb 0 2024-09-12T18:03:20.475 INFO:tasks.workunit.client.0.smithi052.stdout:5/139: write d7/f1b [768461,32574] 0 2024-09-12T18:03:20.475 INFO:tasks.workunit.client.0.smithi052.stdout:9/161: rmdir d0/d18 39 2024-09-12T18:03:20.476 INFO:tasks.workunit.client.0.smithi052.stdout:6/262: mknod d2/d15/d1a/c59 0 2024-09-12T18:03:20.476 INFO:tasks.workunit.client.0.smithi052.stdout:2/146: read - da/dc/f2b zero size 2024-09-12T18:03:20.476 INFO:tasks.workunit.client.0.smithi052.stdout:3/161: mkdir d0/d4/d25/d2a/d6/d7/d34 0 2024-09-12T18:03:20.478 INFO:tasks.workunit.client.0.smithi052.stdout:6/263: dread - d2/d11/d26/f2d zero size 2024-09-12T18:03:20.478 INFO:tasks.workunit.client.0.smithi052.stdout:7/117: truncate d6/dc/f25 3511795 0 2024-09-12T18:03:20.479 INFO:tasks.workunit.client.0.smithi052.stdout:1/146: dread d3/fa [0,4194304] 0 2024-09-12T18:03:20.479 INFO:tasks.workunit.client.0.smithi052.stdout:2/147: creat da/dc/f2e x:0 0 0 2024-09-12T18:03:20.479 INFO:tasks.workunit.client.0.smithi052.stdout:8/206: dwrite d13/d18/f3e [0,4194304] 0 2024-09-12T18:03:20.480 INFO:tasks.workunit.client.0.smithi052.stdout:9/162: creat d0/d6/d3a/f3b x:0 0 0 2024-09-12T18:03:20.480 INFO:tasks.workunit.client.0.smithi052.stdout:5/140: link d7/f1b d7/d1f/f29 0 2024-09-12T18:03:20.481 INFO:tasks.workunit.client.0.smithi052.stdout:7/118: chown d6/d12/d17/l1f 28272 1 2024-09-12T18:03:20.481 INFO:tasks.workunit.client.0.smithi052.stdout:6/264: write d2/d15/f22 [4636752,26431] 0 2024-09-12T18:03:20.481 INFO:tasks.workunit.client.0.smithi052.stdout:1/147: fsync d3/fa 0 2024-09-12T18:03:20.482 INFO:tasks.workunit.client.0.smithi052.stdout:2/148: write da/dc/d15/f1c [1043931,94162] 0 2024-09-12T18:03:20.483 INFO:tasks.workunit.client.0.smithi052.stdout:3/162: rename d0/fc to d0/d4/d33/f35 0 2024-09-12T18:03:20.483 INFO:tasks.workunit.client.0.smithi052.stdout:3/163: sync 2024-09-12T18:03:20.483 INFO:tasks.workunit.client.0.smithi052.stdout:9/163: symlink d0/d6/l3c 0 2024-09-12T18:03:20.486 INFO:tasks.workunit.client.0.smithi052.stdout:4/215: dwrite d11/d17/d23/f27 [0,4194304] 0 2024-09-12T18:03:20.487 INFO:tasks.workunit.client.0.smithi052.stdout:9/164: creat d0/d6/f3d x:0 0 0 2024-09-12T18:03:20.488 INFO:tasks.workunit.client.0.smithi052.stdout:8/207: link ff d13/d18/d38/f40 0 2024-09-12T18:03:20.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/148: creat d3/f35 x:0 0 0 2024-09-12T18:03:20.489 INFO:tasks.workunit.client.0.smithi052.stdout:4/216: symlink d11/d17/d23/l49 0 2024-09-12T18:03:20.490 INFO:tasks.workunit.client.0.smithi052.stdout:0/186: dread d2/d6/dd/f16 [0,4194304] 0 2024-09-12T18:03:20.490 INFO:tasks.workunit.client.0.smithi052.stdout:4/217: readlink d11/d17/l43 0 2024-09-12T18:03:20.491 INFO:tasks.workunit.client.0.smithi052.stdout:7/119: dread d6/d12/f15 [0,4194304] 0 2024-09-12T18:03:20.491 INFO:tasks.workunit.client.0.smithi052.stdout:8/208: readlink d13/l2c 0 2024-09-12T18:03:20.491 INFO:tasks.workunit.client.0.smithi052.stdout:1/149: unlink d3/ff 0 2024-09-12T18:03:20.493 INFO:tasks.workunit.client.0.smithi052.stdout:5/141: dwrite d7/f1a [0,4194304] 0 2024-09-12T18:03:20.495 INFO:tasks.workunit.client.0.smithi052.stdout:6/265: dwrite d2/d49/f4b [0,4194304] 0 2024-09-12T18:03:20.496 INFO:tasks.workunit.client.0.smithi052.stdout:3/164: dread d0/d16/f1e [0,4194304] 0 2024-09-12T18:03:20.497 INFO:tasks.workunit.client.0.smithi052.stdout:6/266: fsync d2/d21/f2a 0 2024-09-12T18:03:20.498 INFO:tasks.workunit.client.0.smithi052.stdout:7/120: creat d6/d26/f28 x:0 0 0 2024-09-12T18:03:20.500 INFO:tasks.workunit.client.0.smithi052.stdout:6/267: mknod d2/d21/c5a 0 2024-09-12T18:03:20.502 INFO:tasks.workunit.client.0.smithi052.stdout:2/149: dwrite da/dc/d15/d20/f24 [0,4194304] 0 2024-09-12T18:03:20.502 INFO:tasks.workunit.client.0.smithi052.stdout:7/121: mkdir d6/d12/d1e/d29 0 2024-09-12T18:03:20.502 INFO:tasks.workunit.client.0.smithi052.stdout:2/150: sync 2024-09-12T18:03:20.502 INFO:tasks.workunit.client.0.smithi052.stdout:1/150: getdents d3/d1d/d22/d27/d28 0 2024-09-12T18:03:20.504 INFO:tasks.workunit.client.0.smithi052.stdout:9/165: dwrite d0/d6/d3a/f3b [0,4194304] 0 2024-09-12T18:03:20.504 INFO:tasks.workunit.client.0.smithi052.stdout:4/218: dwrite d11/f21 [0,4194304] 0 2024-09-12T18:03:20.505 INFO:tasks.workunit.client.0.smithi052.stdout:0/187: dread d2/d8/fa [0,4194304] 0 2024-09-12T18:03:20.506 INFO:tasks.workunit.client.0.smithi052.stdout:6/268: fdatasync d2/d11/d26/f46 0 2024-09-12T18:03:20.506 INFO:tasks.workunit.client.0.smithi052.stdout:7/122: symlink d6/d12/d1e/l2a 0 2024-09-12T18:03:20.506 INFO:tasks.workunit.client.0.smithi052.stdout:2/151: write da/dc/d15/d20/fe [3066084,44173] 0 2024-09-12T18:03:20.507 INFO:tasks.workunit.client.0.smithi052.stdout:9/166: rename d0/d6 to d0/d6/d3a/d3e 22 2024-09-12T18:03:20.507 INFO:tasks.workunit.client.0.smithi052.stdout:5/142: dwrite d7/fc [0,4194304] 0 2024-09-12T18:03:20.508 INFO:tasks.workunit.client.0.smithi052.stdout:6/269: rename d2/d11 to d2/d1e/d5b 0 2024-09-12T18:03:20.508 INFO:tasks.workunit.client.0.smithi052.stdout:3/165: link d0/d4/f19 d0/d4/d25/d2a/d17/f36 0 2024-09-12T18:03:20.508 INFO:tasks.workunit.client.0.smithi052.stdout:5/143: write d7/fc [2813936,66717] 0 2024-09-12T18:03:20.509 INFO:tasks.workunit.client.0.smithi052.stdout:2/152: truncate da/d1d/f29 767697 0 2024-09-12T18:03:20.509 INFO:tasks.workunit.client.0.smithi052.stdout:1/151: getdents d3/d10 0 2024-09-12T18:03:20.509 INFO:tasks.workunit.client.0.smithi052.stdout:9/167: rename d0/l17 to d0/d6/d3a/l3f 0 2024-09-12T18:03:20.510 INFO:tasks.workunit.client.0.smithi052.stdout:4/219: creat d11/d17/d23/d2f/d47/f4a x:0 0 0 2024-09-12T18:03:20.510 INFO:tasks.workunit.client.0.smithi052.stdout:1/152: stat d3/d1d/d22/d27/l2e 0 2024-09-12T18:03:20.510 INFO:tasks.workunit.client.0.smithi052.stdout:5/144: creat d7/d1f/f2a x:0 0 0 2024-09-12T18:03:20.511 INFO:tasks.workunit.client.0.smithi052.stdout:2/153: mkdir da/d2c/d2f 0 2024-09-12T18:03:20.511 INFO:tasks.workunit.client.0.smithi052.stdout:3/166: creat d0/d4/d25/d2a/d6/d7/de/f37 x:0 0 0 2024-09-12T18:03:20.511 INFO:tasks.workunit.client.0.smithi052.stdout:1/153: mknod d3/d1d/c36 0 2024-09-12T18:03:20.511 INFO:tasks.workunit.client.0.smithi052.stdout:9/168: creat d0/d18/f40 x:0 0 0 2024-09-12T18:03:20.512 INFO:tasks.workunit.client.0.smithi052.stdout:1/154: readlink d3/l9 0 2024-09-12T18:03:20.512 INFO:tasks.workunit.client.0.smithi052.stdout:8/209: dread d13/f17 [0,4194304] 0 2024-09-12T18:03:20.515 INFO:tasks.workunit.client.0.smithi052.stdout:2/154: symlink da/dc/d15/d22/l30 0 2024-09-12T18:03:20.515 INFO:tasks.workunit.client.0.smithi052.stdout:1/155: rmdir d3/d1d 39 2024-09-12T18:03:20.515 INFO:tasks.workunit.client.0.smithi052.stdout:7/123: truncate d6/f11 336775 0 2024-09-12T18:03:20.517 INFO:tasks.workunit.client.0.smithi052.stdout:4/220: dread f10 [0,4194304] 0 2024-09-12T18:03:20.518 INFO:tasks.workunit.client.0.smithi052.stdout:0/188: dread d2/d1b/f2e [0,4194304] 0 2024-09-12T18:03:20.518 INFO:tasks.workunit.client.0.smithi052.stdout:2/155: stat da/dc/d15/d20/f24 0 2024-09-12T18:03:20.518 INFO:tasks.workunit.client.0.smithi052.stdout:5/145: dread d7/fc [0,4194304] 0 2024-09-12T18:03:20.519 INFO:tasks.workunit.client.0.smithi052.stdout:2/156: sync 2024-09-12T18:03:20.520 INFO:tasks.workunit.client.0.smithi052.stdout:1/156: write d3/fc [5559628,35269] 0 2024-09-12T18:03:20.521 INFO:tasks.workunit.client.0.smithi052.stdout:5/146: chown d7/c11 1897540 1 2024-09-12T18:03:20.521 INFO:tasks.workunit.client.0.smithi052.stdout:4/221: chown d11/d17/d1b/f2e 3044 1 2024-09-12T18:03:20.523 INFO:tasks.workunit.client.0.smithi052.stdout:7/124: mknod d6/d12/d17/d27/c2b 0 2024-09-12T18:03:20.524 INFO:tasks.workunit.client.0.smithi052.stdout:5/147: truncate d7/f13 456324 0 2024-09-12T18:03:20.524 INFO:tasks.workunit.client.0.smithi052.stdout:6/270: dwrite d2/d3f/f52 [0,4194304] 0 2024-09-12T18:03:20.526 INFO:tasks.workunit.client.0.smithi052.stdout:0/189: creat d2/d6/dd/f39 x:0 0 0 2024-09-12T18:03:20.527 INFO:tasks.workunit.client.0.smithi052.stdout:8/210: dwrite d13/d3c/f3d [0,4194304] 0 2024-09-12T18:03:20.527 INFO:tasks.workunit.client.0.smithi052.stdout:9/169: dwrite d0/f1b [0,4194304] 0 2024-09-12T18:03:20.528 INFO:tasks.workunit.client.0.smithi052.stdout:3/167: dwrite d0/d4/d25/d2a/d6/d7/f2b [0,4194304] 0 2024-09-12T18:03:20.528 INFO:tasks.workunit.client.0.smithi052.stdout:7/125: write d6/dc/fe [4272367,111196] 0 2024-09-12T18:03:20.528 INFO:tasks.workunit.client.0.smithi052.stdout:4/222: write d11/d17/d23/d2f/f2b [3694789,41105] 0 2024-09-12T18:03:20.529 INFO:tasks.workunit.client.0.smithi052.stdout:6/271: stat d2/fa 0 2024-09-12T18:03:20.529 INFO:tasks.workunit.client.0.smithi052.stdout:8/211: creat d13/d18/d21/f41 x:0 0 0 2024-09-12T18:03:20.529 INFO:tasks.workunit.client.0.smithi052.stdout:1/157: read d3/f8 [7471886,28994] 0 2024-09-12T18:03:20.530 INFO:tasks.workunit.client.0.smithi052.stdout:0/190: dread - d2/d6/dd/d21/f35 zero size 2024-09-12T18:03:20.530 INFO:tasks.workunit.client.0.smithi052.stdout:1/158: write d3/f35 [72645,62332] 0 2024-09-12T18:03:20.531 INFO:tasks.workunit.client.0.smithi052.stdout:8/212: chown l5 6331364 1 2024-09-12T18:03:20.531 INFO:tasks.workunit.client.0.smithi052.stdout:7/126: creat d6/d12/d1e/f2c x:0 0 0 2024-09-12T18:03:20.531 INFO:tasks.workunit.client.0.smithi052.stdout:2/157: dread da/dc/d15/d20/f24 [0,4194304] 0 2024-09-12T18:03:20.531 INFO:tasks.workunit.client.0.smithi052.stdout:5/148: creat d7/d1c/d1e/f2b x:0 0 0 2024-09-12T18:03:20.531 INFO:tasks.workunit.client.0.smithi052.stdout:4/223: rmdir d11/d17/d23/d2f 39 2024-09-12T18:03:20.532 INFO:tasks.workunit.client.0.smithi052.stdout:1/159: truncate d3/d10/f26 684683 0 2024-09-12T18:03:20.532 INFO:tasks.workunit.client.0.smithi052.stdout:7/127: write d6/dc/fe [3716769,118981] 0 2024-09-12T18:03:20.533 INFO:tasks.workunit.client.0.smithi052.stdout:8/213: link f7 d13/d35/f42 0 2024-09-12T18:03:20.533 INFO:tasks.workunit.client.0.smithi052.stdout:2/158: readlink da/l1a 0 2024-09-12T18:03:20.533 INFO:tasks.workunit.client.0.smithi052.stdout:6/272: getdents d2/d3f/d58 0 2024-09-12T18:03:20.533 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:20.529+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:20.535 INFO:tasks.workunit.client.0.smithi052.stdout:5/149: write d7/d1f/f2a [979249,109186] 0 2024-09-12T18:03:20.535 INFO:tasks.workunit.client.0.smithi052.stdout:1/160: mknod d3/d1d/c37 0 2024-09-12T18:03:20.535 INFO:tasks.workunit.client.0.smithi052.stdout:7/128: fsync f5 0 2024-09-12T18:03:20.536 INFO:tasks.workunit.client.0.smithi052.stdout:8/214: rmdir d13/d18/d21/d3f 0 2024-09-12T18:03:20.536 INFO:tasks.workunit.client.0.smithi052.stdout:2/159: write f8 [3920132,41685] 0 2024-09-12T18:03:20.537 INFO:tasks.workunit.client.0.smithi052.stdout:1/161: dread - d3/f25 zero size 2024-09-12T18:03:20.538 INFO:tasks.workunit.client.0.smithi052.stdout:6/273: creat d2/d1e/d5b/d26/f5c x:0 0 0 2024-09-12T18:03:20.538 INFO:tasks.workunit.client.0.smithi052.stdout:5/150: rename d7/f1b to d7/d1f/f2c 0 2024-09-12T18:03:20.539 INFO:tasks.workunit.client.0.smithi052.stdout:0/191: dread d2/d8/f20 [0,4194304] 0 2024-09-12T18:03:20.539 INFO:tasks.workunit.client.0.smithi052.stdout:3/168: dwrite d0/d4/d25/f2e [0,4194304] 0 2024-09-12T18:03:20.540 INFO:tasks.workunit.client.0.smithi052.stdout:2/160: fsync da/f13 0 2024-09-12T18:03:20.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/162: chown d3/d10/c1c 39512443 1 2024-09-12T18:03:20.540 INFO:tasks.workunit.client.0.smithi052.stdout:8/215: creat d13/d18/d21/f43 x:0 0 0 2024-09-12T18:03:20.541 INFO:tasks.workunit.client.0.smithi052.stdout:5/151: chown d7/f1a 118371 1 2024-09-12T18:03:20.541 INFO:tasks.workunit.client.0.smithi052.stdout:0/192: fsync d2/d8/f20 0 2024-09-12T18:03:20.542 INFO:tasks.workunit.client.0.smithi052.stdout:7/129: creat d6/f2d x:0 0 0 2024-09-12T18:03:20.542 INFO:tasks.workunit.client.0.smithi052.stdout:1/163: mkdir d3/d10/d38 0 2024-09-12T18:03:20.542 INFO:tasks.workunit.client.0.smithi052.stdout:2/161: write da/dc/d15/f1f [1658093,83918] 0 2024-09-12T18:03:20.543 INFO:tasks.workunit.client.0.smithi052.stdout:8/216: fdatasync d13/f17 0 2024-09-12T18:03:20.543 INFO:tasks.workunit.client.0.smithi052.stdout:5/152: creat d7/f2d x:0 0 0 2024-09-12T18:03:20.543 INFO:tasks.workunit.client.0.smithi052.stdout:9/170: dwrite d0/f1a [0,4194304] 0 2024-09-12T18:03:20.544 INFO:tasks.workunit.client.0.smithi052.stdout:0/193: write d2/d6/dd/f39 [309892,11120] 0 2024-09-12T18:03:20.544 INFO:tasks.workunit.client.0.smithi052.stdout:7/130: chown d6/d12/d17/d27/c2b 6948150 1 2024-09-12T18:03:20.544 INFO:tasks.workunit.client.0.smithi052.stdout:1/164: symlink d3/d10/l39 0 2024-09-12T18:03:20.546 INFO:tasks.workunit.client.0.smithi052.stdout:4/224: read d11/d17/f18 [319761,103555] 0 2024-09-12T18:03:20.550 INFO:tasks.workunit.client.0.smithi052.stdout:9/171: mknod d0/d18/c41 0 2024-09-12T18:03:20.551 INFO:tasks.workunit.client.0.smithi052.stdout:6/274: truncate d2/d1e/f35 337461 0 2024-09-12T18:03:20.552 INFO:tasks.workunit.client.0.smithi052.stdout:5/153: dwrite d7/d1f/f2a [0,4194304] 0 2024-09-12T18:03:20.552 INFO:tasks.workunit.client.0.smithi052.stdout:9/172: write d0/d23/f2f [327872,41919] 0 2024-09-12T18:03:20.552 INFO:tasks.workunit.client.0.smithi052.stdout:0/194: dwrite d2/d6/dd/f39 [0,4194304] 0 2024-09-12T18:03:20.552 INFO:tasks.workunit.client.0.smithi052.stdout:9/173: chown d0/d18/d37/l38 2244 1 2024-09-12T18:03:20.553 INFO:tasks.workunit.client.0.smithi052.stdout:9/174: write d0/d23/f2f [230107,23613] 0 2024-09-12T18:03:20.555 INFO:tasks.workunit.client.0.smithi052.stdout:8/217: creat d13/d18/d38/f44 x:0 0 0 2024-09-12T18:03:20.555 INFO:tasks.workunit.client.0.smithi052.stdout:4/225: mknod d11/d17/d1b/d2a/c4b 0 2024-09-12T18:03:20.556 INFO:tasks.workunit.client.0.smithi052.stdout:2/162: link da/dc/f2b da/d2c/d2f/f31 0 2024-09-12T18:03:20.556 INFO:tasks.workunit.client.0.smithi052.stdout:7/131: unlink d6/f11 0 2024-09-12T18:03:20.556 INFO:tasks.workunit.client.0.smithi052.stdout:5/154: symlink d7/d1c/d1e/l2e 0 2024-09-12T18:03:20.557 INFO:tasks.workunit.client.0.smithi052.stdout:9/175: stat d0/l1 0 2024-09-12T18:03:20.557 INFO:tasks.workunit.client.0.smithi052.stdout:1/165: mknod d3/c3a 0 2024-09-12T18:03:20.557 INFO:tasks.workunit.client.0.smithi052.stdout:8/218: dread - d13/d18/d38/f44 zero size 2024-09-12T18:03:20.557 INFO:tasks.workunit.client.0.smithi052.stdout:0/195: truncate d2/d6/dd/f16 1097278 0 2024-09-12T18:03:20.557 INFO:tasks.workunit.client.0.smithi052.stdout:3/169: getdents d0/d4/d25/d2a/d6 0 2024-09-12T18:03:20.558 INFO:tasks.workunit.client.0.smithi052.stdout:6/275: mkdir d2/d3f/d58/d5d 0 2024-09-12T18:03:20.558 INFO:tasks.workunit.client.0.smithi052.stdout:5/155: write d7/f13 [902192,103782] 0 2024-09-12T18:03:20.558 INFO:tasks.workunit.client.0.smithi052.stdout:7/132: write d6/dc/f1c [314686,71074] 0 2024-09-12T18:03:20.559 INFO:tasks.workunit.client.0.smithi052.stdout:5/156: mknod d7/c2f 0 2024-09-12T18:03:20.559 INFO:tasks.workunit.client.0.smithi052.stdout:9/176: truncate d0/d18/f40 1043822 0 2024-09-12T18:03:20.560 INFO:tasks.workunit.client.0.smithi052.stdout:8/219: write d13/f1c [5510633,12667] 0 2024-09-12T18:03:20.560 INFO:tasks.workunit.client.0.smithi052.stdout:3/170: chown d0/d4/d25/d2a/d6/d7/de 126345 1 2024-09-12T18:03:20.561 INFO:tasks.workunit.client.0.smithi052.stdout:2/163: write da/d2c/d2f/f31 [554334,47684] 0 2024-09-12T18:03:20.561 INFO:tasks.workunit.client.0.smithi052.stdout:4/226: creat d11/d17/d23/d2f/d3b/d3f/f4c x:0 0 0 2024-09-12T18:03:20.561 INFO:tasks.workunit.client.0.smithi052.stdout:6/276: mkdir d2/d5e 0 2024-09-12T18:03:20.561 INFO:tasks.workunit.client.0.smithi052.stdout:3/171: write d0/d4/d25/f2e [1794934,21384] 0 2024-09-12T18:03:20.561 INFO:tasks.workunit.client.0.smithi052.stdout:9/177: write d0/d6/fd [4023561,4625] 0 2024-09-12T18:03:20.562 INFO:tasks.workunit.client.0.smithi052.stdout:1/166: unlink d3/d1d/d22/l23 0 2024-09-12T18:03:20.562 INFO:tasks.workunit.client.0.smithi052.stdout:2/164: readlink da/dc/d15/d22/l30 0 2024-09-12T18:03:20.562 INFO:tasks.workunit.client.0.smithi052.stdout:3/172: chown d0/d16 961670924 1 2024-09-12T18:03:20.562 INFO:tasks.workunit.client.0.smithi052.stdout:8/220: truncate d13/d18/d21/f27 204904 0 2024-09-12T18:03:20.562 INFO:tasks.workunit.client.0.smithi052.stdout:0/196: mkdir d2/d6/dd/d21/d26/d2f/d3a 0 2024-09-12T18:03:20.563 INFO:tasks.workunit.client.0.smithi052.stdout:9/178: dread - d0/d1c/f25 zero size 2024-09-12T18:03:20.563 INFO:tasks.workunit.client.0.smithi052.stdout:4/227: creat d11/d17/d23/d2f/d47/f4d x:0 0 0 2024-09-12T18:03:20.563 INFO:tasks.workunit.client.0.smithi052.stdout:2/165: symlink da/dc/d15/l32 0 2024-09-12T18:03:20.563 INFO:tasks.workunit.client.0.smithi052.stdout:1/167: write d3/d1d/f2c [1263035,126243] 0 2024-09-12T18:03:20.563 INFO:tasks.workunit.client.0.smithi052.stdout:0/197: fdatasync d2/d6/dd/d21/f35 0 2024-09-12T18:03:20.563 INFO:tasks.workunit.client.0.smithi052.stdout:3/173: chown d0/d4/d25/d2a/d6/d7/de 220463 1 2024-09-12T18:03:20.565 INFO:tasks.workunit.client.0.smithi052.stdout:9/179: mkdir d0/d6/d3a/d42 0 2024-09-12T18:03:20.565 INFO:tasks.workunit.client.0.smithi052.stdout:4/228: fsync d11/d17/d23/d2f/f41 0 2024-09-12T18:03:20.565 INFO:tasks.workunit.client.0.smithi052.stdout:3/174: creat d0/d4/d33/f38 x:0 0 0 2024-09-12T18:03:20.565 INFO:tasks.workunit.client.0.smithi052.stdout:1/168: mknod d3/d1d/d22/d27/d28/d2f/c3b 0 2024-09-12T18:03:20.565 INFO:tasks.workunit.client.0.smithi052.stdout:9/180: stat d0/d18/c41 0 2024-09-12T18:03:20.566 INFO:tasks.workunit.client.0.smithi052.stdout:1/169: chown d3/l9 26 1 2024-09-12T18:03:20.566 INFO:tasks.workunit.client.0.smithi052.stdout:9/181: mkdir d0/d6/d3a/d43 0 2024-09-12T18:03:20.568 INFO:tasks.workunit.client.0.smithi052.stdout:1/170: symlink d3/d1d/l3c 0 2024-09-12T18:03:20.568 INFO:tasks.workunit.client.0.smithi052.stdout:4/229: link d11/f16 d11/d17/d23/d2f/d3b/f4e 0 2024-09-12T18:03:20.568 INFO:tasks.workunit.client.0.smithi052.stdout:9/182: mknod d0/d18/d26/c44 0 2024-09-12T18:03:20.569 INFO:tasks.workunit.client.0.smithi052.stdout:4/230: write f8 [3735028,6401] 0 2024-09-12T18:03:20.569 INFO:tasks.workunit.client.0.smithi052.stdout:8/221: dwrite d13/d18/d21/f27 [0,4194304] 0 2024-09-12T18:03:20.570 INFO:tasks.workunit.client.0.smithi052.stdout:4/231: stat d11/d17/l43 0 2024-09-12T18:03:20.571 INFO:tasks.workunit.client.0.smithi052.stdout:0/198: dwrite d2/d8/f20 [0,4194304] 0 2024-09-12T18:03:20.571 INFO:tasks.workunit.client.0.smithi052.stdout:9/183: rename d0/d6/d3a/d42 to d0/d6/d3a/d42/d45 22 2024-09-12T18:03:20.571 INFO:tasks.workunit.client.0.smithi052.stdout:8/222: write d13/d18/d21/f33 [919803,125264] 0 2024-09-12T18:03:20.571 INFO:tasks.workunit.client.0.smithi052.stdout:4/232: chown d11/d17/l43 244100946 1 2024-09-12T18:03:20.574 INFO:tasks.workunit.client.0.smithi052.stdout:8/223: mknod d13/c45 0 2024-09-12T18:03:20.574 INFO:tasks.workunit.client.0.smithi052.stdout:4/233: link d11/d17/d1b/d2a/d32/f3e d11/d17/d1b/f4f 0 2024-09-12T18:03:20.576 INFO:tasks.workunit.client.0.smithi052.stdout:5/157: dread d7/f16 [0,4194304] 0 2024-09-12T18:03:20.577 INFO:tasks.workunit.client.0.smithi052.stdout:4/234: read d11/f15 [3127095,78688] 0 2024-09-12T18:03:20.577 INFO:tasks.workunit.client.0.smithi052.stdout:8/224: creat d13/d18/d38/f46 x:0 0 0 2024-09-12T18:03:20.577 INFO:tasks.workunit.client.0.smithi052.stdout:8/225: readlink l5 0 2024-09-12T18:03:20.580 INFO:tasks.workunit.client.0.smithi052.stdout:1/171: dwrite d3/d1d/d22/f30 [0,4194304] 0 2024-09-12T18:03:20.581 INFO:tasks.workunit.client.0.smithi052.stdout:9/184: dwrite d0/d23/f2f [0,4194304] 0 2024-09-12T18:03:20.581 INFO:tasks.workunit.client.0.smithi052.stdout:0/199: dwrite d2/d1b/f2e [0,4194304] 0 2024-09-12T18:03:20.583 INFO:tasks.workunit.client.0.smithi052.stdout:1/172: stat d3/d1d/d22/d27/d28/d2f/c3b 0 2024-09-12T18:03:20.584 INFO:tasks.workunit.client.0.smithi052.stdout:5/158: creat d7/f30 x:0 0 0 2024-09-12T18:03:20.586 INFO:tasks.workunit.client.0.smithi052.stdout:8/226: rename d13/l22 to d13/d18/l47 0 2024-09-12T18:03:20.588 INFO:tasks.workunit.client.0.smithi052.stdout:8/227: write d13/d18/d21/f23 [1536255,21702] 0 2024-09-12T18:03:20.590 INFO:tasks.workunit.client.0.smithi052.stdout:9/185: creat d0/d18/d26/f46 x:0 0 0 2024-09-12T18:03:20.590 INFO:tasks.workunit.client.0.smithi052.stdout:7/133: truncate d6/dc/f25 261943 0 2024-09-12T18:03:20.591 INFO:tasks.workunit.client.0.smithi052.stdout:3/175: truncate d0/d4/d25/d2a/d6/f15 2111055 0 2024-09-12T18:03:20.591 INFO:tasks.workunit.client.0.smithi052.stdout:1/173: symlink d3/d1d/l3d 0 2024-09-12T18:03:20.592 INFO:tasks.workunit.client.0.smithi052.stdout:7/134: fdatasync d6/d12/f15 0 2024-09-12T18:03:20.592 INFO:tasks.workunit.client.0.smithi052.stdout:1/174: dread - d3/d10/f34 zero size 2024-09-12T18:03:20.592 INFO:tasks.workunit.client.0.smithi052.stdout:0/200: rename d2/d8/c34 to d2/d6/dd/d21/d26/d38/c3b 0 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9234792650000001, 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.594 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.595 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.596 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.597 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.598 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:20.599 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:20.600 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9234422589999998, 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.601 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:20.602 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:20.603 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:20.604 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.605 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.606 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.607 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:20.608 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9233989170000001, 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.609 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:20.610 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.611 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.612 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.613 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:20.614 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:20.615 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9233612679999998, 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.616 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:20.617 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.618 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:20.619 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.620 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.621 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9233215589999997, 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.622 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:20.623 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.624 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.625 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.626 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.627 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.628 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9232837629999997, 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.629 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:20.630 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:20.631 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:20.632 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:20.633 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:20.634 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.923223771, 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:20.636 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:20.637 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.638 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.639 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.640 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:20.641 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.642 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.643 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9231286870000002, 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.644 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.645 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:20.646 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.647 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:20.648 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.649 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9230623590000002, 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.650 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.651 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:20.652 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.653 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.654 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.655 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9230054800000005, 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.656 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:20.657 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.658 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.659 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.660 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.661 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.662 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9229494750000002, 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.663 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:20.664 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:20.665 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.666 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.667 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.668 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:20.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:20.668 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.668 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.668 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.668 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:20.668 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:20.669 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9228842930000001, 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.675 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.676 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9228435109999999, 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:20.677 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.678 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.679 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:20.680 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:20.681 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.682 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9228078550000003, 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.683 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:20.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.685 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.686 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.687 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:20.688 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.689 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9227618130000002, 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.690 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:20.691 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:20.692 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:20.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:20.694 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:20.695 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:20.696 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9227236369999998, 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.697 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.699 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.700 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.701 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:20.702 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:20.703 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.9226771810000001, 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.704 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.705 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:20.706 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.707 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:20.708 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.709 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.8820531349999996, 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.710 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.711 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.712 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.713 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.714 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.715 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.716 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.8820374319999997, 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:20.717 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.718 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.719 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.720 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.721 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.722 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 7.8743071100000002, 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:20.726 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.726 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.726 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.728 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:20.728 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:20.728 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:20.728 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.728 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.728 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:20.728 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.729 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:20.730 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:20.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:20.730 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.730 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.730 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.730 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:20.730 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:20.730 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:20.731 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:20.731 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:20.731 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.731 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.731 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:20.732 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:20.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:20.732 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.732 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.732 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.732 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:20.732 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:20.732 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.734 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.735 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.735 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:20.735 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:20.735 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:20.739 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:20.744 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:20.735+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:20.767 INFO:tasks.workunit.client.0.smithi052.stdout:9/186: creat d0/d18/d37/f47 x:0 0 0 2024-09-12T18:03:20.767 INFO:tasks.workunit.client.0.smithi052.stdout:3/176: chown d0/d4/d25/d2a/d6/d7/f2b 1934072323 1 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:1/175: chown d3/d1d/d22/f30 1777644 1 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:2/166: write da/dc/d15/f19 [428023,124911] 0 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:5/159: dwrite d7/f14 [0,4194304] 0 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:0/201: mknod d2/d6/dd/c3c 0 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:3/177: rmdir d0/d4/d33 39 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:0/202: chown d2/d6/dd/f22 19416745 1 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:2/167: creat da/d2c/d2f/f33 x:0 0 0 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:9/187: link d0/l28 d0/d18/d26/d33/l48 0 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:5/160: write d7/fc [385355,5048] 0 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:2/168: fdatasync f3 0 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:9/188: fdatasync d0/d18/d37/f47 0 2024-09-12T18:03:20.768 INFO:tasks.workunit.client.0.smithi052.stdout:5/161: unlink d7/d1c/d1e/c25 0 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:8/228: dwrite d13/d18/d21/f37 [0,4194304] 0 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:5/162: chown d7/f19 13007 1 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:0/203: link d2/d6/dd/c3c d2/d6/dd/c3d 0 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/277: sync 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/278: read - d2/d1e/d5b/d26/f28 zero size 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:9/189: mkdir d0/d6/d49 0 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:2/169: symlink da/dc/d15/d22/l34 0 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/279: mkdir d2/d3f/d5f 0 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:8/229: creat d13/d18/d21/f48 x:0 0 0 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:8/230: dread - d13/d18/d38/f46 zero size 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/280: mknod d2/d3f/d58/c60 0 2024-09-12T18:03:20.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/281: chown d2/d21/c5a 208226 1 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:6/282: dread - d2/d21/f4e zero size 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/163: dwrite d7/f8 [0,4194304] 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:4/235: dread d11/d17/d1b/d2a/d32/f3e [0,4194304] 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/164: chown d7/f8 16557671 1 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:9/190: dwrite d0/d1c/f25 [0,4194304] 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/165: write d7/fc [622017,130931] 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/166: creat d7/d1c/f31 x:0 0 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:9/191: unlink d0/d18/d26/d33/l48 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:9/192: mkdir d0/d6/d4a 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:9/193: write d0/f1d [3617038,104260] 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/167: dread d7/f1a [0,4194304] 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:2/170: rename da/d2c/d2f to da/d1d/d35 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/168: symlink d7/d1c/l32 0 2024-09-12T18:03:20.770 INFO:tasks.workunit.client.0.smithi052.stdout:0/204: write d2/d6/dd/f39 [4772162,129517] 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:8/231: rename d13/d18/d21/f43 to d13/d18/f49 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:2/171: mkdir da/dc/d15/d36 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:5/169: creat d7/d1c/f33 x:0 0 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:6/283: rename d2/d1e/d5b/f4a to d2/d1e/d5b/d26/f61 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:5/170: readlink d7/d1c/l32 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:8/232: mknod d13/d18/d21/c4a 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:0/205: mknod d2/d6/dd/d21/d26/d2f/c3e 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:4/236: rename d11/f25 to d11/d17/d23/d2f/d3b/d3f/f50 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:5/171: chown d7/d1c/d1e 526697 1 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:6/284: creat d2/d3f/d54/f62 x:0 0 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:8/233: chown d13/d18/d21/f23 40323 1 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:0/206: write d2/d6/dd/d21/f32 [527614,54991] 0 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:4/237: chown d11/d17/f18 232341 1 2024-09-12T18:03:20.771 INFO:tasks.workunit.client.0.smithi052.stdout:8/234: chown fb 196538574 1 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:5/172: chown d7/d1f/f2c 39799696 1 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:8/235: readlink d13/l2c 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:5/173: mkdir d7/d1f/d34 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:2/172: dread da/f12 [0,4194304] 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:2/173: truncate da/dc/f2e 809672 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:2/174: creat da/dc/f37 x:0 0 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:4/238: truncate d11/d17/d1b/f2d 7406607 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:4/239: mkdir d11/d46/d51 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:2/175: dread da/f12 [0,4194304] 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:5/174: dread d7/f13 [0,4194304] 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:5/175: chown d7/d1f/c22 116 1 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:8/236: dwrite d13/f1b [8388608,4194304] 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:4/240: getdents d11/d17/d23/d2f/d3b/d3f 0 2024-09-12T18:03:20.772 INFO:tasks.workunit.client.0.smithi052.stdout:9/194: dread d0/fb [0,4194304] 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:5/176: mknod d7/c35 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:1/176: dread d3/f8 [4194304,4194304] 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:8/237: symlink d13/d18/l4b 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:1/177: fsync d3/d10/f34 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:4/241: rmdir d11/d17/d23/d2f/d3b/d3f 39 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:8/238: chown d13/d35 30268667 1 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:5/177: write d7/f21 [3021819,93385] 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:1/178: readlink d3/d10/l2a 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:9/195: creat d0/d6/d3a/d43/f4b x:0 0 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:4/242: dread - d11/d17/d23/d2f/d47/f4d zero size 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:1/179: write d3/f25 [655771,28163] 0 2024-09-12T18:03:20.773 INFO:tasks.workunit.client.0.smithi052.stdout:5/178: creat d7/d1c/d1e/f36 x:0 0 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:9/196: creat d0/d18/d37/f4c x:0 0 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:5/179: write d7/f19 [183023,71545] 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:2/176: dread da/dc/d15/d20/f24 [0,4194304] 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:4/243: truncate d11/d17/d23/d2f/f41 773609 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:6/285: dread d2/f10 [0,4194304] 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:6/286: chown d2/d49 96590351 1 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:4/244: rename d11/d17/d1b/f4f to d11/d17/d1b/d2a/f52 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:4/245: read d11/f1f [81402,7101] 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:6/287: rename d2/d1e/f20 to d2/d3f/d58/f63 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:4/246: creat d11/d17/d23/d2f/d47/f53 x:0 0 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:1/180: dwrite d3/fa [0,4194304] 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:8/239: getdents d13/d18 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:4/247: dread d11/d17/d23/d2f/f41 [0,4194304] 0 2024-09-12T18:03:20.774 INFO:tasks.workunit.client.0.smithi052.stdout:9/197: getdents d0/d18/d37 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:5/180: dwrite d7/f30 [0,4194304] 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:1/181: fsync d3/d1d/f2c 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:8/240: dread - d13/d18/f26 zero size 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:6/288: dread d2/f3a [0,4194304] 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:2/177: truncate f6 1635669 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:5/181: chown d7/fc 9821450 1 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:5/182: dread - d7/f2d zero size 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:9/198: mkdir d0/d18/d26/d4d 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:5/183: write d7/f30 [2737272,53926] 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:6/289: rmdir d2/d3f/d58 39 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:1/182: mknod d3/d10/d38/c3e 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:5/184: truncate d7/d1c/f33 479467 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:5/185: mkdir d7/d1c/d1e/d37 0 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:3/178: sync 2024-09-12T18:03:20.775 INFO:tasks.workunit.client.0.smithi052.stdout:7/135: sync 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:2/178: mknod da/c38 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:9/199: rmdir d0/d6/d49 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:1/183: mkdir d3/d1d/d22/d3f 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:4/248: getdents d11/d17/d1b/d2a/d32 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:9/200: unlink d0/f2b 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:7/136: creat d6/dc/f2e x:0 0 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:4/249: fsync d11/f21 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:5/186: write d7/f21 [4321805,87095] 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:1/184: creat d3/d10/d38/f40 x:0 0 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:2/179: truncate da/f17 617550 0 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:9/201: dread - d0/d1c/f20 zero size 2024-09-12T18:03:20.776 INFO:tasks.workunit.client.0.smithi052.stdout:6/290: rename d2/c3c to d2/d3f/d58/d5d/c64 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:4/250: symlink d11/d17/d1b/d2a/l54 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:1/185: rename d3 to d3/d41 22 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:6/291: write d2/d3f/f52 [5004991,14902] 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:7/137: rename d6/dc/f1c to d6/dc/f2f 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:2/180: creat da/dc/d15/f39 x:0 0 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:9/202: link d0/c15 d0/d18/d26/c4e 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:7/138: truncate d6/dc/f2f 1195152 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:1/186: mknod d3/d1d/d22/d3f/c42 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:5/187: dread d7/d1f/f2c [0,4194304] 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:6/292: rename d2/d3f/d58/f63 to d2/d21/f65 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:3/179: dread d0/d4/f27 [0,4194304] 0 2024-09-12T18:03:20.777 INFO:tasks.workunit.client.0.smithi052.stdout:2/181: dread da/d1d/d35/f31 [0,4194304] 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:5/188: unlink d7/f2d 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:1/187: mknod d3/d1d/d22/d3f/c43 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:8/241: dwrite d13/d35/f42 [0,4194304] 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:3/180: readlink d0/d4/l8 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:6/293: creat d2/d3f/d58/f66 x:0 0 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:6/294: fdatasync d2/d15/f23 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:8/242: symlink d13/d3c/l4c 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:1/188: readlink d3/d10/l2d 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:4/251: dwrite d11/d17/d23/d2f/f39 [4194304,4194304] 0 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:8/243: chown d13/d18/d21 431 1 2024-09-12T18:03:20.778 INFO:tasks.workunit.client.0.smithi052.stdout:3/181: write d0/d4/f28 [17700,110646] 0 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:5/189: dread d7/d1f/f29 [0,4194304] 0 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:1/189: dread - d3/d1d/d22/d27/d28/f32 zero size 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:7/139: dwrite d6/fd [0,4194304] 0 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:2/182: getdents da/d1d/d35 0 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:6/295: mknod d2/d5e/c67 0 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:4/252: fsync d11/d17/d1b/f2d 0 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:9/203: dwrite d0/f10 [0,4194304] 0 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:7/140: write d6/d12/d1e/f2c [151782,111596] 0 2024-09-12T18:03:20.779 INFO:tasks.workunit.client.0.smithi052.stdout:3/182: mkdir d0/d4/d25/d2a/d17/d39 0 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:7/141: read - d6/d26/f28 zero size 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:2/183: creat da/d2c/f3a x:0 0 0 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:9/204: symlink d0/d6/d4a/l4f 0 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:6/296: creat d2/d3f/d5f/f68 x:0 0 0 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:7/142: chown d6/d12/l21 3833 1 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:9/205: mknod d0/d18/c50 0 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:6/297: truncate d2/d15/f1d 2146685 0 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:9/206: link d0/d6/d3a/d43/f4b d0/d1c/f51 0 2024-09-12T18:03:20.780 INFO:tasks.workunit.client.0.smithi052.stdout:5/190: fdatasync d7/fc 0 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:7/143: link d6/f2d d6/dc/f30 0 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:6/298: rename d2/f19 to d2/d3f/d54/f69 0 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:5/191: fdatasync d7/d1c/f31 0 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:7/144: chown d6/dc/f2e 324433 1 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:4/253: truncate d11/f1f 117192 0 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:5/192: fdatasync d7/d1c/d1e/f36 0 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:5/193: chown d7/f8 218 1 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:7/145: mknod d6/d12/d17/d27/c31 0 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:5/194: readlink d7/d1c/l32 0 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:5/195: chown d7/d1c/d1e/l2e 3 1 2024-09-12T18:03:20.781 INFO:tasks.workunit.client.0.smithi052.stdout:4/254: creat d11/d46/d51/f55 x:0 0 0 2024-09-12T18:03:20.782 INFO:tasks.workunit.client.0.smithi052.stdout:6/299: mkdir d2/d21/d6a 0 2024-09-12T18:03:20.782 INFO:tasks.workunit.client.0.smithi052.stdout:3/183: dwrite d0/f13 [0,4194304] 0 2024-09-12T18:03:20.782 INFO:tasks.workunit.client.0.smithi052.stdout:6/300: symlink d2/d1e/d5b/d26/l6b 0 2024-09-12T18:03:20.782 INFO:tasks.workunit.client.0.smithi052.stdout:9/207: dwrite d0/d6/f3d [0,4194304] 0 2024-09-12T18:03:20.782 INFO:tasks.workunit.client.0.smithi052.stdout:4/255: symlink d11/d17/d23/d2f/d3b/l56 0 2024-09-12T18:03:20.782 INFO:tasks.workunit.client.0.smithi052.stdout:6/301: fsync d2/d15/f23 0 2024-09-12T18:03:20.782 INFO:tasks.workunit.client.0.smithi052.stdout:3/184: write d0/d4/d25/d2a/d17/f36 [1921699,101026] 0 2024-09-12T18:03:20.782 INFO:tasks.workunit.client.0.smithi052.stdout:6/302: stat d2/d21/f2a 0 2024-09-12T18:03:20.783 INFO:tasks.workunit.client.0.smithi052.stdout:9/208: rmdir d0/d6/d4a 39 2024-09-12T18:03:20.783 INFO:tasks.workunit.client.0.smithi052.stdout:9/209: stat d0/f8 0 2024-09-12T18:03:20.783 INFO:tasks.workunit.client.0.smithi052.stdout:5/196: dread d7/f30 [0,4194304] 0 2024-09-12T18:03:20.783 INFO:tasks.workunit.client.0.smithi052.stdout:3/185: mknod d0/d4/d25/d2a/d2c/c3a 0 2024-09-12T18:03:20.783 INFO:tasks.workunit.client.0.smithi052.stdout:9/210: creat d0/d18/d26/d33/f52 x:0 0 0 2024-09-12T18:03:20.783 INFO:tasks.workunit.client.0.smithi052.stdout:5/197: chown d7/d1f/c22 35 1 2024-09-12T18:03:20.783 INFO:tasks.workunit.client.0.smithi052.stdout:9/211: rmdir d0/d6/d3a 39 2024-09-12T18:03:20.783 INFO:tasks.workunit.client.0.smithi052.stdout:3/186: creat d0/d4/d33/f3b x:0 0 0 2024-09-12T18:03:20.784 INFO:tasks.workunit.client.0.smithi052.stdout:5/198: dread f4 [0,4194304] 0 2024-09-12T18:03:20.784 INFO:tasks.workunit.client.0.smithi052.stdout:9/212: unlink d0/d6/f27 0 2024-09-12T18:03:20.784 INFO:tasks.workunit.client.0.smithi052.stdout:5/199: creat d7/f38 x:0 0 0 2024-09-12T18:03:20.784 INFO:tasks.workunit.client.0.smithi052.stdout:9/213: creat d0/d6/d4a/f53 x:0 0 0 2024-09-12T18:03:20.784 INFO:tasks.workunit.client.0.smithi052.stdout:7/146: rename d6/d12/d17/d27 to d6/d12/d1e/d29/d32 0 2024-09-12T18:03:20.784 INFO:tasks.workunit.client.0.smithi052.stdout:9/214: readlink d0/d6/l3c 0 2024-09-12T18:03:20.784 INFO:tasks.workunit.client.0.smithi052.stdout:7/147: readlink d6/l19 0 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:3/187: creat d0/d4/d25/d2a/d6/d7/d34/f3c x:0 0 0 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:4/256: rename d11/d17/d23/d2f/f41 to d11/d46/f57 0 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:9/215: dread - d0/d6/d3a/d43/f4b zero size 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:7/148: symlink d6/d12/d1e/l33 0 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:3/188: creat d0/d4/f3d x:0 0 0 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:4/257: mknod d11/d17/d23/d2f/d47/c58 0 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:1/190: dread d3/f20 [4194304,4194304] 0 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:7/149: chown d6/d12/d1e/l33 29843 1 2024-09-12T18:03:20.785 INFO:tasks.workunit.client.0.smithi052.stdout:1/191: stat d3/l9 0 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/150: chown f5 194645 1 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:3/189: fsync d0/d4/d25/d2a/d6/d7/de/f37 0 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/151: fsync d6/dc/f25 0 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:3/190: chown d0/d4/d25/d2a/d17/f36 59162 1 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:4/258: rename f5 to d11/d17/d23/d2f/d3b/d3f/f59 0 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:6/303: write d2/d1e/d5b/d26/f46 [41816,35986] 0 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/152: dread - d6/d26/f28 zero size 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:3/191: read d0/d16/f1e [1888659,22650] 0 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/153: readlink d6/dc/l1b 0 2024-09-12T18:03:20.786 INFO:tasks.workunit.client.0.smithi052.stdout:4/259: creat d11/d17/d1b/f5a x:0 0 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:7/154: creat d6/dc/f34 x:0 0 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:7/155: stat d6/d12/d1e/l2a 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:9/216: dwrite d0/f1a [0,4194304] 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:9/217: readlink d0/d6/l13 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:8/244: dread d13/f1c [0,4194304] 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:1/192: dwrite d3/d10/f34 [0,4194304] 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:8/245: chown d13/d18/d21/f48 31326 1 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:1/193: mkdir d3/d10/d38/d44 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:1/194: write d3/f8 [1167367,43168] 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:3/192: dwrite d0/d16/f1e [0,4194304] 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:1/195: getdents d3 0 2024-09-12T18:03:20.787 INFO:tasks.workunit.client.0.smithi052.stdout:0/207: sync 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:7/156: dwrite d6/d26/f28 [0,4194304] 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:1/196: creat d3/d1d/d22/d3f/f45 x:0 0 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:0/208: creat d2/d6/dd/d21/d26/d38/f3f x:0 0 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:0/209: rename d2/d6/dd/f16 to d2/d6/dd/d21/d26/f40 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:5/200: write d7/f14 [4921644,8697] 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:7/157: dwrite d6/d12/f15 [0,4194304] 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:6/304: dread d2/d15/f1d [0,4194304] 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:5/201: truncate d7/f1a 1959016 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:1/197: dread d3/d1d/d22/d27/d28/f29 [0,4194304] 0 2024-09-12T18:03:20.788 INFO:tasks.workunit.client.0.smithi052.stdout:5/202: mknod d7/d1f/c39 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/210: dwrite d2/d8/f1c [0,4194304] 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:5/203: truncate d7/d1c/d1e/f36 41276 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:1/198: creat d3/d1d/d22/d27/d28/d2f/f46 x:0 0 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/211: mkdir d2/d6/dd/d21/d41 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:7/158: dwrite f5 [4194304,4194304] 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/212: write d2/d8/fa [2696745,124775] 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:1/199: write d3/d1d/d22/d27/d28/f29 [373749,106397] 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/213: mknod d2/d8/c42 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:7/159: mkdir d6/d12/d1e/d29/d32/d35 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:1/200: mknod d3/d10/c47 0 2024-09-12T18:03:20.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/214: creat d2/d8/f43 x:0 0 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:7/160: creat d6/f36 x:0 0 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/305: dwrite d2/d15/f30 [0,4194304] 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:0/215: fdatasync d2/d6/f10 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:7/161: write d6/fd [8057265,52024] 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/306: mknod d2/c6c 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:5/204: dwrite d7/f16 [0,4194304] 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/307: dread - d2/d1e/d5b/d26/f5c zero size 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:5/205: write d7/d1c/d1e/f2b [295612,106344] 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:5/206: mkdir d7/d1f/d3a 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:0/216: mkdir d2/d6/dd/d21/d41/d44 0 2024-09-12T18:03:20.790 INFO:tasks.workunit.client.0.smithi052.stdout:1/201: dwrite d3/f25 [0,4194304] 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:5/207: symlink d7/d1f/d34/l3b 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:0/217: write d2/d6/dd/f39 [3194979,99967] 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:0/218: mknod d2/d8/c45 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:1/202: mknod d3/d1d/d22/d3f/c48 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:7/162: fsync d6/f36 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:3/193: dread d0/d4/d33/f35 [0,4194304] 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:6/308: dwrite d2/d21/f4c [0,4194304] 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:3/194: fsync d0/f12 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:1/203: mkdir d3/d10/d38/d44/d49 0 2024-09-12T18:03:20.791 INFO:tasks.workunit.client.0.smithi052.stdout:0/219: truncate d2/d6/f10 3340137 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:6/309: symlink d2/d15/d1a/l6d 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:5/208: dread d7/ff [0,4194304] 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:5/209: truncate d7/f21 4740612 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:7/163: link d6/d12/d17/c24 d6/c37 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:3/195: rename d0/c20 to d0/d4/d25/c3e 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:6/310: unlink d2/d21/c5a 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:5/210: fsync d7/f13 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:7/164: write d6/dc/f2f [852286,68840] 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:5/211: creat d7/f3c x:0 0 0 2024-09-12T18:03:20.792 INFO:tasks.workunit.client.0.smithi052.stdout:5/212: write d7/d1c/d1e/f36 [833503,42] 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:7/165: rename d6/d12/d1e/c22 to d6/d12/d17/c38 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/204: dwrite d3/fc [8388608,4194304] 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:7/166: truncate d6/dc/f34 38376 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/205: creat d3/d10/d38/f4a x:0 0 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/206: write d3/f20 [2213174,127146] 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/207: symlink d3/d1d/d22/d3f/l4b 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:7/167: link d6/d12/d1e/l20 d6/d12/d1e/d29/l39 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/208: stat d3/d10/f26 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:7/168: mkdir d6/d12/d1e/d29/d32/d3a 0 2024-09-12T18:03:20.793 INFO:tasks.workunit.client.0.smithi052.stdout:3/196: write d0/d4/d25/d2a/d6/f15 [1843518,126911] 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:5/213: dwrite d7/d1f/f2a [0,4194304] 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:7/169: write d6/ff [362148,31197] 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:1/209: link d3/d1d/c36 d3/d1d/d22/d27/d28/d2f/c4c 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:5/214: creat d7/d1c/d1e/f3d x:0 0 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:3/197: mkdir d0/d4/d25/d2a/d17/d3f 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:1/210: chown d3/d1d/d22/d27/l2e 28438 1 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:5/215: symlink d7/d1f/l3e 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:5/216: dread d7/f14 [0,4194304] 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:7/170: dwrite d6/d12/f15 [0,4194304] 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:7/171: mknod d6/d12/d17/c3b 0 2024-09-12T18:03:20.794 INFO:tasks.workunit.client.0.smithi052.stdout:5/217: link d7/ff d7/d1c/f3f 0 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:3/198: dwrite d0/d4/d33/f3b [0,4194304] 0 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:6/311: dread d2/f43 [0,4194304] 0 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:7/172: creat d6/f3c x:0 0 0 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:6/312: rename d2/d21/d6a to d2/d21/d6a/d6e 22 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:3/199: fdatasync d0/d4/d25/d2a/d6/d7/de/f26 0 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:3/200: mknod d0/c40 0 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:7/173: link d6/ff d6/d12/d1e/d29/d32/d3a/f3d 0 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:3/201: chown d0/d4/d25/d2a/d6/d7/de 931593 1 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:0/220: dread d2/f29 [0,4194304] 0 2024-09-12T18:03:20.795 INFO:tasks.workunit.client.0.smithi052.stdout:7/174: rename d6/d12/d17/l1d to d6/d12/d1e/d29/d32/l3e 0 2024-09-12T18:03:20.803 INFO:tasks.workunit.client.0.smithi052.stdout:9/218: sync 2024-09-12T18:03:20.803 INFO:tasks.workunit.client.0.smithi052.stdout:4/260: sync 2024-09-12T18:03:20.803 INFO:tasks.workunit.client.0.smithi052.stdout:8/246: sync 2024-09-12T18:03:20.803 INFO:tasks.workunit.client.0.smithi052.stdout:2/184: sync 2024-09-12T18:03:20.803 INFO:tasks.workunit.client.0.smithi052.stdout:0/221: rename d2/d8/l14 to d2/d6/dd/d21/d26/d38/l46 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:7/175: mknod d6/d12/d17/c3f 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:8/247: mknod d13/d3c/c4d 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:2/185: rmdir da/dc/d15/d20 39 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:4/261: truncate d11/f15 4929101 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:2/186: readlink da/l1a 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:1/211: fsync d3/f20 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:4/262: chown d11/f15 107 1 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:1/212: fsync d3/f8 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:2/187: fdatasync da/dc/d15/f39 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:6/313: dwrite d2/d3f/d5f/f68 [0,4194304] 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:8/248: creat d13/f4e x:0 0 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:5/218: dwrite d7/f30 [0,4194304] 0 2024-09-12T18:03:20.804 INFO:tasks.workunit.client.0.smithi052.stdout:4/263: write d11/d17/d23/d2f/f3a [935267,62301] 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:2/188: creat da/d2c/f3b x:0 0 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:8/249: read - d13/d18/d21/f41 zero size 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:9/219: dread d0/f1a [0,4194304] 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:5/219: write d7/f14 [5604397,7772] 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:6/314: truncate d2/d1e/f48 637982 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:0/222: dread d2/d6/dd/f39 [0,4194304] 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:6/315: readlink d2/l13 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:4/264: dread - d11/d17/d23/d2f/d47/f4a zero size 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:9/220: write d0/d6/f3d [2631534,68220] 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:8/250: symlink d13/d35/l4f 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:0/223: mkdir d2/d6/dd/d21/d47 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:5/220: truncate d7/ff 2793733 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:8/251: fdatasync d13/d18/f26 0 2024-09-12T18:03:20.805 INFO:tasks.workunit.client.0.smithi052.stdout:2/189: rename da/d2c/f3a to da/dc/d15/f3c 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:4/265: chown d11/d17/d23/d2f/d3b/f4e 84309575 1 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:5/221: dread - d7/d1c/f31 zero size 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:9/221: mkdir d0/d18/d26/d4d/d54 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:7/176: dwrite d6/ff [0,4194304] 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:6/316: rename d2/d1e/f35 to d2/d3f/d54/f6f 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:2/190: mknod da/dc/d15/d22/c3d 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:5/222: creat d7/f40 x:0 0 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:9/222: rename d0/d18 to d0/d18/d55 22 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:8/252: link d13/f30 d13/d18/d21/f50 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:9/223: truncate d0/d18/d37/f47 566359 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:0/224: mkdir d2/d6/dd/d21/d41/d44/d48 0 2024-09-12T18:03:20.806 INFO:tasks.workunit.client.0.smithi052.stdout:5/223: rename d7/c10 to d7/d1c/c41 0 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:7/177: symlink d6/d12/d1e/d29/d32/d3a/l40 0 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:9/224: symlink d0/d6/l56 0 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:2/191: link da/dc/d15/f39 da/dc/d15/f3e 0 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:5/224: write d7/d1c/d1e/f3d [267299,54925] 0 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:9/225: chown d0/d6/fd 25045813 1 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:7/178: truncate d6/dc/f2e 354906 0 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:2/192: chown da/dc/d15 121241 1 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:0/225: link d2/d8/fa d2/d6/dd/d21/d26/d38/f49 0 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:9/226: readlink d0/d6/l3c 0 2024-09-12T18:03:20.807 INFO:tasks.workunit.client.0.smithi052.stdout:5/225: symlink d7/d1f/d3a/l42 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:4/266: dwrite d11/d17/d23/d2f/d47/f4a [0,4194304] 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:2/193: creat da/d1d/d35/f3f x:0 0 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:5/226: symlink d7/l43 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:9/227: write d0/d18/f36 [62671,59171] 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:2/194: creat da/dc/d15/f40 x:0 0 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:4/267: creat d11/d17/d1b/f5b x:0 0 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:5/227: unlink d7/d1c/l27 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:8/253: dwrite fb [0,4194304] 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:4/268: readlink d11/l3d 0 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:2/195: rmdir da/d1d/d35 39 2024-09-12T18:03:20.808 INFO:tasks.workunit.client.0.smithi052.stdout:5/228: readlink d7/le 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:8/254: creat d13/d18/f51 x:0 0 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:4/269: symlink d11/d17/d1b/d2a/l5c 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:5/229: truncate d7/d1f/f2c 2681119 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:7/179: write d6/dc/f30 [875929,90298] 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:6/317: fsync d2/d3f/d54/f6f 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:0/226: dwrite d2/d6/dd/d21/f32 [0,4194304] 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:2/196: link da/dc/d15/d22/l2a da/d21/l41 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:3/202: sync 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:7/180: write d6/ff [923468,80450] 0 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:1/213: sync 2024-09-12T18:03:20.809 INFO:tasks.workunit.client.0.smithi052.stdout:0/227: chown d2/d6/dd/d21/d41/d44 41566803 1 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:2/197: write da/d21/f26 [766667,114590] 0 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:6/318: write d2/d1e/d5b/d26/f46 [1195976,62632] 0 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:1/214: write d3/f8 [7771502,69742] 0 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:0/228: dread - d2/d6/dd/f22 zero size 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:3/203: readlink d0/d4/d25/d2a/d17/l1a 0 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:7/181: symlink d6/d12/d1e/d29/l41 0 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:6/319: stat d2/d15/c50 0 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:3/204: fdatasync d0/d16/f1e 0 2024-09-12T18:03:20.810 INFO:tasks.workunit.client.0.smithi052.stdout:1/215: creat d3/d10/d38/f4d x:0 0 0 2024-09-12T18:03:20.813 INFO:tasks.workunit.client.0.smithi052.stdout:7/182: readlink d6/d12/d1e/d29/d32/l3e 0 2024-09-12T18:03:20.814 INFO:tasks.workunit.client.0.smithi052.stdout:2/198: dread da/dc/f2e [0,4194304] 0 2024-09-12T18:03:20.814 INFO:tasks.workunit.client.0.smithi052.stdout:8/255: dwrite d13/d18/d21/f37 [0,4194304] 0 2024-09-12T18:03:20.814 INFO:tasks.workunit.client.0.smithi052.stdout:9/228: write d0/d1c/f51 [165988,12454] 0 2024-09-12T18:03:20.814 INFO:tasks.workunit.client.0.smithi052.stdout:0/229: write d2/d6/dd/f39 [3888574,62865] 0 2024-09-12T18:03:20.814 INFO:tasks.workunit.client.0.smithi052.stdout:2/199: stat da 0 2024-09-12T18:03:20.814 INFO:tasks.workunit.client.0.smithi052.stdout:3/205: mkdir d0/d4/d25/d2a/d6/d41 0 2024-09-12T18:03:20.814 INFO:tasks.workunit.client.0.smithi052.stdout:7/183: readlink d6/d12/l18 0 2024-09-12T18:03:20.814 INFO:tasks.workunit.client.0.smithi052.stdout:3/206: readlink d0/d4/l8 0 2024-09-12T18:03:20.815 INFO:tasks.workunit.client.0.smithi052.stdout:4/270: dwrite d11/d17/d1b/f20 [0,4194304] 0 2024-09-12T18:03:20.815 INFO:tasks.workunit.client.0.smithi052.stdout:7/184: dread d6/dc/f2e [0,4194304] 0 2024-09-12T18:03:20.815 INFO:tasks.workunit.client.0.smithi052.stdout:3/207: truncate d0/d4/d25/d2a/d6/d7/de/f37 338892 0 2024-09-12T18:03:20.815 INFO:tasks.workunit.client.0.smithi052.stdout:6/320: write d2/d21/f65 [837715,61895] 0 2024-09-12T18:03:20.815 INFO:tasks.workunit.client.0.smithi052.stdout:5/230: chown d7/ff 95782 1 2024-09-12T18:03:20.815 INFO:tasks.workunit.client.0.smithi052.stdout:8/256: write d13/d18/d21/f50 [897128,89956] 0 2024-09-12T18:03:20.815 INFO:tasks.workunit.client.0.smithi052.stdout:6/321: sync 2024-09-12T18:03:20.815 INFO:tasks.workunit.client.0.smithi052.stdout:3/208: rmdir d0/d4/d25 39 2024-09-12T18:03:20.816 INFO:tasks.workunit.client.0.smithi052.stdout:4/271: symlink d11/d17/d23/d2f/l5d 0 2024-09-12T18:03:20.816 INFO:tasks.workunit.client.0.smithi052.stdout:8/257: unlink d13/c45 0 2024-09-12T18:03:20.816 INFO:tasks.workunit.client.0.smithi052.stdout:7/185: creat d6/d12/d1e/d29/d32/f42 x:0 0 0 2024-09-12T18:03:20.817 INFO:tasks.workunit.client.0.smithi052.stdout:6/322: write d2/d15/f30 [414657,80794] 0 2024-09-12T18:03:20.817 INFO:tasks.workunit.client.0.smithi052.stdout:6/323: sync 2024-09-12T18:03:20.817 INFO:tasks.workunit.client.0.smithi052.stdout:4/272: fdatasync d11/d17/d23/d2f/d47/f4d 0 2024-09-12T18:03:20.817 INFO:tasks.workunit.client.0.smithi052.stdout:8/258: chown d13/d18/d21/f28 5 1 2024-09-12T18:03:20.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/200: dwrite da/d2c/f3b [0,4194304] 0 2024-09-12T18:03:20.819 INFO:tasks.workunit.client.0.smithi052.stdout:0/230: dwrite d2/f29 [0,4194304] 0 2024-09-12T18:03:20.819 INFO:tasks.workunit.client.0.smithi052.stdout:1/216: dwrite d3/d1d/d22/d27/d28/f32 [0,4194304] 0 2024-09-12T18:03:20.820 INFO:tasks.workunit.client.0.smithi052.stdout:8/259: readlink l10 0 2024-09-12T18:03:20.820 INFO:tasks.workunit.client.0.smithi052.stdout:4/273: readlink d11/d17/d1b/d2a/l5c 0 2024-09-12T18:03:20.821 INFO:tasks.workunit.client.0.smithi052.stdout:3/209: link d0/d4/l23 d0/d4/d25/d2a/d6/d41/l42 0 2024-09-12T18:03:20.821 INFO:tasks.workunit.client.0.smithi052.stdout:2/201: chown da/l23 1 1 2024-09-12T18:03:20.822 INFO:tasks.workunit.client.0.smithi052.stdout:2/202: sync 2024-09-12T18:03:20.822 INFO:tasks.workunit.client.0.smithi052.stdout:1/217: rmdir d3/d10/d38/d44 39 2024-09-12T18:03:20.823 INFO:tasks.workunit.client.0.smithi052.stdout:6/324: getdents d2/d3f/d58/d5d 0 2024-09-12T18:03:20.823 INFO:tasks.workunit.client.0.smithi052.stdout:0/231: rmdir d2/d6/dd/d21/d41/d44 39 2024-09-12T18:03:20.824 INFO:tasks.workunit.client.0.smithi052.stdout:8/260: fsync d13/d18/d21/f48 0 2024-09-12T18:03:20.824 INFO:tasks.workunit.client.0.smithi052.stdout:2/203: chown da/d2c/f2d 6 1 2024-09-12T18:03:20.824 INFO:tasks.workunit.client.0.smithi052.stdout:3/210: readlink d0/d4/d25/d2a/d17/l1a 0 2024-09-12T18:03:20.825 INFO:tasks.workunit.client.0.smithi052.stdout:5/231: dwrite d7/d1c/f31 [0,4194304] 0 2024-09-12T18:03:20.825 INFO:tasks.workunit.client.0.smithi052.stdout:2/204: chown da/d1d 1 1 2024-09-12T18:03:20.826 INFO:tasks.workunit.client.0.smithi052.stdout:0/232: chown d2/d8/c1f 20 1 2024-09-12T18:03:20.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/186: dwrite f5 [0,4194304] 0 2024-09-12T18:03:20.826 INFO:tasks.workunit.client.0.smithi052.stdout:8/261: dread - d13/d18/d21/f39 zero size 2024-09-12T18:03:20.827 INFO:tasks.workunit.client.0.smithi052.stdout:3/211: chown d0/d4/d25/d2a/d6 120711 1 2024-09-12T18:03:20.827 INFO:tasks.workunit.client.0.smithi052.stdout:2/205: write da/f13 [4553791,93571] 0 2024-09-12T18:03:20.828 INFO:tasks.workunit.client.0.smithi052.stdout:3/212: rename d0/d4/d25 to d0/d4/d25/d2a/d6/d43 22 2024-09-12T18:03:20.829 INFO:tasks.workunit.client.0.smithi052.stdout:5/232: creat d7/d1c/d1e/f44 x:0 0 0 2024-09-12T18:03:20.829 INFO:tasks.workunit.client.0.smithi052.stdout:6/325: creat d2/f70 x:0 0 0 2024-09-12T18:03:20.829 INFO:tasks.workunit.client.0.smithi052.stdout:0/233: mkdir d2/d6/dd/d21/d26/d38/d4a 0 2024-09-12T18:03:20.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/187: truncate d6/dc/f25 365858 0 2024-09-12T18:03:20.831 INFO:tasks.workunit.client.0.smithi052.stdout:6/326: symlink d2/l71 0 2024-09-12T18:03:20.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/213: truncate d0/f12 6261247 0 2024-09-12T18:03:20.831 INFO:tasks.workunit.client.0.smithi052.stdout:8/262: getdents d13/d18 0 2024-09-12T18:03:20.832 INFO:tasks.workunit.client.0.smithi052.stdout:3/214: fdatasync d0/d4/d25/d2a/f32 0 2024-09-12T18:03:20.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/327: truncate d2/d21/f65 1863470 0 2024-09-12T18:03:20.832 INFO:tasks.workunit.client.0.smithi052.stdout:1/218: dwrite d3/fa [0,4194304] 0 2024-09-12T18:03:20.833 INFO:tasks.workunit.client.0.smithi052.stdout:1/219: fdatasync d3/f20 0 2024-09-12T18:03:20.835 INFO:tasks.workunit.client.0.smithi052.stdout:8/263: unlink l10 0 2024-09-12T18:03:20.836 INFO:tasks.workunit.client.0.smithi052.stdout:5/233: read d7/d1c/d1e/f36 [153705,69490] 0 2024-09-12T18:03:20.836 INFO:tasks.workunit.client.0.smithi052.stdout:8/264: readlink d13/d18/l4b 0 2024-09-12T18:03:20.837 INFO:tasks.workunit.client.0.smithi052.stdout:3/215: fdatasync d0/f12 0 2024-09-12T18:03:20.837 INFO:tasks.workunit.client.0.smithi052.stdout:6/328: creat d2/d21/d6a/f72 x:0 0 0 2024-09-12T18:03:20.837 INFO:tasks.workunit.client.0.smithi052.stdout:5/234: readlink d7/le 0 2024-09-12T18:03:20.837 INFO:tasks.workunit.client.0.smithi052.stdout:2/206: link da/f12 da/dc/d15/f42 0 2024-09-12T18:03:20.838 INFO:tasks.workunit.client.0.smithi052.stdout:0/234: dwrite d2/f31 [0,4194304] 0 2024-09-12T18:03:20.839 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:20.837+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:20.839 INFO:tasks.workunit.client.0.smithi052.stdout:8/265: write d13/d35/f42 [3630475,56293] 0 2024-09-12T18:03:20.840 INFO:tasks.workunit.client.0.smithi052.stdout:6/329: mknod d2/d3f/d54/c73 0 2024-09-12T18:03:20.840 INFO:tasks.workunit.client.0.smithi052.stdout:3/216: rmdir d0/d4/d25/d2a/d6/d41 39 2024-09-12T18:03:20.840 INFO:tasks.workunit.client.0.smithi052.stdout:2/207: mkdir da/dc/d15/d43 0 2024-09-12T18:03:20.842 INFO:tasks.workunit.client.0.smithi052.stdout:7/188: dwrite d6/d12/f15 [0,4194304] 0 2024-09-12T18:03:20.842 INFO:tasks.workunit.client.0.smithi052.stdout:2/208: write da/f13 [3862290,84136] 0 2024-09-12T18:03:20.842 INFO:tasks.workunit.client.0.smithi052.stdout:6/330: stat d2/d1e/d5b/d26/f2d 0 2024-09-12T18:03:20.842 INFO:tasks.workunit.client.0.smithi052.stdout:7/189: truncate d6/d12/d1e/d29/d32/f42 769282 0 2024-09-12T18:03:20.843 INFO:tasks.workunit.client.0.smithi052.stdout:2/209: symlink da/dc/l44 0 2024-09-12T18:03:20.843 INFO:tasks.workunit.client.0.smithi052.stdout:7/190: stat d6/d12/f15 0 2024-09-12T18:03:20.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/217: mknod d0/d4/d25/d2a/d17/c44 0 2024-09-12T18:03:20.843 INFO:tasks.workunit.client.0.smithi052.stdout:6/331: symlink d2/d3f/d5f/l74 0 2024-09-12T18:03:20.844 INFO:tasks.workunit.client.0.smithi052.stdout:8/266: link d13/d35/l4f d13/d18/d38/l52 0 2024-09-12T18:03:20.844 INFO:tasks.workunit.client.0.smithi052.stdout:1/220: truncate d3/d1d/d22/f30 1276319 0 2024-09-12T18:03:20.845 INFO:tasks.workunit.client.0.smithi052.stdout:3/218: creat d0/d4/d25/d2a/d6/d41/f45 x:0 0 0 2024-09-12T18:03:20.845 INFO:tasks.workunit.client.0.smithi052.stdout:6/332: chown d2/d3f/d5f 981837 1 2024-09-12T18:03:20.845 INFO:tasks.workunit.client.0.smithi052.stdout:8/267: creat d13/d35/f53 x:0 0 0 2024-09-12T18:03:20.846 INFO:tasks.workunit.client.0.smithi052.stdout:9/229: dread d0/d1c/f22 [0,4194304] 0 2024-09-12T18:03:20.847 INFO:tasks.workunit.client.0.smithi052.stdout:7/191: dread d6/dc/f2e [0,4194304] 0 2024-09-12T18:03:20.847 INFO:tasks.workunit.client.0.smithi052.stdout:0/235: truncate d2/d8/f20 1432165 0 2024-09-12T18:03:20.847 INFO:tasks.workunit.client.0.smithi052.stdout:6/333: read - d2/f70 zero size 2024-09-12T18:03:20.847 INFO:tasks.workunit.client.0.smithi052.stdout:1/221: symlink d3/d10/l4e 0 2024-09-12T18:03:20.847 INFO:tasks.workunit.client.0.smithi052.stdout:8/268: dread - d13/f4e zero size 2024-09-12T18:03:20.847 INFO:tasks.workunit.client.0.smithi052.stdout:3/219: chown d0/d16/l24 913 1 2024-09-12T18:03:20.848 INFO:tasks.workunit.client.0.smithi052.stdout:6/334: unlink d2/d15/f1d 0 2024-09-12T18:03:20.848 INFO:tasks.workunit.client.0.smithi052.stdout:8/269: dread - d13/d35/f53 zero size 2024-09-12T18:03:20.850 INFO:tasks.workunit.client.0.smithi052.stdout:9/230: creat d0/d6/f57 x:0 0 0 2024-09-12T18:03:20.850 INFO:tasks.workunit.client.0.smithi052.stdout:6/335: unlink d2/d21/f4e 0 2024-09-12T18:03:20.850 INFO:tasks.workunit.client.0.smithi052.stdout:3/220: creat d0/d4/d25/d2a/d17/f46 x:0 0 0 2024-09-12T18:03:20.851 INFO:tasks.workunit.client.0.smithi052.stdout:1/222: link d3/fc d3/d1d/d22/d27/f4f 0 2024-09-12T18:03:20.852 INFO:tasks.workunit.client.0.smithi052.stdout:1/223: fsync d3/f35 0 2024-09-12T18:03:20.852 INFO:tasks.workunit.client.0.smithi052.stdout:9/231: dread - d0/d6/d4a/f53 zero size 2024-09-12T18:03:20.853 INFO:tasks.workunit.client.0.smithi052.stdout:5/235: dwrite d7/d1f/f2c [0,4194304] 0 2024-09-12T18:03:20.854 INFO:tasks.workunit.client.0.smithi052.stdout:2/210: dwrite da/dc/f37 [0,4194304] 0 2024-09-12T18:03:20.854 INFO:tasks.workunit.client.0.smithi052.stdout:9/232: write d0/d6/d4a/f53 [859061,99573] 0 2024-09-12T18:03:20.856 INFO:tasks.workunit.client.0.smithi052.stdout:1/224: creat d3/d1d/d22/d27/f50 x:0 0 0 2024-09-12T18:03:20.856 INFO:tasks.workunit.client.0.smithi052.stdout:9/233: read d0/d1c/f25 [3019381,117908] 0 2024-09-12T18:03:20.857 INFO:tasks.workunit.client.0.smithi052.stdout:7/192: dread d6/dc/f2f [0,4194304] 0 2024-09-12T18:03:20.858 INFO:tasks.workunit.client.0.smithi052.stdout:4/274: dread d11/d17/d23/d2f/d3b/d3f/f50 [0,4194304] 0 2024-09-12T18:03:20.858 INFO:tasks.workunit.client.0.smithi052.stdout:5/236: rmdir d7/d1c/d1e/d37 0 2024-09-12T18:03:20.859 INFO:tasks.workunit.client.0.smithi052.stdout:3/221: rename d0/d4/d25/d2a/d6/d7/d34/f3c to d0/d4/f47 0 2024-09-12T18:03:20.859 INFO:tasks.workunit.client.0.smithi052.stdout:0/236: dwrite d2/d6/dd/d21/f35 [0,4194304] 0 2024-09-12T18:03:20.859 INFO:tasks.workunit.client.0.smithi052.stdout:2/211: write da/d1d/d35/f3f [1027771,24902] 0 2024-09-12T18:03:20.860 INFO:tasks.workunit.client.0.smithi052.stdout:9/234: unlink d0/d6/f57 0 2024-09-12T18:03:20.860 INFO:tasks.workunit.client.0.smithi052.stdout:5/237: chown d7/d1c/d1e/l2e 95 1 2024-09-12T18:03:20.861 INFO:tasks.workunit.client.0.smithi052.stdout:1/225: dread - d3/d1d/d22/d27/d28/d2f/f46 zero size 2024-09-12T18:03:20.861 INFO:tasks.workunit.client.0.smithi052.stdout:3/222: chown d0/c40 41115 1 2024-09-12T18:03:20.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/212: dread da/dc/f2b [0,4194304] 0 2024-09-12T18:03:20.863 INFO:tasks.workunit.client.0.smithi052.stdout:6/336: dwrite d2/d15/f2c [4194304,4194304] 0 2024-09-12T18:03:20.863 INFO:tasks.workunit.client.0.smithi052.stdout:7/193: symlink d6/d12/d1e/d29/d32/d3a/l43 0 2024-09-12T18:03:20.863 INFO:tasks.workunit.client.0.smithi052.stdout:5/238: rmdir d7/d1c/d1e 39 2024-09-12T18:03:20.863 INFO:tasks.workunit.client.0.smithi052.stdout:1/226: write d3/d10/f26 [1056577,66214] 0 2024-09-12T18:03:20.864 INFO:tasks.workunit.client.0.smithi052.stdout:5/239: write d7/f30 [214022,47982] 0 2024-09-12T18:03:20.866 INFO:tasks.workunit.client.0.smithi052.stdout:8/270: dwrite d13/d18/d38/f40 [0,4194304] 0 2024-09-12T18:03:20.866 INFO:tasks.workunit.client.0.smithi052.stdout:6/337: creat d2/d21/d6a/f75 x:0 0 0 2024-09-12T18:03:20.867 INFO:tasks.workunit.client.0.smithi052.stdout:8/271: dread - d13/f4e zero size 2024-09-12T18:03:20.868 INFO:tasks.workunit.client.0.smithi052.stdout:8/272: readlink d13/l24 0 2024-09-12T18:03:20.868 INFO:tasks.workunit.client.0.smithi052.stdout:7/194: symlink d6/d12/d1e/d29/d32/d3a/l44 0 2024-09-12T18:03:20.869 INFO:tasks.workunit.client.0.smithi052.stdout:1/227: symlink d3/d10/d38/d44/l51 0 2024-09-12T18:03:20.870 INFO:tasks.workunit.client.0.smithi052.stdout:6/338: rmdir d2/d5e 39 2024-09-12T18:03:20.871 INFO:tasks.workunit.client.0.smithi052.stdout:5/240: fdatasync d7/f1a 0 2024-09-12T18:03:20.871 INFO:tasks.workunit.client.0.smithi052.stdout:4/275: dread d11/d17/d23/d2f/f31 [0,4194304] 0 2024-09-12T18:03:20.871 INFO:tasks.workunit.client.0.smithi052.stdout:6/339: mkdir d2/d21/d76 0 2024-09-12T18:03:20.871 INFO:tasks.workunit.client.0.smithi052.stdout:7/195: readlink d6/d12/d1e/d29/d32/l3e 0 2024-09-12T18:03:20.871 INFO:tasks.workunit.client.0.smithi052.stdout:9/235: dwrite d0/d6/fd [4194304,4194304] 0 2024-09-12T18:03:20.871 INFO:tasks.workunit.client.0.smithi052.stdout:3/223: unlink d0/d4/d25/d2a/d17/c10 0 2024-09-12T18:03:20.871 INFO:tasks.workunit.client.0.smithi052.stdout:8/273: creat d13/d18/d21/f54 x:0 0 0 2024-09-12T18:03:20.872 INFO:tasks.workunit.client.0.smithi052.stdout:8/274: stat d13/d35/f53 0 2024-09-12T18:03:20.873 INFO:tasks.workunit.client.0.smithi052.stdout:8/275: truncate d13/d18/f49 795072 0 2024-09-12T18:03:20.873 INFO:tasks.workunit.client.0.smithi052.stdout:5/241: fsync d7/f21 0 2024-09-12T18:03:20.874 INFO:tasks.workunit.client.0.smithi052.stdout:7/196: creat d6/d12/d1e/d29/f45 x:0 0 0 2024-09-12T18:03:20.874 INFO:tasks.workunit.client.0.smithi052.stdout:4/276: creat d11/d17/d23/d2f/d47/f5e x:0 0 0 2024-09-12T18:03:20.875 INFO:tasks.workunit.client.0.smithi052.stdout:1/228: creat d3/d10/d38/d44/d49/f52 x:0 0 0 2024-09-12T18:03:20.876 INFO:tasks.workunit.client.0.smithi052.stdout:7/197: stat d6/dc/f2e 0 2024-09-12T18:03:20.876 INFO:tasks.workunit.client.0.smithi052.stdout:5/242: mkdir d7/d1f/d45 0 2024-09-12T18:03:20.877 INFO:tasks.workunit.client.0.smithi052.stdout:6/340: link d2/l71 d2/d21/d76/l77 0 2024-09-12T18:03:20.877 INFO:tasks.workunit.client.0.smithi052.stdout:1/229: creat d3/d10/f53 x:0 0 0 2024-09-12T18:03:20.878 INFO:tasks.workunit.client.0.smithi052.stdout:0/237: truncate d2/d6/f23 106563 0 2024-09-12T18:03:20.878 INFO:tasks.workunit.client.0.smithi052.stdout:3/224: dread d0/d16/f1e [0,4194304] 0 2024-09-12T18:03:20.879 INFO:tasks.workunit.client.0.smithi052.stdout:9/236: dread d0/f1d [0,4194304] 0 2024-09-12T18:03:20.879 INFO:tasks.workunit.client.0.smithi052.stdout:1/230: symlink d3/l54 0 2024-09-12T18:03:20.879 INFO:tasks.workunit.client.0.smithi052.stdout:5/243: dread f4 [0,4194304] 0 2024-09-12T18:03:20.880 INFO:tasks.workunit.client.0.smithi052.stdout:7/198: mknod d6/d12/c46 0 2024-09-12T18:03:20.880 INFO:tasks.workunit.client.0.smithi052.stdout:6/341: chown d2/d1e/d5b/f31 2622 1 2024-09-12T18:03:20.880 INFO:tasks.workunit.client.0.smithi052.stdout:9/237: unlink d0/f1b 0 2024-09-12T18:03:20.881 INFO:tasks.workunit.client.0.smithi052.stdout:6/342: chown d2 2 1 2024-09-12T18:03:20.881 INFO:tasks.workunit.client.0.smithi052.stdout:2/213: dwrite f3 [0,4194304] 0 2024-09-12T18:03:20.882 INFO:tasks.workunit.client.0.smithi052.stdout:4/277: write d11/f16 [807757,29003] 0 2024-09-12T18:03:20.882 INFO:tasks.workunit.client.0.smithi052.stdout:5/244: write f4 [556161,29178] 0 2024-09-12T18:03:20.882 INFO:tasks.workunit.client.0.smithi052.stdout:7/199: write d6/d26/f28 [2903722,80653] 0 2024-09-12T18:03:20.884 INFO:tasks.workunit.client.0.smithi052.stdout:7/200: write d6/dc/f34 [667583,37038] 0 2024-09-12T18:03:20.884 INFO:tasks.workunit.client.0.smithi052.stdout:3/225: truncate d0/d4/d25/d2a/d17/f46 595573 0 2024-09-12T18:03:20.884 INFO:tasks.workunit.client.0.smithi052.stdout:8/276: dwrite d13/d35/f53 [0,4194304] 0 2024-09-12T18:03:20.885 INFO:tasks.workunit.client.0.smithi052.stdout:0/238: creat d2/d6/dd/d21/d26/d2f/f4b x:0 0 0 2024-09-12T18:03:20.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/238: mkdir d0/d58 0 2024-09-12T18:03:20.885 INFO:tasks.workunit.client.0.smithi052.stdout:7/201: readlink d6/d12/d1e/d29/d32/l3e 0 2024-09-12T18:03:20.885 INFO:tasks.workunit.client.0.smithi052.stdout:2/214: fsync da/dc/d15/d20/fe 0 2024-09-12T18:03:20.887 INFO:tasks.workunit.client.0.smithi052.stdout:0/239: chown d2/d6/dd/d21/d41/d44 1745 1 2024-09-12T18:03:20.887 INFO:tasks.workunit.client.0.smithi052.stdout:5/245: creat d7/d1c/d1e/f46 x:0 0 0 2024-09-12T18:03:20.887 INFO:tasks.workunit.client.0.smithi052.stdout:8/277: rename d13/d18/d38/f44 to d13/d18/d38/f55 0 2024-09-12T18:03:20.887 INFO:tasks.workunit.client.0.smithi052.stdout:3/226: mkdir d0/d4/d25/d2a/d17/d3f/d48 0 2024-09-12T18:03:20.889 INFO:tasks.workunit.client.0.smithi052.stdout:1/231: read d3/f8 [7227168,62315] 0 2024-09-12T18:03:20.889 INFO:tasks.workunit.client.0.smithi052.stdout:9/239: symlink d0/d18/d26/d4d/d54/l59 0 2024-09-12T18:03:20.889 INFO:tasks.workunit.client.0.smithi052.stdout:7/202: creat d6/d12/f47 x:0 0 0 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11379 4.b 4:d2f5b389:::100000030e7.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:20.874546+0000", 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.015247857, 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015274243999999999, 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:20.890 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11379 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.874546+0000", 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.874546+0000", 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.874547+0000", 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5799999999999999e-07 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:20.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.879760+0000", 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052125449999999999 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.879778+0000", 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8671000000000001e-05 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.879788+0000", 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6989999999999998e-06 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.879860+0000", 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1773999999999994e-05 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.879945+0000", 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5321000000000005e-05 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.880065+0000", 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000119838 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.888391+0000", 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0083256779999999996 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.895 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11384 4.16 4:6bf201c8:::100000032d7.00000000:head [write 667583~37038 in=37038b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:20.885503+0000", 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0042911709999999999, 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0043922630000000004, 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11384 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:20.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885503+0000", 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885503+0000", 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885504+0000", 2024-09-12T18:03:20.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5300000000000004e-07 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885547+0000", 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3748000000000002e-05 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885557+0000", 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.3649999999999993e-06 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885563+0000", 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5370000000000003e-06 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885637+0000", 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3993999999999997e-05 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885770+0000", 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013272100000000001 2024-09-12T18:03:20.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.885886+0000", 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011555700000000001 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.888697+0000", 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002811881 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:20.900 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:20.901 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-12T18:03:20.901 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 2 2024-09-12T18:03:20.901 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:20.903 INFO:tasks.workunit.client.0.smithi052.stdout:8/278: symlink d13/d18/d21/l56 0 2024-09-12T18:03:20.903 INFO:tasks.workunit.client.0.smithi052.stdout:6/343: dwrite d2/fb [0,4194304] 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:3/227: mknod d0/c49 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:9/240: write d0/d18/f40 [328699,108603] 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:1/232: chown d3/d1d/d22/d3f/l4b 336590 1 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:7/203: read d6/d12/d1e/d29/d32/f42 [360483,74065] 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:3/228: mknod d0/d4/d33/c4a 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:2/215: write f8 [1718309,25622] 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:5/246: write d7/fc [3722723,98445] 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:9/241: dread d0/f8 [0,4194304] 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:1/233: fdatasync d3/f25 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:0/240: getdents d2/d6 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:7/204: rmdir d6/d12/d1e/d29/d32/d35 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:0/241: read d2/f31 [2384188,56982] 0 2024-09-12T18:03:20.904 INFO:tasks.workunit.client.0.smithi052.stdout:3/229: write d0/d4/f19 [1909559,93655] 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:9/242: readlink d0/d23/l30 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:6/344: dwrite d2/d1e/d5b/d26/f2d [0,4194304] 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:3/230: fdatasync d0/d4/f47 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:4/278: dwrite d11/f1f [0,4194304] 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:8/279: dread d13/d18/d21/f37 [0,4194304] 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:7/205: dread d6/dc/f2f [0,4194304] 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:6/345: creat d2/d21/d6a/f78 x:0 0 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:8/280: write fb [4329263,113873] 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:9/243: mknod d0/d6/d3a/d42/c5a 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:4/279: mknod d11/d17/d1b/d42/c5f 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:7/206: mknod d6/d12/d17/c48 0 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:3/231: rmdir d0/d4/d25/d2a/d6/d7/de 39 2024-09-12T18:03:20.905 INFO:tasks.workunit.client.0.smithi052.stdout:8/281: mknod d13/d3c/c57 0 2024-09-12T18:03:20.906 INFO:tasks.workunit.client.0.smithi052.stdout:9/244: write d0/d18/f2a [810105,103645] 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:6/346: mkdir d2/d5e/d79 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:4/280: symlink d11/d17/d1b/d42/l60 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/232: mkdir d0/d4b 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:5/247: fdatasync d7/fc 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:7/207: symlink d6/d12/l49 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/233: stat d0/c40 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:4/281: creat d11/d17/d1b/d2a/f61 x:0 0 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:7/208: symlink d6/d12/d1e/d29/d32/l4a 0 2024-09-12T18:03:20.907 INFO:tasks.workunit.client.0.smithi052.stdout:5/248: readlink d7/d1f/d34/l3b 0 2024-09-12T18:03:20.908 INFO:tasks.workunit.client.0.smithi052.stdout:9/245: fsync d0/d18/f40 0 2024-09-12T18:03:20.908 INFO:tasks.workunit.client.0.smithi052.stdout:2/216: sync 2024-09-12T18:03:20.908 INFO:tasks.workunit.client.0.smithi052.stdout:0/242: dwrite d2/d6/dd/d21/d26/d38/f3f [0,4194304] 0 2024-09-12T18:03:20.908 INFO:tasks.workunit.client.0.smithi052.stdout:4/282: mknod d11/d17/d1b/d2a/d32/c62 0 2024-09-12T18:03:20.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/217: mknod da/d1d/d35/c45 0 2024-09-12T18:03:20.911 INFO:tasks.workunit.client.0.smithi052.stdout:1/234: dread d3/d1d/f2c [0,4194304] 0 2024-09-12T18:03:20.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:20.915 INFO:tasks.workunit.client.0.smithi052.stdout:3/234: dread d0/d4/f19 [0,4194304] 0 2024-09-12T18:03:20.915 INFO:tasks.workunit.client.0.smithi052.stdout:2/218: dread da/dc/f2b [0,4194304] 0 2024-09-12T18:03:20.917 INFO:tasks.workunit.client.0.smithi052.stdout:8/282: dwrite d13/d18/f3e [0,4194304] 0 2024-09-12T18:03:20.918 INFO:tasks.workunit.client.0.smithi052.stdout:6/347: dwrite d2/d3f/d5f/f68 [0,4194304] 0 2024-09-12T18:03:20.918 INFO:tasks.workunit.client.0.smithi052.stdout:2/219: creat da/dc/d15/d20/f46 x:0 0 0 2024-09-12T18:03:20.919 INFO:tasks.workunit.client.0.smithi052.stdout:3/235: rmdir d0/d4/d25/d2a/d6/d41 39 2024-09-12T18:03:20.919 INFO:tasks.workunit.client.0.smithi052.stdout:1/235: rename d3/d1d/d22/d3f/c43 to d3/d1d/d22/d27/d28/c55 0 2024-09-12T18:03:20.919 INFO:tasks.workunit.client.0.smithi052.stdout:9/246: dread d0/d1c/f22 [0,4194304] 0 2024-09-12T18:03:20.920 INFO:tasks.workunit.client.0.smithi052.stdout:2/220: chown da/f17 1929822 1 2024-09-12T18:03:20.920 INFO:tasks.workunit.client.0.smithi052.stdout:5/249: dwrite d7/f13 [0,4194304] 0 2024-09-12T18:03:20.921 INFO:tasks.workunit.client.0.smithi052.stdout:8/283: fdatasync d13/d18/d21/f33 0 2024-09-12T18:03:20.922 INFO:tasks.workunit.client.0.smithi052.stdout:2/221: dread da/d1d/d35/f31 [0,4194304] 0 2024-09-12T18:03:20.922 INFO:tasks.workunit.client.0.smithi052.stdout:4/283: dwrite d11/d17/d23/d2f/f39 [4194304,4194304] 0 2024-09-12T18:03:20.923 INFO:tasks.workunit.client.0.smithi052.stdout:2/222: write da/dc/d15/d20/f24 [1014699,79305] 0 2024-09-12T18:03:20.924 INFO:tasks.workunit.client.0.smithi052.stdout:5/250: creat d7/d1f/f47 x:0 0 0 2024-09-12T18:03:20.925 INFO:tasks.workunit.client.0.smithi052.stdout:3/236: rename d0/d4/d25/d2a/d17 to d0/d4b/d4c 0 2024-09-12T18:03:20.925 INFO:tasks.workunit.client.0.smithi052.stdout:4/284: stat d11/d17/d1b/f20 0 2024-09-12T18:03:20.925 INFO:tasks.workunit.client.0.smithi052.stdout:8/284: mknod d13/d18/d38/c58 0 2024-09-12T18:03:20.926 INFO:tasks.workunit.client.0.smithi052.stdout:0/243: write d2/d8/f20 [584590,41190] 0 2024-09-12T18:03:20.926 INFO:tasks.workunit.client.0.smithi052.stdout:7/209: write d6/dc/f25 [343691,109206] 0 2024-09-12T18:03:20.926 INFO:tasks.workunit.client.0.smithi052.stdout:2/223: symlink da/dc/d15/d22/l47 0 2024-09-12T18:03:20.926 INFO:tasks.workunit.client.0.smithi052.stdout:6/348: getdents d2/d3f/d58/d5d 0 2024-09-12T18:03:20.926 INFO:tasks.workunit.client.0.smithi052.stdout:8/285: unlink ce 0 2024-09-12T18:03:20.926 INFO:tasks.workunit.client.0.smithi052.stdout:5/251: creat d7/d1f/d34/f48 x:0 0 0 2024-09-12T18:03:20.927 INFO:tasks.workunit.client.0.smithi052.stdout:4/285: mkdir d11/d17/d23/d2f/d47/d63 0 2024-09-12T18:03:20.927 INFO:tasks.workunit.client.0.smithi052.stdout:7/210: readlink d6/d12/l21 0 2024-09-12T18:03:20.928 INFO:tasks.workunit.client.0.smithi052.stdout:8/286: chown d13/d18/f26 446 1 2024-09-12T18:03:20.928 INFO:tasks.workunit.client.0.smithi052.stdout:0/244: creat d2/d6/f4c x:0 0 0 2024-09-12T18:03:20.928 INFO:tasks.workunit.client.0.smithi052.stdout:6/349: chown d2/l71 67910 1 2024-09-12T18:03:20.928 INFO:tasks.workunit.client.0.smithi052.stdout:3/237: symlink d0/d4/d25/d2a/d6/d7/d34/l4d 0 2024-09-12T18:03:20.928 INFO:tasks.workunit.client.0.smithi052.stdout:2/224: symlink da/dc/d15/d22/l48 0 2024-09-12T18:03:20.928 INFO:tasks.workunit.client.0.smithi052.stdout:5/252: write d7/d1f/f29 [2896767,1033] 0 2024-09-12T18:03:20.929 INFO:tasks.workunit.client.0.smithi052.stdout:8/287: chown d13/l15 7417 1 2024-09-12T18:03:20.933 INFO:tasks.workunit.client.0.smithi052.stdout:4/286: fsync d11/d17/f18 0 2024-09-12T18:03:20.933 INFO:tasks.workunit.client.0.smithi052.stdout:6/350: creat d2/d49/f7a x:0 0 0 2024-09-12T18:03:20.933 INFO:tasks.workunit.client.0.smithi052.stdout:2/225: mknod da/dc/d15/d20/c49 0 2024-09-12T18:03:20.933 INFO:tasks.workunit.client.0.smithi052.stdout:7/211: rmdir d6/d12/d1e/d29/d32/d3a 39 2024-09-12T18:03:20.933 INFO:tasks.workunit.client.0.smithi052.stdout:2/226: sync 2024-09-12T18:03:20.933 INFO:tasks.workunit.client.0.smithi052.stdout:8/288: creat d13/d18/d21/f59 x:0 0 0 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:4/287: read - d11/d17/d1b/f5a zero size 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:6/351: dread - d2/d21/d6a/f78 zero size 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:5/253: chown d7/d1c/d1e/l2e 5146 1 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:2/227: chown da/l23 126152393 1 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:7/212: mknod d6/d12/d1e/c4b 0 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:9/247: dwrite d0/d1c/f20 [0,4194304] 0 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:5/254: rmdir d7/d1f 39 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:8/289: unlink d13/d35/c3b 0 2024-09-12T18:03:20.934 INFO:tasks.workunit.client.0.smithi052.stdout:3/238: dread d0/d4/d33/f35 [0,4194304] 0 2024-09-12T18:03:20.935 INFO:tasks.workunit.client.0.smithi052.stdout:9/248: write d0/d1c/f32 [999917,32349] 0 2024-09-12T18:03:20.935 INFO:tasks.workunit.client.0.smithi052.stdout:1/236: write d3/d1d/d22/f30 [1585718,29367] 0 2024-09-12T18:03:20.935 INFO:tasks.workunit.client.0.smithi052.stdout:5/255: mkdir d7/d1f/d3a/d49 0 2024-09-12T18:03:20.935 INFO:tasks.workunit.client.0.smithi052.stdout:3/239: mknod d0/d4b/c4e 0 2024-09-12T18:03:20.936 INFO:tasks.workunit.client.0.smithi052.stdout:8/290: chown d13/d18/d21/f33 64511100 1 2024-09-12T18:03:20.938 INFO:tasks.workunit.client.0.smithi052.stdout:9/249: creat d0/d18/d26/d4d/d54/f5b x:0 0 0 2024-09-12T18:03:20.938 INFO:tasks.workunit.client.0.smithi052.stdout:8/291: chown d13/d18/f26 73284 1 2024-09-12T18:03:20.939 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:20.935+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:20.940 INFO:tasks.workunit.client.0.smithi052.stdout:3/240: creat d0/d4/d25/d2a/d6/d7/de/f4f x:0 0 0 2024-09-12T18:03:20.940 INFO:tasks.workunit.client.0.smithi052.stdout:9/250: write d0/d1c/f22 [3649478,73855] 0 2024-09-12T18:03:20.940 INFO:tasks.workunit.client.0.smithi052.stdout:2/228: fdatasync da/dc/d15/f42 0 2024-09-12T18:03:20.941 INFO:tasks.workunit.client.0.smithi052.stdout:9/251: fdatasync d0/f8 0 2024-09-12T18:03:20.941 INFO:tasks.workunit.client.0.smithi052.stdout:4/288: dread d11/d17/d23/d2f/d47/f4a [0,4194304] 0 2024-09-12T18:03:20.942 INFO:tasks.workunit.client.0.smithi052.stdout:9/252: creat d0/d6/d3a/f5c x:0 0 0 2024-09-12T18:03:20.943 INFO:tasks.workunit.client.0.smithi052.stdout:5/256: dwrite d7/d1c/d1e/f46 [0,4194304] 0 2024-09-12T18:03:20.943 INFO:tasks.workunit.client.0.smithi052.stdout:4/289: rmdir d11/d17/d23/d2f/d47 39 2024-09-12T18:03:20.945 INFO:tasks.workunit.client.0.smithi052.stdout:9/253: creat d0/d6/d3a/f5d x:0 0 0 2024-09-12T18:03:20.945 INFO:tasks.workunit.client.0.smithi052.stdout:1/237: dread d3/f35 [0,4194304] 0 2024-09-12T18:03:20.946 INFO:tasks.workunit.client.0.smithi052.stdout:4/290: mknod d11/d17/d23/d2f/c64 0 2024-09-12T18:03:20.947 INFO:tasks.workunit.client.0.smithi052.stdout:5/257: symlink d7/d1f/d45/l4a 0 2024-09-12T18:03:20.948 INFO:tasks.workunit.client.0.smithi052.stdout:8/292: dwrite d13/d18/d21/f37 [4194304,4194304] 0 2024-09-12T18:03:20.950 INFO:tasks.workunit.client.0.smithi052.stdout:5/258: creat d7/d1f/f4b x:0 0 0 2024-09-12T18:03:20.950 INFO:tasks.workunit.client.0.smithi052.stdout:5/259: sync 2024-09-12T18:03:20.950 INFO:tasks.workunit.client.0.smithi052.stdout:8/293: fdatasync d13/f30 0 2024-09-12T18:03:20.951 INFO:tasks.workunit.client.0.smithi052.stdout:6/352: dread d2/ff [0,4194304] 0 2024-09-12T18:03:20.952 INFO:tasks.workunit.client.0.smithi052.stdout:1/238: dread d3/d1d/f2c [0,4194304] 0 2024-09-12T18:03:20.953 INFO:tasks.workunit.client.0.smithi052.stdout:2/229: dwrite da/d1d/d35/f31 [0,4194304] 0 2024-09-12T18:03:20.953 INFO:tasks.workunit.client.0.smithi052.stdout:8/294: creat d13/d3c/f5a x:0 0 0 2024-09-12T18:03:20.953 INFO:tasks.workunit.client.0.smithi052.stdout:5/260: symlink d7/d1f/d34/l4c 0 2024-09-12T18:03:20.954 INFO:tasks.workunit.client.0.smithi052.stdout:6/353: symlink d2/d21/d76/l7b 0 2024-09-12T18:03:20.955 INFO:tasks.workunit.client.0.smithi052.stdout:5/261: stat d7/d1f/f2a 0 2024-09-12T18:03:20.956 INFO:tasks.workunit.client.0.smithi052.stdout:9/254: dwrite d0/f10 [0,4194304] 0 2024-09-12T18:03:20.956 INFO:tasks.workunit.client.0.smithi052.stdout:4/291: dread d11/d17/f34 [0,4194304] 0 2024-09-12T18:03:20.958 INFO:tasks.workunit.client.0.smithi052.stdout:9/255: stat d0 0 2024-09-12T18:03:20.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/241: truncate d0/d4/d25/d2a/d6/f15 1221664 0 2024-09-12T18:03:20.958 INFO:tasks.workunit.client.0.smithi052.stdout:9/256: chown d0 2225046 1 2024-09-12T18:03:20.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/242: sync 2024-09-12T18:03:20.959 INFO:tasks.workunit.client.0.smithi052.stdout:8/295: mkdir d13/d18/d5b 0 2024-09-12T18:03:20.959 INFO:tasks.workunit.client.0.smithi052.stdout:2/230: rename da/dc/d15/d20/f24 to da/d21/f4a 0 2024-09-12T18:03:20.959 INFO:tasks.workunit.client.0.smithi052.stdout:6/354: creat d2/d1e/d5b/d26/f7c x:0 0 0 2024-09-12T18:03:20.959 INFO:tasks.workunit.client.0.smithi052.stdout:7/213: dread d6/dc/fe [0,4194304] 0 2024-09-12T18:03:20.960 INFO:tasks.workunit.client.0.smithi052.stdout:5/262: mknod d7/d1f/d45/c4d 0 2024-09-12T18:03:20.960 INFO:tasks.workunit.client.0.smithi052.stdout:8/296: mknod d13/d35/c5c 0 2024-09-12T18:03:20.961 INFO:tasks.workunit.client.0.smithi052.stdout:2/231: unlink da/dc/d15/d22/l34 0 2024-09-12T18:03:20.962 INFO:tasks.workunit.client.0.smithi052.stdout:7/214: symlink d6/dc/l4c 0 2024-09-12T18:03:20.962 INFO:tasks.workunit.client.0.smithi052.stdout:9/257: write d0/d18/d26/f46 [597315,8605] 0 2024-09-12T18:03:20.963 INFO:tasks.workunit.client.0.smithi052.stdout:5/263: mknod d7/c4e 0 2024-09-12T18:03:20.963 INFO:tasks.workunit.client.0.smithi052.stdout:3/243: write d0/d4/d25/d2a/d6/d7/f2b [2909135,87572] 0 2024-09-12T18:03:20.963 INFO:tasks.workunit.client.0.smithi052.stdout:4/292: rename d11/d17/d23/d2f/d47/d63 to d11/d65 0 2024-09-12T18:03:20.963 INFO:tasks.workunit.client.0.smithi052.stdout:1/239: dwrite d3/d10/f26 [0,4194304] 0 2024-09-12T18:03:20.964 INFO:tasks.workunit.client.0.smithi052.stdout:2/232: mknod da/d1d/d35/c4b 0 2024-09-12T18:03:20.965 INFO:tasks.workunit.client.0.smithi052.stdout:9/258: chown d0/d18/c50 30585 1 2024-09-12T18:03:20.965 INFO:tasks.workunit.client.0.smithi052.stdout:2/233: chown da/dc/d15/d22/l30 3710 1 2024-09-12T18:03:20.965 INFO:tasks.workunit.client.0.smithi052.stdout:1/240: dread - d3/d1d/d22/d3f/f45 zero size 2024-09-12T18:03:20.965 INFO:tasks.workunit.client.0.smithi052.stdout:1/241: sync 2024-09-12T18:03:20.966 INFO:tasks.workunit.client.0.smithi052.stdout:9/259: fsync d0/d1c/f51 0 2024-09-12T18:03:20.967 INFO:tasks.workunit.client.0.smithi052.stdout:7/215: creat d6/d26/f4d x:0 0 0 2024-09-12T18:03:20.968 INFO:tasks.workunit.client.0.smithi052.stdout:8/297: dread fb [0,4194304] 0 2024-09-12T18:03:20.968 INFO:tasks.workunit.client.0.smithi052.stdout:2/234: symlink da/dc/d15/d22/l4c 0 2024-09-12T18:03:20.969 INFO:tasks.workunit.client.0.smithi052.stdout:6/355: dwrite d2/f43 [0,4194304] 0 2024-09-12T18:03:20.970 INFO:tasks.workunit.client.0.smithi052.stdout:4/293: symlink d11/d17/d23/d2f/l66 0 2024-09-12T18:03:20.970 INFO:tasks.workunit.client.0.smithi052.stdout:7/216: readlink d6/d12/d1e/l2a 0 2024-09-12T18:03:20.970 INFO:tasks.workunit.client.0.smithi052.stdout:9/260: rmdir d0/d6/d3a/d43 39 2024-09-12T18:03:20.970 INFO:tasks.workunit.client.0.smithi052.stdout:1/242: unlink d3/l9 0 2024-09-12T18:03:20.970 INFO:tasks.workunit.client.0.smithi052.stdout:9/261: stat d0/l4 0 2024-09-12T18:03:20.971 INFO:tasks.workunit.client.0.smithi052.stdout:0/245: dread d2/d6/f10 [0,4194304] 0 2024-09-12T18:03:20.971 INFO:tasks.workunit.client.0.smithi052.stdout:9/262: chown d0/d18/f2a 20938307 1 2024-09-12T18:03:20.972 INFO:tasks.workunit.client.0.smithi052.stdout:3/244: creat d0/d4/f50 x:0 0 0 2024-09-12T18:03:20.972 INFO:tasks.workunit.client.0.smithi052.stdout:2/235: mknod da/dc/c4d 0 2024-09-12T18:03:20.972 INFO:tasks.workunit.client.0.smithi052.stdout:6/356: creat d2/d3f/d58/d5d/f7d x:0 0 0 2024-09-12T18:03:20.972 INFO:tasks.workunit.client.0.smithi052.stdout:4/294: mkdir d11/d17/d23/d2f/d47/d67 0 2024-09-12T18:03:20.973 INFO:tasks.workunit.client.0.smithi052.stdout:5/264: dwrite d7/d1c/d1e/f44 [0,4194304] 0 2024-09-12T18:03:20.973 INFO:tasks.workunit.client.0.smithi052.stdout:7/217: unlink d6/c10 0 2024-09-12T18:03:20.973 INFO:tasks.workunit.client.0.smithi052.stdout:2/236: unlink da/c38 0 2024-09-12T18:03:20.973 INFO:tasks.workunit.client.0.smithi052.stdout:5/265: chown d7/d1f/d45 19824 1 2024-09-12T18:03:20.974 INFO:tasks.workunit.client.0.smithi052.stdout:9/263: symlink d0/d6/d3a/l5e 0 2024-09-12T18:03:20.975 INFO:tasks.workunit.client.0.smithi052.stdout:3/245: unlink d0/d4b/d4c/c44 0 2024-09-12T18:03:20.976 INFO:tasks.workunit.client.0.smithi052.stdout:7/218: symlink d6/dc/l4e 0 2024-09-12T18:03:20.976 INFO:tasks.workunit.client.0.smithi052.stdout:6/357: symlink d2/d3f/d58/l7e 0 2024-09-12T18:03:20.976 INFO:tasks.workunit.client.0.smithi052.stdout:5/266: creat d7/d1f/d3a/f4f x:0 0 0 2024-09-12T18:03:20.976 INFO:tasks.workunit.client.0.smithi052.stdout:9/264: rmdir d0/d18 39 2024-09-12T18:03:20.977 INFO:tasks.workunit.client.0.smithi052.stdout:4/295: mkdir d11/d17/d23/d2f/d47/d67/d68 0 2024-09-12T18:03:20.977 INFO:tasks.workunit.client.0.smithi052.stdout:8/298: fsync d13/d18/f49 0 2024-09-12T18:03:20.978 INFO:tasks.workunit.client.0.smithi052.stdout:2/237: creat da/dc/d15/d43/f4e x:0 0 0 2024-09-12T18:03:20.978 INFO:tasks.workunit.client.0.smithi052.stdout:0/246: creat d2/d6/dd/d21/d41/d44/d48/f4d x:0 0 0 2024-09-12T18:03:20.978 INFO:tasks.workunit.client.0.smithi052.stdout:7/219: mkdir d6/dc/d4f 0 2024-09-12T18:03:20.978 INFO:tasks.workunit.client.0.smithi052.stdout:2/238: chown da/dc/d15 33 1 2024-09-12T18:03:20.978 INFO:tasks.workunit.client.0.smithi052.stdout:9/265: readlink d0/d23/l2e 0 2024-09-12T18:03:20.979 INFO:tasks.workunit.client.0.smithi052.stdout:6/358: creat d2/d21/d76/f7f x:0 0 0 2024-09-12T18:03:20.979 INFO:tasks.workunit.client.0.smithi052.stdout:5/267: write d7/d1c/d1e/f46 [4511838,72920] 0 2024-09-12T18:03:20.980 INFO:tasks.workunit.client.0.smithi052.stdout:1/243: dwrite d3/f20 [4194304,4194304] 0 2024-09-12T18:03:20.982 INFO:tasks.workunit.client.0.smithi052.stdout:5/268: creat d7/d1f/d45/f50 x:0 0 0 2024-09-12T18:03:20.982 INFO:tasks.workunit.client.0.smithi052.stdout:2/239: creat da/dc/d15/d20/f4f x:0 0 0 2024-09-12T18:03:20.983 INFO:tasks.workunit.client.0.smithi052.stdout:3/246: dwrite d0/d4/f47 [0,4194304] 0 2024-09-12T18:03:20.983 INFO:tasks.workunit.client.0.smithi052.stdout:6/359: rename d2/d1e to d2/d80 0 2024-09-12T18:03:20.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/299: getdents d13 0 2024-09-12T18:03:20.985 INFO:tasks.workunit.client.0.smithi052.stdout:2/240: readlink da/dc/d15/d22/l47 0 2024-09-12T18:03:20.985 INFO:tasks.workunit.client.0.smithi052.stdout:3/247: write d0/d16/f1e [3099854,71086] 0 2024-09-12T18:03:20.985 INFO:tasks.workunit.client.0.smithi052.stdout:4/296: dwrite f8 [0,4194304] 0 2024-09-12T18:03:20.986 INFO:tasks.workunit.client.0.smithi052.stdout:6/360: write d2/fb [4805626,56145] 0 2024-09-12T18:03:20.986 INFO:tasks.workunit.client.0.smithi052.stdout:3/248: dread - d0/d4/f3d zero size 2024-09-12T18:03:20.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/300: rmdir d13/d3c 39 2024-09-12T18:03:20.987 INFO:tasks.workunit.client.0.smithi052.stdout:2/241: symlink da/d1d/d35/l50 0 2024-09-12T18:03:20.987 INFO:tasks.workunit.client.0.smithi052.stdout:6/361: write d2/d3f/d54/f62 [542931,90571] 0 2024-09-12T18:03:20.987 INFO:tasks.workunit.client.0.smithi052.stdout:4/297: mknod d11/d17/d23/d2f/d3b/c69 0 2024-09-12T18:03:20.988 INFO:tasks.workunit.client.0.smithi052.stdout:2/242: creat da/d2c/f51 x:0 0 0 2024-09-12T18:03:20.988 INFO:tasks.workunit.client.0.smithi052.stdout:6/362: dread - d2/d80/d5b/d26/f7c zero size 2024-09-12T18:03:20.989 INFO:tasks.workunit.client.0.smithi052.stdout:4/298: write f10 [419779,104942] 0 2024-09-12T18:03:20.989 INFO:tasks.workunit.client.0.smithi052.stdout:2/243: creat da/d2c/f52 x:0 0 0 2024-09-12T18:03:20.989 INFO:tasks.workunit.client.0.smithi052.stdout:8/301: truncate d13/f17 2775978 0 2024-09-12T18:03:20.990 INFO:tasks.workunit.client.0.smithi052.stdout:9/266: dread d0/d6/d4a/f53 [0,4194304] 0 2024-09-12T18:03:20.990 INFO:tasks.workunit.client.0.smithi052.stdout:4/299: chown d11/d17/d23/d2f/d47/f4d 11237449 1 2024-09-12T18:03:20.990 INFO:tasks.workunit.client.0.smithi052.stdout:2/244: truncate da/dc/f37 4833119 0 2024-09-12T18:03:20.991 INFO:tasks.workunit.client.0.smithi052.stdout:9/267: creat d0/d6/d4a/f5f x:0 0 0 2024-09-12T18:03:20.991 INFO:tasks.workunit.client.0.smithi052.stdout:4/300: readlink d11/d17/d1b/d42/l60 0 2024-09-12T18:03:20.991 INFO:tasks.workunit.client.0.smithi052.stdout:2/245: read f3 [2494406,121010] 0 2024-09-12T18:03:20.992 INFO:tasks.workunit.client.0.smithi052.stdout:4/301: mkdir d11/d17/d1b/d2a/d6a 0 2024-09-12T18:03:20.992 INFO:tasks.workunit.client.0.smithi052.stdout:2/246: getdents da/d1d 0 2024-09-12T18:03:20.992 INFO:tasks.workunit.client.0.smithi052.stdout:4/302: symlink d11/d65/l6b 0 2024-09-12T18:03:20.993 INFO:tasks.workunit.client.0.smithi052.stdout:2/247: symlink da/dc/d15/d43/l53 0 2024-09-12T18:03:20.993 INFO:tasks.workunit.client.0.smithi052.stdout:8/302: link d13/d18/d38/f46 d13/d18/d21/f5d 0 2024-09-12T18:03:20.994 INFO:tasks.workunit.client.0.smithi052.stdout:2/248: write f0 [4985590,83388] 0 2024-09-12T18:03:20.994 INFO:tasks.workunit.client.0.smithi052.stdout:8/303: symlink d13/l5e 0 2024-09-12T18:03:20.995 INFO:tasks.workunit.client.0.smithi052.stdout:2/249: readlink da/dc/d15/d22/l48 0 2024-09-12T18:03:20.995 INFO:tasks.workunit.client.0.smithi052.stdout:8/304: creat d13/d18/d38/f5f x:0 0 0 2024-09-12T18:03:20.996 INFO:tasks.workunit.client.0.smithi052.stdout:2/250: creat da/dc/d15/d22/f54 x:0 0 0 2024-09-12T18:03:20.996 INFO:tasks.workunit.client.0.smithi052.stdout:7/220: truncate d6/f2d 809922 0 2024-09-12T18:03:20.997 INFO:tasks.workunit.client.0.smithi052.stdout:2/251: symlink da/dc/d15/l55 0 2024-09-12T18:03:20.997 INFO:tasks.workunit.client.0.smithi052.stdout:7/221: write d6/d12/f15 [593445,34730] 0 2024-09-12T18:03:20.997 INFO:tasks.workunit.client.0.smithi052.stdout:9/268: dwrite d0/d23/f2f [0,4194304] 0 2024-09-12T18:03:20.998 INFO:tasks.workunit.client.0.smithi052.stdout:7/222: stat d6/d12/d17/c48 0 2024-09-12T18:03:20.999 INFO:tasks.workunit.client.0.smithi052.stdout:0/247: truncate d2/d6/dd/f39 232082 0 2024-09-12T18:03:20.999 INFO:tasks.workunit.client.0.smithi052.stdout:5/269: truncate d7/d1f/f2a 1171068 0 2024-09-12T18:03:21.000 INFO:tasks.workunit.client.0.smithi052.stdout:5/270: sync 2024-09-12T18:03:21.000 INFO:tasks.workunit.client.0.smithi052.stdout:4/303: getdents d11/d17/d23/d2f/d3b 0 2024-09-12T18:03:21.000 INFO:tasks.workunit.client.0.smithi052.stdout:1/244: write d3/d1d/d22/d27/f4f [2128464,11122] 0 2024-09-12T18:03:21.000 INFO:tasks.workunit.client.0.smithi052.stdout:9/269: symlink d0/d6/d4a/l60 0 2024-09-12T18:03:21.001 INFO:tasks.workunit.client.0.smithi052.stdout:6/363: write d2/d3f/d54/f69 [574658,120296] 0 2024-09-12T18:03:21.001 INFO:tasks.workunit.client.0.smithi052.stdout:7/223: creat d6/dc/f50 x:0 0 0 2024-09-12T18:03:21.001 INFO:tasks.workunit.client.0.smithi052.stdout:4/304: mkdir d11/d65/d6c 0 2024-09-12T18:03:21.003 INFO:tasks.workunit.client.0.smithi052.stdout:9/270: chown d0/d6/c19 32648655 1 2024-09-12T18:03:21.003 INFO:tasks.workunit.client.0.smithi052.stdout:6/364: truncate d2/ff 1909860 0 2024-09-12T18:03:21.003 INFO:tasks.workunit.client.0.smithi052.stdout:0/248: truncate d2/d6/dd/d21/d41/d44/d48/f4d 785448 0 2024-09-12T18:03:21.004 INFO:tasks.workunit.client.0.smithi052.stdout:1/245: mkdir d3/d1d/d22/d3f/d56 0 2024-09-12T18:03:21.004 INFO:tasks.workunit.client.0.smithi052.stdout:6/365: mknod d2/d49/c81 0 2024-09-12T18:03:21.005 INFO:tasks.workunit.client.0.smithi052.stdout:9/271: mkdir d0/d6/d3a/d42/d61 0 2024-09-12T18:03:21.005 INFO:tasks.workunit.client.0.smithi052.stdout:4/305: creat d11/d46/d51/f6d x:0 0 0 2024-09-12T18:03:21.005 INFO:tasks.workunit.client.0.smithi052.stdout:7/224: truncate d6/dc/f2e 714486 0 2024-09-12T18:03:21.006 INFO:tasks.workunit.client.0.smithi052.stdout:2/252: link da/dc/d15/d22/l47 da/d1d/d35/l56 0 2024-09-12T18:03:21.006 INFO:tasks.workunit.client.0.smithi052.stdout:3/249: dwrite d0/d4/d25/d2a/d6/d7/de/f26 [0,4194304] 0 2024-09-12T18:03:21.007 INFO:tasks.workunit.client.0.smithi052.stdout:8/305: dwrite d13/d18/f3e [4194304,4194304] 0 2024-09-12T18:03:21.009 INFO:tasks.workunit.client.0.smithi052.stdout:5/271: dwrite d7/d1c/d1e/f46 [0,4194304] 0 2024-09-12T18:03:21.010 INFO:tasks.workunit.client.0.smithi052.stdout:0/249: creat d2/d6/dd/d21/d41/d44/f4e x:0 0 0 2024-09-12T18:03:21.010 INFO:tasks.workunit.client.0.smithi052.stdout:7/225: write d6/d12/f47 [260807,21429] 0 2024-09-12T18:03:21.011 INFO:tasks.workunit.client.0.smithi052.stdout:3/250: rename d0/f12 to d0/d4b/d4c/d3f/d48/f51 0 2024-09-12T18:03:21.011 INFO:tasks.workunit.client.0.smithi052.stdout:8/306: mknod d13/d35/c60 0 2024-09-12T18:03:21.011 INFO:tasks.workunit.client.0.smithi052.stdout:4/306: creat d11/d65/d6c/f6e x:0 0 0 2024-09-12T18:03:21.012 INFO:tasks.workunit.client.0.smithi052.stdout:1/246: getdents d3/d1d/d22 0 2024-09-12T18:03:21.013 INFO:tasks.workunit.client.0.smithi052.stdout:7/226: mknod d6/dc/c51 0 2024-09-12T18:03:21.014 INFO:tasks.workunit.client.0.smithi052.stdout:6/366: rmdir d2/d5e/d79 0 2024-09-12T18:03:21.017 INFO:tasks.workunit.client.0.smithi052.stdout:6/367: stat d2/d15/d1a/c59 0 2024-09-12T18:03:21.017 INFO:tasks.workunit.client.0.smithi052.stdout:9/272: dwrite d0/d1c/f22 [0,4194304] 0 2024-09-12T18:03:21.020 INFO:tasks.workunit.client.0.smithi052.stdout:6/368: fsync d2/d21/f65 0 2024-09-12T18:03:21.022 INFO:tasks.workunit.client.0.smithi052.stdout:2/253: dwrite da/dc/f2b [4194304,4194304] 0 2024-09-12T18:03:21.027 INFO:tasks.workunit.client.0.smithi052.stdout:5/272: dwrite d7/fc [0,4194304] 0 2024-09-12T18:03:21.028 INFO:tasks.workunit.client.0.smithi052.stdout:8/307: dwrite d13/d3c/f5a [0,4194304] 0 2024-09-12T18:03:21.028 INFO:tasks.workunit.client.0.smithi052.stdout:8/308: sync 2024-09-12T18:03:21.030 INFO:tasks.workunit.client.0.smithi052.stdout:3/251: dread d0/d4/d25/d2a/d6/d7/de/f26 [0,4194304] 0 2024-09-12T18:03:21.030 INFO:tasks.workunit.client.0.smithi052.stdout:0/250: dwrite d2/d8/f43 [0,4194304] 0 2024-09-12T18:03:21.031 INFO:tasks.workunit.client.0.smithi052.stdout:2/254: symlink da/dc/d15/d36/l57 0 2024-09-12T18:03:21.032 INFO:tasks.workunit.client.0.smithi052.stdout:8/309: dread - d13/d18/d38/f55 zero size 2024-09-12T18:03:21.037 INFO:tasks.workunit.client.0.smithi052.stdout:7/227: dwrite f5 [4194304,4194304] 0 2024-09-12T18:03:21.037 INFO:tasks.workunit.client.0.smithi052.stdout:0/251: creat d2/f4f x:0 0 0 2024-09-12T18:03:21.037 INFO:tasks.workunit.client.0.smithi052.stdout:4/307: dwrite d11/d17/d23/d2f/d47/f4d [0,4194304] 0 2024-09-12T18:03:21.037 INFO:tasks.workunit.client.0.smithi052.stdout:2/255: readlink da/dc/d15/l55 0 2024-09-12T18:03:21.037 INFO:tasks.workunit.client.0.smithi052.stdout:3/252: write d0/d4/f19 [2477923,85474] 0 2024-09-12T18:03:21.039 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:21.035+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:21.040 INFO:tasks.workunit.client.0.smithi052.stdout:8/310: fdatasync d13/d18/d21/f39 0 2024-09-12T18:03:21.040 INFO:tasks.workunit.client.0.smithi052.stdout:0/252: fsync d2/f29 0 2024-09-12T18:03:21.040 INFO:tasks.workunit.client.0.smithi052.stdout:1/247: dwrite d3/fc [0,4194304] 0 2024-09-12T18:03:21.041 INFO:tasks.workunit.client.0.smithi052.stdout:7/228: creat d6/d12/d17/f52 x:0 0 0 2024-09-12T18:03:21.041 INFO:tasks.workunit.client.0.smithi052.stdout:3/253: fdatasync d0/d4/d25/f2e 0 2024-09-12T18:03:21.042 INFO:tasks.workunit.client.0.smithi052.stdout:9/273: dwrite d0/d6/d4a/f53 [0,4194304] 0 2024-09-12T18:03:21.042 INFO:tasks.workunit.client.0.smithi052.stdout:1/248: write d3/d10/f34 [2910022,48388] 0 2024-09-12T18:03:21.043 INFO:tasks.workunit.client.0.smithi052.stdout:6/369: dwrite d2/d3f/d58/d5d/f7d [0,4194304] 0 2024-09-12T18:03:21.046 INFO:tasks.workunit.client.0.smithi052.stdout:3/254: mknod d0/d16/c52 0 2024-09-12T18:03:21.047 INFO:tasks.workunit.client.0.smithi052.stdout:4/308: dread d11/d17/d23/d2f/d47/f4d [0,4194304] 0 2024-09-12T18:03:21.047 INFO:tasks.workunit.client.0.smithi052.stdout:7/229: creat d6/d12/d1e/d29/d32/d3a/f53 x:0 0 0 2024-09-12T18:03:21.048 INFO:tasks.workunit.client.0.smithi052.stdout:8/311: link d13/l24 d13/d18/d38/l61 0 2024-09-12T18:03:21.049 INFO:tasks.workunit.client.0.smithi052.stdout:6/370: symlink d2/d15/l82 0 2024-09-12T18:03:21.050 INFO:tasks.workunit.client.0.smithi052.stdout:1/249: write d3/f8 [3456692,103187] 0 2024-09-12T18:03:21.050 INFO:tasks.workunit.client.0.smithi052.stdout:3/255: readlink d0/d4/d25/d2a/d6/d7/d34/l4d 0 2024-09-12T18:03:21.050 INFO:tasks.workunit.client.0.smithi052.stdout:2/256: dwrite da/f12 [0,4194304] 0 2024-09-12T18:03:21.050 INFO:tasks.workunit.client.0.smithi052.stdout:7/230: creat d6/dc/d1a/f54 x:0 0 0 2024-09-12T18:03:21.051 INFO:tasks.workunit.client.0.smithi052.stdout:8/312: write d13/d3c/f3d [2552857,16396] 0 2024-09-12T18:03:21.051 INFO:tasks.workunit.client.0.smithi052.stdout:1/250: fsync d3/d1d/d22/d3f/f45 0 2024-09-12T18:03:21.051 INFO:tasks.workunit.client.0.smithi052.stdout:0/253: dwrite d2/d8/f20 [0,4194304] 0 2024-09-12T18:03:21.052 INFO:tasks.workunit.client.0.smithi052.stdout:6/371: symlink d2/d15/l83 0 2024-09-12T18:03:21.052 INFO:tasks.workunit.client.0.smithi052.stdout:7/231: unlink d6/f36 0 2024-09-12T18:03:21.052 INFO:tasks.workunit.client.0.smithi052.stdout:6/372: fdatasync d2/d21/d6a/f78 0 2024-09-12T18:03:21.052 INFO:tasks.workunit.client.0.smithi052.stdout:7/232: stat d6/d12/d1e/d29/d32/c2b 0 2024-09-12T18:03:21.052 INFO:tasks.workunit.client.0.smithi052.stdout:8/313: chown d13/c2e 1 1 2024-09-12T18:03:21.053 INFO:tasks.workunit.client.0.smithi052.stdout:8/314: chown d13/d18/d38 131 1 2024-09-12T18:03:21.053 INFO:tasks.workunit.client.0.smithi052.stdout:7/233: stat d6/d12/d1e/d29/d32/c31 0 2024-09-12T18:03:21.054 INFO:tasks.workunit.client.0.smithi052.stdout:8/315: fdatasync d13/d18/d38/f5f 0 2024-09-12T18:03:21.055 INFO:tasks.workunit.client.0.smithi052.stdout:5/273: dread d7/d1c/f33 [0,4194304] 0 2024-09-12T18:03:21.057 INFO:tasks.workunit.client.0.smithi052.stdout:1/251: creat d3/d1d/d22/f57 x:0 0 0 2024-09-12T18:03:21.057 INFO:tasks.workunit.client.0.smithi052.stdout:8/316: write d13/d18/d21/f27 [4147336,85152] 0 2024-09-12T18:03:21.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/256: creat d0/d4/f53 x:0 0 0 2024-09-12T18:03:21.057 INFO:tasks.workunit.client.0.smithi052.stdout:6/373: write d2/f51 [3524224,74494] 0 2024-09-12T18:03:21.057 INFO:tasks.workunit.client.0.smithi052.stdout:5/274: mkdir d7/d51 0 2024-09-12T18:03:21.057 INFO:tasks.workunit.client.0.smithi052.stdout:2/257: getdents da/dc/d15 0 2024-09-12T18:03:21.059 INFO:tasks.workunit.client.0.smithi052.stdout:6/374: mknod d2/c84 0 2024-09-12T18:03:21.059 INFO:tasks.workunit.client.0.smithi052.stdout:3/257: chown d0/d4/d25/d2a/d6/ca 105300855 1 2024-09-12T18:03:21.059 INFO:tasks.workunit.client.0.smithi052.stdout:9/274: read d0/d18/f36 [120520,61864] 0 2024-09-12T18:03:21.059 INFO:tasks.workunit.client.0.smithi052.stdout:8/317: truncate d13/f1f 861119 0 2024-09-12T18:03:21.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/275: read - d7/d1f/d3a/f4f zero size 2024-09-12T18:03:21.061 INFO:tasks.workunit.client.0.smithi052.stdout:2/258: readlink da/dc/d15/d22/l2a 0 2024-09-12T18:03:21.061 INFO:tasks.workunit.client.0.smithi052.stdout:8/318: stat f7 0 2024-09-12T18:03:21.061 INFO:tasks.workunit.client.0.smithi052.stdout:6/375: readlink d2/d3f/d58/l7e 0 2024-09-12T18:03:21.061 INFO:tasks.workunit.client.0.smithi052.stdout:0/254: dwrite d2/d6/dd/f22 [0,4194304] 0 2024-09-12T18:03:21.062 INFO:tasks.workunit.client.0.smithi052.stdout:9/275: creat d0/d18/d26/d33/f62 x:0 0 0 2024-09-12T18:03:21.062 INFO:tasks.workunit.client.0.smithi052.stdout:5/276: dread - d7/d1f/f47 zero size 2024-09-12T18:03:21.064 INFO:tasks.workunit.client.0.smithi052.stdout:4/309: dread d11/d17/f18 [0,4194304] 0 2024-09-12T18:03:21.064 INFO:tasks.workunit.client.0.smithi052.stdout:2/259: symlink da/dc/d15/d20/l58 0 2024-09-12T18:03:21.066 INFO:tasks.workunit.client.0.smithi052.stdout:6/376: chown d2/d3f/d54/f6f 0 1 2024-09-12T18:03:21.066 INFO:tasks.workunit.client.0.smithi052.stdout:1/252: dread d3/f20 [4194304,4194304] 0 2024-09-12T18:03:21.067 INFO:tasks.workunit.client.0.smithi052.stdout:4/310: truncate d11/d46/d51/f6d 450077 0 2024-09-12T18:03:21.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/234: dwrite d6/d26/f4d [0,4194304] 0 2024-09-12T18:03:21.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/235: stat d6/dc/f25 0 2024-09-12T18:03:21.068 INFO:tasks.workunit.client.0.smithi052.stdout:3/258: dread d0/d4/d33/f35 [0,4194304] 0 2024-09-12T18:03:21.068 INFO:tasks.workunit.client.0.smithi052.stdout:6/377: rename d2/d21/d6a/f78 to d2/d3f/d5f/f85 0 2024-09-12T18:03:21.069 INFO:tasks.workunit.client.0.smithi052.stdout:1/253: getdents d3/d1d/d22/d3f/d56 0 2024-09-12T18:03:21.070 INFO:tasks.workunit.client.0.smithi052.stdout:3/259: chown d0/d4/d33 295 1 2024-09-12T18:03:21.070 INFO:tasks.workunit.client.0.smithi052.stdout:9/276: getdents d0/d18 0 2024-09-12T18:03:21.070 INFO:tasks.workunit.client.0.smithi052.stdout:6/378: chown d2/f70 2322331 1 2024-09-12T18:03:21.071 INFO:tasks.workunit.client.0.smithi052.stdout:1/254: stat d3/d10/c18 0 2024-09-12T18:03:21.073 INFO:tasks.workunit.client.0.smithi052.stdout:8/319: dwrite d13/d18/f26 [0,4194304] 0 2024-09-12T18:03:21.073 INFO:tasks.workunit.client.0.smithi052.stdout:3/260: unlink d0/d4/l2d 0 2024-09-12T18:03:21.074 INFO:tasks.workunit.client.0.smithi052.stdout:1/255: stat d3/d10/c1c 0 2024-09-12T18:03:21.074 INFO:tasks.workunit.client.0.smithi052.stdout:6/379: fdatasync d2/d80/d5b/d26/f5c 0 2024-09-12T18:03:21.075 INFO:tasks.workunit.client.0.smithi052.stdout:5/277: dwrite d7/d1c/d1e/f2b [0,4194304] 0 2024-09-12T18:03:21.075 INFO:tasks.workunit.client.0.smithi052.stdout:8/320: readlink d13/l2c 0 2024-09-12T18:03:21.076 INFO:tasks.workunit.client.0.smithi052.stdout:9/277: link d0/d6/d3a/d42/c5a d0/d58/c63 0 2024-09-12T18:03:21.078 INFO:tasks.workunit.client.0.smithi052.stdout:0/255: dwrite d2/d6/dd/d21/d26/d2f/f4b [0,4194304] 0 2024-09-12T18:03:21.078 INFO:tasks.workunit.client.0.smithi052.stdout:8/321: fdatasync d13/d18/d21/f54 0 2024-09-12T18:03:21.081 INFO:tasks.workunit.client.0.smithi052.stdout:3/261: write d0/d4/d25/d2a/d6/d7/de/f26 [1866880,55456] 0 2024-09-12T18:03:21.081 INFO:tasks.workunit.client.0.smithi052.stdout:7/236: dwrite d6/dc/f34 [0,4194304] 0 2024-09-12T18:03:21.081 INFO:tasks.workunit.client.0.smithi052.stdout:5/278: rename d7/d1c/d1e/f3d to d7/d1c/d1e/f52 0 2024-09-12T18:03:21.081 INFO:tasks.workunit.client.0.smithi052.stdout:9/278: dread - d0/d18/d26/d4d/d54/f5b zero size 2024-09-12T18:03:21.082 INFO:tasks.workunit.client.0.smithi052.stdout:9/279: stat d0/d6/d4a 0 2024-09-12T18:03:21.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/311: dwrite d11/d17/d23/f27 [0,4194304] 0 2024-09-12T18:03:21.085 INFO:tasks.workunit.client.0.smithi052.stdout:0/256: creat d2/d6/dd/d21/d26/d2f/f50 x:0 0 0 2024-09-12T18:03:21.085 INFO:tasks.workunit.client.0.smithi052.stdout:2/260: dread da/dc/d15/f19 [0,4194304] 0 2024-09-12T18:03:21.088 INFO:tasks.workunit.client.0.smithi052.stdout:9/280: unlink d0/d6/d3a/f3b 0 2024-09-12T18:03:21.088 INFO:tasks.workunit.client.0.smithi052.stdout:1/256: dwrite d3/f20 [8388608,4194304] 0 2024-09-12T18:03:21.089 INFO:tasks.workunit.client.0.smithi052.stdout:4/312: mkdir d11/d17/d23/d2f/d3b/d6f 0 2024-09-12T18:03:21.089 INFO:tasks.workunit.client.0.smithi052.stdout:2/261: creat da/dc/d15/d43/f59 x:0 0 0 2024-09-12T18:03:21.089 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:21.090 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:21.090 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:21.090 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:21.090 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:21.090 INFO:tasks.workunit.client.0.smithi052.stdout:5/279: link d7/d1f/c22 d7/d1f/d3a/d49/c53 0 2024-09-12T18:03:21.091 INFO:tasks.workunit.client.0.smithi052.stdout:9/281: symlink d0/l64 0 2024-09-12T18:03:21.091 INFO:tasks.workunit.client.0.smithi052.stdout:5/280: stat d7/f16 0 2024-09-12T18:03:21.091 INFO:tasks.workunit.client.0.smithi052.stdout:7/237: dread d6/dc/fe [0,4194304] 0 2024-09-12T18:03:21.092 INFO:tasks.workunit.client.0.smithi052.stdout:1/257: dread - d3/d1d/d22/d27/d28/d2f/f46 zero size 2024-09-12T18:03:21.093 INFO:tasks.workunit.client.0.smithi052.stdout:9/282: symlink d0/d18/d26/d4d/l65 0 2024-09-12T18:03:21.094 INFO:tasks.workunit.client.0.smithi052.stdout:6/380: dwrite d2/d3f/d5f/f85 [0,4194304] 0 2024-09-12T18:03:21.094 INFO:tasks.workunit.client.0.smithi052.stdout:5/281: mkdir d7/d1f/d3a/d49/d54 0 2024-09-12T18:03:21.094 INFO:tasks.workunit.client.0.smithi052.stdout:0/257: dread d2/d8/f43 [0,4194304] 0 2024-09-12T18:03:21.095 INFO:tasks.workunit.client.0.smithi052.stdout:9/283: mkdir d0/d6/d4a/d66 0 2024-09-12T18:03:21.095 INFO:tasks.workunit.client.0.smithi052.stdout:1/258: dread - d3/d10/d38/f4a zero size 2024-09-12T18:03:21.095 INFO:tasks.workunit.client.0.smithi052.stdout:8/322: dwrite d13/d18/d21/f5d [0,4194304] 0 2024-09-12T18:03:21.097 INFO:tasks.workunit.client.0.smithi052.stdout:5/282: fdatasync d7/d1f/f4b 0 2024-09-12T18:03:21.097 INFO:tasks.workunit.client.0.smithi052.stdout:6/381: mkdir d2/d49/d86 0 2024-09-12T18:03:21.097 INFO:tasks.workunit.client.0.smithi052.stdout:7/238: dread d6/d12/d1e/d29/d32/f42 [0,4194304] 0 2024-09-12T18:03:21.098 INFO:tasks.workunit.client.0.smithi052.stdout:1/259: chown d3/d10/c18 243 1 2024-09-12T18:03:21.100 INFO:tasks.workunit.client.0.smithi052.stdout:8/323: creat d13/d3c/f62 x:0 0 0 2024-09-12T18:03:21.101 INFO:tasks.workunit.client.0.smithi052.stdout:6/382: chown d2/d80/d5b/d26/f46 109504 1 2024-09-12T18:03:21.101 INFO:tasks.workunit.client.0.smithi052.stdout:4/313: dwrite d11/d17/d23/d2f/d47/f5e [0,4194304] 0 2024-09-12T18:03:21.102 INFO:tasks.workunit.client.0.smithi052.stdout:6/383: sync 2024-09-12T18:03:21.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/239: truncate d6/dc/f30 1812139 0 2024-09-12T18:03:21.103 INFO:tasks.workunit.client.0.smithi052.stdout:2/262: dwrite da/dc/d15/d43/f4e [0,4194304] 0 2024-09-12T18:03:21.104 INFO:tasks.workunit.client.0.smithi052.stdout:6/384: chown d2/d15/d1a/l6d 35568 1 2024-09-12T18:03:21.104 INFO:tasks.workunit.client.0.smithi052.stdout:8/324: rename d13/d18/d21/f33 to d13/d18/d5b/f63 0 2024-09-12T18:03:21.105 INFO:tasks.workunit.client.0.smithi052.stdout:7/240: fsync d6/dc/d1a/f54 0 2024-09-12T18:03:21.106 INFO:tasks.workunit.client.0.smithi052.stdout:2/263: write da/d1d/f1e [25658,61563] 0 2024-09-12T18:03:21.106 INFO:tasks.workunit.client.0.smithi052.stdout:5/283: dread d7/f19 [0,4194304] 0 2024-09-12T18:03:21.108 INFO:tasks.workunit.client.0.smithi052.stdout:2/264: write da/d2c/f2d [747382,108694] 0 2024-09-12T18:03:21.108 INFO:tasks.workunit.client.0.smithi052.stdout:0/258: dwrite d2/d8/f30 [0,4194304] 0 2024-09-12T18:03:21.109 INFO:tasks.workunit.client.0.smithi052.stdout:6/385: rename d2/d49/d86 to d2/d3f/d58/d5d/d87 0 2024-09-12T18:03:21.109 INFO:tasks.workunit.client.0.smithi052.stdout:8/325: mkdir d13/d18/d21/d64 0 2024-09-12T18:03:21.109 INFO:tasks.workunit.client.0.smithi052.stdout:5/284: mknod d7/d1f/d45/c55 0 2024-09-12T18:03:21.109 INFO:tasks.workunit.client.0.smithi052.stdout:8/326: creat d13/d3c/f65 x:0 0 0 2024-09-12T18:03:21.110 INFO:tasks.workunit.client.0.smithi052.stdout:4/314: write d11/d17/f34 [917161,96889] 0 2024-09-12T18:03:21.111 INFO:tasks.workunit.client.0.smithi052.stdout:2/265: chown da/dc/d15/d22/l2a 10268 1 2024-09-12T18:03:21.111 INFO:tasks.workunit.client.0.smithi052.stdout:5/285: symlink d7/d1c/l56 0 2024-09-12T18:03:21.111 INFO:tasks.workunit.client.0.smithi052.stdout:4/315: write f10 [1886643,74650] 0 2024-09-12T18:03:21.114 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:21.115 INFO:tasks.workunit.client.0.smithi052.stdout:2/266: unlink da/dc/d15/f42 0 2024-09-12T18:03:21.115 INFO:tasks.workunit.client.0.smithi052.stdout:5/286: creat d7/d1c/d1e/f57 x:0 0 0 2024-09-12T18:03:21.116 INFO:tasks.workunit.client.0.smithi052.stdout:0/259: dwrite d2/d6/dd/d21/d26/f2b [0,4194304] 0 2024-09-12T18:03:21.118 INFO:tasks.workunit.client.0.smithi052.stdout:5/287: creat d7/d51/f58 x:0 0 0 2024-09-12T18:03:21.118 INFO:tasks.workunit.client.0.smithi052.stdout:8/327: dwrite d13/d18/d21/f59 [0,4194304] 0 2024-09-12T18:03:21.118 INFO:tasks.workunit.client.0.smithi052.stdout:3/262: read d0/d4/f28 [534401,124399] 0 2024-09-12T18:03:21.118 INFO:tasks.workunit.client.0.smithi052.stdout:7/241: write d6/d12/d1e/d29/d32/f42 [1743182,73178] 0 2024-09-12T18:03:21.118 INFO:tasks.workunit.client.0.smithi052.stdout:0/260: stat d2/d6/dd/d21/d26/d38/d4a 0 2024-09-12T18:03:21.119 INFO:tasks.workunit.client.0.smithi052.stdout:4/316: dread f8 [0,4194304] 0 2024-09-12T18:03:21.119 INFO:tasks.workunit.client.0.smithi052.stdout:7/242: dread - d6/dc/f50 zero size 2024-09-12T18:03:21.119 INFO:tasks.workunit.client.0.smithi052.stdout:4/317: mkdir d11/d70 0 2024-09-12T18:03:21.120 INFO:tasks.workunit.client.0.smithi052.stdout:3/263: mknod d0/d4b/d4c/d3f/c54 0 2024-09-12T18:03:21.120 INFO:tasks.workunit.client.0.smithi052.stdout:7/243: mknod d6/c55 0 2024-09-12T18:03:21.120 INFO:tasks.workunit.client.0.smithi052.stdout:0/261: write d2/d6/dd/d21/f2a [101530,65077] 0 2024-09-12T18:03:21.120 INFO:tasks.workunit.client.0.smithi052.stdout:4/318: creat d11/d65/f71 x:0 0 0 2024-09-12T18:03:21.121 INFO:tasks.workunit.client.0.smithi052.stdout:0/262: mkdir d2/d51 0 2024-09-12T18:03:21.121 INFO:tasks.workunit.client.0.smithi052.stdout:2/267: write da/dc/f2e [187342,46703] 0 2024-09-12T18:03:21.122 INFO:tasks.workunit.client.0.smithi052.stdout:7/244: rmdir d6/d12/d1e 39 2024-09-12T18:03:21.123 INFO:tasks.workunit.client.0.smithi052.stdout:3/264: creat d0/d4/d25/d2a/f55 x:0 0 0 2024-09-12T18:03:21.123 INFO:tasks.workunit.client.0.smithi052.stdout:4/319: mkdir d11/d17/d23/d2f/d72 0 2024-09-12T18:03:21.123 INFO:tasks.workunit.client.0.smithi052.stdout:2/268: truncate da/f17 1627690 0 2024-09-12T18:03:21.123 INFO:tasks.workunit.client.0.smithi052.stdout:7/245: mkdir d6/d56 0 2024-09-12T18:03:21.124 INFO:tasks.workunit.client.0.smithi052.stdout:3/265: write d0/d4/f47 [1652314,14795] 0 2024-09-12T18:03:21.124 INFO:tasks.workunit.client.0.smithi052.stdout:2/269: creat da/d1d/d35/f5a x:0 0 0 2024-09-12T18:03:21.125 INFO:tasks.workunit.client.0.smithi052.stdout:7/246: symlink d6/d12/l57 0 2024-09-12T18:03:21.125 INFO:tasks.workunit.client.0.smithi052.stdout:3/266: chown d0/d4/f53 1297 1 2024-09-12T18:03:21.128 INFO:tasks.workunit.client.0.smithi052.stdout:4/320: dread d11/d17/d1b/f2e [0,4194304] 0 2024-09-12T18:03:21.128 INFO:tasks.workunit.client.0.smithi052.stdout:7/247: rmdir d6/d12/d1e/d29/d32 39 2024-09-12T18:03:21.129 INFO:tasks.workunit.client.0.smithi052.stdout:5/288: dwrite d7/d1c/d1e/f2b [4194304,4194304] 0 2024-09-12T18:03:21.130 INFO:tasks.workunit.client.0.smithi052.stdout:5/289: write d7/f14 [585382,72817] 0 2024-09-12T18:03:21.133 INFO:tasks.workunit.client.0.smithi052.stdout:0/263: dwrite d2/d6/dd/d21/d26/d2f/f33 [0,4194304] 0 2024-09-12T18:03:21.134 INFO:tasks.workunit.client.0.smithi052.stdout:5/290: write d7/d1c/d1e/f52 [1255635,60750] 0 2024-09-12T18:03:21.137 INFO:tasks.workunit.client.0.smithi052.stdout:5/291: readlink d7/d1f/d3a/l42 0 2024-09-12T18:03:21.138 INFO:tasks.workunit.client.0.smithi052.stdout:3/267: dwrite d0/d4b/d4c/f36 [4194304,4194304] 0 2024-09-12T18:03:21.138 INFO:tasks.workunit.client.0.smithi052.stdout:4/321: link d11/d65/f71 d11/d17/d1b/d2a/d6a/f73 0 2024-09-12T18:03:21.139 INFO:tasks.workunit.client.0.smithi052.stdout:0/264: creat d2/d1b/f52 x:0 0 0 2024-09-12T18:03:21.139 INFO:tasks.workunit.client.0.smithi052.stdout:5/292: fsync d7/f40 0 2024-09-12T18:03:21.140 INFO:tasks.workunit.client.0.smithi052.stdout:0/265: fsync d2/d1b/f2e 0 2024-09-12T18:03:21.141 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:21.135+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:21.142 INFO:tasks.workunit.client.0.smithi052.stdout:6/386: dread d2/d3f/f52 [0,4194304] 0 2024-09-12T18:03:21.143 INFO:tasks.workunit.client.0.smithi052.stdout:4/322: stat d11/d17/d23/d2f/d3b/d3f/f50 0 2024-09-12T18:03:21.143 INFO:tasks.workunit.client.0.smithi052.stdout:5/293: mkdir d7/d59 0 2024-09-12T18:03:21.143 INFO:tasks.workunit.client.0.smithi052.stdout:2/270: dwrite f6 [0,4194304] 0 2024-09-12T18:03:21.143 INFO:tasks.workunit.client.0.smithi052.stdout:7/248: dwrite d6/dc/f2e [0,4194304] 0 2024-09-12T18:03:21.144 INFO:tasks.workunit.client.0.smithi052.stdout:6/387: write d2/d21/f4c [1567346,109591] 0 2024-09-12T18:03:21.144 INFO:tasks.workunit.client.0.smithi052.stdout:5/294: creat d7/d1f/d3a/d49/f5a x:0 0 0 2024-09-12T18:03:21.145 INFO:tasks.workunit.client.0.smithi052.stdout:6/388: dread - d2/f70 zero size 2024-09-12T18:03:21.145 INFO:tasks.workunit.client.0.smithi052.stdout:2/271: mknod da/dc/d15/d22/c5b 0 2024-09-12T18:03:21.146 INFO:tasks.workunit.client.0.smithi052.stdout:6/389: sync 2024-09-12T18:03:21.146 INFO:tasks.workunit.client.0.smithi052.stdout:2/272: readlink da/d1d/d35/l56 0 2024-09-12T18:03:21.147 INFO:tasks.workunit.client.0.smithi052.stdout:5/295: rename d7/d1c/f31 to d7/d1f/d3a/d49/d54/f5b 0 2024-09-12T18:03:21.148 INFO:tasks.workunit.client.0.smithi052.stdout:3/268: dwrite d0/d4/d33/f38 [0,4194304] 0 2024-09-12T18:03:21.149 INFO:tasks.workunit.client.0.smithi052.stdout:2/273: creat da/dc/d15/d43/f5c x:0 0 0 2024-09-12T18:03:21.149 INFO:tasks.workunit.client.0.smithi052.stdout:5/296: mkdir d7/d59/d5c 0 2024-09-12T18:03:21.150 INFO:tasks.workunit.client.0.smithi052.stdout:5/297: read d7/ff [3555932,110526] 0 2024-09-12T18:03:21.151 INFO:tasks.workunit.client.0.smithi052.stdout:0/266: dwrite d2/d6/dd/d21/d26/d2f/f4b [0,4194304] 0 2024-09-12T18:03:21.151 INFO:tasks.workunit.client.0.smithi052.stdout:2/274: dread - da/dc/d15/d20/f46 zero size 2024-09-12T18:03:21.152 INFO:tasks.workunit.client.0.smithi052.stdout:5/298: mknod d7/d1f/d34/c5d 0 2024-09-12T18:03:21.152 INFO:tasks.workunit.client.0.smithi052.stdout:2/275: rmdir da/dc/d15/d43 39 2024-09-12T18:03:21.152 INFO:tasks.workunit.client.0.smithi052.stdout:5/299: symlink d7/d1c/d1e/l5e 0 2024-09-12T18:03:21.153 INFO:tasks.workunit.client.0.smithi052.stdout:5/300: sync 2024-09-12T18:03:21.153 INFO:tasks.workunit.client.0.smithi052.stdout:2/276: symlink da/d1d/l5d 0 2024-09-12T18:03:21.154 INFO:tasks.workunit.client.0.smithi052.stdout:7/249: write d6/dc/f30 [2610122,20832] 0 2024-09-12T18:03:21.154 INFO:tasks.workunit.client.0.smithi052.stdout:5/301: truncate d7/f3c 944468 0 2024-09-12T18:03:21.155 INFO:tasks.workunit.client.0.smithi052.stdout:8/328: dread d13/f17 [0,4194304] 0 2024-09-12T18:03:21.156 INFO:tasks.workunit.client.0.smithi052.stdout:2/277: readlink da/dc/d15/d36/l57 0 2024-09-12T18:03:21.157 INFO:tasks.workunit.client.0.smithi052.stdout:5/302: rmdir d7/d1f/d34 39 2024-09-12T18:03:21.157 INFO:tasks.workunit.client.0.smithi052.stdout:8/329: dread - d13/d18/d21/f41 zero size 2024-09-12T18:03:21.158 INFO:tasks.workunit.client.0.smithi052.stdout:2/278: creat da/dc/f5e x:0 0 0 2024-09-12T18:03:21.159 INFO:tasks.workunit.client.0.smithi052.stdout:5/303: rmdir d7/d51 39 2024-09-12T18:03:21.160 INFO:tasks.workunit.client.0.smithi052.stdout:8/330: chown d13/l34 208 1 2024-09-12T18:03:21.160 INFO:tasks.workunit.client.0.smithi052.stdout:3/269: dwrite d0/d16/f1e [4194304,4194304] 0 2024-09-12T18:03:21.161 INFO:tasks.workunit.client.0.smithi052.stdout:6/390: dread d2/f10 [0,4194304] 0 2024-09-12T18:03:21.163 INFO:tasks.workunit.client.0.smithi052.stdout:8/331: creat d13/d18/f66 x:0 0 0 2024-09-12T18:03:21.163 INFO:tasks.workunit.client.0.smithi052.stdout:0/267: dwrite d2/d6/dd/d21/d26/d2f/f4b [4194304,4194304] 0 2024-09-12T18:03:21.163 INFO:tasks.workunit.client.0.smithi052.stdout:2/279: getdents da/d1d 0 2024-09-12T18:03:21.163 INFO:tasks.workunit.client.0.smithi052.stdout:6/391: fdatasync d2/f43 0 2024-09-12T18:03:21.163 INFO:tasks.workunit.client.0.smithi052.stdout:5/304: dread d7/f3c [0,4194304] 0 2024-09-12T18:03:21.163 INFO:tasks.workunit.client.0.smithi052.stdout:8/332: readlink d13/l2c 0 2024-09-12T18:03:21.164 INFO:tasks.workunit.client.0.smithi052.stdout:3/270: chown d0/d4b/d4c/d39 400598551 1 2024-09-12T18:03:21.164 INFO:tasks.workunit.client.0.smithi052.stdout:6/392: dread - d2/d49/f7a zero size 2024-09-12T18:03:21.164 INFO:tasks.workunit.client.0.smithi052.stdout:2/280: creat da/d1d/f5f x:0 0 0 2024-09-12T18:03:21.165 INFO:tasks.workunit.client.0.smithi052.stdout:5/305: read - d7/d1f/d3a/d49/f5a zero size 2024-09-12T18:03:21.167 INFO:tasks.workunit.client.0.smithi052.stdout:8/333: link d13/d18/f3e d13/f67 0 2024-09-12T18:03:21.167 INFO:tasks.workunit.client.0.smithi052.stdout:7/250: dwrite d6/d26/f4d [0,4194304] 0 2024-09-12T18:03:21.167 INFO:tasks.workunit.client.0.smithi052.stdout:3/271: creat d0/d4b/d4c/d3f/d48/f56 x:0 0 0 2024-09-12T18:03:21.167 INFO:tasks.workunit.client.0.smithi052.stdout:2/281: dread - da/dc/f5e zero size 2024-09-12T18:03:21.167 INFO:tasks.workunit.client.0.smithi052.stdout:0/268: chown d2/d6/dd/d21/d26/d38/l46 26 1 2024-09-12T18:03:21.167 INFO:tasks.workunit.client.0.smithi052.stdout:5/306: chown d7/d1f/d3a/d49/f5a 499 1 2024-09-12T18:03:21.167 INFO:tasks.workunit.client.0.smithi052.stdout:2/282: readlink da/dc/d15/d22/l2a 0 2024-09-12T18:03:21.168 INFO:tasks.workunit.client.0.smithi052.stdout:3/272: write d0/d4/d25/d2a/f32 [3373724,14567] 0 2024-09-12T18:03:21.168 INFO:tasks.workunit.client.0.smithi052.stdout:2/283: readlink da/dc/d15/d20/l58 0 2024-09-12T18:03:21.169 INFO:tasks.workunit.client.0.smithi052.stdout:7/251: mknod d6/dc/c58 0 2024-09-12T18:03:21.170 INFO:tasks.workunit.client.0.smithi052.stdout:3/273: mkdir d0/d4b/d57 0 2024-09-12T18:03:21.170 INFO:tasks.workunit.client.0.smithi052.stdout:2/284: mkdir da/dc/d15/d20/d60 0 2024-09-12T18:03:21.170 INFO:tasks.workunit.client.0.smithi052.stdout:0/269: mknod d2/d51/c53 0 2024-09-12T18:03:21.171 INFO:tasks.workunit.client.0.smithi052.stdout:0/270: sync 2024-09-12T18:03:21.171 INFO:tasks.workunit.client.0.smithi052.stdout:5/307: symlink d7/d1f/d34/l5f 0 2024-09-12T18:03:21.172 INFO:tasks.workunit.client.0.smithi052.stdout:7/252: write d6/dc/d1a/f54 [241844,26487] 0 2024-09-12T18:03:21.173 INFO:tasks.workunit.client.0.smithi052.stdout:0/271: mknod d2/d6/dd/c54 0 2024-09-12T18:03:21.173 INFO:tasks.workunit.client.0.smithi052.stdout:8/334: dread d13/d18/d38/f46 [0,4194304] 0 2024-09-12T18:03:21.173 INFO:tasks.workunit.client.0.smithi052.stdout:3/274: rename d0/d4/f53 to d0/d4b/d4c/f58 0 2024-09-12T18:03:21.174 INFO:tasks.workunit.client.0.smithi052.stdout:7/253: write d6/dc/f2e [4922690,56762] 0 2024-09-12T18:03:21.175 INFO:tasks.workunit.client.0.smithi052.stdout:8/335: write d13/d35/f42 [9344593,33196] 0 2024-09-12T18:03:21.175 INFO:tasks.workunit.client.0.smithi052.stdout:6/393: dwrite d2/d15/d1a/f1f [0,4194304] 0 2024-09-12T18:03:21.175 INFO:tasks.workunit.client.0.smithi052.stdout:0/272: dread - d2/d6/dd/d21/d41/d44/f4e zero size 2024-09-12T18:03:21.175 INFO:tasks.workunit.client.0.smithi052.stdout:3/275: write d0/d4b/d4c/f58 [868798,53246] 0 2024-09-12T18:03:21.176 INFO:tasks.workunit.client.0.smithi052.stdout:7/254: write d6/dc/f34 [1119359,107416] 0 2024-09-12T18:03:21.176 INFO:tasks.workunit.client.0.smithi052.stdout:8/336: read d13/d18/d21/f5d [3239555,32876] 0 2024-09-12T18:03:21.177 INFO:tasks.workunit.client.0.smithi052.stdout:3/276: chown d0/d4/d25/d2a/d6/c30 4 1 2024-09-12T18:03:21.177 INFO:tasks.workunit.client.0.smithi052.stdout:2/285: symlink da/d1d/d35/l61 0 2024-09-12T18:03:21.177 INFO:tasks.workunit.client.0.smithi052.stdout:8/337: symlink d13/l68 0 2024-09-12T18:03:21.178 INFO:tasks.workunit.client.0.smithi052.stdout:7/255: dread - d6/d12/d1e/d29/d32/d3a/f53 zero size 2024-09-12T18:03:21.179 INFO:tasks.workunit.client.0.smithi052.stdout:2/286: unlink da/l23 0 2024-09-12T18:03:21.180 INFO:tasks.workunit.client.0.smithi052.stdout:3/277: write d0/d4/d25/d2a/f32 [4943917,56550] 0 2024-09-12T18:03:21.180 INFO:tasks.workunit.client.0.smithi052.stdout:0/273: creat d2/d6/dd/d21/d41/d44/d48/f55 x:0 0 0 2024-09-12T18:03:21.180 INFO:tasks.workunit.client.0.smithi052.stdout:8/338: write d13/d18/d38/f46 [3029108,23197] 0 2024-09-12T18:03:21.185 INFO:tasks.workunit.client.0.smithi052.stdout:5/308: dwrite d7/f19 [4194304,4194304] 0 2024-09-12T18:03:21.185 INFO:tasks.workunit.client.0.smithi052.stdout:7/256: write d6/d12/d1e/d29/d32/d3a/f53 [802384,77114] 0 2024-09-12T18:03:21.185 INFO:tasks.workunit.client.0.smithi052.stdout:8/339: write d13/d3c/f5a [3890918,129136] 0 2024-09-12T18:03:21.186 INFO:tasks.workunit.client.0.smithi052.stdout:2/287: unlink da/dc/d15/d20/f46 0 2024-09-12T18:03:21.186 INFO:tasks.workunit.client.0.smithi052.stdout:0/274: getdents d2 0 2024-09-12T18:03:21.186 INFO:tasks.workunit.client.0.smithi052.stdout:5/309: creat d7/d59/f60 x:0 0 0 2024-09-12T18:03:21.186 INFO:tasks.workunit.client.0.smithi052.stdout:3/278: creat d0/d4/d25/d2a/d6/d41/f59 x:0 0 0 2024-09-12T18:03:21.186 INFO:tasks.workunit.client.0.smithi052.stdout:6/394: dwrite d2/d15/f22 [4194304,4194304] 0 2024-09-12T18:03:21.188 INFO:tasks.workunit.client.0.smithi052.stdout:3/279: mknod d0/c5a 0 2024-09-12T18:03:21.189 INFO:tasks.workunit.client.0.smithi052.stdout:5/310: creat d7/d1c/f61 x:0 0 0 2024-09-12T18:03:21.189 INFO:tasks.workunit.client.0.smithi052.stdout:6/395: write d2/d80/d5b/d26/f7c [51115,84350] 0 2024-09-12T18:03:21.189 INFO:tasks.workunit.client.0.smithi052.stdout:5/311: chown d7/d1c 4776852 1 2024-09-12T18:03:21.191 INFO:tasks.workunit.client.0.smithi052.stdout:8/340: dread d13/d18/f26 [0,4194304] 0 2024-09-12T18:03:21.194 INFO:tasks.workunit.client.0.smithi052.stdout:3/280: creat d0/d4/d25/d2a/d6/d7/d34/f5b x:0 0 0 2024-09-12T18:03:21.194 INFO:tasks.workunit.client.0.smithi052.stdout:7/257: dwrite d6/f2d [0,4194304] 0 2024-09-12T18:03:21.195 INFO:tasks.workunit.client.0.smithi052.stdout:6/396: symlink d2/d3f/d58/d5d/l88 0 2024-09-12T18:03:21.196 INFO:tasks.workunit.client.0.smithi052.stdout:0/275: dwrite d2/d6/dd/d21/d26/d2f/f4b [8388608,4194304] 0 2024-09-12T18:03:21.197 INFO:tasks.workunit.client.0.smithi052.stdout:6/397: chown d2/d3f/d54/f62 1 1 2024-09-12T18:03:21.197 INFO:tasks.workunit.client.0.smithi052.stdout:2/288: dwrite da/dc/d15/d43/f4e [0,4194304] 0 2024-09-12T18:03:21.199 INFO:tasks.workunit.client.0.smithi052.stdout:2/289: write da/dc/d15/d20/fe [5266386,41606] 0 2024-09-12T18:03:21.200 INFO:tasks.workunit.client.0.smithi052.stdout:5/312: dwrite d7/d1c/d1e/f46 [4194304,4194304] 0 2024-09-12T18:03:21.200 INFO:tasks.workunit.client.0.smithi052.stdout:0/276: creat d2/d6/dd/d21/f56 x:0 0 0 2024-09-12T18:03:21.200 INFO:tasks.workunit.client.0.smithi052.stdout:7/258: symlink d6/d56/l59 0 2024-09-12T18:03:21.201 INFO:tasks.workunit.client.0.smithi052.stdout:8/341: link d13/l2f d13/d18/d38/l69 0 2024-09-12T18:03:21.202 INFO:tasks.workunit.client.0.smithi052.stdout:6/398: link d2/l13 d2/d15/d1a/l89 0 2024-09-12T18:03:21.203 INFO:tasks.workunit.client.0.smithi052.stdout:0/277: mkdir d2/d57 0 2024-09-12T18:03:21.203 INFO:tasks.workunit.client.0.smithi052.stdout:3/281: getdents d0/d4b/d4c/d3f 0 2024-09-12T18:03:21.204 INFO:tasks.workunit.client.0.smithi052.stdout:0/278: fdatasync d2/d6/dd/d21/f56 0 2024-09-12T18:03:21.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/259: getdents d6/d12/d1e/d29/d32/d3a 0 2024-09-12T18:03:21.206 INFO:tasks.workunit.client.0.smithi052.stdout:0/279: rename d2/d6/dd/d21/f2a to d2/d6/dd/d21/d47/f58 0 2024-09-12T18:03:21.208 INFO:tasks.workunit.client.0.smithi052.stdout:8/342: dwrite d13/d18/d21/f59 [0,4194304] 0 2024-09-12T18:03:21.211 INFO:tasks.workunit.client.0.smithi052.stdout:2/290: write da/dc/d15/f39 [721914,129394] 0 2024-09-12T18:03:21.211 INFO:tasks.workunit.client.0.smithi052.stdout:5/313: truncate d7/f19 5203450 0 2024-09-12T18:03:21.212 INFO:tasks.workunit.client.0.smithi052.stdout:6/399: truncate d2/d15/f22 3018862 0 2024-09-12T18:03:21.212 INFO:tasks.workunit.client.0.smithi052.stdout:4/323: dread d11/d17/d23/d2f/d3b/d3f/f50 [0,4194304] 0 2024-09-12T18:03:21.212 INFO:tasks.workunit.client.0.smithi052.stdout:0/280: mkdir d2/d6/dd/d21/d41/d59 0 2024-09-12T18:03:21.213 INFO:tasks.workunit.client.0.smithi052.stdout:6/400: chown d2/d21/c40 54209911 1 2024-09-12T18:03:21.213 INFO:tasks.workunit.client.0.smithi052.stdout:5/314: chown d7/d51/f58 9343993 1 2024-09-12T18:03:21.213 INFO:tasks.workunit.client.0.smithi052.stdout:3/282: dread d0/d4/d25/d2a/d6/d7/de/f26 [0,4194304] 0 2024-09-12T18:03:21.213 INFO:tasks.workunit.client.0.smithi052.stdout:7/260: getdents d6/d12/d17 0 2024-09-12T18:03:21.214 INFO:tasks.workunit.client.0.smithi052.stdout:6/401: stat d2/f3a 0 2024-09-12T18:03:21.214 INFO:tasks.workunit.client.0.smithi052.stdout:9/284: dread d0/fc [0,4194304] 0 2024-09-12T18:03:21.214 INFO:tasks.workunit.client.0.smithi052.stdout:2/291: write da/dc/d15/d22/f54 [1007825,51652] 0 2024-09-12T18:03:21.214 INFO:tasks.workunit.client.0.smithi052.stdout:5/315: creat d7/d1f/d45/f62 x:0 0 0 2024-09-12T18:03:21.214 INFO:tasks.workunit.client.0.smithi052.stdout:7/261: write d6/d12/d1e/f2c [903378,115371] 0 2024-09-12T18:03:21.215 INFO:tasks.workunit.client.0.smithi052.stdout:3/283: creat d0/d4/d33/f5c x:0 0 0 2024-09-12T18:03:21.215 INFO:tasks.workunit.client.0.smithi052.stdout:6/402: mknod d2/d21/d76/c8a 0 2024-09-12T18:03:21.215 INFO:tasks.workunit.client.0.smithi052.stdout:9/285: read - d0/d18/d26/d4d/d54/f5b zero size 2024-09-12T18:03:21.216 INFO:tasks.workunit.client.0.smithi052.stdout:5/316: symlink d7/d1f/d34/l63 0 2024-09-12T18:03:21.216 INFO:tasks.workunit.client.0.smithi052.stdout:2/292: write da/dc/d15/d20/f14 [957153,68037] 0 2024-09-12T18:03:21.216 INFO:tasks.workunit.client.0.smithi052.stdout:3/284: chown d0/d4/d25/c3e 32271513 1 2024-09-12T18:03:21.216 INFO:tasks.workunit.client.0.smithi052.stdout:7/262: creat d6/f5a x:0 0 0 2024-09-12T18:03:21.218 INFO:tasks.workunit.client.0.smithi052.stdout:6/403: read d2/d15/f2c [818601,35657] 0 2024-09-12T18:03:21.218 INFO:tasks.workunit.client.0.smithi052.stdout:2/293: fsync f3 0 2024-09-12T18:03:21.218 INFO:tasks.workunit.client.0.smithi052.stdout:8/343: truncate d13/d18/d21/f27 3702474 0 2024-09-12T18:03:21.219 INFO:tasks.workunit.client.0.smithi052.stdout:3/285: readlink d0/d4b/d4c/l1a 0 2024-09-12T18:03:21.219 INFO:tasks.workunit.client.0.smithi052.stdout:5/317: creat d7/d1c/d1e/f64 x:0 0 0 2024-09-12T18:03:21.220 INFO:tasks.workunit.client.0.smithi052.stdout:9/286: rename d0/d18/d26/c4e to d0/d18/d26/d4d/d54/c67 0 2024-09-12T18:03:21.220 INFO:tasks.workunit.client.0.smithi052.stdout:2/294: mknod da/d1d/c62 0 2024-09-12T18:03:21.221 INFO:tasks.workunit.client.0.smithi052.stdout:6/404: mknod d2/d15/c8b 0 2024-09-12T18:03:21.221 INFO:tasks.workunit.client.0.smithi052.stdout:8/344: write f7 [1550052,92579] 0 2024-09-12T18:03:21.222 INFO:tasks.workunit.client.0.smithi052.stdout:5/318: chown d7/d1c/d1e/f46 0 1 2024-09-12T18:03:21.222 INFO:tasks.workunit.client.0.smithi052.stdout:4/324: dwrite d11/d17/d23/d2f/d47/f4d [0,4194304] 0 2024-09-12T18:03:21.223 INFO:tasks.workunit.client.0.smithi052.stdout:0/281: dwrite d2/f29 [0,4194304] 0 2024-09-12T18:03:21.223 INFO:tasks.workunit.client.0.smithi052.stdout:9/287: symlink d0/d6/l68 0 2024-09-12T18:03:21.224 INFO:tasks.workunit.client.0.smithi052.stdout:5/319: fsync d7/d1f/f2c 0 2024-09-12T18:03:21.224 INFO:tasks.workunit.client.0.smithi052.stdout:2/295: write da/f16 [1964135,3596] 0 2024-09-12T18:03:21.225 INFO:tasks.workunit.client.0.smithi052.stdout:4/325: fsync d11/d17/d23/d2f/d47/f5e 0 2024-09-12T18:03:21.225 INFO:tasks.workunit.client.0.smithi052.stdout:5/320: dread - d7/f38 zero size 2024-09-12T18:03:21.227 INFO:tasks.workunit.client.0.smithi052.stdout:5/321: sync 2024-09-12T18:03:21.227 INFO:tasks.workunit.client.0.smithi052.stdout:0/282: unlink d2/d6/dd/d21/d41/d44/d48/f55 0 2024-09-12T18:03:21.228 INFO:tasks.workunit.client.0.smithi052.stdout:2/296: chown da/dc/d15/d22/l47 1043738854 1 2024-09-12T18:03:21.228 INFO:tasks.workunit.client.0.smithi052.stdout:7/263: dread d6/d26/f4d [0,4194304] 0 2024-09-12T18:03:21.230 INFO:tasks.workunit.client.0.smithi052.stdout:6/405: dread d2/f10 [0,4194304] 0 2024-09-12T18:03:21.231 INFO:tasks.workunit.client.0.smithi052.stdout:0/283: rmdir d2/d8 39 2024-09-12T18:03:21.231 INFO:tasks.workunit.client.0.smithi052.stdout:1/260: dread d3/f25 [0,4194304] 0 2024-09-12T18:03:21.231 INFO:tasks.workunit.client.0.smithi052.stdout:7/264: write d6/d12/d1e/d29/d32/f42 [1813939,52709] 0 2024-09-12T18:03:21.231 INFO:tasks.workunit.client.0.smithi052.stdout:2/297: symlink da/dc/d15/d36/l63 0 2024-09-12T18:03:21.232 INFO:tasks.workunit.client.0.smithi052.stdout:5/322: creat d7/d59/f65 x:0 0 0 2024-09-12T18:03:21.232 INFO:tasks.workunit.client.0.smithi052.stdout:6/406: fsync d2/d80/d5b/d26/f28 0 2024-09-12T18:03:21.233 INFO:tasks.workunit.client.0.smithi052.stdout:0/284: dread - d2/d1b/f52 zero size 2024-09-12T18:03:21.233 INFO:tasks.workunit.client.0.smithi052.stdout:4/326: getdents d11/d17/d23/d2f/d47/d67/d68 0 2024-09-12T18:03:21.233 INFO:tasks.workunit.client.0.smithi052.stdout:0/285: sync 2024-09-12T18:03:21.233 INFO:tasks.workunit.client.0.smithi052.stdout:3/286: truncate d0/d4/d33/f38 2128458 0 2024-09-12T18:03:21.234 INFO:tasks.workunit.client.0.smithi052.stdout:1/261: dread - d3/d10/d38/f4a zero size 2024-09-12T18:03:21.234 INFO:tasks.workunit.client.0.smithi052.stdout:7/265: creat d6/dc/d1a/f5b x:0 0 0 2024-09-12T18:03:21.234 INFO:tasks.workunit.client.0.smithi052.stdout:9/288: dwrite d0/d1c/f32 [0,4194304] 0 2024-09-12T18:03:21.234 INFO:tasks.workunit.client.0.smithi052.stdout:6/407: creat d2/d80/f8c x:0 0 0 2024-09-12T18:03:21.234 INFO:tasks.workunit.client.0.smithi052.stdout:5/323: write d7/f21 [2687387,38448] 0 2024-09-12T18:03:21.235 INFO:tasks.workunit.client.0.smithi052.stdout:8/345: dwrite d13/f67 [4194304,4194304] 0 2024-09-12T18:03:21.236 INFO:tasks.workunit.client.0.smithi052.stdout:0/286: write d2/d6/dd/d21/f35 [4292840,51452] 0 2024-09-12T18:03:21.236 INFO:tasks.workunit.client.0.smithi052.stdout:1/262: symlink d3/d1d/d22/d3f/l58 0 2024-09-12T18:03:21.236 INFO:tasks.workunit.client.0.smithi052.stdout:2/298: rename da/d1d/f5f to da/dc/d15/d20/f64 0 2024-09-12T18:03:21.237 INFO:tasks.workunit.client.0.smithi052.stdout:4/327: mkdir d11/d17/d23/d2f/d47/d67/d74 0 2024-09-12T18:03:21.237 INFO:tasks.workunit.client.0.smithi052.stdout:5/324: dread - d7/d1f/f47 zero size 2024-09-12T18:03:21.238 INFO:tasks.workunit.client.0.smithi052.stdout:8/346: chown d13/d18/d21/f37 1908 1 2024-09-12T18:03:21.238 INFO:tasks.workunit.client.0.smithi052.stdout:5/325: dread - d7/d1f/d34/f48 zero size 2024-09-12T18:03:21.240 INFO:tasks.workunit.client.0.smithi052.stdout:1/263: readlink d3/l1a 0 2024-09-12T18:03:21.240 INFO:tasks.workunit.client.0.smithi052.stdout:8/347: stat d13/d18/d38/l61 0 2024-09-12T18:03:21.240 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:21.235+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:21.241 INFO:tasks.workunit.client.0.smithi052.stdout:4/328: chown d11/d17/d1b/c1c 178 1 2024-09-12T18:03:21.242 INFO:tasks.workunit.client.0.smithi052.stdout:1/264: dread - d3/d1d/d22/d27/f50 zero size 2024-09-12T18:03:21.243 INFO:tasks.workunit.client.0.smithi052.stdout:7/266: dread d6/d26/f4d [0,4194304] 0 2024-09-12T18:03:21.243 INFO:tasks.workunit.client.0.smithi052.stdout:4/329: chown d11/d17/d1b/d42 271704 1 2024-09-12T18:03:21.244 INFO:tasks.workunit.client.0.smithi052.stdout:3/287: dwrite d0/d4/f50 [0,4194304] 0 2024-09-12T18:03:21.244 INFO:tasks.workunit.client.0.smithi052.stdout:8/348: getdents d13/d3c 0 2024-09-12T18:03:21.246 INFO:tasks.workunit.client.0.smithi052.stdout:1/265: link d3/f20 d3/d1d/d22/f59 0 2024-09-12T18:03:21.247 INFO:tasks.workunit.client.0.smithi052.stdout:2/299: dwrite da/dc/f2b [0,4194304] 0 2024-09-12T18:03:21.247 INFO:tasks.workunit.client.0.smithi052.stdout:4/330: write d11/d17/d23/d2f/f3a [1157732,49003] 0 2024-09-12T18:03:21.249 INFO:tasks.workunit.client.0.smithi052.stdout:0/287: dwrite d2/d6/f4c [0,4194304] 0 2024-09-12T18:03:21.249 INFO:tasks.workunit.client.0.smithi052.stdout:0/288: sync 2024-09-12T18:03:21.249 INFO:tasks.workunit.client.0.smithi052.stdout:3/288: fdatasync d0/d4/d25/d2a/d6/d7/de/f26 0 2024-09-12T18:03:21.250 INFO:tasks.workunit.client.0.smithi052.stdout:5/326: dwrite d7/f13 [0,4194304] 0 2024-09-12T18:03:21.250 INFO:tasks.workunit.client.0.smithi052.stdout:4/331: chown d11/d46/d51/f6d 122 1 2024-09-12T18:03:21.254 INFO:tasks.workunit.client.0.smithi052.stdout:3/289: mkdir d0/d4b/d5d 0 2024-09-12T18:03:21.254 INFO:tasks.workunit.client.0.smithi052.stdout:7/267: rename d6/d12/d1e/d29/d32/c2b to d6/d12/d1e/d29/c5c 0 2024-09-12T18:03:21.254 INFO:tasks.workunit.client.0.smithi052.stdout:4/332: creat d11/d17/d1b/d2a/d32/f75 x:0 0 0 2024-09-12T18:03:21.255 INFO:tasks.workunit.client.0.smithi052.stdout:1/266: rename d3/d1d/c36 to d3/d10/c5a 0 2024-09-12T18:03:21.255 INFO:tasks.workunit.client.0.smithi052.stdout:7/268: truncate d6/f2d 5221007 0 2024-09-12T18:03:21.255 INFO:tasks.workunit.client.0.smithi052.stdout:3/290: symlink d0/d4b/d4c/d3f/d48/l5e 0 2024-09-12T18:03:21.256 INFO:tasks.workunit.client.0.smithi052.stdout:5/327: rename d7/f14 to d7/d1c/d1e/f66 0 2024-09-12T18:03:21.256 INFO:tasks.workunit.client.0.smithi052.stdout:4/333: creat d11/d17/d1b/d2a/d32/f76 x:0 0 0 2024-09-12T18:03:21.257 INFO:tasks.workunit.client.0.smithi052.stdout:7/269: stat d6/d26/f28 0 2024-09-12T18:03:21.258 INFO:tasks.workunit.client.0.smithi052.stdout:2/300: dwrite da/f16 [0,4194304] 0 2024-09-12T18:03:21.258 INFO:tasks.workunit.client.0.smithi052.stdout:5/328: mkdir d7/d1c/d67 0 2024-09-12T18:03:21.259 INFO:tasks.workunit.client.0.smithi052.stdout:0/289: dwrite d2/d6/dd/d21/d26/d2f/f33 [0,4194304] 0 2024-09-12T18:03:21.260 INFO:tasks.workunit.client.0.smithi052.stdout:5/329: truncate d7/f38 404602 0 2024-09-12T18:03:21.261 INFO:tasks.workunit.client.0.smithi052.stdout:4/334: mknod d11/d17/d1b/d2a/d6a/c77 0 2024-09-12T18:03:21.262 INFO:tasks.workunit.client.0.smithi052.stdout:5/330: mknod d7/d1f/d34/c68 0 2024-09-12T18:03:21.262 INFO:tasks.workunit.client.0.smithi052.stdout:1/267: dread d3/d1d/d22/f59 [4194304,4194304] 0 2024-09-12T18:03:21.262 INFO:tasks.workunit.client.0.smithi052.stdout:5/331: read - d7/d51/f58 zero size 2024-09-12T18:03:21.264 INFO:tasks.workunit.client.0.smithi052.stdout:0/290: getdents d2/d6/dd/d21/d41 0 2024-09-12T18:03:21.265 INFO:tasks.workunit.client.0.smithi052.stdout:5/332: mknod d7/d1f/d34/c69 0 2024-09-12T18:03:21.265 INFO:tasks.workunit.client.0.smithi052.stdout:4/335: link d11/d17/d1b/d2a/d32/l48 d11/d46/l78 0 2024-09-12T18:03:21.265 INFO:tasks.workunit.client.0.smithi052.stdout:2/301: dwrite da/f13 [0,4194304] 0 2024-09-12T18:03:21.265 INFO:tasks.workunit.client.0.smithi052.stdout:0/291: write d2/d8/f1c [923741,48089] 0 2024-09-12T18:03:21.267 INFO:tasks.workunit.client.0.smithi052.stdout:5/333: mknod d7/d1f/c6a 0 2024-09-12T18:03:21.270 INFO:tasks.workunit.client.0.smithi052.stdout:0/292: mknod d2/d6/dd/d21/d41/d44/d48/c5a 0 2024-09-12T18:03:21.270 INFO:tasks.workunit.client.0.smithi052.stdout:6/408: write d2/d80/d5b/f31 [659729,4033] 0 2024-09-12T18:03:21.270 INFO:tasks.workunit.client.0.smithi052.stdout:9/289: rename d0/d18/f2a to d0/d6/d4a/f69 0 2024-09-12T18:03:21.270 INFO:tasks.workunit.client.0.smithi052.stdout:5/334: mkdir d7/d1f/d3a/d49/d54/d6b 0 2024-09-12T18:03:21.272 INFO:tasks.workunit.client.0.smithi052.stdout:0/293: mkdir d2/d57/d5b 0 2024-09-12T18:03:21.272 INFO:tasks.workunit.client.0.smithi052.stdout:1/268: dwrite d3/d10/d38/f4d [0,4194304] 0 2024-09-12T18:03:21.273 INFO:tasks.workunit.client.0.smithi052.stdout:6/409: mknod d2/d3f/d5f/c8d 0 2024-09-12T18:03:21.274 INFO:tasks.workunit.client.0.smithi052.stdout:1/269: write d3/d1d/d22/f57 [494886,5157] 0 2024-09-12T18:03:21.275 INFO:tasks.workunit.client.0.smithi052.stdout:6/410: mknod d2/d49/c8e 0 2024-09-12T18:03:21.276 INFO:tasks.workunit.client.0.smithi052.stdout:5/335: creat d7/d1c/f6c x:0 0 0 2024-09-12T18:03:21.276 INFO:tasks.workunit.client.0.smithi052.stdout:4/336: dwrite d11/d17/d23/d2f/d47/f53 [0,4194304] 0 2024-09-12T18:03:21.276 INFO:tasks.workunit.client.0.smithi052.stdout:2/302: dwrite f3 [0,4194304] 0 2024-09-12T18:03:21.276 INFO:tasks.workunit.client.0.smithi052.stdout:0/294: dread d2/d6/dd/d21/d47/f58 [0,4194304] 0 2024-09-12T18:03:21.279 INFO:tasks.workunit.client.0.smithi052.stdout:7/270: dread d6/dc/d1a/f54 [0,4194304] 0 2024-09-12T18:03:21.280 INFO:tasks.workunit.client.0.smithi052.stdout:2/303: creat da/dc/d15/f65 x:0 0 0 2024-09-12T18:03:21.280 INFO:tasks.workunit.client.0.smithi052.stdout:5/336: getdents d7/d1f/d3a 0 2024-09-12T18:03:21.281 INFO:tasks.workunit.client.0.smithi052.stdout:7/271: dread - d6/dc/d1a/f5b zero size 2024-09-12T18:03:21.282 INFO:tasks.workunit.client.0.smithi052.stdout:2/304: fdatasync da/dc/f37 0 2024-09-12T18:03:21.282 INFO:tasks.workunit.client.0.smithi052.stdout:0/295: creat d2/d6/dd/d21/d26/d2f/d3a/f5c x:0 0 0 2024-09-12T18:03:21.283 INFO:tasks.workunit.client.0.smithi052.stdout:3/291: dread d0/d4/f47 [0,4194304] 0 2024-09-12T18:03:21.283 INFO:tasks.workunit.client.0.smithi052.stdout:7/272: readlink d6/d12/d1e/l2a 0 2024-09-12T18:03:21.285 INFO:tasks.workunit.client.0.smithi052.stdout:9/290: dread d0/d6/d3a/d43/f4b [0,4194304] 0 2024-09-12T18:03:21.285 INFO:tasks.workunit.client.0.smithi052.stdout:0/296: rmdir d2/d51 39 2024-09-12T18:03:21.286 INFO:tasks.workunit.client.0.smithi052.stdout:2/305: truncate da/dc/f2e 1287742 0 2024-09-12T18:03:21.287 INFO:tasks.workunit.client.0.smithi052.stdout:1/270: dwrite d3/d10/f53 [0,4194304] 0 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.621091684, 2024-09-12T18:03:21.288 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:21.289 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.290 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:21.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:21.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.621057935, 2024-09-12T18:03:21.294 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.295 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:21.297 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:21.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:21.300 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.621016566, 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.301 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:21.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.303 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:21.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.305 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 2053189~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:21.306 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.594361641000001, 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037455038000000003, 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.307 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692453+0000", 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0412e-05 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692463+0000", 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0577000000000001e-05 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692471+0000", 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4100000000000002e-06 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718677+0000", 2024-09-12T18:03:21.309 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026206521 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718798+0000", 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120538 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.719143+0000", 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000345235 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.310 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721718+0000", 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025749420000000002 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729675+0000", 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079570179999999997 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729785+0000", 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109874 2024-09-12T18:03:21.311 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729887+0000", 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101811 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 2055638~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.594310619, 2024-09-12T18:03:21.312 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03758189, 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:21.313 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692484+0000", 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692495+0000", 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.132e-05 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.314 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692504+0000", 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4790000000000002e-06 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692511+0000", 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9770000000000003e-06 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720074+0000", 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027562749000000001 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.315 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720202+0000", 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012780100000000001 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720397+0000", 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019465199999999999 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.723964+0000", 2024-09-12T18:03:21.316 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035674280000000001 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729966+0000", 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060025219999999997 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730010+0000", 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3387999999999999e-05 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.317 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730064+0000", 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4620999999999998e-05 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.588944954, 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:21.318 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.319 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.320 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.321 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.322 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:21.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.324 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.588877661, 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.325 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.326 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:21.327 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.328 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.329 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.330 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.588843839000001, 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.331 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.332 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:21.333 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.334 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.335 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.336 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.58879587, 2024-09-12T18:03:21.337 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.340 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:21.341 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.342 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:21.343 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.344 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.345 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.588754674, 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.346 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:21.347 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.348 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.349 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:21.350 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.351 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.585323604999999, 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.352 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:21.353 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.354 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.355 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:21.356 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.357 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.585132250000001, 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.358 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.359 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.360 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.361 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:21.362 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:390 3.2 3:4272d415:::200.0000000b:head [write 0~2532501 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.661413+0000", 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.6253800219999999, 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037293647999999999, 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.364 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.661413+0000", 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.661413+0000", 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.661416+0000", 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1130000000000001e-06 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.365 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667182+0000", 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057653399999999999 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667230+0000", 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8038999999999999e-05 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667245+0000", 2024-09-12T18:03:21.366 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5223e-05 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667384+0000", 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013869699999999999 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667623+0000", 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00023971600000000001 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.367 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667888+0000", 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026457500000000002 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686349+0000", 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018461287999999999 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.698594+0000", 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012245303000000001 2024-09-12T18:03:21.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.698665+0000", 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0337000000000001e-05 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.698707+0000", 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2017000000000001e-05 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.369 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 2532501~3109 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.619508878, 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038228275999999999, 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:21.370 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667287+0000", 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.371 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667297+0000", 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0837e-05 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667318+0000", 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0132e-05 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.372 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667333+0000", 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5464e-05 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682093+0000", 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014760517000000001 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.373 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682239+0000", 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145704 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682429+0000", 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189419 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687963+0000", 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055348469999999999 2024-09-12T18:03:21.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705429+0000", 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017465897000000001 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705472+0000", 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.375 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705513+0000", 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0395000000000002e-05 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 2535610~33089 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.619405403, 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038208328999999999, 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.376 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667389+0000", 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667437+0000", 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8296e-05 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.378 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667461+0000", 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3315999999999998e-05 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667475+0000", 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4806e-05 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683310+0000", 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015835025999999999 2024-09-12T18:03:21.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683414+0000", 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103782 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683558+0000", 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144222 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.380 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687979+0000", 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044206499999999999 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705541+0000", 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017561879999999998 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.381 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705573+0000", 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1513000000000001e-05 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705596+0000", 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3598e-05 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.382 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:393 3.2 3:4272d415:::200.0000000b:head [write 2568699~16268 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.619286118, 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038174923999999999, 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:21.383 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667508+0000", 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.26e-06 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.384 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667540+0000", 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1544999999999997e-05 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667560+0000", 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.965e-05 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667581+0000", 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1073e-05 2024-09-12T18:03:21.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684213+0000", 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016632040000000001 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684298+0000", 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700999999999998e-05 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:21.386 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684441+0000", 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142325 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.688223+0000", 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037828240000000002 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705621+0000", 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017397394 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.387 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705661+0000", 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9725000000000003e-05 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705682+0000", 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1387e-05 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.388 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:394 3.2 3:4272d415:::200.0000000b:head [write 2584967~9560 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.618708423, 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037725440999999998, 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668087+0000", 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4269999999999998e-06 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.390 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668114+0000", 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6475999999999999e-05 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668140+0000", 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5896000000000001e-05 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668159+0000", 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8936999999999998e-05 2024-09-12T18:03:21.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686422+0000", 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018263577999999999 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686807+0000", 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000385263 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:21.392 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687150+0000", 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034306300000000001 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.689567+0000", 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002416961 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705716+0000", 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016148172999999998 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.393 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705773+0000", 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7275999999999998e-05 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705810+0000", 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7391000000000002e-05 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.394 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10722 4.12 4:4a23efdb:::100000030fe.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.6140237609999999, 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039390537000000003, 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10722 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.395 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672772+0000", 2024-09-12T18:03:21.396 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2400000000000002e-06 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680073+0000", 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073009110000000002 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680106+0000", 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3812000000000001e-05 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.397 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680121+0000", 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.486e-05 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690602+0000", 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010480952999999999 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690789+0000", 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018728399999999999 2024-09-12T18:03:21.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690975+0000", 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000185613 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.706973+0000", 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015997546000000001 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.399 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712089+0000", 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051161699999999997 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712130+0000", 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1069000000000003e-05 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712160+0000", 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0079000000000001e-05 2024-09-12T18:03:21.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10804 4.b 4:d006e46e:::10000003140.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 1.2945279240000001, 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044910052999999998, 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:21.401 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10804 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.402 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992268+0000", 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7870000000000002e-06 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012102+0000", 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019833542999999999 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.403 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012139+0000", 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012163+0000", 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3998999999999998e-05 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.404 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012267+0000", 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010427100000000001 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012333+0000", 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5907000000000004e-05 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012775+0000", 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000442058 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.405 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.021332+0000", 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008556882 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037041+0000", 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015709548 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037115+0000", 2024-09-12T18:03:21.406 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3645000000000004e-05 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037175+0000", 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0183000000000003e-05 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11578 4.2d 4:b54e928a:::10000003360.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:21.407 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.118289426, 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041673711000000002, 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11578 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.408 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168505+0000", 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5899999999999995e-07 2024-09-12T18:03:21.409 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182775+0000", 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014270628 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182793+0000", 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8156e-05 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182813+0000", 2024-09-12T18:03:21.410 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9602e-05 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182897+0000", 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3688000000000002e-05 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182995+0000", 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7826999999999997e-05 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.411 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.183185+0000", 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019040999999999999 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.193832+0000", 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010646901 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210041+0000", 2024-09-12T18:03:21.412 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016209214 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210116+0000", 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4482999999999998e-05 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210177+0000", 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1943e-05 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.413 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:21.414 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:21.414 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:21.416 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:21.411+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:21.416 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:21.442 INFO:tasks.workunit.client.0.smithi052.stdout:4/337: dwrite d11/d17/d23/d2f/f2b [0,4194304] 0 2024-09-12T18:03:21.442 INFO:tasks.workunit.client.0.smithi052.stdout:6/411: dwrite d2/d80/d5b/f31 [0,4194304] 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:9/291: dread - d0/d6/d3a/f5d zero size 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:4/338: stat d11/d65/l6b 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:1/271: mknod d3/d1d/d22/d3f/c5b 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:4/339: unlink d11/d46/d51/f6d 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:1/272: stat d3/d1d/c24 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:4/340: chown d11/d65/f71 4835 1 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/273: rename d6/d26 to d6/d12/d1e/d29/d5d 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:4/341: write d11/f21 [985211,28439] 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/337: truncate d7/d1c/d1e/f46 2776649 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:3/292: dread d0/d4/f50 [0,4194304] 0 2024-09-12T18:03:21.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/274: fdatasync d6/d12/d1e/d29/d5d/f28 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:6/412: mknod d2/d15/c8f 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:0/297: link d2/d6/dd/d21/d26/d2f/f4b d2/d6/dd/d21/d26/d2f/d3a/f5d 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:5/338: mknod d7/d59/c6d 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:4/342: write d11/d17/d23/d2f/d3b/f4e [1571214,93929] 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:1/273: getdents d3/d10/d38/d44 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:6/413: read d2/d3f/f52 [2167915,1311] 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:3/293: chown d0/d4/d25/d2a/f32 3916693 1 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:7/275: symlink d6/d12/d1e/d29/d5d/l5e 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:5/339: chown d7/d1f/d45/f62 2989197 1 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:4/343: write f10 [2833858,116100] 0 2024-09-12T18:03:21.444 INFO:tasks.workunit.client.0.smithi052.stdout:3/294: symlink d0/d16/l5f 0 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:1/274: rename d3/f20 to d3/d1d/d22/d27/f5c 0 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:7/276: chown d6/d12/f15 92841263 1 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/292: dwrite d0/d1c/f25 [4194304,4194304] 0 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:3/295: write d0/d4/d25/d2a/d6/d7/de/f26 [4303653,22030] 0 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/293: read d0/d1c/f20 [1897292,63783] 0 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:7/277: chown d6/d12/d1e/d29/d32/f42 60397498 1 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:7/278: chown d6/dc/d1a 38 1 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:4/344: chown d11/d17/d23/d2f/d3b/d3f/f59 250 1 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/294: mkdir d0/d6/d3a/d42/d61/d6a 0 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:7/279: dread - d6/d12/d17/f52 zero size 2024-09-12T18:03:21.445 INFO:tasks.workunit.client.0.smithi052.stdout:4/345: write d11/f16 [961189,125968] 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:8/349: dread fb [0,4194304] 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:5/340: truncate d7/fc 2214852 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/296: getdents d0/d4b/d4c/d3f 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:4/346: dread - d11/d17/d1b/d2a/d6a/f73 zero size 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:5/341: dread - d7/d1f/d34/f48 zero size 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:7/280: symlink d6/d12/d1e/d29/l5f 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:7/281: sync 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:5/342: mknod d7/d1f/d3a/d49/d54/c6e 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:0/298: dread d2/d6/dd/d21/d26/d2f/f33 [0,4194304] 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:4/347: symlink d11/d17/d1b/d2a/l79 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/297: rmdir d0/d4b/d4c/d3f/d48 39 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:1/275: truncate d3/d10/f26 3816993 0 2024-09-12T18:03:21.446 INFO:tasks.workunit.client.0.smithi052.stdout:0/299: fdatasync d2/d6/fb 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:5/343: getdents d7/d59 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:3/298: rename d0/d4b/d5d to d0/d16/d60 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:0/300: fdatasync d2/d6/f4c 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:4/348: mkdir d11/d17/d23/d2f/d3b/d7a 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:3/299: stat d0/d16/d60 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:7/282: link d6/dc/l4c d6/d12/d1e/d29/d32/d3a/l60 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:3/300: readlink d0/d4/l23 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:7/283: stat d6/c8 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:3/301: sync 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:9/295: dwrite d0/d1c/f25 [8388608,4194304] 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:4/349: creat d11/d65/f7b x:0 0 0 2024-09-12T18:03:21.447 INFO:tasks.workunit.client.0.smithi052.stdout:3/302: mknod d0/d16/c61 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:7/284: mknod d6/d56/c61 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:8/350: write d13/d18/d21/f27 [796538,130887] 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:3/303: creat d0/d16/d60/f62 x:0 0 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:7/285: unlink d6/d12/d17/l1f 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:5/344: dwrite d7/d1c/d1e/f52 [0,4194304] 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:0/301: dwrite d2/d6/dd/d21/f56 [0,4194304] 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:1/276: dwrite d3/d1d/d22/f30 [0,4194304] 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:6/414: dread d2/d15/f30 [0,4194304] 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:6/415: sync 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:8/351: mknod d13/d18/c6a 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:4/350: truncate d11/d17/d23/d2f/f31 587893 0 2024-09-12T18:03:21.448 INFO:tasks.workunit.client.0.smithi052.stdout:2/306: dread da/dc/d15/f1f [0,4194304] 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:3/304: creat d0/d4/d25/d2a/d2c/f63 x:0 0 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:0/302: readlink d2/d6/l7 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:8/352: chown d13/d35/c36 238705 1 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:5/345: truncate d7/d1c/f61 317317 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:4/351: chown d11/f15 57230536 1 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:6/416: creat d2/d3f/d5f/f90 x:0 0 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:1/277: symlink d3/d10/d38/l5d 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:9/296: dwrite d0/d18/d37/f4c [0,4194304] 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:7/286: creat d6/f62 x:0 0 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:2/307: write da/dc/d15/f1f [2511176,102031] 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:3/305: rmdir d0/d4/d25/d2a/d6/d41 39 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:6/417: symlink d2/d21/d76/l91 0 2024-09-12T18:03:21.449 INFO:tasks.workunit.client.0.smithi052.stdout:7/287: dread - d6/d12/d17/f52 zero size 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:0/303: creat d2/d6/dd/d21/d26/d2f/f5e x:0 0 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:4/352: symlink d11/d17/d1b/d2a/d32/l7c 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:8/353: rename d13/d18/c1e to d13/c6b 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:0/304: read d2/f29 [951510,101167] 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:7/288: mknod d6/d56/c63 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:4/353: creat d11/d17/d1b/d2a/f7d x:0 0 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:2/308: rmdir da/d21 39 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:8/354: mknod d13/d18/c6c 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:6/418: link d2/f10 d2/d3f/f92 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:0/305: creat d2/d6/dd/d21/f5f x:0 0 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:7/289: mknod d6/c64 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:2/309: readlink da/dc/d15/d36/l57 0 2024-09-12T18:03:21.450 INFO:tasks.workunit.client.0.smithi052.stdout:4/354: mknod d11/d65/d6c/c7e 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:6/419: chown d2/d80/d5b 148950501 1 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:3/306: link d0/d4/d25/d2a/d6/d41/f45 d0/d4b/f64 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:8/355: rename d13/d18/f66 to d13/d3c/f6d 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:9/297: dwrite d0/d1c/f22 [0,4194304] 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:2/310: rmdir da/dc/d15/d22 39 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:1/278: dwrite d3/d1d/d22/d27/d28/f29 [0,4194304] 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:5/346: dwrite d7/d1c/d1e/f36 [0,4194304] 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:6/420: getdents d2/d15 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:5/347: dread - d7/d59/f65 zero size 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:4/355: mkdir d11/d17/d1b/d2a/d6a/d7f 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:6/421: creat d2/d5e/f93 x:0 0 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:2/311: creat da/dc/d15/d22/f66 x:0 0 0 2024-09-12T18:03:21.451 INFO:tasks.workunit.client.0.smithi052.stdout:4/356: stat d11/l3d 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/356: creat d13/d18/d38/f6e x:0 0 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:3/307: link d0/d4/f50 d0/d16/d60/f65 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:1/279: getdents d3/d1d/d22/d3f/d56 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:6/422: creat d2/d3f/d5f/f94 x:0 0 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:6/423: stat d2/f51 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/290: dread d6/dc/f30 [0,4194304] 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/357: write d13/d18/d21/f5d [994978,99001] 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:4/357: rename d11/d17/d1b/f5a to d11/d17/d23/d2f/d47/f80 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:1/280: link d3/d1d/d22/f57 d3/d10/d38/d44/f5e 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/291: fsync d6/dc/fe 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:4/358: readlink d11/d65/l6b 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/358: fdatasync d13/d18/d38/f55 0 2024-09-12T18:03:21.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/359: sync 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:0/306: dread d2/d6/dd/d21/d26/d2f/d3a/f5d [0,4194304] 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:6/424: rename d2/d49/f4b to d2/d21/f95 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:9/298: dwrite d0/fb [4194304,4194304] 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:7/292: chown d6/f62 357260 1 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:1/281: chown d3/d10/d38/f4d 859 1 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:4/359: write d11/d17/f34 [801995,89047] 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:5/348: dwrite d7/d1c/f6c [0,4194304] 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:8/360: link d13/c6b d13/d3c/c6f 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:1/282: creat d3/d1d/d22/d3f/f5f x:0 0 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:4/360: rmdir d11/d17/d23/d2f/d3b 39 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:7/293: link d6/f3c d6/d12/d1e/d29/d5d/f65 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:5/349: mkdir d7/d1c/d6f 0 2024-09-12T18:03:21.453 INFO:tasks.workunit.client.0.smithi052.stdout:9/299: rename d0/d18/d26/c44 to d0/d6/d3a/d42/d61/d6a/c6b 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:8/361: mkdir d13/d18/d5b/d70 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:1/283: truncate d3/f35 717979 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:5/350: mkdir d7/d1c/d67/d70 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:7/294: rename d6/d12/d17/c24 to d6/dc/c66 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:3/308: write d0/d4/d25/d2a/d6/f15 [617644,8622] 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:9/300: write d0/d18/f36 [845231,50151] 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:1/284: rename d3/d10/l12 to d3/d1d/d22/d3f/l60 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:8/362: link d13/d35/c60 d13/d35/c71 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:5/351: symlink d7/d59/d5c/l71 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:9/301: symlink d0/d1c/l6c 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:5/352: readlink d7/d1c/d1e/l2e 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:7/295: creat d6/d12/d1e/d29/f67 x:0 0 0 2024-09-12T18:03:21.454 INFO:tasks.workunit.client.0.smithi052.stdout:3/309: rename d0/d4b/d4c/d3f to d0/d4/d25/d66 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:9/302: unlink d0/d1c/f25 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:7/296: stat d6/c64 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/285: rename d3/d10/d38/d44/l51 to d3/d1d/d22/d3f/d56/l61 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:9/303: truncate d0/d6/d4a/f69 1118430 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:3/310: creat d0/d4/d25/d2a/d2c/f67 x:0 0 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:9/304: read - d0/d18/d26/d4d/d54/f5b zero size 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/286: chown d3/d1d/d22/d27/d28/d2f/c31 471670244 1 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:3/311: mknod d0/d4/d25/d2a/d6/d7/c68 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:9/305: mkdir d0/d58/d6d 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/287: creat d3/d1d/d22/d27/f62 x:0 0 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/288: rmdir d3 39 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:3/312: symlink d0/d4/d25/d66/d48/l69 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:5/353: dwrite d7/d1f/f4b [0,4194304] 0 2024-09-12T18:03:21.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/289: mknod d3/d10/d38/d44/c63 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:3/313: mknod d0/d4b/d4c/c6a 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:5/354: dread - d7/d1c/d1e/f57 zero size 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:1/290: rename d3/d1d/c37 to d3/c64 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:1/291: readlink d3/ld 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/312: dread da/dc/d15/d22/f54 [0,4194304] 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/313: write f3 [1289449,9805] 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/314: fsync da/dc/d15/d43/f59 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:1/292: read d3/d10/f34 [3274751,273] 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:1/293: fsync d3/d10/d38/f4d 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:7/297: truncate d6/d12/d1e/f2c 387665 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:9/306: truncate d0/d23/f2f 3870102 0 2024-09-12T18:03:21.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/315: rmdir da/d1d 39 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:1/294: readlink d3/d1d/d22/d3f/l58 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:2/316: rmdir da 39 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:4/361: dread d11/d17/d23/d2f/f39 [4194304,4194304] 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:0/307: dread d2/d8/fa [0,4194304] 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:3/314: dwrite d0/d4/d33/f3b [0,4194304] 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:2/317: write da/d2c/f3b [2781672,91712] 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:6/425: dread d2/f3a [0,4194304] 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:6/426: read - d2/d49/f7a zero size 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:6/427: truncate d2/d80/f48 1451156 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:4/362: creat d11/d17/d23/d2f/d47/d67/f81 x:0 0 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:9/307: dwrite d0/d23/f31 [0,4194304] 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:2/318: creat da/dc/d15/d43/f67 x:0 0 0 2024-09-12T18:03:21.457 INFO:tasks.workunit.client.0.smithi052.stdout:7/298: rename d6/dc/f25 to d6/d12/d1e/d29/d32/f68 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:0/308: link d2/d6/dd/d21/d41/d44/d48/f4d d2/d6/dd/f60 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:7/299: rmdir d6/d12 39 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:6/428: creat d2/d21/d6a/f96 x:0 0 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:8/363: dread ff [4194304,4194304] 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:5/355: dread d7/f21 [0,4194304] 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:2/319: symlink da/d1d/d35/l68 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:6/429: chown d2/d15/d1a/l6d 115 1 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:5/356: mknod d7/d1c/c72 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:5/357: chown d7/d1f/d45 0 1 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:4/363: rename d11/d17/d23/d2f/d47 to d11/d17/d1b/d2a/d82 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:0/309: truncate d2/d6/dd/d21/d41/d44/f4e 1000560 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:6/430: mkdir d2/d21/d6a/d97 0 2024-09-12T18:03:21.458 INFO:tasks.workunit.client.0.smithi052.stdout:1/295: truncate d3/d1d/d22/d27/d28/f32 4154647 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:8/364: creat d13/d3c/f72 x:0 0 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:0/310: rmdir d2/d1b 39 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:6/431: creat d2/d21/f98 x:0 0 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:6/432: sync 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:3/315: dwrite d0/d4/f47 [4194304,4194304] 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:6/433: sync 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:8/365: symlink d13/d3c/l73 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:4/364: truncate d11/d17/d1b/d2a/f7d 975834 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:8/366: readlink d13/d18/d38/l69 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:2/320: truncate f0 359603 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:3/316: rename d0/d4/d25/d66 to d0/d4b/d4c/d6b 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:7/300: dwrite d6/d12/f15 [0,4194304] 0 2024-09-12T18:03:21.459 INFO:tasks.workunit.client.0.smithi052.stdout:4/365: link d11/d17/d23/d2f/l66 d11/d17/d1b/d42/l83 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:9/308: dread d0/d18/f36 [0,4194304] 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:6/434: dread d2/f51 [0,4194304] 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:2/321: write da/dc/d15/d20/f64 [842905,29838] 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:8/367: link d13/l68 d13/d18/d21/d64/l74 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:4/366: write d11/d17/d1b/d2a/f7d [202522,63748] 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:1/296: write d3/d1d/d22/d27/f5c [12766455,28440] 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:4/367: sync 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:3/317: link d0/d4b/c4e d0/d4/d33/c6c 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:0/311: dwrite d2/d8/f43 [0,4194304] 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:7/301: link d6/d56/l59 d6/d12/l69 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:6/435: creat d2/d3f/f99 x:0 0 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:9/309: getdents d0/d18/d26 0 2024-09-12T18:03:21.460 INFO:tasks.workunit.client.0.smithi052.stdout:7/302: mkdir d6/dc/d1a/d6a 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:3/318: rename d0/d4b/d4c/d39 to d0/d4b/d57/d6d 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:6/436: rmdir d2/d3f/d5f 39 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:9/310: write d0/d6/d3a/f5d [249469,69276] 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:0/312: symlink d2/d6/dd/d21/d47/l61 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:4/368: getdents d11/d17/d1b/d2a/d6a 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:6/437: chown d2/d3f/f99 454365111 1 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:7/303: creat d6/d12/d1e/d29/d32/d3a/f6b x:0 0 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:2/322: creat da/dc/d15/f69 x:0 0 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:9/311: creat d0/d6/d3a/f6e x:0 0 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:4/369: read d11/d17/d23/d2f/d3b/f4e [1292771,52030] 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:8/368: dwrite d13/d18/f51 [0,4194304] 0 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:2/323: dread - da/dc/d15/f69 zero size 2024-09-12T18:03:21.461 INFO:tasks.workunit.client.0.smithi052.stdout:1/297: dwrite d3/d1d/d22/d3f/f45 [0,4194304] 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:4/370: unlink d11/d65/l6b 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:0/313: dwrite d2/d6/dd/d21/d26/f2b [0,4194304] 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:8/369: write d13/d18/f51 [219694,55772] 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:9/312: truncate d0/d23/f2f 4236084 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:3/319: dwrite d0/d4/f47 [4194304,4194304] 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:0/314: chown d2/f29 102 1 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:9/313: read d0/d18/f36 [696382,116740] 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:2/324: mknod da/c6a 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:4/371: mkdir d11/d65/d84 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:9/314: readlink d0/d6/d3a/l3f 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:5/358: dread d7/d1c/d1e/f2b [4194304,4194304] 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:3/320: unlink d0/d4/d25/d2a/d6/d7/de/f37 0 2024-09-12T18:03:21.462 INFO:tasks.workunit.client.0.smithi052.stdout:8/370: creat d13/d18/f75 x:0 0 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:6/438: dwrite d2/d3f/d5f/f90 [0,4194304] 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:2/325: mkdir da/d21/d6b 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:3/321: dread - d0/d4/d25/d2a/d2c/f67 zero size 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:0/315: rmdir d2/d6/dd/d21/d26/d38 39 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:8/371: fdatasync d13/d18/f26 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:6/439: mknod d2/d21/c9a 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:2/326: creat da/d2c/f6c x:0 0 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:0/316: chown d2/d6/dd/d21/f35 648 1 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:8/372: creat d13/d18/d5b/f76 x:0 0 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:6/440: read - d2/d80/d5b/d26/f42 zero size 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:9/315: getdents d0/d6/d4a 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:3/322: getdents d0 0 2024-09-12T18:03:21.463 INFO:tasks.workunit.client.0.smithi052.stdout:2/327: rename da/c6a to da/d21/c6d 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:0/317: readlink d2/d6/dd/d21/d26/d38/l46 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:0/318: sync 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/441: creat d2/d3f/d58/d5d/f9b x:0 0 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:4/372: link d11/f16 d11/d17/d1b/d2a/d82/d67/d68/f85 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/442: fdatasync d2/d49/f7a 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:9/316: chown d0/d6/fd 1117989945 1 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:8/373: link d13/d18/d38/l69 d13/d35/l77 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:3/323: rename d0/c49 to d0/d4/d25/d2a/d6/d7/de/c6e 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:2/328: mkdir da/dc/d15/d20/d60/d6e 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:5/359: dwrite f4 [0,4194304] 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:0/319: symlink d2/d1b/l62 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:8/374: symlink d13/d3c/l78 0 2024-09-12T18:03:21.464 INFO:tasks.workunit.client.0.smithi052.stdout:9/317: write d0/d18/d26/d33/f62 [629862,84346] 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:8/375: stat d13/c32 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:4/373: truncate d11/d17/d1b/d2a/d82/f80 604722 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:2/329: write da/dc/d15/d43/f67 [125363,127701] 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:8/376: unlink d13/d35/f53 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:0/320: fdatasync d2/d6/dd/f39 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:4/374: stat d11/d17/d23/d2f/c64 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:2/330: creat da/d1d/d35/f6f x:0 0 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:3/324: write d0/d4b/d4c/f58 [833695,109481] 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:0/321: mknod d2/d1b/c63 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:7/304: dread d6/d12/d1e/d29/d32/f68 [0,4194304] 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:2/331: write da/d2c/f52 [663659,67078] 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:8/377: mknod d13/d18/d21/d64/c79 0 2024-09-12T18:03:21.465 INFO:tasks.workunit.client.0.smithi052.stdout:6/443: dread d2/d3f/f92 [0,4194304] 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:2/332: dread - da/dc/f5e zero size 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:8/378: mkdir d13/d18/d38/d7a 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:4/375: truncate d11/d17/d1b/d2a/d6a/f73 121135 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:3/325: chown d0/d4/d33/f3b 246022595 1 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:7/305: rename d6/d12/d1e/d29/d32 to d6/dc/d1a/d6c 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:0/322: dread d2/d6/dd/d21/d41/d44/d48/f4d [0,4194304] 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:4/376: mknod d11/d17/d1b/d2a/d32/c86 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:4/377: sync 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:9/318: dread d0/d18/d26/f46 [0,4194304] 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:3/326: mkdir d0/d4/d25/d2a/d6/d41/d6f 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:7/306: creat d6/d12/d1e/f6d x:0 0 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:5/360: dwrite d7/d1f/d3a/d49/f5a [0,4194304] 0 2024-09-12T18:03:21.466 INFO:tasks.workunit.client.0.smithi052.stdout:9/319: write d0/d6/fd [5306272,8897] 0 2024-09-12T18:03:21.467 INFO:tasks.workunit.client.0.smithi052.stdout:4/378: stat d11/d17/d23/d2f/d3b/d3f/f59 0 2024-09-12T18:03:21.467 INFO:tasks.workunit.client.0.smithi052.stdout:5/361: readlink d7/l43 0 2024-09-12T18:03:21.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/379: read d13/d18/d21/f27 [2045219,60928] 0 2024-09-12T18:03:21.467 INFO:tasks.workunit.client.0.smithi052.stdout:0/323: fdatasync d2/d8/fa 0 2024-09-12T18:03:21.467 INFO:tasks.workunit.client.0.smithi052.stdout:3/327: unlink d0/d4/l8 0 2024-09-12T18:03:21.467 INFO:tasks.workunit.client.0.smithi052.stdout:7/307: rename d6/dc/d4f to d6/dc/d6e 0 2024-09-12T18:03:21.470 INFO:tasks.workunit.client.0.smithi052.stdout:7/308: fdatasync d6/f62 0 2024-09-12T18:03:21.470 INFO:tasks.workunit.client.0.smithi052.stdout:5/362: creat d7/d1f/d3a/d49/f73 x:0 0 0 2024-09-12T18:03:21.470 INFO:tasks.workunit.client.0.smithi052.stdout:1/298: dread d3/d1d/d22/d27/f4f [4194304,4194304] 0 2024-09-12T18:03:21.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/380: symlink d13/d18/d38/d7a/l7b 0 2024-09-12T18:03:21.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/381: read d13/d18/f26 [3528202,122251] 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:2/333: dwrite f0 [0,4194304] 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:8/382: creat d13/d35/f7c x:0 0 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:6/444: truncate d2/d80/f48 384623 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:3/328: dwrite d0/d4b/d4c/f36 [4194304,4194304] 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:9/320: write d0/d1c/f20 [5074117,4806] 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:5/363: truncate d7/f8 1734499 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:8/383: link d13/d18/d21/c4a d13/d18/d38/c7d 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:8/384: fsync d13/d3c/f3d 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:4/379: dwrite d11/d17/d1b/f2d [4194304,4194304] 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:5/364: read d7/f19 [1684702,5387] 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:3/329: getdents d0/d16 0 2024-09-12T18:03:21.471 INFO:tasks.workunit.client.0.smithi052.stdout:4/380: fdatasync d11/f1f 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/385: write d13/d18/d38/f5f [353738,62172] 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:4/381: readlink d11/d17/d23/d2f/l26 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:5/365: truncate d7/d1c/d1e/f64 608486 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/321: unlink d0/d6/d3a/f5c 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:6/445: rename d2/d80/d5b to d2/d3f/d58/d5d/d9c 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:3/330: symlink d0/d4b/l70 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:5/366: write d7/d1c/d1e/f44 [1116848,87300] 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/322: creat d0/d6/d4a/f6f x:0 0 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/386: mkdir d13/d7e 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/387: stat d13/d3c/f6d 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:5/367: rename d7/d1c/c23 to d7/d1c/c74 0 2024-09-12T18:03:21.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/323: symlink d0/d34/l70 0 2024-09-12T18:03:21.473 INFO:tasks.workunit.client.0.smithi052.stdout:3/331: getdents d0/d4/d33 0 2024-09-12T18:03:21.473 INFO:tasks.workunit.client.0.smithi052.stdout:5/368: unlink d7/d1f/f2c 0 2024-09-12T18:03:21.473 INFO:tasks.workunit.client.0.smithi052.stdout:8/388: write ff [7761544,98338] 0 2024-09-12T18:03:21.473 INFO:tasks.workunit.client.0.smithi052.stdout:9/324: symlink d0/d18/d26/d4d/d54/l71 0 2024-09-12T18:03:21.473 INFO:tasks.workunit.client.0.smithi052.stdout:8/389: unlink d13/d18/d38/f5f 0 2024-09-12T18:03:21.473 INFO:tasks.workunit.client.0.smithi052.stdout:4/382: dwrite d11/d17/d23/d2f/f3a [0,4194304] 0 2024-09-12T18:03:21.474 INFO:tasks.workunit.client.0.smithi052.stdout:6/446: dwrite d2/d15/f22 [0,4194304] 0 2024-09-12T18:03:21.474 INFO:tasks.workunit.client.0.smithi052.stdout:4/383: getdents d11/d65/d84 0 2024-09-12T18:03:21.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/390: write d13/d3c/f6d [75810,29710] 0 2024-09-12T18:03:21.474 INFO:tasks.workunit.client.0.smithi052.stdout:6/447: rmdir d2/d3f 39 2024-09-12T18:03:21.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/391: dread - d13/d35/f7c zero size 2024-09-12T18:03:21.474 INFO:tasks.workunit.client.0.smithi052.stdout:7/309: dread d6/dc/d1a/d6c/d3a/f3d [0,4194304] 0 2024-09-12T18:03:21.475 INFO:tasks.workunit.client.0.smithi052.stdout:5/369: dread d7/d1f/d3a/d49/f5a [0,4194304] 0 2024-09-12T18:03:21.476 INFO:tasks.workunit.client.0.smithi052.stdout:2/334: dread da/dc/f2b [0,4194304] 0 2024-09-12T18:03:21.477 INFO:tasks.workunit.client.0.smithi052.stdout:6/448: unlink d2/d15/d1a/c59 0 2024-09-12T18:03:21.477 INFO:tasks.workunit.client.0.smithi052.stdout:7/310: unlink d6/d12/d1e/d29/l41 0 2024-09-12T18:03:21.477 INFO:tasks.workunit.client.0.smithi052.stdout:8/392: truncate d13/d18/d21/f28 617296 0 2024-09-12T18:03:21.477 INFO:tasks.workunit.client.0.smithi052.stdout:9/325: dwrite d0/d18/f40 [0,4194304] 0 2024-09-12T18:03:21.479 INFO:tasks.workunit.client.0.smithi052.stdout:0/324: dread d2/d6/dd/d21/d26/d38/f3f [0,4194304] 0 2024-09-12T18:03:21.479 INFO:tasks.workunit.client.0.smithi052.stdout:7/311: chown d6/dc/f50 230297 1 2024-09-12T18:03:21.482 INFO:tasks.workunit.client.0.smithi052.stdout:6/449: link d2/d80/f8c d2/d5e/f9d 0 2024-09-12T18:03:21.483 INFO:tasks.workunit.client.0.smithi052.stdout:5/370: dread d7/f19 [0,4194304] 0 2024-09-12T18:03:21.483 INFO:tasks.workunit.client.0.smithi052.stdout:1/299: dread d3/f25 [0,4194304] 0 2024-09-12T18:03:21.485 INFO:tasks.workunit.client.0.smithi052.stdout:1/300: write d3/d1d/d22/d27/f50 [869903,88899] 0 2024-09-12T18:03:21.485 INFO:tasks.workunit.client.0.smithi052.stdout:1/301: sync 2024-09-12T18:03:21.486 INFO:tasks.workunit.client.0.smithi052.stdout:2/335: dwrite da/dc/d15/d20/f64 [0,4194304] 0 2024-09-12T18:03:21.486 INFO:tasks.workunit.client.0.smithi052.stdout:8/393: read d13/d3c/f5a [281250,32123] 0 2024-09-12T18:03:21.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/371: symlink d7/l75 0 2024-09-12T18:03:21.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/302: mknod d3/d1d/d22/d27/d28/d2f/c65 0 2024-09-12T18:03:21.489 INFO:tasks.workunit.client.0.smithi052.stdout:8/394: stat l12 0 2024-09-12T18:03:21.490 INFO:tasks.workunit.client.0.smithi052.stdout:2/336: creat da/dc/d15/d20/d60/f70 x:0 0 0 2024-09-12T18:03:21.490 INFO:tasks.workunit.client.0.smithi052.stdout:9/326: dwrite d0/f1a [0,4194304] 0 2024-09-12T18:03:21.490 INFO:tasks.workunit.client.0.smithi052.stdout:8/395: creat d13/d18/f7f x:0 0 0 2024-09-12T18:03:21.492 INFO:tasks.workunit.client.0.smithi052.stdout:7/312: dwrite d6/dc/f50 [0,4194304] 0 2024-09-12T18:03:21.492 INFO:tasks.workunit.client.0.smithi052.stdout:1/303: truncate d3/d10/f33 376402 0 2024-09-12T18:03:21.492 INFO:tasks.workunit.client.0.smithi052.stdout:5/372: write d7/d59/f65 [1035574,93390] 0 2024-09-12T18:03:21.494 INFO:tasks.workunit.client.0.smithi052.stdout:2/337: write da/dc/d15/d43/f67 [563981,123106] 0 2024-09-12T18:03:21.495 INFO:tasks.workunit.client.0.smithi052.stdout:3/332: dread d0/d4/d25/d2a/f32 [0,4194304] 0 2024-09-12T18:03:21.496 INFO:tasks.workunit.client.0.smithi052.stdout:0/325: dwrite d2/d6/dd/d21/d26/d2f/f4b [4194304,4194304] 0 2024-09-12T18:03:21.496 INFO:tasks.workunit.client.0.smithi052.stdout:8/396: rename d13/d18/d38/d7a/l7b to d13/d7e/l80 0 2024-09-12T18:03:21.496 INFO:tasks.workunit.client.0.smithi052.stdout:7/313: creat d6/d12/d1e/f6f x:0 0 0 2024-09-12T18:03:21.496 INFO:tasks.workunit.client.0.smithi052.stdout:1/304: mkdir d3/d1d/d22/d66 0 2024-09-12T18:03:21.497 INFO:tasks.workunit.client.0.smithi052.stdout:3/333: mkdir d0/d4/d25/d2a/d6/d7/d34/d71 0 2024-09-12T18:03:21.497 INFO:tasks.workunit.client.0.smithi052.stdout:2/338: chown da/dc/c27 6241 1 2024-09-12T18:03:21.497 INFO:tasks.workunit.client.0.smithi052.stdout:3/334: readlink d0/d4b/d4c/l1a 0 2024-09-12T18:03:21.498 INFO:tasks.workunit.client.0.smithi052.stdout:8/397: creat d13/d18/d5b/d70/f81 x:0 0 0 2024-09-12T18:03:21.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/327: dread d0/f1a [0,4194304] 0 2024-09-12T18:03:21.498 INFO:tasks.workunit.client.0.smithi052.stdout:1/305: unlink d3/d1d/d22/d3f/l4b 0 2024-09-12T18:03:21.499 INFO:tasks.workunit.client.0.smithi052.stdout:0/326: write d2/d6/dd/d21/d26/d2f/f4b [11537479,36944] 0 2024-09-12T18:03:21.499 INFO:tasks.workunit.client.0.smithi052.stdout:7/314: getdents d6/dc/d6e 0 2024-09-12T18:03:21.499 INFO:tasks.workunit.client.0.smithi052.stdout:2/339: mkdir da/d71 0 2024-09-12T18:03:21.499 INFO:tasks.workunit.client.0.smithi052.stdout:3/335: read - d0/d4/d25/d2a/d2c/f63 zero size 2024-09-12T18:03:21.500 INFO:tasks.workunit.client.0.smithi052.stdout:2/340: fsync da/dc/f5e 0 2024-09-12T18:03:21.500 INFO:tasks.workunit.client.0.smithi052.stdout:9/328: rmdir d0/d58/d6d 0 2024-09-12T18:03:21.500 INFO:tasks.workunit.client.0.smithi052.stdout:7/315: mknod d6/dc/d1a/c70 0 2024-09-12T18:03:21.500 INFO:tasks.workunit.client.0.smithi052.stdout:6/450: truncate d2/d21/f95 809481 0 2024-09-12T18:03:21.501 INFO:tasks.workunit.client.0.smithi052.stdout:0/327: creat d2/d57/d5b/f64 x:0 0 0 2024-09-12T18:03:21.501 INFO:tasks.workunit.client.0.smithi052.stdout:8/398: write d13/d18/d38/f46 [2278856,16410] 0 2024-09-12T18:03:21.501 INFO:tasks.workunit.client.0.smithi052.stdout:2/341: creat da/dc/d15/d43/f72 x:0 0 0 2024-09-12T18:03:21.501 INFO:tasks.workunit.client.0.smithi052.stdout:3/336: mkdir d0/d4/d25/d2a/d6/d7/d34/d72 0 2024-09-12T18:03:21.501 INFO:tasks.workunit.client.0.smithi052.stdout:0/328: chown d2/d8/fa 357995 1 2024-09-12T18:03:21.502 INFO:tasks.workunit.client.0.smithi052.stdout:2/342: stat da/d21/c6d 0 2024-09-12T18:03:21.502 INFO:tasks.workunit.client.0.smithi052.stdout:8/399: mknod d13/d18/d38/c82 0 2024-09-12T18:03:21.502 INFO:tasks.workunit.client.0.smithi052.stdout:3/337: creat d0/d4/d33/f73 x:0 0 0 2024-09-12T18:03:21.503 INFO:tasks.workunit.client.0.smithi052.stdout:7/316: rename d6/dc/d1a/d6c to d6/d12/d1e/d29/d5d/d71 0 2024-09-12T18:03:21.503 INFO:tasks.workunit.client.0.smithi052.stdout:7/317: sync 2024-09-12T18:03:21.503 INFO:tasks.workunit.client.0.smithi052.stdout:8/400: unlink d13/d18/d21/l56 0 2024-09-12T18:03:21.503 INFO:tasks.workunit.client.0.smithi052.stdout:2/343: link da/f13 da/d71/f73 0 2024-09-12T18:03:21.505 INFO:tasks.workunit.client.0.smithi052.stdout:2/344: symlink da/dc/d15/d20/d60/d6e/l74 0 2024-09-12T18:03:21.506 INFO:tasks.workunit.client.0.smithi052.stdout:2/345: chown da/c11 4 1 2024-09-12T18:03:21.507 INFO:tasks.workunit.client.0.smithi052.stdout:0/329: dread d2/d8/f43 [0,4194304] 0 2024-09-12T18:03:21.507 INFO:tasks.workunit.client.0.smithi052.stdout:2/346: mknod da/d21/d6b/c75 0 2024-09-12T18:03:21.508 INFO:tasks.workunit.client.0.smithi052.stdout:2/347: mkdir da/dc/d76 0 2024-09-12T18:03:21.509 INFO:tasks.workunit.client.0.smithi052.stdout:0/330: mkdir d2/d6/dd/d21/d26/d65 0 2024-09-12T18:03:21.509 INFO:tasks.workunit.client.0.smithi052.stdout:2/348: symlink da/d1d/d35/l77 0 2024-09-12T18:03:21.510 INFO:tasks.workunit.client.0.smithi052.stdout:2/349: chown da/d2c 149323 1 2024-09-12T18:03:21.510 INFO:tasks.workunit.client.0.smithi052.stdout:3/338: dwrite d0/d4/d25/d2a/f32 [4194304,4194304] 0 2024-09-12T18:03:21.511 INFO:tasks.workunit.client.0.smithi052.stdout:3/339: readlink d0/d4b/d4c/l29 0 2024-09-12T18:03:21.514 INFO:tasks.workunit.client.0.smithi052.stdout:9/329: truncate d0/d6/fd 991396 0 2024-09-12T18:03:21.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/318: truncate d6/dc/f2e 2637967 0 2024-09-12T18:03:21.516 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:21.511+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:21.516 INFO:tasks.workunit.client.0.smithi052.stdout:9/330: mkdir d0/d34/d72 0 2024-09-12T18:03:21.518 INFO:tasks.workunit.client.0.smithi052.stdout:4/384: dread d11/f21 [0,4194304] 0 2024-09-12T18:03:21.520 INFO:tasks.workunit.client.0.smithi052.stdout:2/350: dwrite da/dc/d15/f3e [0,4194304] 0 2024-09-12T18:03:21.521 INFO:tasks.workunit.client.0.smithi052.stdout:7/319: creat d6/dc/d1a/d6a/f72 x:0 0 0 2024-09-12T18:03:21.521 INFO:tasks.workunit.client.0.smithi052.stdout:0/331: write d2/d6/dd/f39 [399956,20962] 0 2024-09-12T18:03:21.521 INFO:tasks.workunit.client.0.smithi052.stdout:5/373: dwrite d7/ff [0,4194304] 0 2024-09-12T18:03:21.522 INFO:tasks.workunit.client.0.smithi052.stdout:3/340: dwrite d0/d16/d60/f62 [0,4194304] 0 2024-09-12T18:03:21.522 INFO:tasks.workunit.client.0.smithi052.stdout:2/351: chown da/dc/d15/d20/d60/f70 1601 1 2024-09-12T18:03:21.523 INFO:tasks.workunit.client.0.smithi052.stdout:2/352: write da/d1d/d35/f33 [777262,126200] 0 2024-09-12T18:03:21.524 INFO:tasks.workunit.client.0.smithi052.stdout:7/320: creat d6/d12/f73 x:0 0 0 2024-09-12T18:03:21.525 INFO:tasks.workunit.client.0.smithi052.stdout:9/331: write d0/d23/f2f [4540972,54207] 0 2024-09-12T18:03:21.526 INFO:tasks.workunit.client.0.smithi052.stdout:2/353: fdatasync da/d2c/f6c 0 2024-09-12T18:03:21.528 INFO:tasks.workunit.client.0.smithi052.stdout:9/332: creat d0/d34/f73 x:0 0 0 2024-09-12T18:03:21.528 INFO:tasks.workunit.client.0.smithi052.stdout:3/341: creat d0/d4/d25/d2a/d6/d7/f74 x:0 0 0 2024-09-12T18:03:21.529 INFO:tasks.workunit.client.0.smithi052.stdout:8/401: dread d13/d3c/f5a [0,4194304] 0 2024-09-12T18:03:21.529 INFO:tasks.workunit.client.0.smithi052.stdout:2/354: chown da/dc/d15/d20/f4f 106630456 1 2024-09-12T18:03:21.530 INFO:tasks.workunit.client.0.smithi052.stdout:9/333: mkdir d0/d6/d3a/d43/d74 0 2024-09-12T18:03:21.530 INFO:tasks.workunit.client.0.smithi052.stdout:8/402: creat d13/d18/d21/d64/f83 x:0 0 0 2024-09-12T18:03:21.531 INFO:tasks.workunit.client.0.smithi052.stdout:6/451: dread d2/d21/f65 [0,4194304] 0 2024-09-12T18:03:21.531 INFO:tasks.workunit.client.0.smithi052.stdout:5/374: rename d7/d1c/d1e/f57 to d7/d1f/f76 0 2024-09-12T18:03:21.532 INFO:tasks.workunit.client.0.smithi052.stdout:9/334: write d0/d1c/f22 [298151,105947] 0 2024-09-12T18:03:21.532 INFO:tasks.workunit.client.0.smithi052.stdout:8/403: symlink d13/d3c/l84 0 2024-09-12T18:03:21.532 INFO:tasks.workunit.client.0.smithi052.stdout:2/355: getdents da/dc/d15/d36 0 2024-09-12T18:03:21.533 INFO:tasks.workunit.client.0.smithi052.stdout:0/332: dread d2/d6/dd/d21/d26/f40 [0,4194304] 0 2024-09-12T18:03:21.534 INFO:tasks.workunit.client.0.smithi052.stdout:2/356: unlink da/d21/l41 0 2024-09-12T18:03:21.535 INFO:tasks.workunit.client.0.smithi052.stdout:0/333: creat d2/d6/dd/d21/d26/f66 x:0 0 0 2024-09-12T18:03:21.536 INFO:tasks.workunit.client.0.smithi052.stdout:2/357: read da/d21/f4a [1401747,103241] 0 2024-09-12T18:03:21.536 INFO:tasks.workunit.client.0.smithi052.stdout:4/385: truncate d11/d17/d1b/d2a/d82/f53 720008 0 2024-09-12T18:03:21.538 INFO:tasks.workunit.client.0.smithi052.stdout:4/386: unlink d11/d17/f34 0 2024-09-12T18:03:21.538 INFO:tasks.workunit.client.0.smithi052.stdout:1/306: dread d3/d10/f34 [0,4194304] 0 2024-09-12T18:03:21.539 INFO:tasks.workunit.client.0.smithi052.stdout:1/307: chown d3/d1d/d22/d27/f62 1 1 2024-09-12T18:03:21.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/308: chown d3/d10/d38/l5d 4 1 2024-09-12T18:03:21.541 INFO:tasks.workunit.client.0.smithi052.stdout:9/335: dwrite d0/d18/f36 [0,4194304] 0 2024-09-12T18:03:21.541 INFO:tasks.workunit.client.0.smithi052.stdout:1/309: mkdir d3/d1d/d22/d27/d67 0 2024-09-12T18:03:21.542 INFO:tasks.workunit.client.0.smithi052.stdout:9/336: rename d0/d6/c14 to d0/d34/c75 0 2024-09-12T18:03:21.543 INFO:tasks.workunit.client.0.smithi052.stdout:7/321: write d6/f3c [934308,110870] 0 2024-09-12T18:03:21.543 INFO:tasks.workunit.client.0.smithi052.stdout:1/310: write d3/d10/f34 [1505288,106415] 0 2024-09-12T18:03:21.543 INFO:tasks.workunit.client.0.smithi052.stdout:2/358: truncate f8 3934414 0 2024-09-12T18:03:21.544 INFO:tasks.workunit.client.0.smithi052.stdout:5/375: chown d7/d1f/d34/l63 56484 1 2024-09-12T18:03:21.545 INFO:tasks.workunit.client.0.smithi052.stdout:7/322: dread - d6/f5a zero size 2024-09-12T18:03:21.545 INFO:tasks.workunit.client.0.smithi052.stdout:9/337: creat d0/d6/d3a/d42/f76 x:0 0 0 2024-09-12T18:03:21.546 INFO:tasks.workunit.client.0.smithi052.stdout:2/359: mknod da/dc/d15/d43/c78 0 2024-09-12T18:03:21.549 INFO:tasks.workunit.client.0.smithi052.stdout:7/323: fsync d6/dc/f2f 0 2024-09-12T18:03:21.549 INFO:tasks.workunit.client.0.smithi052.stdout:2/360: fdatasync da/d1d/d35/f6f 0 2024-09-12T18:03:21.549 INFO:tasks.workunit.client.0.smithi052.stdout:4/387: write d11/d17/d1b/d2a/d82/d67/d68/f85 [2465650,70594] 0 2024-09-12T18:03:21.551 INFO:tasks.workunit.client.0.smithi052.stdout:2/361: chown da/dc/d15/d43/c78 7 1 2024-09-12T18:03:21.555 INFO:tasks.workunit.client.0.smithi052.stdout:3/342: dread d0/d16/d60/f65 [0,4194304] 0 2024-09-12T18:03:21.556 INFO:tasks.workunit.client.0.smithi052.stdout:3/343: write d0/d4b/d4c/d6b/d48/f56 [199797,55934] 0 2024-09-12T18:03:21.558 INFO:tasks.workunit.client.0.smithi052.stdout:8/404: dread d13/d18/d38/f46 [0,4194304] 0 2024-09-12T18:03:21.559 INFO:tasks.workunit.client.0.smithi052.stdout:3/344: truncate d0/d4/d25/d2a/d6/d41/f45 427095 0 2024-09-12T18:03:21.559 INFO:tasks.workunit.client.0.smithi052.stdout:0/334: dread d2/f31 [0,4194304] 0 2024-09-12T18:03:21.559 INFO:tasks.workunit.client.0.smithi052.stdout:8/405: fsync d13/d3c/f72 0 2024-09-12T18:03:21.560 INFO:tasks.workunit.client.0.smithi052.stdout:0/335: write d2/d8/f20 [5228081,88089] 0 2024-09-12T18:03:21.560 INFO:tasks.workunit.client.0.smithi052.stdout:6/452: dread d2/d3f/d5f/f85 [0,4194304] 0 2024-09-12T18:03:21.561 INFO:tasks.workunit.client.0.smithi052.stdout:0/336: chown d2/d6/dd/d21/d47 10950960 1 2024-09-12T18:03:21.561 INFO:tasks.workunit.client.0.smithi052.stdout:5/376: rmdir d7/d1c/d67/d70 0 2024-09-12T18:03:21.561 INFO:tasks.workunit.client.0.smithi052.stdout:1/311: rename d3/d10/d38/d44/f5e to d3/d10/d38/f68 0 2024-09-12T18:03:21.562 INFO:tasks.workunit.client.0.smithi052.stdout:6/453: mknod d2/d15/c9e 0 2024-09-12T18:03:21.562 INFO:tasks.workunit.client.0.smithi052.stdout:4/388: link d11/d17/d1b/f5b d11/d17/d1b/d2a/d82/d67/f87 0 2024-09-12T18:03:21.562 INFO:tasks.workunit.client.0.smithi052.stdout:7/324: rmdir d6/dc/d6e 0 2024-09-12T18:03:21.562 INFO:tasks.workunit.client.0.smithi052.stdout:9/338: rename d0/f8 to d0/d6/d3a/d43/d74/f77 0 2024-09-12T18:03:21.563 INFO:tasks.workunit.client.0.smithi052.stdout:8/406: rename d13/d18/d21/f48 to d13/d35/f85 0 2024-09-12T18:03:21.563 INFO:tasks.workunit.client.0.smithi052.stdout:0/337: creat d2/d6/dd/d21/d47/f67 x:0 0 0 2024-09-12T18:03:21.563 INFO:tasks.workunit.client.0.smithi052.stdout:6/454: truncate d2/d5e/f9d 719299 0 2024-09-12T18:03:21.563 INFO:tasks.workunit.client.0.smithi052.stdout:3/345: rename d0/d4/d25/d2a/d6 to d0/d4/d25/d2a/d6/d7/d34/d72/d75 22 2024-09-12T18:03:21.563 INFO:tasks.workunit.client.0.smithi052.stdout:6/455: dread - d2/f70 zero size 2024-09-12T18:03:21.564 INFO:tasks.workunit.client.0.smithi052.stdout:8/407: truncate d13/d18/d5b/f63 1796231 0 2024-09-12T18:03:21.564 INFO:tasks.workunit.client.0.smithi052.stdout:3/346: write d0/d4/d25/d2a/d2c/f67 [313308,23653] 0 2024-09-12T18:03:21.565 INFO:tasks.workunit.client.0.smithi052.stdout:8/408: dread - d13/d18/d21/f54 zero size 2024-09-12T18:03:21.565 INFO:tasks.workunit.client.0.smithi052.stdout:3/347: fsync d0/d4/d33/f73 0 2024-09-12T18:03:21.567 INFO:tasks.workunit.client.0.smithi052.stdout:5/377: dwrite d7/d1c/f3f [4194304,4194304] 0 2024-09-12T18:03:21.568 INFO:tasks.workunit.client.0.smithi052.stdout:7/325: dread d6/dc/f2f [0,4194304] 0 2024-09-12T18:03:21.568 INFO:tasks.workunit.client.0.smithi052.stdout:2/362: link da/dc/d15/f1c da/dc/d15/f79 0 2024-09-12T18:03:21.568 INFO:tasks.workunit.client.0.smithi052.stdout:9/339: creat d0/d6/d3a/d43/f78 x:0 0 0 2024-09-12T18:03:21.568 INFO:tasks.workunit.client.0.smithi052.stdout:0/338: mknod d2/d57/c68 0 2024-09-12T18:03:21.568 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:21.568 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:1090 3.13 3:cb3d3880:::200.0000000d:head [write 1110868~1766298 [fadvise_dontneed] in=1766298b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.566726+0000", 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0029034569999999999, 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029237099999999999, 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.566726+0000", 2024-09-12T18:03:21.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.566726+0000", 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.566731+0000", 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8500000000000002e-06 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.568357+0000", 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016256 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.568371+0000", 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4793e-05 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.568379+0000", 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2350000000000002e-06 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:21.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.568452+0000", 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3279000000000001e-05 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.568560+0000", 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010844300000000001 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.568714+0000", 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015398300000000001 2024-09-12T18:03:21.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:21.573 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:21.573 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:21.573 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:21.573 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:03:21.573 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-09-12T18:03:21.573 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:4/389: rename d11/d17/d1b/d2a/l5c to d11/d17/d1b/d2a/d6a/d7f/l88 0 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:6/456: mkdir d2/d21/d9f 0 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:8/409: rename d13/d18/l4b to d13/d18/d21/l86 0 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:2/363: mkdir da/d1d/d35/d7a 0 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:3/348: mknod d0/d4b/d4c/c76 0 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:7/326: chown d6/d12/d1e/d29/d5d/d71/d3a/l44 5739279 1 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:4/390: chown d11/d17/d1b/d2a/c30 3 1 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:8/410: dread - d13/d18/d38/f6e zero size 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:9/340: rename d0/d23 to d0/d18/d79 0 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:3/349: chown d0/c21 194 1 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:9/341: creat d0/d6/d3a/d43/f7a x:0 0 0 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:8/411: truncate d13/d18/d21/f41 703229 0 2024-09-12T18:03:21.575 INFO:tasks.workunit.client.0.smithi052.stdout:4/391: rename f10 to d11/d17/d23/d2f/d3b/d6f/f89 0 2024-09-12T18:03:21.576 INFO:tasks.workunit.client.0.smithi052.stdout:7/327: getdents d6/d56 0 2024-09-12T18:03:21.576 INFO:tasks.workunit.client.0.smithi052.stdout:7/328: fsync d6/d12/f47 0 2024-09-12T18:03:21.576 INFO:tasks.workunit.client.0.smithi052.stdout:3/350: creat d0/d4b/d57/d6d/f77 x:0 0 0 2024-09-12T18:03:21.576 INFO:tasks.workunit.client.0.smithi052.stdout:8/412: mknod d13/d18/d21/c87 0 2024-09-12T18:03:21.576 INFO:tasks.workunit.client.0.smithi052.stdout:2/364: rename da/d2c/f6c to da/d1d/f7b 0 2024-09-12T18:03:21.576 INFO:tasks.workunit.client.0.smithi052.stdout:4/392: creat d11/d17/f8a x:0 0 0 2024-09-12T18:03:21.576 INFO:tasks.workunit.client.0.smithi052.stdout:8/413: rmdir d13/d35 39 2024-09-12T18:03:21.577 INFO:tasks.workunit.client.0.smithi052.stdout:4/393: creat d11/f8b x:0 0 0 2024-09-12T18:03:21.577 INFO:tasks.workunit.client.0.smithi052.stdout:7/329: read d6/dc/fe [842907,112815] 0 2024-09-12T18:03:21.577 INFO:tasks.workunit.client.0.smithi052.stdout:8/414: dread - d13/f4e zero size 2024-09-12T18:03:21.577 INFO:tasks.workunit.client.0.smithi052.stdout:2/365: rmdir da/dc/d15/d20 39 2024-09-12T18:03:21.577 INFO:tasks.workunit.client.0.smithi052.stdout:3/351: rename d0/d4/d33/c6c to d0/d4b/d57/d6d/c78 0 2024-09-12T18:03:21.577 INFO:tasks.workunit.client.0.smithi052.stdout:9/342: dread d0/d18/f36 [0,4194304] 0 2024-09-12T18:03:21.577 INFO:tasks.workunit.client.0.smithi052.stdout:0/339: dwrite d2/d6/dd/d21/f35 [0,4194304] 0 2024-09-12T18:03:21.577 INFO:tasks.workunit.client.0.smithi052.stdout:8/415: mknod d13/d18/d5b/c88 0 2024-09-12T18:03:21.578 INFO:tasks.workunit.client.0.smithi052.stdout:4/394: creat d11/d17/d1b/d2a/d33/f8c x:0 0 0 2024-09-12T18:03:21.578 INFO:tasks.workunit.client.0.smithi052.stdout:7/330: write d6/d12/d1e/d29/d5d/d71/d3a/f53 [170551,67940] 0 2024-09-12T18:03:21.578 INFO:tasks.workunit.client.0.smithi052.stdout:2/366: creat da/dc/d15/d20/d60/f7c x:0 0 0 2024-09-12T18:03:21.579 INFO:tasks.workunit.client.0.smithi052.stdout:8/416: truncate d13/d18/d38/f6e 473497 0 2024-09-12T18:03:21.579 INFO:tasks.workunit.client.0.smithi052.stdout:2/367: dread - da/dc/d15/d43/f59 zero size 2024-09-12T18:03:21.579 INFO:tasks.workunit.client.0.smithi052.stdout:9/343: truncate d0/d18/d26/d4d/d54/f5b 600639 0 2024-09-12T18:03:21.583 INFO:tasks.workunit.client.0.smithi052.stdout:3/352: mkdir d0/d4/d25/d2a/d6/d7/d79 0 2024-09-12T18:03:21.583 INFO:tasks.workunit.client.0.smithi052.stdout:4/395: creat d11/d46/f8d x:0 0 0 2024-09-12T18:03:21.585 INFO:tasks.workunit.client.0.smithi052.stdout:8/417: symlink d13/d7e/l89 0 2024-09-12T18:03:21.587 INFO:tasks.workunit.client.0.smithi052.stdout:9/344: dread d0/d18/f36 [0,4194304] 0 2024-09-12T18:03:21.587 INFO:tasks.workunit.client.0.smithi052.stdout:8/418: write d13/f4e [364316,91707] 0 2024-09-12T18:03:21.587 INFO:tasks.workunit.client.0.smithi052.stdout:3/353: dread - d0/d4/d25/d2a/d2c/f63 zero size 2024-09-12T18:03:21.589 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:21.592 INFO:tasks.workunit.client.0.smithi052.stdout:7/331: link d6/dc/d1a/d6a/f72 d6/d12/d17/f74 0 2024-09-12T18:03:21.593 INFO:tasks.workunit.client.0.smithi052.stdout:2/368: fsync da/dc/d15/f3c 0 2024-09-12T18:03:21.594 INFO:tasks.workunit.client.0.smithi052.stdout:3/354: mkdir d0/d4b/d57/d7a 0 2024-09-12T18:03:21.594 INFO:tasks.workunit.client.0.smithi052.stdout:1/312: dread d3/d1d/d22/d27/d28/f32 [0,4194304] 0 2024-09-12T18:03:21.597 INFO:tasks.workunit.client.0.smithi052.stdout:6/457: getdents d2/d21 0 2024-09-12T18:03:21.597 INFO:tasks.workunit.client.0.smithi052.stdout:5/378: truncate d7/d1c/d1e/f52 39698 0 2024-09-12T18:03:21.598 INFO:tasks.workunit.client.0.smithi052.stdout:4/396: truncate d11/d17/d23/d2f/f39 8236800 0 2024-09-12T18:03:21.598 INFO:tasks.workunit.client.0.smithi052.stdout:3/355: creat d0/d4b/d57/d6d/f7b x:0 0 0 2024-09-12T18:03:21.599 INFO:tasks.workunit.client.0.smithi052.stdout:2/369: mkdir da/d1d/d7d 0 2024-09-12T18:03:21.599 INFO:tasks.workunit.client.0.smithi052.stdout:5/379: dread - d7/d1f/d3a/f4f zero size 2024-09-12T18:03:21.599 INFO:tasks.workunit.client.0.smithi052.stdout:1/313: mkdir d3/d69 0 2024-09-12T18:03:21.600 INFO:tasks.workunit.client.0.smithi052.stdout:6/458: rename d2/d21/c40 to d2/d3f/d58/ca0 0 2024-09-12T18:03:21.600 INFO:tasks.workunit.client.0.smithi052.stdout:3/356: mkdir d0/d16/d7c 0 2024-09-12T18:03:21.600 INFO:tasks.workunit.client.0.smithi052.stdout:8/419: link d13/c14 d13/c8a 0 2024-09-12T18:03:21.600 INFO:tasks.workunit.client.0.smithi052.stdout:4/397: mkdir d11/d17/d23/d8e 0 2024-09-12T18:03:21.601 INFO:tasks.workunit.client.0.smithi052.stdout:2/370: stat da/dc/d15/d22/l48 0 2024-09-12T18:03:21.602 INFO:tasks.workunit.client.0.smithi052.stdout:1/314: stat d3/d1d/d22/d3f/l58 0 2024-09-12T18:03:21.602 INFO:tasks.workunit.client.0.smithi052.stdout:5/380: symlink d7/d59/d5c/l77 0 2024-09-12T18:03:21.602 INFO:tasks.workunit.client.0.smithi052.stdout:0/340: dwrite d2/f29 [0,4194304] 0 2024-09-12T18:03:21.602 INFO:tasks.workunit.client.0.smithi052.stdout:6/459: symlink d2/la1 0 2024-09-12T18:03:21.602 INFO:tasks.workunit.client.0.smithi052.stdout:7/332: dwrite d6/d12/d1e/d29/d5d/f65 [0,4194304] 0 2024-09-12T18:03:21.602 INFO:tasks.workunit.client.0.smithi052.stdout:8/420: write d13/d35/f42 [9894474,35504] 0 2024-09-12T18:03:21.603 INFO:tasks.workunit.client.0.smithi052.stdout:6/460: dread - d2/f70 zero size 2024-09-12T18:03:21.604 INFO:tasks.workunit.client.0.smithi052.stdout:0/341: write d2/d57/d5b/f64 [33494,65407] 0 2024-09-12T18:03:21.606 INFO:tasks.workunit.client.0.smithi052.stdout:5/381: mknod d7/d1c/d1e/c78 0 2024-09-12T18:03:21.606 INFO:tasks.workunit.client.0.smithi052.stdout:2/371: symlink da/d71/l7e 0 2024-09-12T18:03:21.606 INFO:tasks.workunit.client.0.smithi052.stdout:3/357: rename d0/d4b/d4c/f36 to d0/d4b/d57/f7d 0 2024-09-12T18:03:21.607 INFO:tasks.workunit.client.0.smithi052.stdout:0/342: read d2/d1b/f2e [4042520,113285] 0 2024-09-12T18:03:21.610 INFO:tasks.workunit.client.0.smithi052.stdout:3/358: rename d0/d4/d33/f73 to d0/d4b/d57/d6d/f7e 0 2024-09-12T18:03:21.610 INFO:tasks.workunit.client.0.smithi052.stdout:0/343: mkdir d2/d6/dd/d21/d26/d2f/d3a/d69 0 2024-09-12T18:03:21.610 INFO:tasks.workunit.client.0.smithi052.stdout:7/333: dwrite d6/fd [0,4194304] 0 2024-09-12T18:03:21.611 INFO:tasks.workunit.client.0.smithi052.stdout:5/382: rename d7/d1c/d1e to d7/d1c/d1e/d79 22 2024-09-12T18:03:21.611 INFO:tasks.workunit.client.0.smithi052.stdout:4/398: write d11/d17/d1b/f5b [924329,104843] 0 2024-09-12T18:03:21.613 INFO:tasks.workunit.client.0.smithi052.stdout:3/359: symlink d0/d4/d25/d2a/d6/d7/l7f 0 2024-09-12T18:03:21.614 INFO:tasks.workunit.client.0.smithi052.stdout:8/421: dwrite fb [0,4194304] 0 2024-09-12T18:03:21.615 INFO:tasks.workunit.client.0.smithi052.stdout:8/422: fdatasync d13/d3c/f6d 0 2024-09-12T18:03:21.615 INFO:tasks.workunit.client.0.smithi052.stdout:2/372: dwrite f0 [0,4194304] 0 2024-09-12T18:03:21.615 INFO:tasks.workunit.client.0.smithi052.stdout:5/383: link d7/d1c/d1e/f44 d7/d1f/d45/f7a 0 2024-09-12T18:03:21.616 INFO:tasks.workunit.client.0.smithi052.stdout:8/423: dread - d13/d18/f75 zero size 2024-09-12T18:03:21.616 INFO:tasks.workunit.client.0.smithi052.stdout:3/360: write d0/d4/d25/d2a/d6/d41/f59 [258045,43939] 0 2024-09-12T18:03:21.617 INFO:tasks.workunit.client.0.smithi052.stdout:8/424: dread - d13/d3c/f65 zero size 2024-09-12T18:03:21.617 INFO:tasks.workunit.client.0.smithi052.stdout:5/384: unlink d7/d51/f58 0 2024-09-12T18:03:21.617 INFO:tasks.workunit.client.0.smithi052.stdout:7/334: dread f5 [0,4194304] 0 2024-09-12T18:03:21.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/373: fdatasync da/d21/f4a 0 2024-09-12T18:03:21.619 INFO:tasks.workunit.client.0.smithi052.stdout:8/425: chown d13/l24 18 1 2024-09-12T18:03:21.619 INFO:tasks.workunit.client.0.smithi052.stdout:3/361: mknod d0/d4/d25/d2a/d6/d7/d79/c80 0 2024-09-12T18:03:21.619 INFO:tasks.workunit.client.0.smithi052.stdout:7/335: chown d6/l19 116796 1 2024-09-12T18:03:21.619 INFO:tasks.workunit.client.0.smithi052.stdout:8/426: write d13/d3c/f5a [4448682,85641] 0 2024-09-12T18:03:21.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/374: creat da/dc/d15/d36/f7f x:0 0 0 2024-09-12T18:03:21.619 INFO:tasks.workunit.client.0.smithi052.stdout:1/315: write d3/d10/d38/f68 [1345960,6190] 0 2024-09-12T18:03:21.620 INFO:tasks.workunit.client.0.smithi052.stdout:3/362: creat d0/d4/d25/f81 x:0 0 0 2024-09-12T18:03:21.620 INFO:tasks.workunit.client.0.smithi052.stdout:8/427: truncate d13/d18/d21/f50 1432238 0 2024-09-12T18:03:21.621 INFO:tasks.workunit.client.0.smithi052.stdout:1/316: symlink d3/d69/l6a 0 2024-09-12T18:03:21.621 INFO:tasks.workunit.client.0.smithi052.stdout:3/363: mknod d0/d4/d25/d2a/d2c/c82 0 2024-09-12T18:03:21.621 INFO:tasks.workunit.client.0.smithi052.stdout:8/428: creat d13/d35/f8b x:0 0 0 2024-09-12T18:03:21.622 INFO:tasks.workunit.client.0.smithi052.stdout:2/375: creat da/f80 x:0 0 0 2024-09-12T18:03:21.622 INFO:tasks.workunit.client.0.smithi052.stdout:1/317: symlink d3/d10/l6b 0 2024-09-12T18:03:21.623 INFO:tasks.workunit.client.0.smithi052.stdout:2/376: chown da/d21/d6b/c75 30 1 2024-09-12T18:03:21.623 INFO:tasks.workunit.client.0.smithi052.stdout:8/429: chown d13/d18/d21/c4a 5389 1 2024-09-12T18:03:21.624 INFO:tasks.workunit.client.0.smithi052.stdout:8/430: chown d13/d18/d21/f54 13 1 2024-09-12T18:03:21.624 INFO:tasks.workunit.client.0.smithi052.stdout:3/364: mkdir d0/d4/d25/d2a/d6/d7/d34/d72/d83 0 2024-09-12T18:03:21.625 INFO:tasks.workunit.client.0.smithi052.stdout:7/336: dwrite d6/d12/d17/f52 [0,4194304] 0 2024-09-12T18:03:21.627 INFO:tasks.workunit.client.0.smithi052.stdout:8/431: chown d13/d35/c60 3 1 2024-09-12T18:03:21.627 INFO:tasks.workunit.client.0.smithi052.stdout:7/337: mknod d6/d12/d1e/d29/d5d/d71/c75 0 2024-09-12T18:03:21.627 INFO:tasks.workunit.client.0.smithi052.stdout:8/432: chown d13/d18/d38/f6e 363432430 1 2024-09-12T18:03:21.628 INFO:tasks.workunit.client.0.smithi052.stdout:8/433: creat d13/d18/d21/d64/f8c x:0 0 0 2024-09-12T18:03:21.629 INFO:tasks.workunit.client.0.smithi052.stdout:8/434: dread - d13/d18/f75 zero size 2024-09-12T18:03:21.630 INFO:tasks.workunit.client.0.smithi052.stdout:8/435: write d13/d18/d21/d64/f8c [979612,24129] 0 2024-09-12T18:03:21.630 INFO:tasks.workunit.client.0.smithi052.stdout:2/377: dwrite da/dc/d15/f3c [0,4194304] 0 2024-09-12T18:03:21.630 INFO:tasks.workunit.client.0.smithi052.stdout:2/378: chown da/d71 1 1 2024-09-12T18:03:21.631 INFO:tasks.workunit.client.0.smithi052.stdout:8/436: write d13/d18/f51 [594744,104121] 0 2024-09-12T18:03:21.632 INFO:tasks.workunit.client.0.smithi052.stdout:2/379: rename da/dc/d15/d22/l2a to da/d21/d6b/l81 0 2024-09-12T18:03:21.632 INFO:tasks.workunit.client.0.smithi052.stdout:2/380: rmdir da/d21 39 2024-09-12T18:03:21.633 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:21.631+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:21.634 INFO:tasks.workunit.client.0.smithi052.stdout:0/344: truncate d2/d6/f23 1063969 0 2024-09-12T18:03:21.634 INFO:tasks.workunit.client.0.smithi052.stdout:3/365: getdents d0/d4/d25 0 2024-09-12T18:03:21.635 INFO:tasks.workunit.client.0.smithi052.stdout:0/345: stat d2/d6/f23 0 2024-09-12T18:03:21.635 INFO:tasks.workunit.client.0.smithi052.stdout:3/366: chown d0/d4/l23 2294 1 2024-09-12T18:03:21.636 INFO:tasks.workunit.client.0.smithi052.stdout:3/367: write d0/f13 [5593312,68903] 0 2024-09-12T18:03:21.637 INFO:tasks.workunit.client.0.smithi052.stdout:3/368: mknod d0/c84 0 2024-09-12T18:03:21.638 INFO:tasks.workunit.client.0.smithi052.stdout:5/385: dread d7/d1c/d1e/f64 [0,4194304] 0 2024-09-12T18:03:21.639 INFO:tasks.workunit.client.0.smithi052.stdout:3/369: readlink d0/d4b/d4c/l1a 0 2024-09-12T18:03:21.641 INFO:tasks.workunit.client.0.smithi052.stdout:1/318: dwrite d3/d10/f26 [0,4194304] 0 2024-09-12T18:03:21.642 INFO:tasks.workunit.client.0.smithi052.stdout:0/346: dwrite d2/d8/fa [0,4194304] 0 2024-09-12T18:03:21.643 INFO:tasks.workunit.client.0.smithi052.stdout:1/319: write d3/d10/d38/f68 [1390839,102498] 0 2024-09-12T18:03:21.643 INFO:tasks.workunit.client.0.smithi052.stdout:3/370: mkdir d0/d16/d7c/d85 0 2024-09-12T18:03:21.645 INFO:tasks.workunit.client.0.smithi052.stdout:5/386: dread d7/f21 [4194304,4194304] 0 2024-09-12T18:03:21.646 INFO:tasks.workunit.client.0.smithi052.stdout:3/371: mknod d0/d16/d7c/c86 0 2024-09-12T18:03:21.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/320: rename d3/d1d/l3c to d3/d1d/d22/l6c 0 2024-09-12T18:03:21.646 INFO:tasks.workunit.client.0.smithi052.stdout:5/387: chown d7/d1f/d34 14368 1 2024-09-12T18:03:21.646 INFO:tasks.workunit.client.0.smithi052.stdout:4/399: dwrite d11/d17/d23/d2f/f39 [0,4194304] 0 2024-09-12T18:03:21.647 INFO:tasks.workunit.client.0.smithi052.stdout:0/347: rename d2/d6/dd/d21/f56 to d2/d6/dd/d21/d41/d44/d48/f6a 0 2024-09-12T18:03:21.647 INFO:tasks.workunit.client.0.smithi052.stdout:3/372: mknod d0/d4b/c87 0 2024-09-12T18:03:21.647 INFO:tasks.workunit.client.0.smithi052.stdout:0/348: chown d2 142717 1 2024-09-12T18:03:21.648 INFO:tasks.workunit.client.0.smithi052.stdout:5/388: symlink d7/d1f/d3a/d49/d54/d6b/l7b 0 2024-09-12T18:03:21.649 INFO:tasks.workunit.client.0.smithi052.stdout:2/381: dread da/d1d/f29 [0,4194304] 0 2024-09-12T18:03:21.649 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:21.651 INFO:tasks.workunit.client.0.smithi052.stdout:0/349: write d2/d57/d5b/f64 [168374,48393] 0 2024-09-12T18:03:21.651 INFO:tasks.workunit.client.0.smithi052.stdout:5/389: mkdir d7/d59/d5c/d7c 0 2024-09-12T18:03:21.651 INFO:tasks.workunit.client.0.smithi052.stdout:2/382: link da/dc/d15/d43/f72 da/dc/f82 0 2024-09-12T18:03:21.651 INFO:tasks.workunit.client.0.smithi052.stdout:5/390: mknod d7/d1c/d67/c7d 0 2024-09-12T18:03:21.652 INFO:tasks.workunit.client.0.smithi052.stdout:2/383: creat da/d1d/d35/f83 x:0 0 0 2024-09-12T18:03:21.653 INFO:tasks.workunit.client.0.smithi052.stdout:2/384: readlink da/dc/d15/d20/d60/d6e/l74 0 2024-09-12T18:03:21.653 INFO:tasks.workunit.client.0.smithi052.stdout:3/373: link d0/d16/c52 d0/d4/d25/d2a/d6/d7/d34/d72/d83/c88 0 2024-09-12T18:03:21.654 INFO:tasks.workunit.client.0.smithi052.stdout:4/400: write d11/d17/d23/d2f/d3b/d3f/f50 [720385,113806] 0 2024-09-12T18:03:21.655 INFO:tasks.workunit.client.0.smithi052.stdout:3/374: chown d0/d16/d60 0 1 2024-09-12T18:03:21.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/401: unlink d11/d17/d1b/d2a/d32/f76 0 2024-09-12T18:03:21.656 INFO:tasks.workunit.client.0.smithi052.stdout:3/375: mkdir d0/d4/d33/d89 0 2024-09-12T18:03:21.657 INFO:tasks.workunit.client.0.smithi052.stdout:0/350: dread d2/d6/dd/f39 [0,4194304] 0 2024-09-12T18:03:21.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/376: symlink d0/d16/l8a 0 2024-09-12T18:03:21.657 INFO:tasks.workunit.client.0.smithi052.stdout:4/402: creat d11/d17/d1b/d42/f8f x:0 0 0 2024-09-12T18:03:21.658 INFO:tasks.workunit.client.0.smithi052.stdout:5/391: dwrite d7/f19 [0,4194304] 0 2024-09-12T18:03:21.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/403: mkdir d11/d17/d1b/d2a/d6a/d7f/d90 0 2024-09-12T18:03:21.659 INFO:tasks.workunit.client.0.smithi052.stdout:0/351: creat d2/d6/dd/d21/d26/d2f/f6b x:0 0 0 2024-09-12T18:03:21.659 INFO:tasks.workunit.client.0.smithi052.stdout:2/385: dread da/dc/d15/f3e [0,4194304] 0 2024-09-12T18:03:21.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/404: chown d11/d17/d23/d2f/d3b/d6f 78552 1 2024-09-12T18:03:21.660 INFO:tasks.workunit.client.0.smithi052.stdout:2/386: rename da/dc/d15/d43/f59 to da/dc/d15/d22/f84 0 2024-09-12T18:03:21.664 INFO:tasks.workunit.client.0.smithi052.stdout:5/392: dwrite d7/d59/f65 [0,4194304] 0 2024-09-12T18:03:21.666 INFO:tasks.workunit.client.0.smithi052.stdout:5/393: creat d7/d59/f7e x:0 0 0 2024-09-12T18:03:21.666 INFO:tasks.workunit.client.0.smithi052.stdout:4/405: read d11/d17/d23/d2f/f2b [4922990,115651] 0 2024-09-12T18:03:21.667 INFO:tasks.workunit.client.0.smithi052.stdout:9/345: sync 2024-09-12T18:03:21.667 INFO:tasks.workunit.client.0.smithi052.stdout:4/406: write d11/d17/d23/f27 [2653181,77415] 0 2024-09-12T18:03:21.668 INFO:tasks.workunit.client.0.smithi052.stdout:9/346: symlink d0/d18/d26/l7b 0 2024-09-12T18:03:21.668 INFO:tasks.workunit.client.0.smithi052.stdout:4/407: mknod d11/d46/d51/c91 0 2024-09-12T18:03:21.669 INFO:tasks.workunit.client.0.smithi052.stdout:5/394: link d7/d1f/d3a/d49/d54/c6e d7/d1f/c7f 0 2024-09-12T18:03:21.669 INFO:tasks.workunit.client.0.smithi052.stdout:4/408: dread - d11/d17/d1b/d2a/d32/f75 zero size 2024-09-12T18:03:21.670 INFO:tasks.workunit.client.0.smithi052.stdout:2/387: truncate da/d1d/d35/f31 4248677 0 2024-09-12T18:03:21.670 INFO:tasks.workunit.client.0.smithi052.stdout:4/409: symlink d11/d17/d1b/d2a/d33/l92 0 2024-09-12T18:03:21.671 INFO:tasks.workunit.client.0.smithi052.stdout:9/347: rename d0/d6/d4a/d66 to d0/d6/d3a/d42/d61/d7c 0 2024-09-12T18:03:21.675 INFO:tasks.workunit.client.0.smithi052.stdout:4/410: creat d11/d17/d1b/d2a/f93 x:0 0 0 2024-09-12T18:03:21.676 INFO:tasks.workunit.client.0.smithi052.stdout:8/437: dread d13/f67 [4194304,4194304] 0 2024-09-12T18:03:21.679 INFO:tasks.workunit.client.0.smithi052.stdout:4/411: chown d11/d17/d1b/d2a/d82/f53 317242 1 2024-09-12T18:03:21.679 INFO:tasks.workunit.client.0.smithi052.stdout:2/388: dwrite f0 [0,4194304] 0 2024-09-12T18:03:21.681 INFO:tasks.workunit.client.0.smithi052.stdout:4/412: dread - d11/d17/d1b/d42/f8f zero size 2024-09-12T18:03:21.681 INFO:tasks.workunit.client.0.smithi052.stdout:9/348: dwrite d0/d6/d4a/f5f [0,4194304] 0 2024-09-12T18:03:21.681 INFO:tasks.workunit.client.0.smithi052.stdout:5/395: dwrite d7/f8 [0,4194304] 0 2024-09-12T18:03:21.682 INFO:tasks.workunit.client.0.smithi052.stdout:9/349: stat d0/d6/l3c 0 2024-09-12T18:03:21.682 INFO:tasks.workunit.client.0.smithi052.stdout:4/413: write d11/d65/d6c/f6e [314073,111123] 0 2024-09-12T18:03:21.683 INFO:tasks.workunit.client.0.smithi052.stdout:9/350: chown d0/d18/d79/f31 12290 1 2024-09-12T18:03:21.683 INFO:tasks.workunit.client.0.smithi052.stdout:8/438: dread fb [0,4194304] 0 2024-09-12T18:03:21.683 INFO:tasks.workunit.client.0.smithi052.stdout:9/351: write d0/d34/f73 [803078,105614] 0 2024-09-12T18:03:21.684 INFO:tasks.workunit.client.0.smithi052.stdout:8/439: link d13/f67 d13/d7e/f8d 0 2024-09-12T18:03:21.684 INFO:tasks.workunit.client.0.smithi052.stdout:9/352: chown d0/d6/l24 299517 1 2024-09-12T18:03:21.684 INFO:tasks.workunit.client.0.smithi052.stdout:4/414: creat d11/d65/d84/f94 x:0 0 0 2024-09-12T18:03:21.686 INFO:tasks.workunit.client.0.smithi052.stdout:4/415: mkdir d11/d17/d1b/d2a/d82/d67/d95 0 2024-09-12T18:03:21.686 INFO:tasks.workunit.client.0.smithi052.stdout:8/440: link d13/f4e d13/d18/d21/d64/f8e 0 2024-09-12T18:03:21.687 INFO:tasks.workunit.client.0.smithi052.stdout:8/441: mkdir d13/d18/d5b/d8f 0 2024-09-12T18:03:21.687 INFO:tasks.workunit.client.0.smithi052.stdout:4/416: chown d11/d46/d51/c91 50089478 1 2024-09-12T18:03:21.687 INFO:tasks.workunit.client.0.smithi052.stdout:8/442: chown d13/d18/d21/f23 700973 1 2024-09-12T18:03:21.689 INFO:tasks.workunit.client.0.smithi052.stdout:4/417: symlink d11/d17/d23/d2f/l96 0 2024-09-12T18:03:21.689 INFO:tasks.workunit.client.0.smithi052.stdout:8/443: creat d13/d18/d5b/d70/f90 x:0 0 0 2024-09-12T18:03:21.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/418: chown d11/d46/f57 57482 1 2024-09-12T18:03:21.691 INFO:tasks.workunit.client.0.smithi052.stdout:8/444: dread - d13/d18/d21/d64/f83 zero size 2024-09-12T18:03:21.692 INFO:tasks.workunit.client.0.smithi052.stdout:5/396: dwrite d7/f3c [0,4194304] 0 2024-09-12T18:03:21.692 INFO:tasks.workunit.client.0.smithi052.stdout:4/419: write d11/d46/f8d [691140,2389] 0 2024-09-12T18:03:21.693 INFO:tasks.workunit.client.0.smithi052.stdout:9/353: dwrite d0/fb [0,4194304] 0 2024-09-12T18:03:21.693 INFO:tasks.workunit.client.0.smithi052.stdout:4/420: write d11/f8b [467905,35549] 0 2024-09-12T18:03:21.693 INFO:tasks.workunit.client.0.smithi052.stdout:8/445: creat d13/d18/d38/f91 x:0 0 0 2024-09-12T18:03:21.694 INFO:tasks.workunit.client.0.smithi052.stdout:9/354: creat d0/d34/f7d x:0 0 0 2024-09-12T18:03:21.694 INFO:tasks.workunit.client.0.smithi052.stdout:4/421: chown d11/d46 2951702 1 2024-09-12T18:03:21.694 INFO:tasks.workunit.client.0.smithi052.stdout:5/397: mknod d7/d1f/d3a/d49/d54/c80 0 2024-09-12T18:03:21.694 INFO:tasks.workunit.client.0.smithi052.stdout:8/446: mknod d13/d35/c92 0 2024-09-12T18:03:21.694 INFO:tasks.workunit.client.0.smithi052.stdout:5/398: stat d7/d1f 0 2024-09-12T18:03:21.695 INFO:tasks.workunit.client.0.smithi052.stdout:4/422: rename d11/d17/f18 to d11/d17/d1b/d2a/d82/d67/f97 0 2024-09-12T18:03:21.695 INFO:tasks.workunit.client.0.smithi052.stdout:8/447: write d13/d18/d21/f23 [1056404,64452] 0 2024-09-12T18:03:21.695 INFO:tasks.workunit.client.0.smithi052.stdout:5/399: symlink d7/d1f/d45/l81 0 2024-09-12T18:03:21.696 INFO:tasks.workunit.client.0.smithi052.stdout:8/448: chown d13/d18/d38/l61 51085 1 2024-09-12T18:03:21.697 INFO:tasks.workunit.client.0.smithi052.stdout:5/400: write d7/d1f/d34/f48 [917033,76380] 0 2024-09-12T18:03:21.697 INFO:tasks.workunit.client.0.smithi052.stdout:4/423: rename d11/d17/d23/d2f/d3b/d7a to d11/d17/d1b/d2a/d6a/d98 0 2024-09-12T18:03:21.699 INFO:tasks.workunit.client.0.smithi052.stdout:8/449: rename d13/c16 to d13/d18/c93 0 2024-09-12T18:03:21.699 INFO:tasks.workunit.client.0.smithi052.stdout:5/401: mknod d7/d1f/d3a/d49/d54/c82 0 2024-09-12T18:03:21.699 INFO:tasks.workunit.client.0.smithi052.stdout:5/402: readlink d7/d1f/d45/l4a 0 2024-09-12T18:03:21.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:03:21.704 INFO:tasks.workunit.client.0.smithi052.stdout:4/424: dwrite d11/d17/d1b/d2a/f93 [0,4194304] 0 2024-09-12T18:03:21.704 INFO:tasks.workunit.client.0.smithi052.stdout:8/450: dwrite d13/d18/f26 [0,4194304] 0 2024-09-12T18:03:21.705 INFO:tasks.workunit.client.0.smithi052.stdout:8/451: write d13/d3c/f5a [4683327,87979] 0 2024-09-12T18:03:21.708 INFO:tasks.workunit.client.0.smithi052.stdout:8/452: getdents d13/d18 0 2024-09-12T18:03:21.714 INFO:tasks.workunit.client.0.smithi052.stdout:8/453: dwrite f7 [0,4194304] 0 2024-09-12T18:03:21.715 INFO:tasks.workunit.client.0.smithi052.stdout:8/454: unlink d13/d3c/l73 0 2024-09-12T18:03:21.717 INFO:tasks.workunit.client.0.smithi052.stdout:8/455: write d13/d18/d21/f5d [3532797,129388] 0 2024-09-12T18:03:21.717 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:21.715+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:21.718 INFO:tasks.workunit.client.0.smithi052.stdout:8/456: creat d13/d18/d5b/d8f/f94 x:0 0 0 2024-09-12T18:03:21.718 INFO:tasks.workunit.client.0.smithi052.stdout:5/403: dread d7/d1c/f6c [0,4194304] 0 2024-09-12T18:03:21.719 INFO:tasks.workunit.client.0.smithi052.stdout:8/457: creat d13/d3c/f95 x:0 0 0 2024-09-12T18:03:21.720 INFO:tasks.workunit.client.0.smithi052.stdout:5/404: symlink d7/d1c/d67/l83 0 2024-09-12T18:03:21.721 INFO:tasks.workunit.client.0.smithi052.stdout:5/405: read d7/d1c/d1e/f64 [73742,99709] 0 2024-09-12T18:03:21.721 INFO:tasks.workunit.client.0.smithi052.stdout:5/406: rmdir d7/d1c 39 2024-09-12T18:03:21.721 INFO:tasks.workunit.client.0.smithi052.stdout:4/425: dread d11/d17/d1b/d2a/d82/f4d [0,4194304] 0 2024-09-12T18:03:21.722 INFO:tasks.workunit.client.0.smithi052.stdout:5/407: mkdir d7/d59/d84 0 2024-09-12T18:03:21.723 INFO:tasks.workunit.client.0.smithi052.stdout:4/426: creat d11/d17/d23/d2f/d3b/f99 x:0 0 0 2024-09-12T18:03:21.723 INFO:tasks.workunit.client.0.smithi052.stdout:5/408: rename d7/d1c/d1e/f66 to d7/d1f/d3a/f85 0 2024-09-12T18:03:21.724 INFO:tasks.workunit.client.0.smithi052.stdout:8/458: write d13/d18/d21/d64/f8e [681369,99226] 0 2024-09-12T18:03:21.725 INFO:tasks.workunit.client.0.smithi052.stdout:5/409: mknod d7/d59/d5c/d7c/c86 0 2024-09-12T18:03:21.725 INFO:tasks.workunit.client.0.smithi052.stdout:8/459: link d13/d18/d38/f91 d13/d18/d38/d7a/f96 0 2024-09-12T18:03:21.725 INFO:tasks.workunit.client.0.smithi052.stdout:5/410: creat d7/d1f/d3a/d49/f87 x:0 0 0 2024-09-12T18:03:21.726 INFO:tasks.workunit.client.0.smithi052.stdout:5/411: read d7/f8 [885199,66725] 0 2024-09-12T18:03:21.726 INFO:tasks.workunit.client.0.smithi052.stdout:8/460: creat d13/d18/d5b/d70/f97 x:0 0 0 2024-09-12T18:03:21.727 INFO:tasks.workunit.client.0.smithi052.stdout:5/412: symlink d7/d1f/d34/l88 0 2024-09-12T18:03:21.729 INFO:tasks.workunit.client.0.smithi052.stdout:4/427: read d11/d17/d1b/d2a/f7d [678088,88661] 0 2024-09-12T18:03:21.730 INFO:tasks.workunit.client.0.smithi052.stdout:4/428: truncate d11/d65/d84/f94 754479 0 2024-09-12T18:03:21.732 INFO:tasks.workunit.client.0.smithi052.stdout:4/429: creat d11/d17/d1b/d2a/d82/f9a x:0 0 0 2024-09-12T18:03:21.732 INFO:tasks.workunit.client.0.smithi052.stdout:4/430: stat d11/d17/d1b/d2a/d6a/d7f 0 2024-09-12T18:03:21.734 INFO:tasks.workunit.client.0.smithi052.stdout:8/461: truncate d13/d18/d21/f5d 2870923 0 2024-09-12T18:03:21.735 INFO:tasks.workunit.client.0.smithi052.stdout:8/462: symlink d13/d18/d5b/d70/l98 0 2024-09-12T18:03:21.735 INFO:tasks.workunit.client.0.smithi052.stdout:8/463: creat d13/d7e/f99 x:0 0 0 2024-09-12T18:03:21.736 INFO:tasks.workunit.client.0.smithi052.stdout:8/464: rename d13/l34 to d13/d18/d21/d64/l9a 0 2024-09-12T18:03:21.736 INFO:tasks.workunit.client.0.smithi052.stdout:8/465: readlink l12 0 2024-09-12T18:03:21.737 INFO:tasks.workunit.client.0.smithi052.stdout:8/466: mkdir d13/d9b 0 2024-09-12T18:03:21.746 INFO:tasks.workunit.client.0.smithi052.stdout:4/431: write d11/d17/d1b/d2a/d82/d67/f97 [758835,66557] 0 2024-09-12T18:03:21.746 INFO:tasks.workunit.client.0.smithi052.stdout:8/467: rename d13/d7e to d13/d35/d9c 0 2024-09-12T18:03:21.747 INFO:tasks.workunit.client.0.smithi052.stdout:4/432: unlink cf 0 2024-09-12T18:03:21.747 INFO:tasks.workunit.client.0.smithi052.stdout:4/433: chown d11/d17/d1b/d2a/d82/d67 16345 1 2024-09-12T18:03:21.748 INFO:tasks.workunit.client.0.smithi052.stdout:8/468: getdents d13/d18 0 2024-09-12T18:03:21.748 INFO:tasks.workunit.client.0.smithi052.stdout:4/434: rename cb to d11/d17/d1b/d42/c9b 0 2024-09-12T18:03:21.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/435: truncate d11/d17/d1b/d2a/f93 4377833 0 2024-09-12T18:03:21.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/436: write d11/d17/d1b/d2a/f93 [1676518,100401] 0 2024-09-12T18:03:21.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/437: mkdir d11/d17/d1b/d2a/d6a/d7f/d90/d9c 0 2024-09-12T18:03:21.753 INFO:tasks.workunit.client.0.smithi052.stdout:1/321: sync 2024-09-12T18:03:21.753 INFO:tasks.workunit.client.0.smithi052.stdout:6/461: sync 2024-09-12T18:03:21.753 INFO:tasks.workunit.client.0.smithi052.stdout:0/352: sync 2024-09-12T18:03:21.754 INFO:tasks.workunit.client.0.smithi052.stdout:3/377: sync 2024-09-12T18:03:21.754 INFO:tasks.workunit.client.0.smithi052.stdout:7/338: sync 2024-09-12T18:03:21.754 INFO:tasks.workunit.client.0.smithi052.stdout:5/413: dread d7/d1c/d1e/f36 [0,4194304] 0 2024-09-12T18:03:21.755 INFO:tasks.workunit.client.0.smithi052.stdout:1/322: mknod d3/d10/d38/d44/d49/c6d 0 2024-09-12T18:03:21.755 INFO:tasks.workunit.client.0.smithi052.stdout:1/323: creat d3/d1d/d22/d66/f6e x:0 0 0 2024-09-12T18:03:21.757 INFO:tasks.workunit.client.0.smithi052.stdout:8/469: rmdir d13/d35/d9c 39 2024-09-12T18:03:21.759 INFO:tasks.workunit.client.0.smithi052.stdout:8/470: creat d13/f9d x:0 0 0 2024-09-12T18:03:21.760 INFO:tasks.workunit.client.0.smithi052.stdout:8/471: chown d13/l15 163993 1 2024-09-12T18:03:21.760 INFO:tasks.workunit.client.0.smithi052.stdout:7/339: dwrite d6/d12/d1e/d29/f45 [0,4194304] 0 2024-09-12T18:03:21.761 INFO:tasks.workunit.client.0.smithi052.stdout:8/472: fsync d13/d18/d38/f91 0 2024-09-12T18:03:21.761 INFO:tasks.workunit.client.0.smithi052.stdout:0/353: write d2/d6/dd/f60 [1129115,84433] 0 2024-09-12T18:03:21.761 INFO:tasks.workunit.client.0.smithi052.stdout:4/438: write d11/d65/f71 [630403,64328] 0 2024-09-12T18:03:21.762 INFO:tasks.workunit.client.0.smithi052.stdout:7/340: write d6/d12/f15 [2525389,119722] 0 2024-09-12T18:03:21.762 INFO:tasks.workunit.client.0.smithi052.stdout:8/473: chown d13/d18/d21/f28 371 1 2024-09-12T18:03:21.763 INFO:tasks.workunit.client.0.smithi052.stdout:0/354: chown d2/d6/dd/d21/d47/l61 54370 1 2024-09-12T18:03:21.764 INFO:tasks.workunit.client.0.smithi052.stdout:7/341: creat d6/f76 x:0 0 0 2024-09-12T18:03:21.766 INFO:tasks.workunit.client.0.smithi052.stdout:7/342: symlink d6/dc/d1a/l77 0 2024-09-12T18:03:21.766 INFO:tasks.workunit.client.0.smithi052.stdout:3/378: dwrite d0/d4/d33/f38 [0,4194304] 0 2024-09-12T18:03:21.766 INFO:tasks.workunit.client.0.smithi052.stdout:7/343: chown d6/dc/d1a/d6a 0 1 2024-09-12T18:03:21.767 INFO:tasks.workunit.client.0.smithi052.stdout:3/379: write d0/d16/d60/f62 [696291,84910] 0 2024-09-12T18:03:21.769 INFO:tasks.workunit.client.0.smithi052.stdout:3/380: read d0/d4b/d4c/d6b/d48/f51 [1175485,35112] 0 2024-09-12T18:03:21.771 INFO:tasks.workunit.client.0.smithi052.stdout:6/462: dread d2/d3f/d58/d5d/f7d [0,4194304] 0 2024-09-12T18:03:21.772 INFO:tasks.workunit.client.0.smithi052.stdout:4/439: dread d11/d17/d1b/f5b [0,4194304] 0 2024-09-12T18:03:21.772 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:21.772 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:21.773 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:21.773 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:21.773 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:21.773 INFO:tasks.workunit.client.0.smithi052.stdout:3/381: truncate d0/d4/f28 494827 0 2024-09-12T18:03:21.773 INFO:tasks.workunit.client.0.smithi052.stdout:6/463: chown d2/d15/d1a 67 1 2024-09-12T18:03:21.774 INFO:tasks.workunit.client.0.smithi052.stdout:4/440: chown d11/d17/d1b/d42/c9b 43 1 2024-09-12T18:03:21.774 INFO:tasks.workunit.client.0.smithi052.stdout:3/382: getdents d0/d4b/d57/d6d 0 2024-09-12T18:03:21.775 INFO:tasks.workunit.client.0.smithi052.stdout:3/383: fsync d0/d4b/d57/d6d/f77 0 2024-09-12T18:03:21.775 INFO:tasks.workunit.client.0.smithi052.stdout:0/355: truncate d2/d6/dd/d21/d26/d38/f49 3939809 0 2024-09-12T18:03:21.775 INFO:tasks.workunit.client.0.smithi052.stdout:4/441: symlink d11/d17/d1b/d2a/d32/l9d 0 2024-09-12T18:03:21.775 INFO:tasks.workunit.client.0.smithi052.stdout:7/344: truncate d6/d12/d1e/d29/d5d/d71/f42 1577313 0 2024-09-12T18:03:21.776 INFO:tasks.workunit.client.0.smithi052.stdout:7/345: chown d6/dc/f50 117 1 2024-09-12T18:03:21.777 INFO:tasks.workunit.client.0.smithi052.stdout:0/356: chown d2/d6/dd/d21/d26/d2f/f4b 10898270 1 2024-09-12T18:03:21.778 INFO:tasks.workunit.client.0.smithi052.stdout:4/442: creat d11/d17/d1b/d2a/d82/d67/d95/f9e x:0 0 0 2024-09-12T18:03:21.779 INFO:tasks.workunit.client.0.smithi052.stdout:0/357: creat d2/d6/dd/d21/d41/d44/f6c x:0 0 0 2024-09-12T18:03:21.780 INFO:tasks.workunit.client.0.smithi052.stdout:0/358: fdatasync d2/f29 0 2024-09-12T18:03:21.781 INFO:tasks.workunit.client.0.smithi052.stdout:8/474: dread d13/f1c [4194304,4194304] 0 2024-09-12T18:03:21.781 INFO:tasks.workunit.client.0.smithi052.stdout:6/464: dwrite d2/d21/d6a/f96 [0,4194304] 0 2024-09-12T18:03:21.781 INFO:tasks.workunit.client.0.smithi052.stdout:4/443: write d11/d17/d1b/d2a/f61 [424048,45642] 0 2024-09-12T18:03:21.781 INFO:tasks.workunit.client.0.smithi052.stdout:3/384: dread d0/d4/d25/d2a/d6/d41/f59 [0,4194304] 0 2024-09-12T18:03:21.781 INFO:tasks.workunit.client.0.smithi052.stdout:7/346: rename d6/d12/d1e/d29/d5d/d71/d3a/f6b to d6/d12/d1e/d29/d5d/f78 0 2024-09-12T18:03:21.782 INFO:tasks.workunit.client.0.smithi052.stdout:0/359: symlink d2/d6/dd/d21/d47/l6d 0 2024-09-12T18:03:21.782 INFO:tasks.workunit.client.0.smithi052.stdout:7/347: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d79 0 2024-09-12T18:03:21.783 INFO:tasks.workunit.client.0.smithi052.stdout:6/465: fsync d2/d15/f30 0 2024-09-12T18:03:21.783 INFO:tasks.workunit.client.0.smithi052.stdout:0/360: mknod d2/d51/c6e 0 2024-09-12T18:03:21.784 INFO:tasks.workunit.client.0.smithi052.stdout:7/348: dread - d6/dc/d1a/d6a/f72 zero size 2024-09-12T18:03:21.784 INFO:tasks.workunit.client.0.smithi052.stdout:6/466: chown d2/d80/c55 142758373 1 2024-09-12T18:03:21.785 INFO:tasks.workunit.client.0.smithi052.stdout:0/361: write d2/d6/dd/d21/d26/d2f/f6b [764380,102043] 0 2024-09-12T18:03:21.787 INFO:tasks.workunit.client.0.smithi052.stdout:6/467: write d2/d15/f25 [29206,77717] 0 2024-09-12T18:03:21.788 INFO:tasks.workunit.client.0.smithi052.stdout:6/468: mknod d2/d21/d76/ca2 0 2024-09-12T18:03:21.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/469: creat d2/d80/fa3 x:0 0 0 2024-09-12T18:03:21.790 INFO:tasks.workunit.client.0.smithi052.stdout:3/385: dread d0/d4/d25/f2e [0,4194304] 0 2024-09-12T18:03:21.790 INFO:tasks.workunit.client.0.smithi052.stdout:4/444: dwrite d11/f21 [0,4194304] 0 2024-09-12T18:03:21.791 INFO:tasks.workunit.client.0.smithi052.stdout:6/470: fsync d2/d15/f30 0 2024-09-12T18:03:21.793 INFO:tasks.workunit.client.0.smithi052.stdout:0/362: dwrite d2/d6/f4c [0,4194304] 0 2024-09-12T18:03:21.793 INFO:tasks.workunit.client.0.smithi052.stdout:4/445: read d11/d17/d1b/f20 [2882972,34706] 0 2024-09-12T18:03:21.793 INFO:tasks.workunit.client.0.smithi052.stdout:7/349: dwrite d6/dc/d1a/f54 [0,4194304] 0 2024-09-12T18:03:21.794 INFO:tasks.workunit.client.0.smithi052.stdout:3/386: write d0/d16/d60/f65 [3195967,38808] 0 2024-09-12T18:03:21.796 INFO:tasks.workunit.client.0.smithi052.stdout:3/387: rmdir d0/d4/d33 39 2024-09-12T18:03:21.797 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:21.798 INFO:tasks.workunit.client.0.smithi052.stdout:4/446: creat d11/d17/d1b/f9f x:0 0 0 2024-09-12T18:03:21.798 INFO:tasks.workunit.client.0.smithi052.stdout:6/471: getdents d2/d49 0 2024-09-12T18:03:21.799 INFO:tasks.workunit.client.0.smithi052.stdout:3/388: truncate d0/d4/d25/d2a/d6/d41/f45 1401225 0 2024-09-12T18:03:21.799 INFO:tasks.workunit.client.0.smithi052.stdout:6/472: creat d2/d80/fa4 x:0 0 0 2024-09-12T18:03:21.800 INFO:tasks.workunit.client.0.smithi052.stdout:0/363: rename d2/d6/dd/d21/d26/d2f/f4b to d2/d57/f6f 0 2024-09-12T18:03:21.802 INFO:tasks.workunit.client.0.smithi052.stdout:4/447: rename d11/d17/f8a to d11/d17/d1b/d2a/d33/fa0 0 2024-09-12T18:03:21.803 INFO:tasks.workunit.client.0.smithi052.stdout:4/448: creat d11/d17/d1b/d2a/d6a/d7f/d90/fa1 x:0 0 0 2024-09-12T18:03:21.805 INFO:tasks.workunit.client.0.smithi052.stdout:4/449: symlink d11/d70/la2 0 2024-09-12T18:03:21.806 INFO:tasks.workunit.client.0.smithi052.stdout:6/473: dwrite d2/f70 [0,4194304] 0 2024-09-12T18:03:21.812 INFO:tasks.workunit.client.0.smithi052.stdout:0/364: truncate d2/d57/f6f 5590961 0 2024-09-12T18:03:21.813 INFO:tasks.workunit.client.0.smithi052.stdout:6/474: truncate d2/d3f/d5f/f85 1374559 0 2024-09-12T18:03:21.814 INFO:tasks.workunit.client.0.smithi052.stdout:6/475: chown d2/d80/fa4 257 1 2024-09-12T18:03:21.815 INFO:tasks.workunit.client.0.smithi052.stdout:6/476: chown d2/d3f/d58/d5d/l88 69639 1 2024-09-12T18:03:21.816 INFO:tasks.workunit.client.0.smithi052.stdout:6/477: truncate d2/d3f/d58/d5d/d9c/d26/f5c 259460 0 2024-09-12T18:03:21.817 INFO:tasks.workunit.client.0.smithi052.stdout:0/365: write d2/d6/f10 [1554082,45477] 0 2024-09-12T18:03:21.817 INFO:tasks.workunit.client.0.smithi052.stdout:6/478: fsync d2/f10 0 2024-09-12T18:03:21.818 INFO:tasks.workunit.client.0.smithi052.stdout:0/366: readlink d2/d1b/l62 0 2024-09-12T18:03:21.818 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:21.815+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:21.819 INFO:tasks.workunit.client.0.smithi052.stdout:6/479: truncate d2/d15/f23 2463829 0 2024-09-12T18:03:21.820 INFO:tasks.workunit.client.0.smithi052.stdout:6/480: chown d2/d3f/d58/d5d/l88 132 1 2024-09-12T18:03:21.820 INFO:tasks.workunit.client.0.smithi052.stdout:4/450: dread d11/d65/d6c/f6e [0,4194304] 0 2024-09-12T18:03:21.821 INFO:tasks.workunit.client.0.smithi052.stdout:4/451: readlink d11/l3d 0 2024-09-12T18:03:21.821 INFO:tasks.workunit.client.0.smithi052.stdout:6/481: fsync d2/d15/f25 0 2024-09-12T18:03:21.822 INFO:tasks.workunit.client.0.smithi052.stdout:4/452: symlink d11/d17/d1b/d2a/d6a/d7f/la3 0 2024-09-12T18:03:21.822 INFO:tasks.workunit.client.0.smithi052.stdout:6/482: write d2/d3f/d58/d5d/d9c/f31 [2719800,115769] 0 2024-09-12T18:03:21.824 INFO:tasks.workunit.client.0.smithi052.stdout:6/483: write d2/d3f/d58/d5d/d9c/d26/f36 [185533,92825] 0 2024-09-12T18:03:21.825 INFO:tasks.workunit.client.0.smithi052.stdout:4/453: creat d11/d17/fa4 x:0 0 0 2024-09-12T18:03:21.825 INFO:tasks.workunit.client.0.smithi052.stdout:0/367: dwrite d2/d6/dd/f1d [0,4194304] 0 2024-09-12T18:03:21.826 INFO:tasks.workunit.client.0.smithi052.stdout:6/484: chown d2/d15/c8b 11646 1 2024-09-12T18:03:21.826 INFO:tasks.workunit.client.0.smithi052.stdout:0/368: rmdir d2/d6/dd/d21/d41/d44/d48 39 2024-09-12T18:03:21.826 INFO:tasks.workunit.client.0.smithi052.stdout:4/454: write d11/d17/d23/d2f/d3b/d3f/f4c [890647,46552] 0 2024-09-12T18:03:21.827 INFO:tasks.workunit.client.0.smithi052.stdout:6/485: rename d2/d21/d6a/f75 to d2/d80/fa5 0 2024-09-12T18:03:21.828 INFO:tasks.workunit.client.0.smithi052.stdout:4/455: rename d11/d17/d1b/d2a/d6a/d98 to d11/d17/d1b/d2a/d6a/d7f/d90/da5 0 2024-09-12T18:03:21.829 INFO:tasks.workunit.client.0.smithi052.stdout:6/486: rename d2/d15/c50 to d2/d5e/ca6 0 2024-09-12T18:03:21.829 INFO:tasks.workunit.client.0.smithi052.stdout:4/456: creat d11/d17/fa6 x:0 0 0 2024-09-12T18:03:21.830 INFO:tasks.workunit.client.0.smithi052.stdout:6/487: write d2/d3f/d58/f66 [228520,57005] 0 2024-09-12T18:03:21.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/389: dread d0/d4/d33/f3b [0,4194304] 0 2024-09-12T18:03:21.831 INFO:tasks.workunit.client.0.smithi052.stdout:6/488: unlink d2/d21/c9a 0 2024-09-12T18:03:21.832 INFO:tasks.workunit.client.0.smithi052.stdout:4/457: rmdir d11/d17/d1b/d2a/d82/d67/d74 0 2024-09-12T18:03:21.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/489: fdatasync d2/d15/f25 0 2024-09-12T18:03:21.832 INFO:tasks.workunit.client.0.smithi052.stdout:4/458: write d11/d17/fa4 [37845,94263] 0 2024-09-12T18:03:21.833 INFO:tasks.workunit.client.0.smithi052.stdout:6/490: write d2/d21/d76/f7f [382682,50491] 0 2024-09-12T18:03:21.834 INFO:tasks.workunit.client.0.smithi052.stdout:6/491: read d2/d3f/d58/f66 [87104,3791] 0 2024-09-12T18:03:21.835 INFO:tasks.workunit.client.0.smithi052.stdout:6/492: creat d2/d21/d6a/fa7 x:0 0 0 2024-09-12T18:03:21.836 INFO:tasks.workunit.client.0.smithi052.stdout:4/459: dread d11/d17/d1b/d2a/f61 [0,4194304] 0 2024-09-12T18:03:21.837 INFO:tasks.workunit.client.0.smithi052.stdout:4/460: creat d11/fa7 x:0 0 0 2024-09-12T18:03:21.837 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:21.837 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:21.839 INFO:tasks.workunit.client.0.smithi052.stdout:3/390: dwrite d0/d4/d25/d2a/d6/d41/f45 [0,4194304] 0 2024-09-12T18:03:21.841 INFO:tasks.workunit.client.0.smithi052.stdout:6/493: dread d2/d21/f95 [0,4194304] 0 2024-09-12T18:03:21.841 INFO:tasks.workunit.client.0.smithi052.stdout:3/391: mknod d0/d4/d25/d2a/d6/d7/d79/c8b 0 2024-09-12T18:03:21.842 INFO:tasks.workunit.client.0.smithi052.stdout:6/494: creat d2/d3f/d58/fa8 x:0 0 0 2024-09-12T18:03:21.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/392: mknod d0/d4b/d57/d7a/c8c 0 2024-09-12T18:03:21.844 INFO:tasks.workunit.client.0.smithi052.stdout:6/495: chown d2/d3f/d58/d5d/d9c/d26/f46 80538427 1 2024-09-12T18:03:21.844 INFO:tasks.workunit.client.0.smithi052.stdout:4/461: dwrite d11/d65/f7b [0,4194304] 0 2024-09-12T18:03:21.846 INFO:tasks.workunit.client.0.smithi052.stdout:4/462: write d11/d17/d1b/d2a/d32/f75 [752520,35800] 0 2024-09-12T18:03:21.846 INFO:tasks.workunit.client.0.smithi052.stdout:3/393: creat d0/d4b/d4c/d6b/f8d x:0 0 0 2024-09-12T18:03:21.847 INFO:tasks.workunit.client.0.smithi052.stdout:6/496: link d2/d21/f65 d2/d3f/fa9 0 2024-09-12T18:03:21.847 INFO:tasks.workunit.client.0.smithi052.stdout:4/463: write d11/d17/d1b/d2a/d82/f4a [1749666,58580] 0 2024-09-12T18:03:21.848 INFO:tasks.workunit.client.0.smithi052.stdout:3/394: symlink d0/d4/d25/d2a/d6/l8e 0 2024-09-12T18:03:21.849 INFO:tasks.workunit.client.0.smithi052.stdout:3/395: rename d0/d4/d25/d2a/d6/l8e to d0/d4/d25/d2a/l8f 0 2024-09-12T18:03:21.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/464: write d11/d17/d1b/d2a/d82/f53 [1187509,121220] 0 2024-09-12T18:03:21.854 INFO:tasks.workunit.client.0.smithi052.stdout:6/497: write d2/f10 [4027485,78281] 0 2024-09-12T18:03:21.854 INFO:tasks.workunit.client.0.smithi052.stdout:6/498: stat d2/d3f/d5f/c8d 0 2024-09-12T18:03:21.855 INFO:tasks.workunit.client.0.smithi052.stdout:3/396: dwrite d0/d4/d33/f3b [0,4194304] 0 2024-09-12T18:03:21.856 INFO:tasks.workunit.client.0.smithi052.stdout:5/414: sync 2024-09-12T18:03:21.856 INFO:tasks.workunit.client.0.smithi052.stdout:1/324: sync 2024-09-12T18:03:21.857 INFO:tasks.workunit.client.0.smithi052.stdout:9/355: sync 2024-09-12T18:03:21.857 INFO:tasks.workunit.client.0.smithi052.stdout:2/389: sync 2024-09-12T18:03:21.857 INFO:tasks.workunit.client.0.smithi052.stdout:7/350: sync 2024-09-12T18:03:21.857 INFO:tasks.workunit.client.0.smithi052.stdout:8/475: sync 2024-09-12T18:03:21.859 INFO:tasks.workunit.client.0.smithi052.stdout:1/325: write d3/f35 [1622635,4857] 0 2024-09-12T18:03:21.859 INFO:tasks.workunit.client.0.smithi052.stdout:3/397: mknod d0/d4/c90 0 2024-09-12T18:03:21.859 INFO:tasks.workunit.client.0.smithi052.stdout:1/326: readlink d3/d10/l39 0 2024-09-12T18:03:21.860 INFO:tasks.workunit.client.0.smithi052.stdout:1/327: rename d3/fc to d3/d1d/f6f 0 2024-09-12T18:03:21.861 INFO:tasks.workunit.client.0.smithi052.stdout:7/351: write d6/d12/f15 [4211294,103047] 0 2024-09-12T18:03:21.861 INFO:tasks.workunit.client.0.smithi052.stdout:9/356: chown d0/c1f 3 1 2024-09-12T18:03:21.864 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:21.864 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:21.865 INFO:tasks.workunit.client.0.smithi052.stdout:2/390: rename da/dc/d15/d43/c78 to da/d21/d6b/c85 0 2024-09-12T18:03:21.865 INFO:tasks.workunit.client.0.smithi052.stdout:3/398: chown d0/d4/d25/d2a/d6/d7/l7f 1 1 2024-09-12T18:03:21.865 INFO:tasks.workunit.client.0.smithi052.stdout:1/328: symlink d3/d10/d38/d44/d49/l70 0 2024-09-12T18:03:21.866 INFO:tasks.workunit.client.0.smithi052.stdout:9/357: rmdir d0/d6/d4a 39 2024-09-12T18:03:21.867 INFO:tasks.workunit.client.0.smithi052.stdout:2/391: chown da/d21/d6b 9 1 2024-09-12T18:03:21.867 INFO:tasks.workunit.client.0.smithi052.stdout:1/329: rmdir d3/d1d/d22/d66 39 2024-09-12T18:03:21.868 INFO:tasks.workunit.client.0.smithi052.stdout:5/415: dwrite d7/d59/f7e [0,4194304] 0 2024-09-12T18:03:21.868 INFO:tasks.workunit.client.0.smithi052.stdout:6/499: dwrite d2/f70 [0,4194304] 0 2024-09-12T18:03:21.868 INFO:tasks.workunit.client.0.smithi052.stdout:7/352: write d6/d12/f47 [904119,74837] 0 2024-09-12T18:03:21.870 INFO:tasks.workunit.client.0.smithi052.stdout:2/392: write da/d1d/d35/f83 [840983,43496] 0 2024-09-12T18:03:21.870 INFO:tasks.workunit.client.0.smithi052.stdout:3/399: read d0/d4/f27 [1782985,47485] 0 2024-09-12T18:03:21.870 INFO:tasks.workunit.client.0.smithi052.stdout:8/476: dwrite fb [0,4194304] 0 2024-09-12T18:03:21.871 INFO:tasks.workunit.client.0.smithi052.stdout:8/477: chown d13/d35/c3a 1069 1 2024-09-12T18:03:21.871 INFO:tasks.workunit.client.0.smithi052.stdout:8/478: write d13/d18/f26 [3358943,87009] 0 2024-09-12T18:03:21.873 INFO:tasks.workunit.client.0.smithi052.stdout:9/358: creat d0/d18/d79/f7e x:0 0 0 2024-09-12T18:03:21.874 INFO:tasks.workunit.client.0.smithi052.stdout:8/479: unlink d13/d3c/f5a 0 2024-09-12T18:03:21.875 INFO:tasks.workunit.client.0.smithi052.stdout:2/393: truncate da/f13 699608 0 2024-09-12T18:03:21.875 INFO:tasks.workunit.client.0.smithi052.stdout:1/330: link d3/d1d/d22/d3f/c48 d3/d10/c71 0 2024-09-12T18:03:21.877 INFO:tasks.workunit.client.0.smithi052.stdout:8/480: write d13/d18/d21/f50 [1277458,42340] 0 2024-09-12T18:03:21.878 INFO:tasks.workunit.client.0.smithi052.stdout:1/331: mkdir d3/d1d/d72 0 2024-09-12T18:03:21.879 INFO:tasks.workunit.client.0.smithi052.stdout:3/400: dread d0/d4/d25/d2a/d6/d41/f45 [0,4194304] 0 2024-09-12T18:03:21.879 INFO:tasks.workunit.client.0.smithi052.stdout:2/394: write da/d1d/d35/f83 [1383811,32742] 0 2024-09-12T18:03:21.879 INFO:tasks.workunit.client.0.smithi052.stdout:3/401: readlink d0/d16/l24 0 2024-09-12T18:03:21.880 INFO:tasks.workunit.client.0.smithi052.stdout:8/481: creat d13/f9e x:0 0 0 2024-09-12T18:03:21.880 INFO:tasks.workunit.client.0.smithi052.stdout:9/359: getdents d0/d18 0 2024-09-12T18:03:21.880 INFO:tasks.workunit.client.0.smithi052.stdout:1/332: symlink d3/d1d/d22/d27/d28/d2f/l73 0 2024-09-12T18:03:21.880 INFO:tasks.workunit.client.0.smithi052.stdout:9/360: fsync d0/d6/d3a/f6e 0 2024-09-12T18:03:21.881 INFO:tasks.workunit.client.0.smithi052.stdout:2/395: mknod da/d1d/d7d/c86 0 2024-09-12T18:03:21.881 INFO:tasks.workunit.client.0.smithi052.stdout:3/402: write d0/d4/d25/d2a/d2c/f63 [744132,605] 0 2024-09-12T18:03:21.882 INFO:tasks.workunit.client.0.smithi052.stdout:9/361: chown d0/d6/d4a/l60 489198455 1 2024-09-12T18:03:21.883 INFO:tasks.workunit.client.0.smithi052.stdout:3/403: read - d0/d4/d25/d2a/d6/d7/d34/f5b zero size 2024-09-12T18:03:21.883 INFO:tasks.workunit.client.0.smithi052.stdout:9/362: truncate d0/d6/d4a/f6f 782650 0 2024-09-12T18:03:21.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/363: unlink d0/d18/d79/f7e 0 2024-09-12T18:03:21.885 INFO:tasks.workunit.client.0.smithi052.stdout:7/353: truncate d6/f3c 142759 0 2024-09-12T18:03:21.887 INFO:tasks.workunit.client.0.smithi052.stdout:7/354: dread - d6/d12/d1e/d29/d5d/f78 zero size 2024-09-12T18:03:21.889 INFO:tasks.workunit.client.0.smithi052.stdout:7/355: stat d6/d12/d1e/d29/d5d/d71/l4a 0 2024-09-12T18:03:21.891 INFO:tasks.workunit.client.0.smithi052.stdout:1/333: read d3/f8 [7453913,123800] 0 2024-09-12T18:03:21.892 INFO:tasks.workunit.client.0.smithi052.stdout:4/465: dread d11/d17/d23/d2f/d3b/f4e [0,4194304] 0 2024-09-12T18:03:21.894 INFO:tasks.workunit.client.0.smithi052.stdout:6/500: dwrite d2/d3f/d5f/f85 [0,4194304] 0 2024-09-12T18:03:21.894 INFO:tasks.workunit.client.0.smithi052.stdout:0/369: sync 2024-09-12T18:03:21.895 INFO:tasks.workunit.client.0.smithi052.stdout:0/370: truncate d2/d6/dd/d21/d41/d44/f4e 1327657 0 2024-09-12T18:03:21.896 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:21.896 INFO:tasks.workunit.client.0.smithi052.stdout:0/371: chown d2/d6/dd/d21/d26/d38/l15 485 1 2024-09-12T18:03:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:21.899 INFO:tasks.workunit.client.0.smithi052.stdout:3/404: truncate d0/d4/d25/d2a/f32 4750684 0 2024-09-12T18:03:21.901 INFO:tasks.workunit.client.0.smithi052.stdout:4/466: rmdir d11/d17/d1b/d2a/d6a/d7f/d90/da5 0 2024-09-12T18:03:21.901 INFO:tasks.workunit.client.0.smithi052.stdout:8/482: dread d13/d18/d38/f40 [0,4194304] 0 2024-09-12T18:03:21.902 INFO:tasks.workunit.client.0.smithi052.stdout:3/405: chown d0/d4/d25/d2a/d6/d7/f2b 492 1 2024-09-12T18:03:21.903 INFO:tasks.workunit.client.0.smithi052.stdout:7/356: dwrite d6/d12/d1e/d29/d5d/f78 [0,4194304] 0 2024-09-12T18:03:21.905 INFO:tasks.workunit.client.0.smithi052.stdout:4/467: mkdir d11/d17/d1b/d2a/d6a/da8 0 2024-09-12T18:03:21.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/406: write d0/d4b/d4c/d6b/f8d [882503,30640] 0 2024-09-12T18:03:21.908 INFO:tasks.workunit.client.0.smithi052.stdout:1/334: dwrite d3/d1d/d22/d27/d28/f32 [4194304,4194304] 0 2024-09-12T18:03:21.910 INFO:tasks.workunit.client.0.smithi052.stdout:3/407: stat d0/d4/d25/d2a/d6/d41/l42 0 2024-09-12T18:03:21.910 INFO:tasks.workunit.client.0.smithi052.stdout:0/372: dwrite d2/d6/dd/d21/d26/d38/f3f [4194304,4194304] 0 2024-09-12T18:03:21.911 INFO:tasks.workunit.client.0.smithi052.stdout:3/408: fdatasync d0/d4/f50 0 2024-09-12T18:03:21.912 INFO:tasks.workunit.client.0.smithi052.stdout:1/335: rmdir d3/d1d/d22/d27/d67 0 2024-09-12T18:03:21.913 INFO:tasks.workunit.client.0.smithi052.stdout:2/396: dread da/d2c/f3b [0,4194304] 0 2024-09-12T18:03:21.914 INFO:tasks.workunit.client.0.smithi052.stdout:0/373: mknod d2/d6/dd/d21/d26/d2f/d3a/c70 0 2024-09-12T18:03:21.915 INFO:tasks.workunit.client.0.smithi052.stdout:5/416: dread d7/f16 [0,4194304] 0 2024-09-12T18:03:21.916 INFO:tasks.workunit.client.0.smithi052.stdout:4/468: read d11/d17/d1b/d2a/f7d [273555,115601] 0 2024-09-12T18:03:21.917 INFO:tasks.workunit.client.0.smithi052.stdout:1/336: mkdir d3/d1d/d22/d27/d28/d2f/d74 0 2024-09-12T18:03:21.917 INFO:tasks.workunit.client.0.smithi052.stdout:7/357: dwrite d6/d12/d1e/f6d [0,4194304] 0 2024-09-12T18:03:21.918 INFO:tasks.workunit.client.0.smithi052.stdout:0/374: dread - d2/d6/dd/d21/d26/d2f/d3a/f5c zero size 2024-09-12T18:03:21.918 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:21.915+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:21.919 INFO:tasks.workunit.client.0.smithi052.stdout:2/397: getdents da/d1d/d7d 0 2024-09-12T18:03:21.920 INFO:tasks.workunit.client.0.smithi052.stdout:2/398: chown da/dc/d15/f3e 6827925 1 2024-09-12T18:03:21.921 INFO:tasks.workunit.client.0.smithi052.stdout:7/358: fsync d6/d12/d1e/d29/d5d/f4d 0 2024-09-12T18:03:21.923 INFO:tasks.workunit.client.0.smithi052.stdout:9/364: dread d0/fc [0,4194304] 0 2024-09-12T18:03:21.923 INFO:tasks.workunit.client.0.smithi052.stdout:2/399: truncate da/f12 489505 0 2024-09-12T18:03:21.923 INFO:tasks.workunit.client.0.smithi052.stdout:9/365: mkdir d0/d58/d7f 0 2024-09-12T18:03:21.923 INFO:tasks.workunit.client.0.smithi052.stdout:7/359: getdents d6/dc 0 2024-09-12T18:03:21.923 INFO:tasks.workunit.client.0.smithi052.stdout:5/417: creat d7/d1c/d6f/f89 x:0 0 0 2024-09-12T18:03:21.924 INFO:tasks.workunit.client.0.smithi052.stdout:3/409: truncate d0/d4b/d4c/d6b/d48/f51 1923600 0 2024-09-12T18:03:21.925 INFO:tasks.workunit.client.0.smithi052.stdout:2/400: truncate da/dc/d15/d43/f67 1679037 0 2024-09-12T18:03:21.925 INFO:tasks.workunit.client.0.smithi052.stdout:5/418: dread - d7/d1f/d3a/f4f zero size 2024-09-12T18:03:21.926 INFO:tasks.workunit.client.0.smithi052.stdout:9/366: rmdir d0/d6/d3a/d42/d61/d7c 0 2024-09-12T18:03:21.926 INFO:tasks.workunit.client.0.smithi052.stdout:3/410: chown d0/d4/f19 0 1 2024-09-12T18:03:21.927 INFO:tasks.workunit.client.0.smithi052.stdout:5/419: chown d7/c35 119 1 2024-09-12T18:03:21.927 INFO:tasks.workunit.client.0.smithi052.stdout:2/401: mkdir da/dc/d15/d22/d87 0 2024-09-12T18:03:21.928 INFO:tasks.workunit.client.0.smithi052.stdout:1/337: dread d3/f35 [0,4194304] 0 2024-09-12T18:03:21.929 INFO:tasks.workunit.client.0.smithi052.stdout:7/360: creat d6/d12/d1e/d29/d5d/d71/d3a/d79/f7a x:0 0 0 2024-09-12T18:03:21.930 INFO:tasks.workunit.client.0.smithi052.stdout:9/367: truncate d0/d6/d3a/d42/f76 189135 0 2024-09-12T18:03:21.930 INFO:tasks.workunit.client.0.smithi052.stdout:0/375: dwrite d2/d6/dd/d21/d26/d2f/f33 [0,4194304] 0 2024-09-12T18:03:21.931 INFO:tasks.workunit.client.0.smithi052.stdout:4/469: dwrite d11/d17/d23/d2f/f3a [4194304,4194304] 0 2024-09-12T18:03:21.931 INFO:tasks.workunit.client.0.smithi052.stdout:2/402: fdatasync da/d1d/d35/f31 0 2024-09-12T18:03:21.932 INFO:tasks.workunit.client.0.smithi052.stdout:3/411: mkdir d0/d4/d25/d2a/d6/d7/d34/d72/d83/d91 0 2024-09-12T18:03:21.932 INFO:tasks.workunit.client.0.smithi052.stdout:7/361: rmdir d6/d12/d1e/d29/d5d 39 2024-09-12T18:03:21.933 INFO:tasks.workunit.client.0.smithi052.stdout:3/412: dread - d0/d4/d25/f81 zero size 2024-09-12T18:03:21.934 INFO:tasks.workunit.client.0.smithi052.stdout:4/470: mknod d11/d17/d23/d8e/ca9 0 2024-09-12T18:03:21.935 INFO:tasks.workunit.client.0.smithi052.stdout:3/413: write d0/d4/d25/d2a/f55 [446276,87307] 0 2024-09-12T18:03:21.935 INFO:tasks.workunit.client.0.smithi052.stdout:9/368: creat d0/d6/f80 x:0 0 0 2024-09-12T18:03:21.936 INFO:tasks.workunit.client.0.smithi052.stdout:1/338: getdents d3/d10/d38/d44/d49 0 2024-09-12T18:03:21.936 INFO:tasks.workunit.client.0.smithi052.stdout:5/420: dwrite d7/d1f/d3a/d49/f87 [0,4194304] 0 2024-09-12T18:03:21.936 INFO:tasks.workunit.client.0.smithi052.stdout:0/376: creat d2/d6/dd/d21/d41/d59/f71 x:0 0 0 2024-09-12T18:03:21.936 INFO:tasks.workunit.client.0.smithi052.stdout:9/369: dread - d0/d6/f80 zero size 2024-09-12T18:03:21.937 INFO:tasks.workunit.client.0.smithi052.stdout:4/471: rename d11/f8b to d11/d17/faa 0 2024-09-12T18:03:21.938 INFO:tasks.workunit.client.0.smithi052.stdout:0/377: chown d2/d1b/f52 30273 1 2024-09-12T18:03:21.939 INFO:tasks.workunit.client.0.smithi052.stdout:5/421: fdatasync d7/d1f/d45/f62 0 2024-09-12T18:03:21.939 INFO:tasks.workunit.client.0.smithi052.stdout:9/370: rmdir d0/d6/d3a/d43 39 2024-09-12T18:03:21.940 INFO:tasks.workunit.client.0.smithi052.stdout:3/414: rename d0/d4/c11 to d0/d4/d25/d2a/d6/d41/c92 0 2024-09-12T18:03:21.941 INFO:tasks.workunit.client.0.smithi052.stdout:4/472: dread - d11/d17/d1b/d2a/d82/d67/f81 zero size 2024-09-12T18:03:21.943 INFO:tasks.workunit.client.0.smithi052.stdout:5/422: unlink d7/d1f/d3a/d49/f73 0 2024-09-12T18:03:21.944 INFO:tasks.workunit.client.0.smithi052.stdout:2/403: dwrite da/dc/d15/f3e [4194304,4194304] 0 2024-09-12T18:03:21.946 INFO:tasks.workunit.client.0.smithi052.stdout:3/415: creat d0/d4/d25/d2a/d6/d7/d34/d72/f93 x:0 0 0 2024-09-12T18:03:21.947 INFO:tasks.workunit.client.0.smithi052.stdout:5/423: symlink d7/d1c/d1e/l8a 0 2024-09-12T18:03:21.947 INFO:tasks.workunit.client.0.smithi052.stdout:2/404: chown da/dc/d15/l32 32513236 1 2024-09-12T18:03:21.947 INFO:tasks.workunit.client.0.smithi052.stdout:6/501: dread d2/d3f/d58/d5d/d9c/d26/f2d [0,4194304] 0 2024-09-12T18:03:21.948 INFO:tasks.workunit.client.0.smithi052.stdout:1/339: dwrite d3/d1d/f2c [0,4194304] 0 2024-09-12T18:03:21.950 INFO:tasks.workunit.client.0.smithi052.stdout:4/473: dread d11/d17/d23/d2f/f3a [4194304,4194304] 0 2024-09-12T18:03:21.950 INFO:tasks.workunit.client.0.smithi052.stdout:9/371: dwrite d0/d1c/f32 [4194304,4194304] 0 2024-09-12T18:03:21.951 INFO:tasks.workunit.client.0.smithi052.stdout:4/474: dread - d11/d17/fa6 zero size 2024-09-12T18:03:21.951 INFO:tasks.workunit.client.0.smithi052.stdout:2/405: symlink da/dc/d15/d20/l88 0 2024-09-12T18:03:21.951 INFO:tasks.workunit.client.0.smithi052.stdout:3/416: creat d0/d4b/d57/f94 x:0 0 0 2024-09-12T18:03:21.952 INFO:tasks.workunit.client.0.smithi052.stdout:4/475: readlink d11/d17/d23/l49 0 2024-09-12T18:03:21.952 INFO:tasks.workunit.client.0.smithi052.stdout:9/372: mknod d0/d34/d72/c81 0 2024-09-12T18:03:21.953 INFO:tasks.workunit.client.0.smithi052.stdout:3/417: mkdir d0/d4b/d4c/d95 0 2024-09-12T18:03:21.954 INFO:tasks.workunit.client.0.smithi052.stdout:2/406: rename da/d1d/d35/c45 to da/d1d/d35/c89 0 2024-09-12T18:03:21.954 INFO:tasks.workunit.client.0.smithi052.stdout:6/502: getdents d2/d21/d76 0 2024-09-12T18:03:21.954 INFO:tasks.workunit.client.0.smithi052.stdout:3/418: symlink d0/d4/l96 0 2024-09-12T18:03:21.955 INFO:tasks.workunit.client.0.smithi052.stdout:2/407: getdents da/dc/d76 0 2024-09-12T18:03:21.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/419: unlink d0/c40 0 2024-09-12T18:03:21.958 INFO:tasks.workunit.client.0.smithi052.stdout:2/408: write da/dc/d15/d43/f4e [3023666,114676] 0 2024-09-12T18:03:21.959 INFO:tasks.workunit.client.0.smithi052.stdout:3/420: dread - d0/d4/d25/d2a/d6/d7/f74 zero size 2024-09-12T18:03:21.960 INFO:tasks.workunit.client.0.smithi052.stdout:5/424: dwrite d7/d1f/d45/f50 [0,4194304] 0 2024-09-12T18:03:21.960 INFO:tasks.workunit.client.0.smithi052.stdout:8/483: sync 2024-09-12T18:03:21.961 INFO:tasks.workunit.client.0.smithi052.stdout:4/476: dread d11/d17/d1b/d2a/d82/f80 [0,4194304] 0 2024-09-12T18:03:21.962 INFO:tasks.workunit.client.0.smithi052.stdout:9/373: dwrite d0/d6/d4a/f53 [0,4194304] 0 2024-09-12T18:03:21.963 INFO:tasks.workunit.client.0.smithi052.stdout:8/484: readlink d13/d18/d5b/d70/l98 0 2024-09-12T18:03:21.964 INFO:tasks.workunit.client.0.smithi052.stdout:6/503: dwrite d2/d3f/d54/f69 [0,4194304] 0 2024-09-12T18:03:21.964 INFO:tasks.workunit.client.0.smithi052.stdout:6/504: fsync d2/d3f/d58/fa8 0 2024-09-12T18:03:21.966 INFO:tasks.workunit.client.0.smithi052.stdout:5/425: mkdir d7/d51/d8b 0 2024-09-12T18:03:21.966 INFO:tasks.workunit.client.0.smithi052.stdout:9/374: creat d0/d6/d3a/d42/d61/f82 x:0 0 0 2024-09-12T18:03:21.967 INFO:tasks.workunit.client.0.smithi052.stdout:6/505: readlink d2/d15/d1a/l89 0 2024-09-12T18:03:21.967 INFO:tasks.workunit.client.0.smithi052.stdout:8/485: mkdir d13/d35/d9c/d9f 0 2024-09-12T18:03:21.968 INFO:tasks.workunit.client.0.smithi052.stdout:4/477: creat d11/d17/d23/d2f/fab x:0 0 0 2024-09-12T18:03:21.969 INFO:tasks.workunit.client.0.smithi052.stdout:8/486: read - d13/d3c/f95 zero size 2024-09-12T18:03:21.969 INFO:tasks.workunit.client.0.smithi052.stdout:3/421: dwrite d0/d4b/d57/d6d/f7e [0,4194304] 0 2024-09-12T18:03:21.969 INFO:tasks.workunit.client.0.smithi052.stdout:9/375: creat d0/d58/f83 x:0 0 0 2024-09-12T18:03:21.970 INFO:tasks.workunit.client.0.smithi052.stdout:2/409: dread da/dc/d15/d20/fe [4194304,4194304] 0 2024-09-12T18:03:21.970 INFO:tasks.workunit.client.0.smithi052.stdout:8/487: chown d13/d35/c60 119548848 1 2024-09-12T18:03:21.971 INFO:tasks.workunit.client.0.smithi052.stdout:9/376: rmdir d0/d6 39 2024-09-12T18:03:21.972 INFO:tasks.workunit.client.0.smithi052.stdout:7/362: dread d6/d12/d1e/d29/d5d/d71/d3a/f53 [0,4194304] 0 2024-09-12T18:03:21.973 INFO:tasks.workunit.client.0.smithi052.stdout:2/410: readlink da/d21/d6b/l81 0 2024-09-12T18:03:21.974 INFO:tasks.workunit.client.0.smithi052.stdout:3/422: creat d0/d4b/d4c/f97 x:0 0 0 2024-09-12T18:03:21.975 INFO:tasks.workunit.client.0.smithi052.stdout:4/478: getdents d11/d17/d1b 0 2024-09-12T18:03:21.976 INFO:tasks.workunit.client.0.smithi052.stdout:7/363: mknod d6/d12/c7b 0 2024-09-12T18:03:21.976 INFO:tasks.workunit.client.0.smithi052.stdout:2/411: read - da/d1d/d35/f5a zero size 2024-09-12T18:03:21.977 INFO:tasks.workunit.client.0.smithi052.stdout:9/377: write d0/d6/d4a/f6f [821543,47333] 0 2024-09-12T18:03:21.977 INFO:tasks.workunit.client.0.smithi052.stdout:4/479: stat d11/d17/d1b/d2a/d82/c58 0 2024-09-12T18:03:21.978 INFO:tasks.workunit.client.0.smithi052.stdout:1/340: dread d3/d1d/d22/d27/f50 [0,4194304] 0 2024-09-12T18:03:21.978 INFO:tasks.workunit.client.0.smithi052.stdout:5/426: dwrite d7/f8 [4194304,4194304] 0 2024-09-12T18:03:21.980 INFO:tasks.workunit.client.0.smithi052.stdout:8/488: rename d13/d18/f49 to d13/d35/d9c/d9f/fa0 0 2024-09-12T18:03:21.980 INFO:tasks.workunit.client.0.smithi052.stdout:0/378: dread d2/d6/dd/d21/f35 [0,4194304] 0 2024-09-12T18:03:21.980 INFO:tasks.workunit.client.0.smithi052.stdout:5/427: chown d7/d1f/d45/l4a 823736334 1 2024-09-12T18:03:21.981 INFO:tasks.workunit.client.0.smithi052.stdout:7/364: chown d6/d12/l69 0 1 2024-09-12T18:03:21.981 INFO:tasks.workunit.client.0.smithi052.stdout:2/412: symlink da/dc/d76/l8a 0 2024-09-12T18:03:21.983 INFO:tasks.workunit.client.0.smithi052.stdout:8/489: fdatasync d13/d18/d21/f50 0 2024-09-12T18:03:21.983 INFO:tasks.workunit.client.0.smithi052.stdout:6/506: dwrite d2/d3f/d58/d5d/f7d [0,4194304] 0 2024-09-12T18:03:21.984 INFO:tasks.workunit.client.0.smithi052.stdout:1/341: symlink d3/d1d/d22/d3f/d56/l75 0 2024-09-12T18:03:21.984 INFO:tasks.workunit.client.0.smithi052.stdout:6/507: truncate d2/d80/fa5 141959 0 2024-09-12T18:03:21.984 INFO:tasks.workunit.client.0.smithi052.stdout:6/508: stat d2/c44 0 2024-09-12T18:03:21.985 INFO:tasks.workunit.client.0.smithi052.stdout:2/413: fsync da/dc/d15/f79 0 2024-09-12T18:03:21.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/342: fdatasync d3/d1d/d22/d27/d28/f29 0 2024-09-12T18:03:21.986 INFO:tasks.workunit.client.0.smithi052.stdout:6/509: readlink d2/d21/l29 0 2024-09-12T18:03:21.986 INFO:tasks.workunit.client.0.smithi052.stdout:0/379: rename d2/d6/dd/d21/d26/d2f/d3a to d2/d1b/d72 0 2024-09-12T18:03:21.986 INFO:tasks.workunit.client.0.smithi052.stdout:7/365: creat d6/d12/d1e/d29/d5d/d71/d3a/d79/f7c x:0 0 0 2024-09-12T18:03:21.986 INFO:tasks.workunit.client.0.smithi052.stdout:5/428: creat d7/d1f/f8c x:0 0 0 2024-09-12T18:03:21.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/490: rename d13/d18/d38/c58 to d13/d35/d9c/d9f/ca1 0 2024-09-12T18:03:21.987 INFO:tasks.workunit.client.0.smithi052.stdout:9/378: getdents d0/d6/d3a/d42/d61/d6a 0 2024-09-12T18:03:21.987 INFO:tasks.workunit.client.0.smithi052.stdout:2/414: symlink da/dc/d15/l8b 0 2024-09-12T18:03:21.987 INFO:tasks.workunit.client.0.smithi052.stdout:7/366: stat d6/d12/d1e/d29/d5d/f4d 0 2024-09-12T18:03:21.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/491: fsync d13/d18/d21/f39 0 2024-09-12T18:03:21.989 INFO:tasks.workunit.client.0.smithi052.stdout:8/492: stat d13/d18/f3e 0 2024-09-12T18:03:21.990 INFO:tasks.workunit.client.0.smithi052.stdout:2/415: creat da/d21/d6b/f8c x:0 0 0 2024-09-12T18:03:21.990 INFO:tasks.workunit.client.0.smithi052.stdout:6/510: rename d2/d21/d76/c8a to d2/d49/caa 0 2024-09-12T18:03:21.990 INFO:tasks.workunit.client.0.smithi052.stdout:7/367: mkdir d6/d7d 0 2024-09-12T18:03:21.990 INFO:tasks.workunit.client.0.smithi052.stdout:8/493: mknod d13/d9b/ca2 0 2024-09-12T18:03:21.992 INFO:tasks.workunit.client.0.smithi052.stdout:8/494: chown d13/d18/d21 3830318 1 2024-09-12T18:03:21.992 INFO:tasks.workunit.client.0.smithi052.stdout:6/511: unlink d2/d15/l82 0 2024-09-12T18:03:21.993 INFO:tasks.workunit.client.0.smithi052.stdout:6/512: readlink d2/d21/l29 0 2024-09-12T18:03:21.994 INFO:tasks.workunit.client.0.smithi052.stdout:8/495: mkdir d13/d35/d9c/da3 0 2024-09-12T18:03:21.995 INFO:tasks.workunit.client.0.smithi052.stdout:4/480: dread d11/d17/d1b/d2a/d32/f75 [0,4194304] 0 2024-09-12T18:03:21.996 INFO:tasks.workunit.client.0.smithi052.stdout:6/513: mknod d2/d15/cab 0 2024-09-12T18:03:21.996 INFO:tasks.workunit.client.0.smithi052.stdout:0/380: dwrite d2/d6/dd/d21/d41/d44/f4e [0,4194304] 0 2024-09-12T18:03:21.997 INFO:tasks.workunit.client.0.smithi052.stdout:5/429: dwrite d7/f40 [0,4194304] 0 2024-09-12T18:03:21.997 INFO:tasks.workunit.client.0.smithi052.stdout:9/379: dwrite d0/d6/d3a/d42/f76 [0,4194304] 0 2024-09-12T18:03:21.997 INFO:tasks.workunit.client.0.smithi052.stdout:4/481: dread d11/d65/d6c/f6e [0,4194304] 0 2024-09-12T18:03:21.997 INFO:tasks.workunit.client.0.smithi052.stdout:7/368: truncate d6/dc/d1a/d6a/f72 367678 0 2024-09-12T18:03:21.998 INFO:tasks.workunit.client.0.smithi052.stdout:4/482: stat d11/d17/d1b/d2a/d82/f9a 0 2024-09-12T18:03:21.999 INFO:tasks.workunit.client.0.smithi052.stdout:8/496: symlink d13/d18/d21/la4 0 2024-09-12T18:03:21.999 INFO:tasks.workunit.client.0.smithi052.stdout:6/514: creat d2/d21/d76/fac x:0 0 0 2024-09-12T18:03:21.999 INFO:tasks.workunit.client.0.smithi052.stdout:5/430: mkdir d7/d51/d8d 0 2024-09-12T18:03:22.000 INFO:tasks.workunit.client.0.smithi052.stdout:0/381: rename d2/d8/f20 to d2/d6/dd/d21/d26/d2f/f73 0 2024-09-12T18:03:22.000 INFO:tasks.workunit.client.0.smithi052.stdout:8/497: write d13/d18/d5b/d70/f97 [687313,50967] 0 2024-09-12T18:03:22.003 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:22.003 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:22.004 INFO:tasks.workunit.client.0.smithi052.stdout:5/431: creat d7/d51/d8d/f8e x:0 0 0 2024-09-12T18:03:22.004 INFO:tasks.workunit.client.0.smithi052.stdout:5/432: stat d7/ff 0 2024-09-12T18:03:22.004 INFO:tasks.workunit.client.0.smithi052.stdout:3/423: truncate d0/d4/d25/d2a/d6/d7/de/f26 3783124 0 2024-09-12T18:03:22.004 INFO:tasks.workunit.client.0.smithi052.stdout:5/433: write d7/f38 [660027,25855] 0 2024-09-12T18:03:22.004 INFO:tasks.workunit.client.0.smithi052.stdout:1/343: truncate d3/fa 67800 0 2024-09-12T18:03:22.004 INFO:tasks.workunit.client.0.smithi052.stdout:8/498: rmdir d13/d18/d38 39 2024-09-12T18:03:22.005 INFO:tasks.workunit.client.0.smithi052.stdout:3/424: symlink d0/d16/d60/l98 0 2024-09-12T18:03:22.006 INFO:tasks.workunit.client.0.smithi052.stdout:1/344: truncate d3/d10/d38/f4d 1365051 0 2024-09-12T18:03:22.006 INFO:tasks.workunit.client.0.smithi052.stdout:8/499: symlink d13/d18/d38/d7a/la5 0 2024-09-12T18:03:22.007 INFO:tasks.workunit.client.0.smithi052.stdout:1/345: chown d3/d1d/d22/d3f/d56/l75 470 1 2024-09-12T18:03:22.007 INFO:tasks.workunit.client.0.smithi052.stdout:8/500: mknod d13/d18/d21/d64/ca6 0 2024-09-12T18:03:22.008 INFO:tasks.workunit.client.0.smithi052.stdout:1/346: write d3/d1d/d22/d27/f5c [7248936,80710] 0 2024-09-12T18:03:22.009 INFO:tasks.workunit.client.0.smithi052.stdout:9/380: read d0/d6/d4a/f6f [574174,62442] 0 2024-09-12T18:03:22.009 INFO:tasks.workunit.client.0.smithi052.stdout:8/501: rename d13/d35/f42 to d13/d35/d9c/fa7 0 2024-09-12T18:03:22.009 INFO:tasks.workunit.client.0.smithi052.stdout:2/416: dwrite da/dc/d15/d43/f72 [0,4194304] 0 2024-09-12T18:03:22.009 INFO:tasks.workunit.client.0.smithi052.stdout:1/347: fdatasync d3/d1d/d22/d3f/f5f 0 2024-09-12T18:03:22.009 INFO:tasks.workunit.client.0.smithi052.stdout:9/381: chown d0/d6/d4a/f6f 8034 1 2024-09-12T18:03:22.010 INFO:tasks.workunit.client.0.smithi052.stdout:9/382: stat d0/f1a 0 2024-09-12T18:03:22.010 INFO:tasks.workunit.client.0.smithi052.stdout:2/417: write da/dc/d15/f3c [1326876,38229] 0 2024-09-12T18:03:22.010 INFO:tasks.workunit.client.0.smithi052.stdout:9/383: dread - d0/d6/f80 zero size 2024-09-12T18:03:22.011 INFO:tasks.workunit.client.0.smithi052.stdout:1/348: fdatasync d3/d1d/d22/d27/f4f 0 2024-09-12T18:03:22.011 INFO:tasks.workunit.client.0.smithi052.stdout:8/502: mkdir d13/d35/d9c/da3/da8 0 2024-09-12T18:03:22.011 INFO:tasks.workunit.client.0.smithi052.stdout:1/349: fsync d3/f8 0 2024-09-12T18:03:22.012 INFO:tasks.workunit.client.0.smithi052.stdout:4/483: write d11/d17/d23/d2f/f31 [13363,39072] 0 2024-09-12T18:03:22.013 INFO:tasks.workunit.client.0.smithi052.stdout:8/503: read d13/f30 [997450,72248] 0 2024-09-12T18:03:22.019 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:22.015+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:22.020 INFO:tasks.workunit.client.0.smithi052.stdout:1/350: dread d3/d1d/f2c [0,4194304] 0 2024-09-12T18:03:22.020 INFO:tasks.workunit.client.0.smithi052.stdout:9/384: dwrite d0/d6/f80 [0,4194304] 0 2024-09-12T18:03:22.021 INFO:tasks.workunit.client.0.smithi052.stdout:1/351: fsync d3/d1d/f2c 0 2024-09-12T18:03:22.025 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:22.026 INFO:tasks.workunit.client.0.smithi052.stdout:8/504: dwrite d13/f1f [0,4194304] 0 2024-09-12T18:03:22.027 INFO:tasks.workunit.client.0.smithi052.stdout:4/484: dwrite d11/d17/d1b/d2a/f93 [0,4194304] 0 2024-09-12T18:03:22.027 INFO:tasks.workunit.client.0.smithi052.stdout:3/425: dread d0/d4/f47 [0,4194304] 0 2024-09-12T18:03:22.028 INFO:tasks.workunit.client.0.smithi052.stdout:8/505: chown d13/d35/c71 98852 1 2024-09-12T18:03:22.029 INFO:tasks.workunit.client.0.smithi052.stdout:9/385: truncate d0/d6/d3a/d42/f76 4748718 0 2024-09-12T18:03:22.029 INFO:tasks.workunit.client.0.smithi052.stdout:6/515: dread d2/f10 [0,4194304] 0 2024-09-12T18:03:22.029 INFO:tasks.workunit.client.0.smithi052.stdout:1/352: truncate d3/d1d/d22/d27/d28/f29 3021270 0 2024-09-12T18:03:22.030 INFO:tasks.workunit.client.0.smithi052.stdout:9/386: chown d0/fc 418 1 2024-09-12T18:03:22.030 INFO:tasks.workunit.client.0.smithi052.stdout:3/426: symlink d0/d4b/d4c/d6b/d48/l99 0 2024-09-12T18:03:22.031 INFO:tasks.workunit.client.0.smithi052.stdout:4/485: mknod d11/d17/d1b/d2a/d82/cac 0 2024-09-12T18:03:22.031 INFO:tasks.workunit.client.0.smithi052.stdout:7/369: dwrite d6/d12/d17/f74 [0,4194304] 0 2024-09-12T18:03:22.031 INFO:tasks.workunit.client.0.smithi052.stdout:6/516: stat d2/d3f/d58/d5d/d9c/d26/c27 0 2024-09-12T18:03:22.032 INFO:tasks.workunit.client.0.smithi052.stdout:3/427: write d0/d4/d25/d2a/d6/d7/f2b [3137722,33877] 0 2024-09-12T18:03:22.032 INFO:tasks.workunit.client.0.smithi052.stdout:7/370: write d6/dc/f50 [4491314,86382] 0 2024-09-12T18:03:22.034 INFO:tasks.workunit.client.0.smithi052.stdout:1/353: mkdir d3/d1d/d22/d76 0 2024-09-12T18:03:22.034 INFO:tasks.workunit.client.0.smithi052.stdout:7/371: write d6/dc/f50 [241214,101403] 0 2024-09-12T18:03:22.034 INFO:tasks.workunit.client.0.smithi052.stdout:3/428: rmdir d0 39 2024-09-12T18:03:22.034 INFO:tasks.workunit.client.0.smithi052.stdout:8/506: creat d13/d18/d38/d7a/fa9 x:0 0 0 2024-09-12T18:03:22.035 INFO:tasks.workunit.client.0.smithi052.stdout:8/507: chown d13/d18/f26 126572479 1 2024-09-12T18:03:22.035 INFO:tasks.workunit.client.0.smithi052.stdout:8/508: fsync d13/d3c/f62 0 2024-09-12T18:03:22.039 INFO:tasks.workunit.client.0.smithi052.stdout:3/429: creat d0/d4/d25/d2a/d6/d7/f9a x:0 0 0 2024-09-12T18:03:22.041 INFO:tasks.workunit.client.0.smithi052.stdout:4/486: dwrite d11/d17/d1b/d2a/d82/f4d [0,4194304] 0 2024-09-12T18:03:22.041 INFO:tasks.workunit.client.0.smithi052.stdout:9/387: dwrite d0/d34/f73 [0,4194304] 0 2024-09-12T18:03:22.042 INFO:tasks.workunit.client.0.smithi052.stdout:0/382: dread d2/d6/dd/d21/d26/d2f/f73 [0,4194304] 0 2024-09-12T18:03:22.043 INFO:tasks.workunit.client.0.smithi052.stdout:0/383: stat d2/c24 0 2024-09-12T18:03:22.043 INFO:tasks.workunit.client.0.smithi052.stdout:7/372: dwrite d6/dc/d1a/f5b [0,4194304] 0 2024-09-12T18:03:22.043 INFO:tasks.workunit.client.0.smithi052.stdout:3/430: creat d0/d4/d25/d2a/d6/d7/de/f9b x:0 0 0 2024-09-12T18:03:22.043 INFO:tasks.workunit.client.0.smithi052.stdout:0/384: mknod d2/d6/dd/d21/d47/c74 0 2024-09-12T18:03:22.043 INFO:tasks.workunit.client.0.smithi052.stdout:4/487: creat d11/d46/fad x:0 0 0 2024-09-12T18:03:22.044 INFO:tasks.workunit.client.0.smithi052.stdout:7/373: symlink d6/d7d/l7e 0 2024-09-12T18:03:22.044 INFO:tasks.workunit.client.0.smithi052.stdout:3/431: mknod d0/d4b/d57/c9c 0 2024-09-12T18:03:22.045 INFO:tasks.workunit.client.0.smithi052.stdout:0/385: truncate d2/d8/f43 4387599 0 2024-09-12T18:03:22.045 INFO:tasks.workunit.client.0.smithi052.stdout:0/386: chown d2/d57 6 1 2024-09-12T18:03:22.046 INFO:tasks.workunit.client.0.smithi052.stdout:6/517: dread d2/d15/f25 [0,4194304] 0 2024-09-12T18:03:22.046 INFO:tasks.workunit.client.0.smithi052.stdout:8/509: truncate d13/d18/d21/f27 133502 0 2024-09-12T18:03:22.046 INFO:tasks.workunit.client.0.smithi052.stdout:9/388: link d0/l2 d0/d18/d26/d33/l84 0 2024-09-12T18:03:22.048 INFO:tasks.workunit.client.0.smithi052.stdout:6/518: chown d2/d3f/f99 1830475863 1 2024-09-12T18:03:22.048 INFO:tasks.workunit.client.0.smithi052.stdout:0/387: creat d2/d6/dd/d21/d41/f75 x:0 0 0 2024-09-12T18:03:22.048 INFO:tasks.workunit.client.0.smithi052.stdout:9/389: unlink d0/d6/c9 0 2024-09-12T18:03:22.048 INFO:tasks.workunit.client.0.smithi052.stdout:3/432: mknod d0/d4/d33/d89/c9d 0 2024-09-12T18:03:22.049 INFO:tasks.workunit.client.0.smithi052.stdout:8/510: write d13/d18/d21/d64/f8c [1992673,115977] 0 2024-09-12T18:03:22.050 INFO:tasks.workunit.client.0.smithi052.stdout:0/388: fsync d2/d6/dd/d21/d26/d2f/f33 0 2024-09-12T18:03:22.051 INFO:tasks.workunit.client.0.smithi052.stdout:6/519: link d2/d3f/d58/d5d/d9c/d26/f5c d2/d21/d6a/fad 0 2024-09-12T18:03:22.051 INFO:tasks.workunit.client.0.smithi052.stdout:8/511: link d13/l2c d13/laa 0 2024-09-12T18:03:22.052 INFO:tasks.workunit.client.0.smithi052.stdout:4/488: dwrite d11/d17/d1b/d2a/d82/f53 [0,4194304] 0 2024-09-12T18:03:22.054 INFO:tasks.workunit.client.0.smithi052.stdout:7/374: dread d6/d12/d1e/d29/d5d/f65 [0,4194304] 0 2024-09-12T18:03:22.055 INFO:tasks.workunit.client.0.smithi052.stdout:6/520: rename d2/d21/d76/fac to d2/d80/fae 0 2024-09-12T18:03:22.057 INFO:tasks.workunit.client.0.smithi052.stdout:6/521: creat d2/d3f/d58/d5d/d9c/d26/faf x:0 0 0 2024-09-12T18:03:22.057 INFO:tasks.workunit.client.0.smithi052.stdout:7/375: mknod d6/c7f 0 2024-09-12T18:03:22.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/433: dwrite d0/d4/d25/d2a/d6/d41/f45 [4194304,4194304] 0 2024-09-12T18:03:22.059 INFO:tasks.workunit.client.0.smithi052.stdout:6/522: chown d2/d5e/f93 7 1 2024-09-12T18:03:22.059 INFO:tasks.workunit.client.0.smithi052.stdout:7/376: chown d6/dc/c66 3398538 1 2024-09-12T18:03:22.060 INFO:tasks.workunit.client.0.smithi052.stdout:6/523: unlink d2/d21/f65 0 2024-09-12T18:03:22.060 INFO:tasks.workunit.client.0.smithi052.stdout:4/489: dwrite d11/d17/d1b/f9f [0,4194304] 0 2024-09-12T18:03:22.061 INFO:tasks.workunit.client.0.smithi052.stdout:0/389: getdents d2/d6/dd/d21/d47 0 2024-09-12T18:03:22.061 INFO:tasks.workunit.client.0.smithi052.stdout:9/390: truncate d0/fb 4006507 0 2024-09-12T18:03:22.061 INFO:tasks.workunit.client.0.smithi052.stdout:6/524: chown d2/d21/f2a 199354 1 2024-09-12T18:03:22.061 INFO:tasks.workunit.client.0.smithi052.stdout:8/512: dwrite d13/d18/d5b/d70/f90 [0,4194304] 0 2024-09-12T18:03:22.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/377: unlink d6/dc/f2e 0 2024-09-12T18:03:22.065 INFO:tasks.workunit.client.0.smithi052.stdout:8/513: chown d13/d18/d21/f54 43590 1 2024-09-12T18:03:22.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/378: mkdir d6/d56/d80 0 2024-09-12T18:03:22.066 INFO:tasks.workunit.client.0.smithi052.stdout:6/525: creat d2/d3f/d58/d5d/fb0 x:0 0 0 2024-09-12T18:03:22.066 INFO:tasks.workunit.client.0.smithi052.stdout:8/514: mknod d13/d18/d5b/d70/cab 0 2024-09-12T18:03:22.066 INFO:tasks.workunit.client.0.smithi052.stdout:3/434: dwrite d0/d4/d33/f3b [0,4194304] 0 2024-09-12T18:03:22.067 INFO:tasks.workunit.client.0.smithi052.stdout:3/435: write d0/d4b/d57/d6d/f7e [1271416,22631] 0 2024-09-12T18:03:22.067 INFO:tasks.workunit.client.0.smithi052.stdout:0/390: mknod d2/d6/dd/d21/d41/d59/c76 0 2024-09-12T18:03:22.068 INFO:tasks.workunit.client.0.smithi052.stdout:3/436: dread d0/d4/f28 [0,4194304] 0 2024-09-12T18:03:22.068 INFO:tasks.workunit.client.0.smithi052.stdout:0/391: mknod d2/d6/dd/d21/d41/d59/c77 0 2024-09-12T18:03:22.068 INFO:tasks.workunit.client.0.smithi052.stdout:6/526: mknod d2/d3f/cb1 0 2024-09-12T18:03:22.068 INFO:tasks.workunit.client.0.smithi052.stdout:8/515: truncate d13/d18/d21/f54 338811 0 2024-09-12T18:03:22.071 INFO:tasks.workunit.client.0.smithi052.stdout:8/516: creat d13/d18/d21/fac x:0 0 0 2024-09-12T18:03:22.071 INFO:tasks.workunit.client.0.smithi052.stdout:3/437: read d0/d4/d25/d2a/d2c/f67 [249849,2309] 0 2024-09-12T18:03:22.071 INFO:tasks.workunit.client.0.smithi052.stdout:0/392: rename d2/d6/dd/d21/d26/d2f/f73 to d2/d6/dd/d21/d26/f78 0 2024-09-12T18:03:22.071 INFO:tasks.workunit.client.0.smithi052.stdout:9/391: read d0/d1c/f22 [2247164,110214] 0 2024-09-12T18:03:22.072 INFO:tasks.workunit.client.0.smithi052.stdout:8/517: rename d13/d3c/f65 to d13/d35/d9c/da3/fad 0 2024-09-12T18:03:22.072 INFO:tasks.workunit.client.0.smithi052.stdout:9/392: unlink d0/d6/f3d 0 2024-09-12T18:03:22.073 INFO:tasks.workunit.client.0.smithi052.stdout:8/518: write d13/d35/d9c/fa7 [4346770,120334] 0 2024-09-12T18:03:22.075 INFO:tasks.workunit.client.0.smithi052.stdout:6/527: dwrite d2/d15/d1a/f1f [0,4194304] 0 2024-09-12T18:03:22.076 INFO:tasks.workunit.client.0.smithi052.stdout:2/418: sync 2024-09-12T18:03:22.076 INFO:tasks.workunit.client.0.smithi052.stdout:5/434: sync 2024-09-12T18:03:22.078 INFO:tasks.workunit.client.0.smithi052.stdout:6/528: symlink d2/d3f/d58/d5d/d9c/lb2 0 2024-09-12T18:03:22.078 INFO:tasks.workunit.client.0.smithi052.stdout:3/438: dwrite d0/f13 [8388608,4194304] 0 2024-09-12T18:03:22.083 INFO:tasks.workunit.client.0.smithi052.stdout:9/393: dwrite d0/d6/d4a/f69 [0,4194304] 0 2024-09-12T18:03:22.083 INFO:tasks.workunit.client.0.smithi052.stdout:5/435: rename d7/d1c/c72 to d7/d1c/d67/c8f 0 2024-09-12T18:03:22.083 INFO:tasks.workunit.client.0.smithi052.stdout:6/529: write d2/d3f/d58/d5d/d9c/d26/f7c [543624,119057] 0 2024-09-12T18:03:22.084 INFO:tasks.workunit.client.0.smithi052.stdout:8/519: dwrite d13/d35/d9c/da3/fad [0,4194304] 0 2024-09-12T18:03:22.086 INFO:tasks.workunit.client.0.smithi052.stdout:5/436: symlink d7/d1f/d3a/d49/d54/d6b/l90 0 2024-09-12T18:03:22.088 INFO:tasks.workunit.client.0.smithi052.stdout:9/394: mkdir d0/d6/d3a/d42/d61/d85 0 2024-09-12T18:03:22.088 INFO:tasks.workunit.client.0.smithi052.stdout:7/379: write d6/f3c [711038,26695] 0 2024-09-12T18:03:22.088 INFO:tasks.workunit.client.0.smithi052.stdout:8/520: write d13/d18/d21/f39 [360883,76662] 0 2024-09-12T18:03:22.089 INFO:tasks.workunit.client.0.smithi052.stdout:5/437: mkdir d7/d1f/d3a/d49/d91 0 2024-09-12T18:03:22.089 INFO:tasks.workunit.client.0.smithi052.stdout:9/395: read d0/fc [2311089,9008] 0 2024-09-12T18:03:22.089 INFO:tasks.workunit.client.0.smithi052.stdout:3/439: truncate d0/d4b/d4c/d6b/d48/f51 880488 0 2024-09-12T18:03:22.090 INFO:tasks.workunit.client.0.smithi052.stdout:8/521: write d13/d18/d21/f59 [4520278,47447] 0 2024-09-12T18:03:22.092 INFO:tasks.workunit.client.0.smithi052.stdout:8/522: symlink d13/d35/d9c/da3/lae 0 2024-09-12T18:03:22.093 INFO:tasks.workunit.client.0.smithi052.stdout:2/419: dwrite da/dc/d15/d20/f4f [0,4194304] 0 2024-09-12T18:03:22.093 INFO:tasks.workunit.client.0.smithi052.stdout:9/396: link d0/d6/l2c d0/d58/d7f/l86 0 2024-09-12T18:03:22.094 INFO:tasks.workunit.client.0.smithi052.stdout:3/440: mknod d0/d4/d25/d2a/d6/d7/d34/d72/c9e 0 2024-09-12T18:03:22.094 INFO:tasks.workunit.client.0.smithi052.stdout:6/530: dwrite d2/d15/d1a/f45 [0,4194304] 0 2024-09-12T18:03:22.095 INFO:tasks.workunit.client.0.smithi052.stdout:2/420: fdatasync da/dc/d15/d20/d60/f7c 0 2024-09-12T18:03:22.095 INFO:tasks.workunit.client.0.smithi052.stdout:5/438: link d7/d1f/d34/l63 d7/d1c/d1e/l92 0 2024-09-12T18:03:22.095 INFO:tasks.workunit.client.0.smithi052.stdout:9/397: rename d0/d34 to d0/d18/d37/d87 0 2024-09-12T18:03:22.096 INFO:tasks.workunit.client.0.smithi052.stdout:6/531: creat d2/d80/fb3 x:0 0 0 2024-09-12T18:03:22.097 INFO:tasks.workunit.client.0.smithi052.stdout:9/398: mknod d0/d6/d4a/c88 0 2024-09-12T18:03:22.097 INFO:tasks.workunit.client.0.smithi052.stdout:6/532: creat d2/d49/fb4 x:0 0 0 2024-09-12T18:03:22.099 INFO:tasks.workunit.client.0.smithi052.stdout:6/533: link d2/d3f/f99 d2/d21/d9f/fb5 0 2024-09-12T18:03:22.099 INFO:tasks.workunit.client.0.smithi052.stdout:9/399: getdents d0/d18/d26/d33 0 2024-09-12T18:03:22.101 INFO:tasks.workunit.client.0.smithi052.stdout:0/393: dread d2/d6/dd/d21/d26/d38/f49 [0,4194304] 0 2024-09-12T18:03:22.101 INFO:tasks.workunit.client.0.smithi052.stdout:9/400: write d0/d58/f83 [841700,55077] 0 2024-09-12T18:03:22.102 INFO:tasks.workunit.client.0.smithi052.stdout:0/394: creat d2/d6/dd/d21/d41/f79 x:0 0 0 2024-09-12T18:03:22.102 INFO:tasks.workunit.client.0.smithi052.stdout:4/490: sync 2024-09-12T18:03:22.103 INFO:tasks.workunit.client.0.smithi052.stdout:1/354: sync 2024-09-12T18:03:22.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/380: sync 2024-09-12T18:03:22.103 INFO:tasks.workunit.client.0.smithi052.stdout:9/401: link d0/d18/d37/d87/l70 d0/d6/d3a/d43/d74/l89 0 2024-09-12T18:03:22.103 INFO:tasks.workunit.client.0.smithi052.stdout:9/402: stat d0/d18/c39 0 2024-09-12T18:03:22.103 INFO:tasks.workunit.client.0.smithi052.stdout:9/403: sync 2024-09-12T18:03:22.104 INFO:tasks.workunit.client.0.smithi052.stdout:0/395: getdents d2/d6/dd/d21/d26/d2f 0 2024-09-12T18:03:22.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/381: write d6/d12/d1e/f6d [1145216,29117] 0 2024-09-12T18:03:22.105 INFO:tasks.workunit.client.0.smithi052.stdout:9/404: creat d0/d18/d26/d4d/f8a x:0 0 0 2024-09-12T18:03:22.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/405: sync 2024-09-12T18:03:22.106 INFO:tasks.workunit.client.0.smithi052.stdout:0/396: chown d2/d8/c42 2882426 1 2024-09-12T18:03:22.106 INFO:tasks.workunit.client.0.smithi052.stdout:4/491: truncate d11/d17/d1b/d2a/d6a/f73 939101 0 2024-09-12T18:03:22.106 INFO:tasks.workunit.client.0.smithi052.stdout:7/382: truncate d6/f5a 2134 0 2024-09-12T18:03:22.107 INFO:tasks.workunit.client.0.smithi052.stdout:9/406: write d0/d1c/f20 [3206073,58205] 0 2024-09-12T18:03:22.108 INFO:tasks.workunit.client.0.smithi052.stdout:0/397: fsync d2/d57/d5b/f64 0 2024-09-12T18:03:22.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/407: unlink d0/cf 0 2024-09-12T18:03:22.110 INFO:tasks.workunit.client.0.smithi052.stdout:4/492: mkdir d11/d17/d23/dae 0 2024-09-12T18:03:22.110 INFO:tasks.workunit.client.0.smithi052.stdout:2/421: dread da/dc/d15/f19 [0,4194304] 0 2024-09-12T18:03:22.110 INFO:tasks.workunit.client.0.smithi052.stdout:0/398: write d2/d6/f10 [173637,85329] 0 2024-09-12T18:03:22.110 INFO:tasks.workunit.client.0.smithi052.stdout:7/383: rename f5 to d6/d12/d1e/d29/d5d/d71/d3a/d79/f81 0 2024-09-12T18:03:22.112 INFO:tasks.workunit.client.0.smithi052.stdout:2/422: readlink da/dc/d15/l8b 0 2024-09-12T18:03:22.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/534: dwrite d2/d21/f4c [0,4194304] 0 2024-09-12T18:03:22.112 INFO:tasks.workunit.client.0.smithi052.stdout:0/399: mkdir d2/d57/d5b/d7a 0 2024-09-12T18:03:22.112 INFO:tasks.workunit.client.0.smithi052.stdout:4/493: write d11/f1f [4976396,34381] 0 2024-09-12T18:03:22.113 INFO:tasks.workunit.client.0.smithi052.stdout:2/423: rmdir da/dc/d15 39 2024-09-12T18:03:22.114 INFO:tasks.workunit.client.0.smithi052.stdout:8/523: dread d13/f17 [0,4194304] 0 2024-09-12T18:03:22.116 INFO:tasks.workunit.client.0.smithi052.stdout:6/535: write d2/f51 [246351,52559] 0 2024-09-12T18:03:22.116 INFO:tasks.workunit.client.0.smithi052.stdout:7/384: mknod d6/dc/d1a/c82 0 2024-09-12T18:03:22.117 INFO:tasks.workunit.client.0.smithi052.stdout:8/524: symlink d13/d35/d9c/da3/laf 0 2024-09-12T18:03:22.117 INFO:tasks.workunit.client.0.smithi052.stdout:2/424: creat da/dc/d15/d22/f8d x:0 0 0 2024-09-12T18:03:22.118 INFO:tasks.workunit.client.0.smithi052.stdout:7/385: write d6/f3c [1569175,86653] 0 2024-09-12T18:03:22.119 INFO:tasks.workunit.client.0.smithi052.stdout:4/494: getdents d11/d17/d1b 0 2024-09-12T18:03:22.119 INFO:tasks.workunit.client.0.smithi052.stdout:6/536: fsync d2/d3f/d58/f66 0 2024-09-12T18:03:22.119 INFO:tasks.workunit.client.0.smithi052.stdout:2/425: chown da/dc/d15/d36/l63 1 1 2024-09-12T18:03:22.120 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:22.115+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:22.120 INFO:tasks.workunit.client.0.smithi052.stdout:8/525: rmdir d13/d35/d9c/da3/da8 0 2024-09-12T18:03:22.120 INFO:tasks.workunit.client.0.smithi052.stdout:5/439: dread d7/d1c/d1e/f2b [0,4194304] 0 2024-09-12T18:03:22.120 INFO:tasks.workunit.client.0.smithi052.stdout:3/441: dread d0/f13 [4194304,4194304] 0 2024-09-12T18:03:22.121 INFO:tasks.workunit.client.0.smithi052.stdout:6/537: write d2/d3f/d54/f69 [1159420,126958] 0 2024-09-12T18:03:22.121 INFO:tasks.workunit.client.0.smithi052.stdout:5/440: read - d7/d1c/d6f/f89 zero size 2024-09-12T18:03:22.122 INFO:tasks.workunit.client.0.smithi052.stdout:8/526: creat d13/d18/d5b/d70/fb0 x:0 0 0 2024-09-12T18:03:22.122 INFO:tasks.workunit.client.0.smithi052.stdout:4/495: mkdir d11/d17/d1b/d2a/d82/d67/daf 0 2024-09-12T18:03:22.122 INFO:tasks.workunit.client.0.smithi052.stdout:3/442: readlink d0/d4/l96 0 2024-09-12T18:03:22.122 INFO:tasks.workunit.client.0.smithi052.stdout:2/426: write da/d1d/f1e [235715,9229] 0 2024-09-12T18:03:22.122 INFO:tasks.workunit.client.0.smithi052.stdout:6/538: symlink d2/d80/lb6 0 2024-09-12T18:03:22.122 INFO:tasks.workunit.client.0.smithi052.stdout:2/427: rmdir da/d1d 39 2024-09-12T18:03:22.123 INFO:tasks.workunit.client.0.smithi052.stdout:3/443: symlink d0/d4/d25/l9f 0 2024-09-12T18:03:22.124 INFO:tasks.workunit.client.0.smithi052.stdout:4/496: mknod d11/d17/d1b/d2a/d82/d67/d95/cb0 0 2024-09-12T18:03:22.124 INFO:tasks.workunit.client.0.smithi052.stdout:0/400: write d2/d1b/f2e [247919,71642] 0 2024-09-12T18:03:22.124 INFO:tasks.workunit.client.0.smithi052.stdout:7/386: rename d6/d12/d1e/d29/d5d/d71/d3a/d79 to d6/d12/d1e/d29/d5d/d71/d3a/d83 0 2024-09-12T18:03:22.125 INFO:tasks.workunit.client.0.smithi052.stdout:8/527: truncate d13/d18/d38/f91 636642 0 2024-09-12T18:03:22.125 INFO:tasks.workunit.client.0.smithi052.stdout:2/428: dread - da/d21/d6b/f8c zero size 2024-09-12T18:03:22.125 INFO:tasks.workunit.client.0.smithi052.stdout:3/444: write d0/d16/f1e [3248210,35580] 0 2024-09-12T18:03:22.125 INFO:tasks.workunit.client.0.smithi052.stdout:8/528: dread - d13/f9e zero size 2024-09-12T18:03:22.126 INFO:tasks.workunit.client.0.smithi052.stdout:7/387: write d6/d12/d1e/d29/d5d/f78 [4967137,124298] 0 2024-09-12T18:03:22.127 INFO:tasks.workunit.client.0.smithi052.stdout:0/401: creat d2/d1b/d72/d69/f7b x:0 0 0 2024-09-12T18:03:22.127 INFO:tasks.workunit.client.0.smithi052.stdout:3/445: creat d0/fa0 x:0 0 0 2024-09-12T18:03:22.127 INFO:tasks.workunit.client.0.smithi052.stdout:9/408: truncate d0/d18/d26/d33/f62 357324 0 2024-09-12T18:03:22.128 INFO:tasks.workunit.client.0.smithi052.stdout:8/529: creat d13/d18/d5b/fb1 x:0 0 0 2024-09-12T18:03:22.128 INFO:tasks.workunit.client.0.smithi052.stdout:4/497: write d11/d17/d1b/d2a/d82/d67/f87 [600345,32932] 0 2024-09-12T18:03:22.129 INFO:tasks.workunit.client.0.smithi052.stdout:9/409: symlink d0/d18/l8b 0 2024-09-12T18:03:22.129 INFO:tasks.workunit.client.0.smithi052.stdout:8/530: fsync d13/d18/d38/f46 0 2024-09-12T18:03:22.129 INFO:tasks.workunit.client.0.smithi052.stdout:6/539: dread d2/f51 [0,4194304] 0 2024-09-12T18:03:22.130 INFO:tasks.workunit.client.0.smithi052.stdout:0/402: creat d2/d6/dd/d21/d26/d65/f7c x:0 0 0 2024-09-12T18:03:22.131 INFO:tasks.workunit.client.0.smithi052.stdout:3/446: mkdir d0/d4/d25/d2a/d6/d7/de/da1 0 2024-09-12T18:03:22.131 INFO:tasks.workunit.client.0.smithi052.stdout:8/531: rmdir d13/d9b 39 2024-09-12T18:03:22.131 INFO:tasks.workunit.client.0.smithi052.stdout:7/388: rename d6/d12/d1e/d29/d5d/d71/d3a/f3d to d6/d12/d1e/d29/d5d/d71/d3a/f84 0 2024-09-12T18:03:22.131 INFO:tasks.workunit.client.0.smithi052.stdout:0/403: read - d2/d1b/d72/d69/f7b zero size 2024-09-12T18:03:22.131 INFO:tasks.workunit.client.0.smithi052.stdout:6/540: symlink d2/d3f/lb7 0 2024-09-12T18:03:22.132 INFO:tasks.workunit.client.0.smithi052.stdout:4/498: getdents d11/d17/d23/d2f 0 2024-09-12T18:03:22.132 INFO:tasks.workunit.client.0.smithi052.stdout:8/532: fsync d13/d35/f8b 0 2024-09-12T18:03:22.132 INFO:tasks.workunit.client.0.smithi052.stdout:3/447: mknod d0/d4/d25/ca2 0 2024-09-12T18:03:22.133 INFO:tasks.workunit.client.0.smithi052.stdout:5/441: write d7/d1c/d1e/f44 [1544488,58166] 0 2024-09-12T18:03:22.134 INFO:tasks.workunit.client.0.smithi052.stdout:2/429: dread da/d1d/d35/f33 [0,4194304] 0 2024-09-12T18:03:22.134 INFO:tasks.workunit.client.0.smithi052.stdout:7/389: write d6/dc/d1a/f54 [2689052,106762] 0 2024-09-12T18:03:22.134 INFO:tasks.workunit.client.0.smithi052.stdout:1/355: dread d3/d1d/d22/d27/f5c [4194304,4194304] 0 2024-09-12T18:03:22.135 INFO:tasks.workunit.client.0.smithi052.stdout:2/430: mkdir da/d1d/d35/d8e 0 2024-09-12T18:03:22.136 INFO:tasks.workunit.client.0.smithi052.stdout:5/442: symlink d7/d1c/d6f/l93 0 2024-09-12T18:03:22.136 INFO:tasks.workunit.client.0.smithi052.stdout:7/390: chown d6/d7d/l7e 8 1 2024-09-12T18:03:22.136 INFO:tasks.workunit.client.0.smithi052.stdout:8/533: creat d13/d35/fb2 x:0 0 0 2024-09-12T18:03:22.136 INFO:tasks.workunit.client.0.smithi052.stdout:9/410: dread d0/d6/f80 [0,4194304] 0 2024-09-12T18:03:22.137 INFO:tasks.workunit.client.0.smithi052.stdout:1/356: creat d3/f77 x:0 0 0 2024-09-12T18:03:22.137 INFO:tasks.workunit.client.0.smithi052.stdout:8/534: fdatasync d13/d18/d21/fac 0 2024-09-12T18:03:22.138 INFO:tasks.workunit.client.0.smithi052.stdout:2/431: symlink da/l8f 0 2024-09-12T18:03:22.138 INFO:tasks.workunit.client.0.smithi052.stdout:5/443: fsync d7/d51/d8d/f8e 0 2024-09-12T18:03:22.138 INFO:tasks.workunit.client.0.smithi052.stdout:3/448: fsync d0/d4/d25/d2a/d6/d7/de/f4f 0 2024-09-12T18:03:22.138 INFO:tasks.workunit.client.0.smithi052.stdout:6/541: dread d2/d21/f95 [0,4194304] 0 2024-09-12T18:03:22.139 INFO:tasks.workunit.client.0.smithi052.stdout:1/357: symlink d3/d1d/d22/d27/d28/d2f/l78 0 2024-09-12T18:03:22.141 INFO:tasks.workunit.client.0.smithi052.stdout:2/432: fdatasync da/d1d/f29 0 2024-09-12T18:03:22.141 INFO:tasks.workunit.client.0.smithi052.stdout:8/535: mknod d13/d18/d5b/cb3 0 2024-09-12T18:03:22.141 INFO:tasks.workunit.client.0.smithi052.stdout:3/449: rmdir d0/d4/d25/d2a/d2c 39 2024-09-12T18:03:22.142 INFO:tasks.workunit.client.0.smithi052.stdout:4/499: dwrite d11/f16 [0,4194304] 0 2024-09-12T18:03:22.142 INFO:tasks.workunit.client.0.smithi052.stdout:9/411: getdents d0/d6/d3a/d42 0 2024-09-12T18:03:22.142 INFO:tasks.workunit.client.0.smithi052.stdout:4/500: readlink d11/l3d 0 2024-09-12T18:03:22.142 INFO:tasks.workunit.client.0.smithi052.stdout:1/358: truncate d3/d1d/d22/d66/f6e 531274 0 2024-09-12T18:03:22.143 INFO:tasks.workunit.client.0.smithi052.stdout:1/359: readlink d3/d10/d38/d44/d49/l70 0 2024-09-12T18:03:22.143 INFO:tasks.workunit.client.0.smithi052.stdout:1/360: sync 2024-09-12T18:03:22.144 INFO:tasks.workunit.client.0.smithi052.stdout:8/536: creat d13/d18/d38/fb4 x:0 0 0 2024-09-12T18:03:22.145 INFO:tasks.workunit.client.0.smithi052.stdout:0/404: truncate d2/d6/f10 3220085 0 2024-09-12T18:03:22.145 INFO:tasks.workunit.client.0.smithi052.stdout:6/542: link d2/d3f/d58/d5d/l88 d2/d21/d6a/d97/lb8 0 2024-09-12T18:03:22.146 INFO:tasks.workunit.client.0.smithi052.stdout:9/412: link d0/d18/c50 d0/d18/d26/c8c 0 2024-09-12T18:03:22.146 INFO:tasks.workunit.client.0.smithi052.stdout:0/405: chown d2/d6/dd/f60 5 1 2024-09-12T18:03:22.146 INFO:tasks.workunit.client.0.smithi052.stdout:2/433: creat da/dc/d15/d22/d87/f90 x:0 0 0 2024-09-12T18:03:22.147 INFO:tasks.workunit.client.0.smithi052.stdout:9/413: chown d0/d18/d37/d87/d72/c81 2 1 2024-09-12T18:03:22.148 INFO:tasks.workunit.client.0.smithi052.stdout:0/406: chown d2/d6/dd/c54 193530 1 2024-09-12T18:03:22.148 INFO:tasks.workunit.client.0.smithi052.stdout:4/501: dread d11/d17/d23/d2f/f3a [4194304,4194304] 0 2024-09-12T18:03:22.148 INFO:tasks.workunit.client.0.smithi052.stdout:6/543: creat d2/d5e/fb9 x:0 0 0 2024-09-12T18:03:22.148 INFO:tasks.workunit.client.0.smithi052.stdout:0/407: chown d2/f31 185459101 1 2024-09-12T18:03:22.149 INFO:tasks.workunit.client.0.smithi052.stdout:9/414: creat d0/d1c/f8d x:0 0 0 2024-09-12T18:03:22.149 INFO:tasks.workunit.client.0.smithi052.stdout:2/434: creat da/d1d/d7d/f91 x:0 0 0 2024-09-12T18:03:22.149 INFO:tasks.workunit.client.0.smithi052.stdout:2/435: sync 2024-09-12T18:03:22.149 INFO:tasks.workunit.client.0.smithi052.stdout:4/502: fsync f8 0 2024-09-12T18:03:22.149 INFO:tasks.workunit.client.0.smithi052.stdout:5/444: truncate d7/d1c/d1e/f2b 7302410 0 2024-09-12T18:03:22.150 INFO:tasks.workunit.client.0.smithi052.stdout:4/503: rmdir d11 39 2024-09-12T18:03:22.150 INFO:tasks.workunit.client.0.smithi052.stdout:9/415: write d0/d18/f36 [405180,103013] 0 2024-09-12T18:03:22.150 INFO:tasks.workunit.client.0.smithi052.stdout:6/544: write d2/d3f/d58/d5d/f7d [3806676,42790] 0 2024-09-12T18:03:22.150 INFO:tasks.workunit.client.0.smithi052.stdout:0/408: unlink d2/d6/dd/d21/d26/d2f/f33 0 2024-09-12T18:03:22.151 INFO:tasks.workunit.client.0.smithi052.stdout:5/445: chown f4 6 1 2024-09-12T18:03:22.151 INFO:tasks.workunit.client.0.smithi052.stdout:0/409: readlink d2/l2d 0 2024-09-12T18:03:22.152 INFO:tasks.workunit.client.0.smithi052.stdout:9/416: readlink d0/d6/d3a/d43/d74/l89 0 2024-09-12T18:03:22.152 INFO:tasks.workunit.client.0.smithi052.stdout:2/436: truncate da/dc/d15/d22/f54 1101329 0 2024-09-12T18:03:22.152 INFO:tasks.workunit.client.0.smithi052.stdout:9/417: sync 2024-09-12T18:03:22.153 INFO:tasks.workunit.client.0.smithi052.stdout:5/446: creat d7/d1f/d45/f94 x:0 0 0 2024-09-12T18:03:22.153 INFO:tasks.workunit.client.0.smithi052.stdout:0/410: fdatasync d2/d8/f30 0 2024-09-12T18:03:22.153 INFO:tasks.workunit.client.0.smithi052.stdout:4/504: write d11/d17/d1b/d2a/d33/f8c [1017142,89418] 0 2024-09-12T18:03:22.155 INFO:tasks.workunit.client.0.smithi052.stdout:8/537: dwrite f7 [4194304,4194304] 0 2024-09-12T18:03:22.156 INFO:tasks.workunit.client.0.smithi052.stdout:6/545: write d2/d3f/d58/d5d/d9c/d26/f36 [1056134,71184] 0 2024-09-12T18:03:22.156 INFO:tasks.workunit.client.0.smithi052.stdout:4/505: readlink d11/d17/d23/d2f/l96 0 2024-09-12T18:03:22.156 INFO:tasks.workunit.client.0.smithi052.stdout:9/418: creat d0/d1c/f8e x:0 0 0 2024-09-12T18:03:22.157 INFO:tasks.workunit.client.0.smithi052.stdout:2/437: truncate da/dc/f2b 679367 0 2024-09-12T18:03:22.157 INFO:tasks.workunit.client.0.smithi052.stdout:3/450: dwrite d0/d4/d33/f35 [0,4194304] 0 2024-09-12T18:03:22.157 INFO:tasks.workunit.client.0.smithi052.stdout:6/546: rmdir d2/d80 39 2024-09-12T18:03:22.161 INFO:tasks.workunit.client.0.smithi052.stdout:3/451: mknod d0/d4b/d57/d7a/ca3 0 2024-09-12T18:03:22.161 INFO:tasks.workunit.client.0.smithi052.stdout:9/419: write d0/d6/d3a/d42/d61/f82 [82781,119318] 0 2024-09-12T18:03:22.161 INFO:tasks.workunit.client.0.smithi052.stdout:3/452: dread - d0/d4/d33/f5c zero size 2024-09-12T18:03:22.162 INFO:tasks.workunit.client.0.smithi052.stdout:6/547: creat d2/d3f/d58/d5d/fba x:0 0 0 2024-09-12T18:03:22.162 INFO:tasks.workunit.client.0.smithi052.stdout:3/453: chown d0/d4b/d4c/d6b/d48/l99 8 1 2024-09-12T18:03:22.162 INFO:tasks.workunit.client.0.smithi052.stdout:2/438: write da/d2c/f2d [329720,13457] 0 2024-09-12T18:03:22.164 INFO:tasks.workunit.client.0.smithi052.stdout:6/548: creat d2/d80/fbb x:0 0 0 2024-09-12T18:03:22.167 INFO:tasks.workunit.client.0.smithi052.stdout:4/506: dwrite d11/d17/d1b/d2a/d82/d67/f81 [0,4194304] 0 2024-09-12T18:03:22.168 INFO:tasks.workunit.client.0.smithi052.stdout:5/447: dwrite d7/d1f/f47 [0,4194304] 0 2024-09-12T18:03:22.171 INFO:tasks.workunit.client.0.smithi052.stdout:8/538: truncate d13/d35/d9c/da3/fad 1341893 0 2024-09-12T18:03:22.171 INFO:tasks.workunit.client.0.smithi052.stdout:3/454: dwrite d0/d4b/f64 [0,4194304] 0 2024-09-12T18:03:22.171 INFO:tasks.workunit.client.0.smithi052.stdout:9/420: write d0/fb [942850,29411] 0 2024-09-12T18:03:22.173 INFO:tasks.workunit.client.0.smithi052.stdout:4/507: mknod d11/d17/d1b/d2a/d82/d67/d95/cb1 0 2024-09-12T18:03:22.173 INFO:tasks.workunit.client.0.smithi052.stdout:1/361: dread d3/d1d/d22/d3f/f45 [0,4194304] 0 2024-09-12T18:03:22.174 INFO:tasks.workunit.client.0.smithi052.stdout:4/508: dread - d11/d46/fad zero size 2024-09-12T18:03:22.176 INFO:tasks.workunit.client.0.smithi052.stdout:8/539: creat d13/d18/d21/d64/fb5 x:0 0 0 2024-09-12T18:03:22.177 INFO:tasks.workunit.client.0.smithi052.stdout:9/421: mknod d0/d58/c8f 0 2024-09-12T18:03:22.177 INFO:tasks.workunit.client.0.smithi052.stdout:4/509: creat d11/d46/fb2 x:0 0 0 2024-09-12T18:03:22.177 INFO:tasks.workunit.client.0.smithi052.stdout:2/439: rename da/d71/f73 to da/dc/d15/f92 0 2024-09-12T18:03:22.178 INFO:tasks.workunit.client.0.smithi052.stdout:3/455: mkdir d0/d4/d25/d2a/d6/d7/de/da1/da4 0 2024-09-12T18:03:22.178 INFO:tasks.workunit.client.0.smithi052.stdout:7/391: dread d6/dc/d1a/f54 [0,4194304] 0 2024-09-12T18:03:22.179 INFO:tasks.workunit.client.0.smithi052.stdout:4/510: chown d11/d17/d23/f27 686613 1 2024-09-12T18:03:22.179 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:22.179 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:22.181 INFO:tasks.workunit.client.0.smithi052.stdout:2/440: chown da/dc/d15/d43/f5c 938076553 1 2024-09-12T18:03:22.181 INFO:tasks.workunit.client.0.smithi052.stdout:8/540: link d13/d18/d5b/d70/fb0 d13/d18/d5b/fb6 0 2024-09-12T18:03:22.181 INFO:tasks.workunit.client.0.smithi052.stdout:7/392: mkdir d6/d56/d85 0 2024-09-12T18:03:22.181 INFO:tasks.workunit.client.0.smithi052.stdout:5/448: dwrite d7/d1f/f4b [0,4194304] 0 2024-09-12T18:03:22.181 INFO:tasks.workunit.client.0.smithi052.stdout:3/456: rmdir d0/d4/d25/d2a 39 2024-09-12T18:03:22.182 INFO:tasks.workunit.client.0.smithi052.stdout:6/549: rename d2/d21/d6a/fad to d2/fbc 0 2024-09-12T18:03:22.182 INFO:tasks.workunit.client.0.smithi052.stdout:0/411: dwrite d2/d6/f10 [0,4194304] 0 2024-09-12T18:03:22.182 INFO:tasks.workunit.client.0.smithi052.stdout:4/511: creat d11/d46/d51/fb3 x:0 0 0 2024-09-12T18:03:22.182 INFO:tasks.workunit.client.0.smithi052.stdout:9/422: getdents d0/d6/d3a/d42 0 2024-09-12T18:03:22.183 INFO:tasks.workunit.client.0.smithi052.stdout:7/393: symlink d6/d56/d85/l86 0 2024-09-12T18:03:22.183 INFO:tasks.workunit.client.0.smithi052.stdout:2/441: chown da/d1d/d7d/c86 3870 1 2024-09-12T18:03:22.183 INFO:tasks.workunit.client.0.smithi052.stdout:3/457: chown d0/d16/d60/l98 10505726 1 2024-09-12T18:03:22.183 INFO:tasks.workunit.client.0.smithi052.stdout:5/449: rename d7/f40 to d7/d1c/f95 0 2024-09-12T18:03:22.183 INFO:tasks.workunit.client.0.smithi052.stdout:5/450: sync 2024-09-12T18:03:22.183 INFO:tasks.workunit.client.0.smithi052.stdout:4/512: symlink d11/d17/d23/dae/lb4 0 2024-09-12T18:03:22.184 INFO:tasks.workunit.client.0.smithi052.stdout:8/541: creat d13/d18/d21/fb7 x:0 0 0 2024-09-12T18:03:22.184 INFO:tasks.workunit.client.0.smithi052.stdout:8/542: sync 2024-09-12T18:03:22.186 INFO:tasks.workunit.client.0.smithi052.stdout:7/394: rename d6/d12/d1e/d29/d5d/d71/d3a/l40 to d6/d56/d85/l87 0 2024-09-12T18:03:22.186 INFO:tasks.workunit.client.0.smithi052.stdout:4/513: unlink d11/d46/d51/fb3 0 2024-09-12T18:03:22.186 INFO:tasks.workunit.client.0.smithi052.stdout:2/442: mknod da/d1d/d35/d7a/c93 0 2024-09-12T18:03:22.186 INFO:tasks.workunit.client.0.smithi052.stdout:9/423: link d0/l64 d0/d18/d37/l90 0 2024-09-12T18:03:22.187 INFO:tasks.workunit.client.0.smithi052.stdout:3/458: link d0/d4b/d4c/c76 d0/d4b/d57/d6d/ca5 0 2024-09-12T18:03:22.189 INFO:tasks.workunit.client.0.smithi052.stdout:6/550: dread d2/d3f/d58/d5d/d9c/d26/f61 [0,4194304] 0 2024-09-12T18:03:22.190 INFO:tasks.workunit.client.0.smithi052.stdout:1/362: truncate d3/d1d/d22/d27/d28/f32 3700367 0 2024-09-12T18:03:22.190 INFO:tasks.workunit.client.0.smithi052.stdout:3/459: unlink d0/d4/d33/f3b 0 2024-09-12T18:03:22.190 INFO:tasks.workunit.client.0.smithi052.stdout:7/395: symlink d6/d12/d1e/l88 0 2024-09-12T18:03:22.191 INFO:tasks.workunit.client.0.smithi052.stdout:6/551: chown d2/d3f/d5f/c8d 74303 1 2024-09-12T18:03:22.191 INFO:tasks.workunit.client.0.smithi052.stdout:4/514: rename d11/d17/d1b/d2a/d33/fa0 to d11/d65/d6c/fb5 0 2024-09-12T18:03:22.191 INFO:tasks.workunit.client.0.smithi052.stdout:7/396: sync 2024-09-12T18:03:22.191 INFO:tasks.workunit.client.0.smithi052.stdout:0/412: dwrite d2/d6/dd/d21/d41/d59/f71 [0,4194304] 0 2024-09-12T18:03:22.191 INFO:tasks.workunit.client.0.smithi052.stdout:3/460: creat d0/d16/d7c/fa6 x:0 0 0 2024-09-12T18:03:22.192 INFO:tasks.workunit.client.0.smithi052.stdout:6/552: fsync d2/d3f/d5f/f68 0 2024-09-12T18:03:22.193 INFO:tasks.workunit.client.0.smithi052.stdout:4/515: write d11/d17/d1b/d2a/f93 [835988,98604] 0 2024-09-12T18:03:22.194 INFO:tasks.workunit.client.0.smithi052.stdout:6/553: write d2/d3f/d5f/f85 [4493664,25109] 0 2024-09-12T18:03:22.195 INFO:tasks.workunit.client.0.smithi052.stdout:1/363: creat d3/d1d/d22/d3f/d56/f79 x:0 0 0 2024-09-12T18:03:22.195 INFO:tasks.workunit.client.0.smithi052.stdout:3/461: mknod d0/d4/d25/d2a/d6/d41/ca7 0 2024-09-12T18:03:22.195 INFO:tasks.workunit.client.0.smithi052.stdout:4/516: symlink d11/d17/d1b/d2a/d82/lb6 0 2024-09-12T18:03:22.196 INFO:tasks.workunit.client.0.smithi052.stdout:3/462: read - d0/d4/d25/f81 zero size 2024-09-12T18:03:22.197 INFO:tasks.workunit.client.0.smithi052.stdout:9/424: dwrite d0/d6/d3a/d42/f76 [0,4194304] 0 2024-09-12T18:03:22.197 INFO:tasks.workunit.client.0.smithi052.stdout:3/463: chown d0/d4b/c87 251 1 2024-09-12T18:03:22.198 INFO:tasks.workunit.client.0.smithi052.stdout:0/413: dread d2/d6/dd/d21/f35 [0,4194304] 0 2024-09-12T18:03:22.200 INFO:tasks.workunit.client.0.smithi052.stdout:0/414: creat d2/d6/dd/d21/d26/d65/f7d x:0 0 0 2024-09-12T18:03:22.201 INFO:tasks.workunit.client.0.smithi052.stdout:4/517: chown d11/d17/d23/d2f/d3b/c69 73 1 2024-09-12T18:03:22.201 INFO:tasks.workunit.client.0.smithi052.stdout:3/464: creat d0/d4/d25/fa8 x:0 0 0 2024-09-12T18:03:22.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:22.203 INFO:tasks.workunit.client.0.smithi052.stdout:4/518: creat d11/d17/fb7 x:0 0 0 2024-09-12T18:03:22.204 INFO:tasks.workunit.client.0.smithi052.stdout:4/519: mkdir d11/d46/db8 0 2024-09-12T18:03:22.204 INFO:tasks.workunit.client.0.smithi052.stdout:0/415: write d2/d6/dd/d21/f35 [2312225,100906] 0 2024-09-12T18:03:22.205 INFO:tasks.workunit.client.0.smithi052.stdout:8/543: dread d13/d18/d21/f23 [0,4194304] 0 2024-09-12T18:03:22.205 INFO:tasks.workunit.client.0.smithi052.stdout:3/465: rmdir d0/d4/d25/d2a/d6/d41/d6f 0 2024-09-12T18:03:22.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/397: read d6/d12/d17/f52 [1483675,31225] 0 2024-09-12T18:03:22.206 INFO:tasks.workunit.client.0.smithi052.stdout:0/416: creat d2/d57/d5b/f7e x:0 0 0 2024-09-12T18:03:22.206 INFO:tasks.workunit.client.0.smithi052.stdout:7/398: sync 2024-09-12T18:03:22.206 INFO:tasks.workunit.client.0.smithi052.stdout:9/425: dwrite d0/d18/d26/d4d/f8a [0,4194304] 0 2024-09-12T18:03:22.206 INFO:tasks.workunit.client.0.smithi052.stdout:3/466: write d0/d4/d33/f35 [4770000,11204] 0 2024-09-12T18:03:22.207 INFO:tasks.workunit.client.0.smithi052.stdout:3/467: readlink d0/d4/d25/l9f 0 2024-09-12T18:03:22.208 INFO:tasks.workunit.client.0.smithi052.stdout:9/426: fsync d0/f1a 0 2024-09-12T18:03:22.208 INFO:tasks.workunit.client.0.smithi052.stdout:8/544: getdents d13/d3c 0 2024-09-12T18:03:22.208 INFO:tasks.workunit.client.0.smithi052.stdout:4/520: link d11/d17/d1b/d2a/d82/d67/d95/f9e d11/d17/d1b/d2a/d82/d67/d68/fb9 0 2024-09-12T18:03:22.208 INFO:tasks.workunit.client.0.smithi052.stdout:0/417: chown d2/d6/dd/d21/d41/d44/f6c 60152903 1 2024-09-12T18:03:22.209 INFO:tasks.workunit.client.0.smithi052.stdout:7/399: creat d6/f89 x:0 0 0 2024-09-12T18:03:22.209 INFO:tasks.workunit.client.0.smithi052.stdout:3/468: mkdir d0/d4/d25/d2a/d2c/da9 0 2024-09-12T18:03:22.209 INFO:tasks.workunit.client.0.smithi052.stdout:9/427: write d0/d18/d37/f4c [5147687,45558] 0 2024-09-12T18:03:22.209 INFO:tasks.workunit.client.0.smithi052.stdout:0/418: read - d2/d1b/d72/f5c zero size 2024-09-12T18:03:22.210 INFO:tasks.workunit.client.0.smithi052.stdout:8/545: write d13/f1c [8388677,127848] 0 2024-09-12T18:03:22.210 INFO:tasks.workunit.client.0.smithi052.stdout:4/521: creat d11/d17/d1b/d42/fba x:0 0 0 2024-09-12T18:03:22.210 INFO:tasks.workunit.client.0.smithi052.stdout:8/546: dread - d13/d18/d5b/fb6 zero size 2024-09-12T18:03:22.211 INFO:tasks.workunit.client.0.smithi052.stdout:9/428: unlink d0/d18/d79/l2e 0 2024-09-12T18:03:22.211 INFO:tasks.workunit.client.0.smithi052.stdout:4/522: write d11/d65/f71 [1480988,74844] 0 2024-09-12T18:03:22.211 INFO:tasks.workunit.client.0.smithi052.stdout:3/469: fdatasync d0/d4/d25/d2a/d2c/f67 0 2024-09-12T18:03:22.212 INFO:tasks.workunit.client.0.smithi052.stdout:5/451: write d7/d1c/d1e/f46 [3120850,23230] 0 2024-09-12T18:03:22.212 INFO:tasks.workunit.client.0.smithi052.stdout:0/419: rename d2/d6/dd/f22 to d2/d1b/d72/d69/f7f 0 2024-09-12T18:03:22.213 INFO:tasks.workunit.client.0.smithi052.stdout:2/443: truncate da/dc/d15/d43/f67 1148736 0 2024-09-12T18:03:22.213 INFO:tasks.workunit.client.0.smithi052.stdout:8/547: unlink d13/d18/c6a 0 2024-09-12T18:03:22.213 INFO:tasks.workunit.client.0.smithi052.stdout:4/523: creat d11/fbb x:0 0 0 2024-09-12T18:03:22.213 INFO:tasks.workunit.client.0.smithi052.stdout:6/554: truncate d2/d3f/d58/d5d/d9c/d26/f61 3482965 0 2024-09-12T18:03:22.213 INFO:tasks.workunit.client.0.smithi052.stdout:2/444: sync 2024-09-12T18:03:22.213 INFO:tasks.workunit.client.0.smithi052.stdout:7/400: link d6/d12/d1e/d29/d5d/d71/f68 d6/dc/d1a/d6a/f8a 0 2024-09-12T18:03:22.214 INFO:tasks.workunit.client.0.smithi052.stdout:2/445: chown c9 732197391 1 2024-09-12T18:03:22.214 INFO:tasks.workunit.client.0.smithi052.stdout:8/548: readlink d13/d18/l47 0 2024-09-12T18:03:22.214 INFO:tasks.workunit.client.0.smithi052.stdout:6/555: chown d2/d5e/c67 89685261 1 2024-09-12T18:03:22.214 INFO:tasks.workunit.client.0.smithi052.stdout:4/524: chown d11/d17/d1b/d2a/d6a/d7f 53 1 2024-09-12T18:03:22.215 INFO:tasks.workunit.client.0.smithi052.stdout:5/452: fsync d7/d1f/d3a/f85 0 2024-09-12T18:03:22.215 INFO:tasks.workunit.client.0.smithi052.stdout:6/556: fsync d2/fb 0 2024-09-12T18:03:22.215 INFO:tasks.workunit.client.0.smithi052.stdout:7/401: creat d6/dc/d1a/d6a/f8b x:0 0 0 2024-09-12T18:03:22.215 INFO:tasks.workunit.client.0.smithi052.stdout:2/446: creat da/d71/f94 x:0 0 0 2024-09-12T18:03:22.215 INFO:tasks.workunit.client.0.smithi052.stdout:3/470: rename d0/d4/f3d to d0/d4b/d57/d6d/faa 0 2024-09-12T18:03:22.215 INFO:tasks.workunit.client.0.smithi052.stdout:8/549: write d13/d18/d5b/fb1 [132158,53171] 0 2024-09-12T18:03:22.216 INFO:tasks.workunit.client.0.smithi052.stdout:4/525: truncate d11/fa7 335012 0 2024-09-12T18:03:22.216 INFO:tasks.workunit.client.0.smithi052.stdout:7/402: fsync d6/f3c 0 2024-09-12T18:03:22.216 INFO:tasks.workunit.client.0.smithi052.stdout:8/550: stat d13 0 2024-09-12T18:03:22.217 INFO:tasks.workunit.client.0.smithi052.stdout:9/429: link d0/d6/d3a/d42/d61/d6a/c6b d0/c91 0 2024-09-12T18:03:22.217 INFO:tasks.workunit.client.0.smithi052.stdout:0/420: write d2/d6/dd/d21/d41/d44/d48/f6a [3704032,6825] 0 2024-09-12T18:03:22.217 INFO:tasks.workunit.client.0.smithi052.stdout:6/557: symlink d2/d49/lbd 0 2024-09-12T18:03:22.217 INFO:tasks.workunit.client.0.smithi052.stdout:5/453: readlink d7/d1f/d45/l4a 0 2024-09-12T18:03:22.217 INFO:tasks.workunit.client.0.smithi052.stdout:5/454: chown d7/d1f/d45/f62 2095935200 1 2024-09-12T18:03:22.218 INFO:tasks.workunit.client.0.smithi052.stdout:0/421: mkdir d2/d1b/d80 0 2024-09-12T18:03:22.218 INFO:tasks.workunit.client.0.smithi052.stdout:3/471: getdents d0/d4b/d57 0 2024-09-12T18:03:22.219 INFO:tasks.workunit.client.0.smithi052.stdout:8/551: rename d13/d18/d38/c7d to d13/d35/d9c/d9f/cb8 0 2024-09-12T18:03:22.219 INFO:tasks.workunit.client.0.smithi052.stdout:9/430: link d0/d18/d79/f31 d0/d18/d26/f92 0 2024-09-12T18:03:22.219 INFO:tasks.workunit.client.0.smithi052.stdout:5/455: mknod d7/d59/d5c/c96 0 2024-09-12T18:03:22.219 INFO:tasks.workunit.client.0.smithi052.stdout:6/558: getdents d2/d3f/d54 0 2024-09-12T18:03:22.220 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:22.215+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:22.220 INFO:tasks.workunit.client.0.smithi052.stdout:0/422: mkdir d2/d6/dd/d81 0 2024-09-12T18:03:22.221 INFO:tasks.workunit.client.0.smithi052.stdout:8/552: mknod d13/d35/cb9 0 2024-09-12T18:03:22.221 INFO:tasks.workunit.client.0.smithi052.stdout:9/431: write d0/d1c/f22 [3667167,123176] 0 2024-09-12T18:03:22.222 INFO:tasks.workunit.client.0.smithi052.stdout:7/403: dread d6/dc/d1a/d6a/f72 [0,4194304] 0 2024-09-12T18:03:22.223 INFO:tasks.workunit.client.0.smithi052.stdout:9/432: mkdir d0/d6/d3a/d42/d93 0 2024-09-12T18:03:22.223 INFO:tasks.workunit.client.0.smithi052.stdout:0/423: rename d2/d6/dd/d21/d41/d44/f6c to d2/d57/f82 0 2024-09-12T18:03:22.224 INFO:tasks.workunit.client.0.smithi052.stdout:7/404: creat d6/dc/f8c x:0 0 0 2024-09-12T18:03:22.227 INFO:tasks.workunit.client.0.smithi052.stdout:4/526: dread d11/d17/d1b/d2a/d33/f8c [0,4194304] 0 2024-09-12T18:03:22.228 INFO:tasks.workunit.client.0.smithi052.stdout:7/405: write d6/dc/f2f [1069333,88888] 0 2024-09-12T18:03:22.228 INFO:tasks.workunit.client.0.smithi052.stdout:1/364: dread d3/d10/d38/f4d [0,4194304] 0 2024-09-12T18:03:22.231 INFO:tasks.workunit.client.0.smithi052.stdout:7/406: stat d6/f3c 0 2024-09-12T18:03:22.231 INFO:tasks.workunit.client.0.smithi052.stdout:9/433: mkdir d0/d6/d94 0 2024-09-12T18:03:22.231 INFO:tasks.workunit.client.0.smithi052.stdout:3/472: dwrite d0/d4/f47 [4194304,4194304] 0 2024-09-12T18:03:22.231 INFO:tasks.workunit.client.0.smithi052.stdout:4/527: mknod d11/d46/d51/cbc 0 2024-09-12T18:03:22.234 INFO:tasks.workunit.client.0.smithi052.stdout:6/559: dwrite d2/d3f/d58/d5d/f9b [0,4194304] 0 2024-09-12T18:03:22.234 INFO:tasks.workunit.client.0.smithi052.stdout:8/553: dwrite ff [4194304,4194304] 0 2024-09-12T18:03:22.235 INFO:tasks.workunit.client.0.smithi052.stdout:1/365: write d3/d1d/d22/d3f/f45 [4048872,9766] 0 2024-09-12T18:03:22.235 INFO:tasks.workunit.client.0.smithi052.stdout:6/560: write d2/d49/fb4 [915527,127439] 0 2024-09-12T18:03:22.237 INFO:tasks.workunit.client.0.smithi052.stdout:3/473: mkdir d0/d4/d25/d2a/d6/d7/dab 0 2024-09-12T18:03:22.237 INFO:tasks.workunit.client.0.smithi052.stdout:0/424: truncate d2/d6/f10 3854483 0 2024-09-12T18:03:22.237 INFO:tasks.workunit.client.0.smithi052.stdout:4/528: rename d11/d65/d84 to d11/d70/dbd 0 2024-09-12T18:03:22.237 INFO:tasks.workunit.client.0.smithi052.stdout:2/447: dwrite da/dc/d15/d43/f67 [0,4194304] 0 2024-09-12T18:03:22.237 INFO:tasks.workunit.client.0.smithi052.stdout:7/407: symlink d6/d56/d80/l8d 0 2024-09-12T18:03:22.239 INFO:tasks.workunit.client.0.smithi052.stdout:6/561: mknod d2/d3f/d58/d5d/cbe 0 2024-09-12T18:03:22.240 INFO:tasks.workunit.client.0.smithi052.stdout:1/366: write d3/d1d/d22/f59 [4895854,55116] 0 2024-09-12T18:03:22.240 INFO:tasks.workunit.client.0.smithi052.stdout:9/434: symlink d0/d6/d3a/d42/d61/d85/l95 0 2024-09-12T18:03:22.240 INFO:tasks.workunit.client.0.smithi052.stdout:8/554: symlink d13/d18/lba 0 2024-09-12T18:03:22.240 INFO:tasks.workunit.client.0.smithi052.stdout:4/529: readlink d11/d17/d1b/d2a/d33/l92 0 2024-09-12T18:03:22.241 INFO:tasks.workunit.client.0.smithi052.stdout:7/408: write d6/dc/f8c [40596,97228] 0 2024-09-12T18:03:22.241 INFO:tasks.workunit.client.0.smithi052.stdout:4/530: stat d11/f21 0 2024-09-12T18:03:22.241 INFO:tasks.workunit.client.0.smithi052.stdout:2/448: creat da/dc/d15/d20/f95 x:0 0 0 2024-09-12T18:03:22.242 INFO:tasks.workunit.client.0.smithi052.stdout:5/456: dread d7/d1f/d45/f50 [0,4194304] 0 2024-09-12T18:03:22.242 INFO:tasks.workunit.client.0.smithi052.stdout:7/409: write d6/dc/fe [4782941,9150] 0 2024-09-12T18:03:22.243 INFO:tasks.workunit.client.0.smithi052.stdout:5/457: stat d7/d1f/f47 0 2024-09-12T18:03:22.243 INFO:tasks.workunit.client.0.smithi052.stdout:0/425: symlink d2/d6/dd/l83 0 2024-09-12T18:03:22.243 INFO:tasks.workunit.client.0.smithi052.stdout:6/562: creat d2/d3f/d58/fbf x:0 0 0 2024-09-12T18:03:22.243 INFO:tasks.workunit.client.0.smithi052.stdout:3/474: rename d0/d4/d33/f38 to d0/d4b/d57/d7a/fac 0 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:2/449: mkdir da/dc/d15/d20/d96 0 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:7/410: stat d6/dc/d1a/d6a/f72 0 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:0/426: chown d2/d1b/f2e 427 1 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:5/458: chown d7/d1f/c22 8 1 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:9/435: rename d0/d6/d4a to d0/d6/d3a/d42/d93/d96 0 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:8/555: rmdir d13/d9b 39 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:7/411: chown d6/d12/d17/c38 394053 1 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:6/563: write d2/d15/f30 [2966478,10329] 0 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:1/367: dread d3/d1d/d22/d27/f5c [8388608,4194304] 0 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:5/459: creat d7/d59/f97 x:0 0 0 2024-09-12T18:03:22.246 INFO:tasks.workunit.client.0.smithi052.stdout:3/475: link d0/d4b/d57/d6d/faa d0/d4b/d57/d7a/fad 0 2024-09-12T18:03:22.247 INFO:tasks.workunit.client.0.smithi052.stdout:5/460: stat d7/d1f/d3a/d49/d54/c80 0 2024-09-12T18:03:22.247 INFO:tasks.workunit.client.0.smithi052.stdout:7/412: write d6/fd [5275550,56850] 0 2024-09-12T18:03:22.247 INFO:tasks.workunit.client.0.smithi052.stdout:0/427: fdatasync d2/d6/dd/d21/d41/f79 0 2024-09-12T18:03:22.248 INFO:tasks.workunit.client.0.smithi052.stdout:1/368: write d3/d1d/d22/d3f/f5f [923615,16866] 0 2024-09-12T18:03:22.249 INFO:tasks.workunit.client.0.smithi052.stdout:6/564: getdents d2/d49 0 2024-09-12T18:03:22.249 INFO:tasks.workunit.client.0.smithi052.stdout:8/556: symlink d13/d35/lbb 0 2024-09-12T18:03:22.250 INFO:tasks.workunit.client.0.smithi052.stdout:7/413: write d6/dc/d1a/f5b [3529722,93977] 0 2024-09-12T18:03:22.250 INFO:tasks.workunit.client.0.smithi052.stdout:3/476: creat d0/d4b/d4c/d6b/fae x:0 0 0 2024-09-12T18:03:22.250 INFO:tasks.workunit.client.0.smithi052.stdout:5/461: rmdir d7/d1f/d3a/d49/d91 0 2024-09-12T18:03:22.251 INFO:tasks.workunit.client.0.smithi052.stdout:6/565: creat d2/d21/d6a/d97/fc0 x:0 0 0 2024-09-12T18:03:22.252 INFO:tasks.workunit.client.0.smithi052.stdout:4/531: dwrite d11/d17/d1b/d2a/f61 [0,4194304] 0 2024-09-12T18:03:22.253 INFO:tasks.workunit.client.0.smithi052.stdout:7/414: mkdir d6/d12/d1e/d8e 0 2024-09-12T18:03:22.253 INFO:tasks.workunit.client.0.smithi052.stdout:8/557: symlink d13/d18/d5b/lbc 0 2024-09-12T18:03:22.253 INFO:tasks.workunit.client.0.smithi052.stdout:2/450: dwrite da/dc/d15/f39 [0,4194304] 0 2024-09-12T18:03:22.254 INFO:tasks.workunit.client.0.smithi052.stdout:4/532: stat d11/d17/d1b/d2a/d82/d67/d95/f9e 0 2024-09-12T18:03:22.255 INFO:tasks.workunit.client.0.smithi052.stdout:1/369: dread d3/fa [0,4194304] 0 2024-09-12T18:03:22.256 INFO:tasks.workunit.client.0.smithi052.stdout:3/477: rmdir d0/d4/d25/d2a/d6/d7 39 2024-09-12T18:03:22.256 INFO:tasks.workunit.client.0.smithi052.stdout:6/566: link d2/d80/c55 d2/d3f/d58/cc1 0 2024-09-12T18:03:22.257 INFO:tasks.workunit.client.0.smithi052.stdout:1/370: creat d3/d1d/d22/d27/d28/f7a x:0 0 0 2024-09-12T18:03:22.257 INFO:tasks.workunit.client.0.smithi052.stdout:6/567: dread - d2/d3f/d58/fa8 zero size 2024-09-12T18:03:22.257 INFO:tasks.workunit.client.0.smithi052.stdout:3/478: chown d0/d4/d25/d2a/d6/d7/de/da1/da4 43632572 1 2024-09-12T18:03:22.258 INFO:tasks.workunit.client.0.smithi052.stdout:6/568: fsync d2/d49/fb4 0 2024-09-12T18:03:22.261 INFO:tasks.workunit.client.0.smithi052.stdout:7/415: dread d6/f5a [0,4194304] 0 2024-09-12T18:03:22.261 INFO:tasks.workunit.client.0.smithi052.stdout:3/479: mkdir d0/daf 0 2024-09-12T18:03:22.262 INFO:tasks.workunit.client.0.smithi052.stdout:4/533: dwrite d11/d46/fb2 [0,4194304] 0 2024-09-12T18:03:22.263 INFO:tasks.workunit.client.0.smithi052.stdout:3/480: stat d0/d4b/c4e 0 2024-09-12T18:03:22.264 INFO:tasks.workunit.client.0.smithi052.stdout:0/428: dread d2/d6/dd/f39 [0,4194304] 0 2024-09-12T18:03:22.264 INFO:tasks.workunit.client.0.smithi052.stdout:7/416: rename d6/d56 to d6/d12/d1e/d29/d5d/d71/d3a/d8f 0 2024-09-12T18:03:22.264 INFO:tasks.workunit.client.0.smithi052.stdout:5/462: truncate d7/f19 7196454 0 2024-09-12T18:03:22.265 INFO:tasks.workunit.client.0.smithi052.stdout:3/481: symlink d0/d4b/d4c/d6b/lb0 0 2024-09-12T18:03:22.266 INFO:tasks.workunit.client.0.smithi052.stdout:2/451: dwrite da/d2c/f2d [0,4194304] 0 2024-09-12T18:03:22.266 INFO:tasks.workunit.client.0.smithi052.stdout:7/417: mknod d6/d12/d17/c90 0 2024-09-12T18:03:22.266 INFO:tasks.workunit.client.0.smithi052.stdout:6/569: dread d2/d21/f4c [0,4194304] 0 2024-09-12T18:03:22.266 INFO:tasks.workunit.client.0.smithi052.stdout:4/534: getdents d11/d17/d23/dae 0 2024-09-12T18:03:22.267 INFO:tasks.workunit.client.0.smithi052.stdout:7/418: readlink d6/d12/d1e/l33 0 2024-09-12T18:03:22.267 INFO:tasks.workunit.client.0.smithi052.stdout:3/482: chown d0/d16/l8a 22 1 2024-09-12T18:03:22.267 INFO:tasks.workunit.client.0.smithi052.stdout:0/429: link d2/l3 d2/d6/dd/d21/d41/d44/l84 0 2024-09-12T18:03:22.269 INFO:tasks.workunit.client.0.smithi052.stdout:3/483: creat d0/d4/d25/d2a/d6/d7/d34/fb1 x:0 0 0 2024-09-12T18:03:22.269 INFO:tasks.workunit.client.0.smithi052.stdout:0/430: fdatasync d2/f31 0 2024-09-12T18:03:22.269 INFO:tasks.workunit.client.0.smithi052.stdout:0/431: readlink d2/d6/dd/l83 0 2024-09-12T18:03:22.270 INFO:tasks.workunit.client.0.smithi052.stdout:3/484: unlink d0/d4b/d57/d6d/faa 0 2024-09-12T18:03:22.271 INFO:tasks.workunit.client.0.smithi052.stdout:0/432: unlink d2/d6/dd/d21/d26/f66 0 2024-09-12T18:03:22.271 INFO:tasks.workunit.client.0.smithi052.stdout:8/558: truncate d13/d18/d21/f28 211323 0 2024-09-12T18:03:22.271 INFO:tasks.workunit.client.0.smithi052.stdout:6/570: dread d2/d3f/f92 [0,4194304] 0 2024-09-12T18:03:22.272 INFO:tasks.workunit.client.0.smithi052.stdout:6/571: fsync d2/d21/f2a 0 2024-09-12T18:03:22.274 INFO:tasks.workunit.client.0.smithi052.stdout:3/485: creat d0/d4/d25/d2a/d6/d7/de/da1/fb2 x:0 0 0 2024-09-12T18:03:22.274 INFO:tasks.workunit.client.0.smithi052.stdout:1/371: truncate d3/d1d/d22/d27/f5c 9930089 0 2024-09-12T18:03:22.274 INFO:tasks.workunit.client.0.smithi052.stdout:0/433: write d2/d6/dd/d21/f35 [2594625,130795] 0 2024-09-12T18:03:22.274 INFO:tasks.workunit.client.0.smithi052.stdout:8/559: truncate d13/d35/d9c/d9f/fa0 869043 0 2024-09-12T18:03:22.275 INFO:tasks.workunit.client.0.smithi052.stdout:0/434: dread - d2/d1b/f52 zero size 2024-09-12T18:03:22.275 INFO:tasks.workunit.client.0.smithi052.stdout:1/372: write d3/d10/d38/d44/d49/f52 [457164,74102] 0 2024-09-12T18:03:22.276 INFO:tasks.workunit.client.0.smithi052.stdout:9/436: dread d0/d18/f40 [0,4194304] 0 2024-09-12T18:03:22.276 INFO:tasks.workunit.client.0.smithi052.stdout:0/435: mknod d2/d6/dd/d21/d47/c85 0 2024-09-12T18:03:22.277 INFO:tasks.workunit.client.0.smithi052.stdout:1/373: mkdir d3/d1d/d22/d3f/d56/d7b 0 2024-09-12T18:03:22.277 INFO:tasks.workunit.client.0.smithi052.stdout:9/437: creat d0/d6/d3a/f97 x:0 0 0 2024-09-12T18:03:22.278 INFO:tasks.workunit.client.0.smithi052.stdout:0/436: dread d2/d8/f43 [4194304,4194304] 0 2024-09-12T18:03:22.278 INFO:tasks.workunit.client.0.smithi052.stdout:1/374: write d3/d1d/f2c [3442627,70583] 0 2024-09-12T18:03:22.278 INFO:tasks.workunit.client.0.smithi052.stdout:9/438: readlink d0/d18/d37/l38 0 2024-09-12T18:03:22.279 INFO:tasks.workunit.client.0.smithi052.stdout:9/439: creat d0/d18/f98 x:0 0 0 2024-09-12T18:03:22.279 INFO:tasks.workunit.client.0.smithi052.stdout:1/375: creat d3/d1d/d22/d27/d28/f7c x:0 0 0 2024-09-12T18:03:22.280 INFO:tasks.workunit.client.0.smithi052.stdout:0/437: mkdir d2/d6/dd/d21/d26/d38/d4a/d86 0 2024-09-12T18:03:22.280 INFO:tasks.workunit.client.0.smithi052.stdout:1/376: unlink d3/d10/d38/f68 0 2024-09-12T18:03:22.281 INFO:tasks.workunit.client.0.smithi052.stdout:9/440: fsync d0/d6/d3a/d42/d93/d96/f69 0 2024-09-12T18:03:22.281 INFO:tasks.workunit.client.0.smithi052.stdout:0/438: write d2/d1b/f2e [1809119,55309] 0 2024-09-12T18:03:22.281 INFO:tasks.workunit.client.0.smithi052.stdout:8/560: dwrite d13/d18/f7f [0,4194304] 0 2024-09-12T18:03:22.282 INFO:tasks.workunit.client.0.smithi052.stdout:0/439: dread - d2/d57/d5b/f7e zero size 2024-09-12T18:03:22.282 INFO:tasks.workunit.client.0.smithi052.stdout:8/561: truncate d13/d18/f75 857744 0 2024-09-12T18:03:22.285 INFO:tasks.workunit.client.0.smithi052.stdout:8/562: unlink d13/d18/d38/d7a/la5 0 2024-09-12T18:03:22.285 INFO:tasks.workunit.client.0.smithi052.stdout:1/377: mkdir d3/d1d/d22/d27/d28/d2f/d74/d7d 0 2024-09-12T18:03:22.285 INFO:tasks.workunit.client.0.smithi052.stdout:0/440: link d2/d6/dd/f60 d2/d1b/f87 0 2024-09-12T18:03:22.286 INFO:tasks.workunit.client.0.smithi052.stdout:1/378: chown d3/d1d 15500 1 2024-09-12T18:03:22.286 INFO:tasks.workunit.client.0.smithi052.stdout:8/563: rmdir d13/d18/d21/d64 39 2024-09-12T18:03:22.288 INFO:tasks.workunit.client.0.smithi052.stdout:0/441: write d2/d1b/d72/d69/f7f [846403,103271] 0 2024-09-12T18:03:22.288 INFO:tasks.workunit.client.0.smithi052.stdout:8/564: unlink d13/d3c/c4d 0 2024-09-12T18:03:22.288 INFO:tasks.workunit.client.0.smithi052.stdout:9/441: dwrite d0/d6/d3a/d43/f78 [0,4194304] 0 2024-09-12T18:03:22.289 INFO:tasks.workunit.client.0.smithi052.stdout:8/565: symlink d13/d35/d9c/lbd 0 2024-09-12T18:03:22.289 INFO:tasks.workunit.client.0.smithi052.stdout:3/486: dwrite d0/d4/f28 [0,4194304] 0 2024-09-12T18:03:22.291 INFO:tasks.workunit.client.0.smithi052.stdout:3/487: write d0/d4/d25/d2a/d6/d7/d34/f5b [852317,110243] 0 2024-09-12T18:03:22.291 INFO:tasks.workunit.client.0.smithi052.stdout:6/572: write d2/d5e/f9d [1716621,20174] 0 2024-09-12T18:03:22.292 INFO:tasks.workunit.client.0.smithi052.stdout:3/488: unlink d0/d4b/d4c/d6b/lb0 0 2024-09-12T18:03:22.293 INFO:tasks.workunit.client.0.smithi052.stdout:8/566: link d13/d18/d38/l61 d13/d35/lbe 0 2024-09-12T18:03:22.293 INFO:tasks.workunit.client.0.smithi052.stdout:6/573: rename d2/d15/f30 to d2/d49/fc2 0 2024-09-12T18:03:22.294 INFO:tasks.workunit.client.0.smithi052.stdout:2/452: dread f0 [0,4194304] 0 2024-09-12T18:03:22.294 INFO:tasks.workunit.client.0.smithi052.stdout:8/567: mkdir d13/d18/d38/dbf 0 2024-09-12T18:03:22.294 INFO:tasks.workunit.client.0.smithi052.stdout:3/489: rmdir d0/d4/d25/d2a/d2c 39 2024-09-12T18:03:22.294 INFO:tasks.workunit.client.0.smithi052.stdout:6/574: creat d2/d5e/fc3 x:0 0 0 2024-09-12T18:03:22.294 INFO:tasks.workunit.client.0.smithi052.stdout:2/453: mknod da/d71/c97 0 2024-09-12T18:03:22.295 INFO:tasks.workunit.client.0.smithi052.stdout:6/575: rename d2/l13 to d2/d3f/d54/lc4 0 2024-09-12T18:03:22.296 INFO:tasks.workunit.client.0.smithi052.stdout:2/454: creat da/d71/f98 x:0 0 0 2024-09-12T18:03:22.296 INFO:tasks.workunit.client.0.smithi052.stdout:8/568: dread d13/d18/d21/f41 [0,4194304] 0 2024-09-12T18:03:22.297 INFO:tasks.workunit.client.0.smithi052.stdout:6/576: dread - d2/d21/d6a/f72 zero size 2024-09-12T18:03:22.297 INFO:tasks.workunit.client.0.smithi052.stdout:3/490: truncate d0/d4b/d4c/d6b/d48/f56 692985 0 2024-09-12T18:03:22.297 INFO:tasks.workunit.client.0.smithi052.stdout:2/455: truncate da/d2c/f51 257158 0 2024-09-12T18:03:22.298 INFO:tasks.workunit.client.0.smithi052.stdout:6/577: unlink d2/d15/d1a/l89 0 2024-09-12T18:03:22.298 INFO:tasks.workunit.client.0.smithi052.stdout:9/442: dwrite d0/d6/d3a/d43/f7a [0,4194304] 0 2024-09-12T18:03:22.298 INFO:tasks.workunit.client.0.smithi052.stdout:3/491: fsync d0/d4/d25/d2a/d6/d7/de/da1/fb2 0 2024-09-12T18:03:22.299 INFO:tasks.workunit.client.0.smithi052.stdout:8/569: dread d13/d35/d9c/da3/fad [0,4194304] 0 2024-09-12T18:03:22.300 INFO:tasks.workunit.client.0.smithi052.stdout:8/570: dread - d13/d18/d21/fb7 zero size 2024-09-12T18:03:22.300 INFO:tasks.workunit.client.0.smithi052.stdout:2/456: symlink da/dc/d15/l99 0 2024-09-12T18:03:22.300 INFO:tasks.workunit.client.0.smithi052.stdout:3/492: rmdir d0/d4/d25/d2a 39 2024-09-12T18:03:22.301 INFO:tasks.workunit.client.0.smithi052.stdout:8/571: symlink d13/d18/lc0 0 2024-09-12T18:03:22.301 INFO:tasks.workunit.client.0.smithi052.stdout:3/493: mknod d0/daf/cb3 0 2024-09-12T18:03:22.301 INFO:tasks.workunit.client.0.smithi052.stdout:8/572: stat d13/d35/d9c/d9f/ca1 0 2024-09-12T18:03:22.302 INFO:tasks.workunit.client.0.smithi052.stdout:3/494: creat d0/d16/fb4 x:0 0 0 2024-09-12T18:03:22.302 INFO:tasks.workunit.client.0.smithi052.stdout:8/573: write d13/d18/d38/d7a/fa9 [398979,113579] 0 2024-09-12T18:03:22.303 INFO:tasks.workunit.client.0.smithi052.stdout:3/495: chown d0/d4b/d4c/d6b/d48/l99 27 1 2024-09-12T18:03:22.303 INFO:tasks.workunit.client.0.smithi052.stdout:3/496: stat d0/d4/d33/c4a 0 2024-09-12T18:03:22.304 INFO:tasks.workunit.client.0.smithi052.stdout:8/574: rename d13/d18/d5b/d8f to d13/d18/d21/dc1 0 2024-09-12T18:03:22.305 INFO:tasks.workunit.client.0.smithi052.stdout:9/443: dwrite d0/d6/d3a/f6e [0,4194304] 0 2024-09-12T18:03:22.306 INFO:tasks.workunit.client.0.smithi052.stdout:9/444: chown d0/fb 76 1 2024-09-12T18:03:22.307 INFO:tasks.workunit.client.0.smithi052.stdout:3/497: read d0/d4/d25/d2a/f55 [183198,126280] 0 2024-09-12T18:03:22.308 INFO:tasks.workunit.client.0.smithi052.stdout:9/445: write d0/f1d [2067381,51402] 0 2024-09-12T18:03:22.309 INFO:tasks.workunit.client.0.smithi052.stdout:5/463: dread d7/f3c [0,4194304] 0 2024-09-12T18:03:22.309 INFO:tasks.workunit.client.0.smithi052.stdout:3/498: creat d0/d4/d25/fb5 x:0 0 0 2024-09-12T18:03:22.310 INFO:tasks.workunit.client.0.smithi052.stdout:7/419: sync 2024-09-12T18:03:22.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/535: sync 2024-09-12T18:03:22.310 INFO:tasks.workunit.client.0.smithi052.stdout:0/442: sync 2024-09-12T18:03:22.311 INFO:tasks.workunit.client.0.smithi052.stdout:0/443: chown d2/d6/dd/d21/d41/d44 2991 1 2024-09-12T18:03:22.311 INFO:tasks.workunit.client.0.smithi052.stdout:3/499: truncate d0/d4/d25/d2a/d6/d41/f59 704061 0 2024-09-12T18:03:22.312 INFO:tasks.workunit.client.0.smithi052.stdout:5/464: mkdir d7/d1c/d1e/d98 0 2024-09-12T18:03:22.312 INFO:tasks.workunit.client.0.smithi052.stdout:3/500: mknod d0/d4b/cb6 0 2024-09-12T18:03:22.313 INFO:tasks.workunit.client.0.smithi052.stdout:8/575: dwrite d13/d18/d21/d64/f8e [0,4194304] 0 2024-09-12T18:03:22.313 INFO:tasks.workunit.client.0.smithi052.stdout:5/465: chown d7/c11 24068366 1 2024-09-12T18:03:22.314 INFO:tasks.workunit.client.0.smithi052.stdout:3/501: symlink d0/d4b/d57/d6d/lb7 0 2024-09-12T18:03:22.315 INFO:tasks.workunit.client.0.smithi052.stdout:5/466: fdatasync d7/f3c 0 2024-09-12T18:03:22.316 INFO:tasks.workunit.client.0.smithi052.stdout:0/444: read d2/d6/dd/f1d [2387952,116474] 0 2024-09-12T18:03:22.316 INFO:tasks.workunit.client.0.smithi052.stdout:8/576: getdents d13/d18/d21/d64 0 2024-09-12T18:03:22.317 INFO:tasks.workunit.client.0.smithi052.stdout:4/536: dwrite d11/d65/f71 [0,4194304] 0 2024-09-12T18:03:22.318 INFO:tasks.workunit.client.0.smithi052.stdout:7/420: dwrite d6/dc/f8c [0,4194304] 0 2024-09-12T18:03:22.318 INFO:tasks.workunit.client.0.smithi052.stdout:3/502: write d0/d4/d25/d2a/d6/d7/de/da1/fb2 [888399,74462] 0 2024-09-12T18:03:22.319 INFO:tasks.workunit.client.0.smithi052.stdout:8/577: write d13/d18/d5b/fb1 [712538,12853] 0 2024-09-12T18:03:22.319 INFO:tasks.workunit.client.0.smithi052.stdout:4/537: read d11/d65/f71 [856615,51002] 0 2024-09-12T18:03:22.320 INFO:tasks.workunit.client.0.smithi052.stdout:0/445: link d2/d6/dd/f1d d2/f88 0 2024-09-12T18:03:22.321 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:22.317+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:22.321 INFO:tasks.workunit.client.0.smithi052.stdout:0/446: rmdir d2/d8 39 2024-09-12T18:03:22.321 INFO:tasks.workunit.client.0.smithi052.stdout:3/503: truncate d0/d4/d25/fb5 599965 0 2024-09-12T18:03:22.322 INFO:tasks.workunit.client.0.smithi052.stdout:4/538: rename d11/d17/d1b/d42 to d11/d17/d1b/d2a/dbe 0 2024-09-12T18:03:22.322 INFO:tasks.workunit.client.0.smithi052.stdout:2/457: dread da/f16 [0,4194304] 0 2024-09-12T18:03:22.322 INFO:tasks.workunit.client.0.smithi052.stdout:7/421: truncate d6/d12/d1e/d29/d5d/f65 1711088 0 2024-09-12T18:03:22.323 INFO:tasks.workunit.client.0.smithi052.stdout:4/539: fdatasync d11/d17/d1b/d2a/f93 0 2024-09-12T18:03:22.324 INFO:tasks.workunit.client.0.smithi052.stdout:2/458: creat da/d2c/f9a x:0 0 0 2024-09-12T18:03:22.324 INFO:tasks.workunit.client.0.smithi052.stdout:3/504: truncate d0/d16/fb4 755759 0 2024-09-12T18:03:22.325 INFO:tasks.workunit.client.0.smithi052.stdout:4/540: read d11/d46/fb2 [1408923,100535] 0 2024-09-12T18:03:22.325 INFO:tasks.workunit.client.0.smithi052.stdout:4/541: dread - d11/d46/d51/f55 zero size 2024-09-12T18:03:22.326 INFO:tasks.workunit.client.0.smithi052.stdout:7/422: creat d6/d12/d1e/d29/f91 x:0 0 0 2024-09-12T18:03:22.326 INFO:tasks.workunit.client.0.smithi052.stdout:2/459: mknod da/d1d/c9b 0 2024-09-12T18:03:22.327 INFO:tasks.workunit.client.0.smithi052.stdout:4/542: rename d11/d17/d23 to d11/d17/d1b/d2a/d82/d67/d95/dbf 0 2024-09-12T18:03:22.328 INFO:tasks.workunit.client.0.smithi052.stdout:7/423: creat d6/d12/d1e/d8e/f92 x:0 0 0 2024-09-12T18:03:22.328 INFO:tasks.workunit.client.0.smithi052.stdout:8/578: dwrite d13/d18/d21/d64/fb5 [0,4194304] 0 2024-09-12T18:03:22.329 INFO:tasks.workunit.client.0.smithi052.stdout:7/424: write d6/f76 [829466,1539] 0 2024-09-12T18:03:22.329 INFO:tasks.workunit.client.0.smithi052.stdout:0/447: dwrite d2/d6/dd/d21/d26/d65/f7d [0,4194304] 0 2024-09-12T18:03:22.329 INFO:tasks.workunit.client.0.smithi052.stdout:2/460: rename da/d21/d6b/c85 to da/dc/d15/d20/d60/d6e/c9c 0 2024-09-12T18:03:22.330 INFO:tasks.workunit.client.0.smithi052.stdout:7/425: link d6/f62 d6/d12/d1e/d29/d5d/d71/d3a/d8f/f93 0 2024-09-12T18:03:22.331 INFO:tasks.workunit.client.0.smithi052.stdout:7/426: chown d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/l8d 1 1 2024-09-12T18:03:22.333 INFO:tasks.workunit.client.0.smithi052.stdout:7/427: mknod d6/dc/c94 0 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi052.stdout:7/428: fdatasync d6/dc/f34 0 2024-09-12T18:03:22.335 INFO:tasks.workunit.client.0.smithi052.stdout:5/467: truncate d7/d1c/d1e/f36 577815 0 2024-09-12T18:03:22.336 INFO:tasks.workunit.client.0.smithi052.stdout:3/505: dread d0/d4/d25/d2a/d6/d7/de/da1/fb2 [0,4194304] 0 2024-09-12T18:03:22.336 INFO:tasks.workunit.client.0.smithi052.stdout:4/543: dwrite d11/d17/d1b/d2a/d82/d67/d68/f85 [4194304,4194304] 0 2024-09-12T18:03:22.336 INFO:tasks.workunit.client.0.smithi052.stdout:2/461: dwrite da/d71/f98 [0,4194304] 0 2024-09-12T18:03:22.339 INFO:tasks.workunit.client.0.smithi052.stdout:5/468: creat d7/d59/d5c/f99 x:0 0 0 2024-09-12T18:03:22.339 INFO:tasks.workunit.client.0.smithi052.stdout:6/578: sync 2024-09-12T18:03:22.339 INFO:tasks.workunit.client.0.smithi052.stdout:9/446: sync 2024-09-12T18:03:22.339 INFO:tasks.workunit.client.0.smithi052.stdout:1/379: sync 2024-09-12T18:03:22.340 INFO:tasks.workunit.client.0.smithi052.stdout:8/579: sync 2024-09-12T18:03:22.340 INFO:tasks.workunit.client.0.smithi052.stdout:0/448: sync 2024-09-12T18:03:22.340 INFO:tasks.workunit.client.0.smithi052.stdout:4/544: sync 2024-09-12T18:03:22.340 INFO:tasks.workunit.client.0.smithi052.stdout:5/469: readlink d7/d1f/d34/l88 0 2024-09-12T18:03:22.341 INFO:tasks.workunit.client.0.smithi052.stdout:7/429: link d6/d12/d1e/d29/d5d/d71/d3a/d8f/l59 d6/d12/l95 0 2024-09-12T18:03:22.342 INFO:tasks.workunit.client.0.smithi052.stdout:9/447: creat d0/d1c/f99 x:0 0 0 2024-09-12T18:03:22.342 INFO:tasks.workunit.client.0.smithi052.stdout:8/580: write d13/d35/f7c [862107,7258] 0 2024-09-12T18:03:22.343 INFO:tasks.workunit.client.0.smithi052.stdout:5/470: rename d7/f13 to d7/d51/f9a 0 2024-09-12T18:03:22.344 INFO:tasks.workunit.client.0.smithi052.stdout:8/581: mknod d13/d3c/cc2 0 2024-09-12T18:03:22.345 INFO:tasks.workunit.client.0.smithi052.stdout:6/579: write d2/d3f/d58/d5d/d9c/d26/f28 [86334,82248] 0 2024-09-12T18:03:22.345 INFO:tasks.workunit.client.0.smithi052.stdout:2/462: dread da/d1d/d35/f3f [0,4194304] 0 2024-09-12T18:03:22.345 INFO:tasks.workunit.client.0.smithi052.stdout:3/506: dwrite d0/d4b/f64 [0,4194304] 0 2024-09-12T18:03:22.345 INFO:tasks.workunit.client.0.smithi052.stdout:4/545: rename d11/d17/d1b/d2a/d82/d67/d95/dbf/d2f/f31 to d11/d46/db8/fc0 0 2024-09-12T18:03:22.347 INFO:tasks.workunit.client.0.smithi052.stdout:6/580: truncate d2/d49/f7a 228961 0 2024-09-12T18:03:22.347 INFO:tasks.workunit.client.0.smithi052.stdout:4/546: chown d11/d17/fa6 894784 1 2024-09-12T18:03:22.348 INFO:tasks.workunit.client.0.smithi052.stdout:2/463: creat da/dc/d15/d22/f9d x:0 0 0 2024-09-12T18:03:22.349 INFO:tasks.workunit.client.0.smithi052.stdout:6/581: fsync d2/d80/f8c 0 2024-09-12T18:03:22.349 INFO:tasks.workunit.client.0.smithi052.stdout:3/507: mkdir d0/d4/d25/d2a/d2c/da9/db8 0 2024-09-12T18:03:22.351 INFO:tasks.workunit.client.0.smithi052.stdout:6/582: mknod d2/d3f/d58/cc5 0 2024-09-12T18:03:22.351 INFO:tasks.workunit.client.0.smithi052.stdout:4/547: creat d11/d17/d1b/d2a/d82/d67/d95/dbf/d8e/fc1 x:0 0 0 2024-09-12T18:03:22.351 INFO:tasks.workunit.client.0.smithi052.stdout:6/583: chown d2/d15/c8b 83 1 2024-09-12T18:03:22.351 INFO:tasks.workunit.client.0.smithi052.stdout:5/471: dwrite d7/f30 [4194304,4194304] 0 2024-09-12T18:03:22.352 INFO:tasks.workunit.client.0.smithi052.stdout:2/464: rename da/d21/d6b/l81 to da/dc/l9e 0 2024-09-12T18:03:22.352 INFO:tasks.workunit.client.0.smithi052.stdout:8/582: dread d13/d18/d21/d64/f8e [0,4194304] 0 2024-09-12T18:03:22.352 INFO:tasks.workunit.client.0.smithi052.stdout:2/465: dread - da/d1d/f7b zero size 2024-09-12T18:03:22.352 INFO:tasks.workunit.client.0.smithi052.stdout:6/584: dread - d2/d3f/f99 zero size 2024-09-12T18:03:22.353 INFO:tasks.workunit.client.0.smithi052.stdout:5/472: creat d7/d59/d5c/d7c/f9b x:0 0 0 2024-09-12T18:03:22.353 INFO:tasks.workunit.client.0.smithi052.stdout:2/466: symlink da/d21/d6b/l9f 0 2024-09-12T18:03:22.355 INFO:tasks.workunit.client.0.smithi052.stdout:5/473: chown d7/d1f/d3a/d49/d54/f5b 23912185 1 2024-09-12T18:03:22.355 INFO:tasks.workunit.client.0.smithi052.stdout:7/430: write d6/f62 [82079,104988] 0 2024-09-12T18:03:22.355 INFO:tasks.workunit.client.0.smithi052.stdout:2/467: creat da/dc/d15/d22/d87/fa0 x:0 0 0 2024-09-12T18:03:22.356 INFO:tasks.workunit.client.0.smithi052.stdout:5/474: chown d7/d59/d5c/d7c/f9b 3128680 1 2024-09-12T18:03:22.356 INFO:tasks.workunit.client.0.smithi052.stdout:7/431: mknod d6/d12/d1e/c96 0 2024-09-12T18:03:22.356 INFO:tasks.workunit.client.0.smithi052.stdout:2/468: mknod da/d1d/d35/d7a/ca1 0 2024-09-12T18:03:22.357 INFO:tasks.workunit.client.0.smithi052.stdout:0/449: truncate d2/d1b/f2e 1131766 0 2024-09-12T18:03:22.357 INFO:tasks.workunit.client.0.smithi052.stdout:2/469: mkdir da/d21/da2 0 2024-09-12T18:03:22.358 INFO:tasks.workunit.client.0.smithi052.stdout:5/475: link d7/d1c/d67/c7d d7/d1f/d34/c9c 0 2024-09-12T18:03:22.358 INFO:tasks.workunit.client.0.smithi052.stdout:7/432: mknod d6/d12/d1e/d29/d5d/d71/c97 0 2024-09-12T18:03:22.358 INFO:tasks.workunit.client.0.smithi052.stdout:4/548: read d11/fa7 [314391,1523] 0 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi052.stdout:2/470: chown da/dc/d15/f65 164968679 1 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi052.stdout:5/476: mknod d7/d51/c9d 0 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi052.stdout:8/583: dwrite d13/d35/fb2 [0,4194304] 0 2024-09-12T18:03:22.360 INFO:tasks.workunit.client.0.smithi052.stdout:7/433: chown d6/d12/d1e/d29/d5d/d71/d3a/f53 0 1 2024-09-12T18:03:22.361 INFO:tasks.workunit.client.0.smithi052.stdout:7/434: write d6/dc/d1a/d6a/f8b [1026979,102362] 0 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi052.stdout:0/450: truncate d2/d6/dd/d21/d26/d38/f49 2141127 0 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi052.stdout:2/471: rename da/d1d/c62 to da/dc/ca3 0 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi052.stdout:7/435: mknod d6/d12/d1e/d29/d5d/d71/c98 0 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi052.stdout:4/549: mknod d11/d17/d1b/d2a/d82/d67/d95/dbf/d2f/cc2 0 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi052.stdout:0/451: symlink d2/l89 0 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi052.stdout:3/508: truncate d0/d4/d25/d2a/d6/f15 356064 0 2024-09-12T18:03:22.366 INFO:tasks.workunit.client.0.smithi052.stdout:5/477: rename d7/c4e to d7/d1c/c9e 0 2024-09-12T18:03:22.366 INFO:tasks.workunit.client.0.smithi052.stdout:4/550: chown d11/d17/d1b/d2a/d32/c62 27 1 2024-09-12T18:03:22.367 INFO:tasks.workunit.client.0.smithi052.stdout:2/472: link da/f12 da/d1d/d7d/fa4 0 2024-09-12T18:03:22.368 INFO:tasks.workunit.client.0.smithi052.stdout:3/509: write d0/d4b/d57/d6d/f77 [274753,500] 0 2024-09-12T18:03:22.369 INFO:tasks.workunit.client.0.smithi052.stdout:0/452: read d2/d6/dd/d21/d41/d44/d48/f4d [465569,99846] 0 2024-09-12T18:03:22.371 INFO:tasks.workunit.client.0.smithi052.stdout:8/584: dwrite d13/d35/d9c/fa7 [8388608,4194304] 0 2024-09-12T18:03:22.371 INFO:tasks.workunit.client.0.smithi052.stdout:3/510: chown d0/d4b/l70 27 1 2024-09-12T18:03:22.372 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:22.373 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:22.374 INFO:tasks.workunit.client.0.smithi052.stdout:9/448: dwrite d0/d18/d26/d33/f62 [0,4194304] 0 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi052.stdout:6/585: dwrite d2/d3f/d58/d5d/d9c/d26/f46 [0,4194304] 0 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi052.stdout:2/473: getdents da/d1d/d35/d7a 0 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi052.stdout:7/436: dread d6/f76 [0,4194304] 0 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi052.stdout:0/453: mknod d2/d6/dd/d21/d26/d38/d4a/c8a 0 2024-09-12T18:03:22.376 INFO:tasks.workunit.client.0.smithi052.stdout:2/474: chown da/d21 5 1 2024-09-12T18:03:22.377 INFO:tasks.workunit.client.0.smithi052.stdout:9/449: fsync d0/d6/d3a/d42/f76 0 2024-09-12T18:03:22.378 INFO:tasks.workunit.client.0.smithi052.stdout:1/380: dread d3/d1d/d22/d27/d28/f32 [0,4194304] 0 2024-09-12T18:03:22.378 INFO:tasks.workunit.client.0.smithi052.stdout:3/511: getdents d0/d4b/d4c/d95 0 2024-09-12T18:03:22.379 INFO:tasks.workunit.client.0.smithi052.stdout:5/478: dwrite d7/d1f/d34/f48 [0,4194304] 0 2024-09-12T18:03:22.380 INFO:tasks.workunit.client.0.smithi052.stdout:9/450: fdatasync d0/d6/d3a/d42/d93/d96/f53 0 2024-09-12T18:03:22.381 INFO:tasks.workunit.client.0.smithi052.stdout:6/586: rename d2/d15/d1a to d2/dc6 0 2024-09-12T18:03:22.381 INFO:tasks.workunit.client.0.smithi052.stdout:4/551: dwrite d11/d17/d1b/d2a/d82/f80 [0,4194304] 0 2024-09-12T18:03:22.381 INFO:tasks.workunit.client.0.smithi052.stdout:2/475: truncate da/d21/f4a 544152 0 2024-09-12T18:03:22.382 INFO:tasks.workunit.client.0.smithi052.stdout:0/454: getdents d2/d1b 0 2024-09-12T18:03:22.383 INFO:tasks.workunit.client.0.smithi052.stdout:1/381: dread - d3/d1d/d22/d27/d28/f7a zero size 2024-09-12T18:03:22.385 INFO:tasks.workunit.client.0.smithi052.stdout:8/585: truncate ff 1322932 0 2024-09-12T18:03:22.386 INFO:tasks.workunit.client.0.smithi052.stdout:5/479: symlink d7/l9f 0 2024-09-12T18:03:22.387 INFO:tasks.workunit.client.0.smithi052.stdout:9/451: rename d0/f1a to d0/d18/f9a 0 2024-09-12T18:03:22.387 INFO:tasks.workunit.client.0.smithi052.stdout:1/382: creat d3/d69/f7e x:0 0 0 2024-09-12T18:03:22.388 INFO:tasks.workunit.client.0.smithi052.stdout:7/437: dwrite d6/fd [4194304,4194304] 0 2024-09-12T18:03:22.388 INFO:tasks.workunit.client.0.smithi052.stdout:4/552: mknod d11/d17/d1b/d2a/d6a/da8/cc3 0 2024-09-12T18:03:22.389 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:22.390 INFO:tasks.workunit.client.0.smithi052.stdout:1/383: readlink d3/d1d/l3d 0 2024-09-12T18:03:22.390 INFO:tasks.workunit.client.0.smithi052.stdout:2/476: rmdir da/dc/d15/d20/d96 0 2024-09-12T18:03:22.390 INFO:tasks.workunit.client.0.smithi052.stdout:5/480: symlink d7/d1f/d3a/la0 0 2024-09-12T18:03:22.391 INFO:tasks.workunit.client.0.smithi052.stdout:0/455: getdents d2/d6/dd/d21 0 2024-09-12T18:03:22.391 INFO:tasks.workunit.client.0.smithi052.stdout:7/438: rmdir d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85 39 2024-09-12T18:03:22.391 INFO:tasks.workunit.client.0.smithi052.stdout:4/553: symlink d11/d17/d1b/d2a/d33/lc4 0 2024-09-12T18:03:22.391 INFO:tasks.workunit.client.0.smithi052.stdout:0/456: stat d2/d8 0 2024-09-12T18:03:22.391 INFO:tasks.workunit.client.0.smithi052.stdout:2/477: mkdir da/dc/d15/d20/da5 0 2024-09-12T18:03:22.391 INFO:tasks.workunit.client.0.smithi052.stdout:3/512: dwrite d0/d4/d33/f35 [4194304,4194304] 0 2024-09-12T18:03:22.391 INFO:tasks.workunit.client.0.smithi052.stdout:4/554: fsync d11/d46/d51/f55 0 2024-09-12T18:03:22.391 INFO:tasks.workunit.client.0.smithi052.stdout:0/457: rename d2/d51 to d2/d51/d8b 22 2024-09-12T18:03:22.392 INFO:tasks.workunit.client.0.smithi052.stdout:2/478: truncate da/dc/f5e 315185 0 2024-09-12T18:03:22.392 INFO:tasks.workunit.client.0.smithi052.stdout:0/458: fdatasync d2/d6/dd/d21/d41/f75 0 2024-09-12T18:03:22.392 INFO:tasks.workunit.client.0.smithi052.stdout:2/479: truncate da/dc/d15/f65 597363 0 2024-09-12T18:03:22.393 INFO:tasks.workunit.client.0.smithi052.stdout:2/480: chown da/dc/c27 0 1 2024-09-12T18:03:22.394 INFO:tasks.workunit.client.0.smithi052.stdout:2/481: write da/dc/f82 [2822572,126757] 0 2024-09-12T18:03:22.394 INFO:tasks.workunit.client.0.smithi052.stdout:5/481: read d7/d1c/d1e/f64 [104697,79714] 0 2024-09-12T18:03:22.396 INFO:tasks.workunit.client.0.smithi052.stdout:5/482: dread - d7/d1f/d3a/f4f zero size 2024-09-12T18:03:22.398 INFO:tasks.workunit.client.0.smithi052.stdout:4/555: dwrite d11/f1f [0,4194304] 0 2024-09-12T18:03:22.399 INFO:tasks.workunit.client.0.smithi052.stdout:3/513: dwrite d0/d16/d60/f62 [0,4194304] 0 2024-09-12T18:03:22.399 INFO:tasks.workunit.client.0.smithi052.stdout:5/483: creat d7/d1f/d3a/d49/d54/d6b/fa1 x:0 0 0 2024-09-12T18:03:22.400 INFO:tasks.workunit.client.0.smithi052.stdout:9/452: dwrite d0/d18/d37/d87/f73 [0,4194304] 0 2024-09-12T18:03:22.402 INFO:tasks.workunit.client.0.smithi052.stdout:0/459: getdents d2/d6/dd/d21/d26 0 2024-09-12T18:03:22.402 INFO:tasks.workunit.client.0.smithi052.stdout:9/453: unlink d0/fc 0 2024-09-12T18:03:22.403 INFO:tasks.workunit.client.0.smithi052.stdout:0/460: symlink d2/d8/l8c 0 2024-09-12T18:03:22.403 INFO:tasks.workunit.client.0.smithi052.stdout:4/556: mkdir d11/d17/d1b/d2a/dbe/dc5 0 2024-09-12T18:03:22.404 INFO:tasks.workunit.client.0.smithi052.stdout:9/454: read - d0/d18/d37/d87/f7d zero size 2024-09-12T18:03:22.405 INFO:tasks.workunit.client.0.smithi052.stdout:4/557: rename d11/d17/d1b/d2a/d82/d67 to d11/d65/dc6 0 2024-09-12T18:03:22.406 INFO:tasks.workunit.client.0.smithi052.stdout:9/455: write d0/d1c/f32 [5961401,87763] 0 2024-09-12T18:03:22.406 INFO:tasks.workunit.client.0.smithi052.stdout:2/482: dwrite da/dc/d15/d22/f54 [0,4194304] 0 2024-09-12T18:03:22.408 INFO:tasks.workunit.client.0.smithi052.stdout:9/456: rename d0/d6/d3a/d43/f78 to d0/d6/d3a/d42/d93/d96/f9b 0 2024-09-12T18:03:22.409 INFO:tasks.workunit.client.0.smithi052.stdout:4/558: readlink d11/d65/dc6/d95/dbf/d2f/d3b/l56 0 2024-09-12T18:03:22.409 INFO:tasks.workunit.client.0.smithi052.stdout:7/439: sync 2024-09-12T18:03:22.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/514: sync 2024-09-12T18:03:22.410 INFO:tasks.workunit.client.0.smithi052.stdout:9/457: symlink d0/d18/d79/l9c 0 2024-09-12T18:03:22.411 INFO:tasks.workunit.client.0.smithi052.stdout:0/461: write d2/d1b/f87 [1408086,88783] 0 2024-09-12T18:03:22.411 INFO:tasks.workunit.client.0.smithi052.stdout:4/559: chown d11/d17/d1b/d2a/dbe/dc5 375 1 2024-09-12T18:03:22.411 INFO:tasks.workunit.client.0.smithi052.stdout:7/440: creat d6/d12/f99 x:0 0 0 2024-09-12T18:03:22.412 INFO:tasks.workunit.client.0.smithi052.stdout:9/458: write d0/f10 [97801,89812] 0 2024-09-12T18:03:22.412 INFO:tasks.workunit.client.0.smithi052.stdout:0/462: mkdir d2/d1b/d72/d8d 0 2024-09-12T18:03:22.413 INFO:tasks.workunit.client.0.smithi052.stdout:4/560: mkdir d11/d17/d1b/d2a/dbe/dc5/dc7 0 2024-09-12T18:03:22.414 INFO:tasks.workunit.client.0.smithi052.stdout:7/441: link d6/dc/l1b d6/d12/d1e/d29/d5d/d71/d3a/d83/l9a 0 2024-09-12T18:03:22.414 INFO:tasks.workunit.client.0.smithi052.stdout:4/561: creat d11/d17/d1b/d2a/d6a/fc8 x:0 0 0 2024-09-12T18:03:22.415 INFO:tasks.workunit.client.0.smithi052.stdout:4/562: fdatasync d11/d65/dc6/d95/dbf/d2f/fab 0 2024-09-12T18:03:22.415 INFO:tasks.workunit.client.0.smithi052.stdout:7/442: unlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/l59 0 2024-09-12T18:03:22.416 INFO:tasks.workunit.client.0.smithi052.stdout:7/443: write d6/ff [1101968,83689] 0 2024-09-12T18:03:22.416 INFO:tasks.workunit.client.0.smithi052.stdout:4/563: symlink d11/d65/dc6/daf/lc9 0 2024-09-12T18:03:22.418 INFO:tasks.workunit.client.0.smithi052.stdout:4/564: rmdir d11/d17/d1b/d2a/d32 39 2024-09-12T18:03:22.418 INFO:tasks.workunit.client.0.smithi052.stdout:7/444: fsync d6/d12/d1e/d29/d5d/d71/f68 0 2024-09-12T18:03:22.419 INFO:tasks.workunit.client.0.smithi052.stdout:4/565: chown d11/d17/d1b/d2a/d32/c86 10 1 2024-09-12T18:03:22.419 INFO:tasks.workunit.client.0.smithi052.stdout:7/445: chown d6/d12/d1e/d29/d5d/d71/c97 3 1 2024-09-12T18:03:22.420 INFO:tasks.workunit.client.0.smithi052.stdout:7/446: mkdir d6/d9b 0 2024-09-12T18:03:22.420 INFO:tasks.workunit.client.0.smithi052.stdout:4/566: dread - d11/d17/d1b/d2a/dbe/f8f zero size 2024-09-12T18:03:22.421 INFO:tasks.workunit.client.0.smithi052.stdout:7/447: unlink d6/d12/d1e/d29/d5d/f4d 0 2024-09-12T18:03:22.421 INFO:tasks.workunit.client.0.smithi052.stdout:4/567: readlink d11/d65/dc6/d95/dbf/d2f/l96 0 2024-09-12T18:03:22.421 INFO:tasks.workunit.client.0.smithi052.stdout:7/448: dread - d6/d12/d1e/f6f zero size 2024-09-12T18:03:22.422 INFO:tasks.workunit.client.0.smithi052.stdout:8/586: dread d13/d18/d21/f5d [0,4194304] 0 2024-09-12T18:03:22.422 INFO:tasks.workunit.client.0.smithi052.stdout:3/515: dread d0/d4b/d4c/d6b/f8d [0,4194304] 0 2024-09-12T18:03:22.423 INFO:tasks.workunit.client.0.smithi052.stdout:8/587: write d13/d18/d38/f46 [2232694,49016] 0 2024-09-12T18:03:22.423 INFO:tasks.workunit.client.0.smithi052.stdout:3/516: creat d0/d4b/d4c/d6b/d48/fb9 x:0 0 0 2024-09-12T18:03:22.423 INFO:tasks.workunit.client.0.smithi052.stdout:4/568: mknod d11/d17/d1b/d2a/dbe/dc5/dc7/cca 0 2024-09-12T18:03:22.424 INFO:tasks.workunit.client.0.smithi052.stdout:8/588: creat d13/d3c/fc3 x:0 0 0 2024-09-12T18:03:22.424 INFO:tasks.workunit.client.0.smithi052.stdout:7/449: link d6/d12/d1e/c96 d6/d12/d1e/d29/d5d/c9c 0 2024-09-12T18:03:22.424 INFO:tasks.workunit.client.0.smithi052.stdout:3/517: fdatasync d0/d4b/d4c/f46 0 2024-09-12T18:03:22.426 INFO:tasks.workunit.client.0.smithi052.stdout:3/518: write d0/d16/fb4 [376675,32188] 0 2024-09-12T18:03:22.427 INFO:tasks.workunit.client.0.smithi052.stdout:1/384: dread d3/d10/f53 [0,4194304] 0 2024-09-12T18:03:22.427 INFO:tasks.workunit.client.0.smithi052.stdout:5/484: sync 2024-09-12T18:03:22.428 INFO:tasks.workunit.client.0.smithi052.stdout:9/459: sync 2024-09-12T18:03:22.428 INFO:tasks.workunit.client.0.smithi052.stdout:5/485: sync 2024-09-12T18:03:22.430 INFO:tasks.workunit.client.0.smithi052.stdout:6/587: dread d2/d3f/d58/d5d/f7d [0,4194304] 0 2024-09-12T18:03:22.430 INFO:tasks.workunit.client.0.smithi052.stdout:1/385: mkdir d3/d1d/d22/d27/d28/d2f/d74/d7f 0 2024-09-12T18:03:22.431 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:22.429+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:22.431 INFO:tasks.workunit.client.0.smithi052.stdout:2/483: dwrite da/d1d/d35/f31 [0,4194304] 0 2024-09-12T18:03:22.432 INFO:tasks.workunit.client.0.smithi052.stdout:6/588: write d2/d80/f8c [212890,105045] 0 2024-09-12T18:03:22.433 INFO:tasks.workunit.client.0.smithi052.stdout:1/386: creat d3/d1d/d22/d27/d28/d2f/f80 x:0 0 0 2024-09-12T18:03:22.433 INFO:tasks.workunit.client.0.smithi052.stdout:6/589: stat d2/d21/d76/l7b 0 2024-09-12T18:03:22.433 INFO:tasks.workunit.client.0.smithi052.stdout:2/484: mkdir da/dc/d15/da6 0 2024-09-12T18:03:22.433 INFO:tasks.workunit.client.0.smithi052.stdout:2/485: sync 2024-09-12T18:03:22.433 INFO:tasks.workunit.client.0.smithi052.stdout:5/486: read d7/d1f/d3a/d49/d54/f5b [3365032,128662] 0 2024-09-12T18:03:22.435 INFO:tasks.workunit.client.0.smithi052.stdout:2/486: write da/d71/f94 [135664,71244] 0 2024-09-12T18:03:22.435 INFO:tasks.workunit.client.0.smithi052.stdout:5/487: dread - d7/d59/d5c/f99 zero size 2024-09-12T18:03:22.437 INFO:tasks.workunit.client.0.smithi052.stdout:2/487: read f8 [282286,49182] 0 2024-09-12T18:03:22.437 INFO:tasks.workunit.client.0.smithi052.stdout:5/488: getdents d7/d1c 0 2024-09-12T18:03:22.437 INFO:tasks.workunit.client.0.smithi052.stdout:8/589: dwrite d13/d18/d21/f27 [0,4194304] 0 2024-09-12T18:03:22.438 INFO:tasks.workunit.client.0.smithi052.stdout:4/569: dread d11/d65/dc6/d95/dbf/d2f/d3b/d6f/f89 [0,4194304] 0 2024-09-12T18:03:22.438 INFO:tasks.workunit.client.0.smithi052.stdout:2/488: chown da/dc/d15/d22/c5b 1 1 2024-09-12T18:03:22.439 INFO:tasks.workunit.client.0.smithi052.stdout:8/590: rename d13/d18/f7f to d13/d18/d38/dbf/fc4 0 2024-09-12T18:03:22.439 INFO:tasks.workunit.client.0.smithi052.stdout:4/570: readlink d11/d17/d1b/d2a/l54 0 2024-09-12T18:03:22.439 INFO:tasks.workunit.client.0.smithi052.stdout:9/460: write d0/d6/d3a/d43/d74/f77 [18701,61715] 0 2024-09-12T18:03:22.439 INFO:tasks.workunit.client.0.smithi052.stdout:9/461: sync 2024-09-12T18:03:22.440 INFO:tasks.workunit.client.0.smithi052.stdout:5/489: getdents d7/d1f/d3a 0 2024-09-12T18:03:22.441 INFO:tasks.workunit.client.0.smithi052.stdout:4/571: dread - d11/d17/d1b/d2a/d6a/fc8 zero size 2024-09-12T18:03:22.441 INFO:tasks.workunit.client.0.smithi052.stdout:8/591: chown d13/d18/d5b/fb6 0 1 2024-09-12T18:03:22.441 INFO:tasks.workunit.client.0.smithi052.stdout:2/489: rename da/dc/d15/f3e to da/d1d/d7d/fa7 0 2024-09-12T18:03:22.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/462: creat d0/d18/d26/d33/f9d x:0 0 0 2024-09-12T18:03:22.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/463: sync 2024-09-12T18:03:22.442 INFO:tasks.workunit.client.0.smithi052.stdout:8/592: fsync d13/f9d 0 2024-09-12T18:03:22.442 INFO:tasks.workunit.client.0.smithi052.stdout:5/490: creat d7/d1c/d1e/d98/fa2 x:0 0 0 2024-09-12T18:03:22.443 INFO:tasks.workunit.client.0.smithi052.stdout:9/464: mkdir d0/d18/d37/d9e 0 2024-09-12T18:03:22.444 INFO:tasks.workunit.client.0.smithi052.stdout:2/490: rename da/d71/f98 to da/d1d/d35/fa8 0 2024-09-12T18:03:22.444 INFO:tasks.workunit.client.0.smithi052.stdout:4/572: write d11/d70/dbd/f94 [442364,124976] 0 2024-09-12T18:03:22.444 INFO:tasks.workunit.client.0.smithi052.stdout:8/593: fdatasync d13/d18/d21/d64/fb5 0 2024-09-12T18:03:22.444 INFO:tasks.workunit.client.0.smithi052.stdout:6/590: dwrite d2/d3f/d54/f6f [0,4194304] 0 2024-09-12T18:03:22.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/465: creat d0/d18/f9f x:0 0 0 2024-09-12T18:03:22.445 INFO:tasks.workunit.client.0.smithi052.stdout:2/491: rmdir da/dc 39 2024-09-12T18:03:22.445 INFO:tasks.workunit.client.0.smithi052.stdout:5/491: chown d7/d1f/d45/f50 5 1 2024-09-12T18:03:22.445 INFO:tasks.workunit.client.0.smithi052.stdout:1/387: dwrite d3/d1d/d22/f59 [0,4194304] 0 2024-09-12T18:03:22.446 INFO:tasks.workunit.client.0.smithi052.stdout:4/573: creat d11/d17/d1b/d2a/d6a/da8/fcb x:0 0 0 2024-09-12T18:03:22.446 INFO:tasks.workunit.client.0.smithi052.stdout:6/591: truncate d2/d5e/fb9 946686 0 2024-09-12T18:03:22.447 INFO:tasks.workunit.client.0.smithi052.stdout:2/492: stat da/dc/d15/d22/d87/fa0 0 2024-09-12T18:03:22.447 INFO:tasks.workunit.client.0.smithi052.stdout:6/592: stat d2/d3f/d54/f6f 0 2024-09-12T18:03:22.447 INFO:tasks.workunit.client.0.smithi052.stdout:8/594: truncate d13/d35/d9c/f99 984048 0 2024-09-12T18:03:22.447 INFO:tasks.workunit.client.0.smithi052.stdout:1/388: fsync d3/d1d/d22/d3f/f5f 0 2024-09-12T18:03:22.448 INFO:tasks.workunit.client.0.smithi052.stdout:4/574: chown d11/d17/d1b/d2a/dbe/dc5/dc7 9024334 1 2024-09-12T18:03:22.448 INFO:tasks.workunit.client.0.smithi052.stdout:9/466: mknod d0/d6/d3a/d42/d61/ca0 0 2024-09-12T18:03:22.449 INFO:tasks.workunit.client.0.smithi052.stdout:2/493: symlink da/dc/d15/d20/la9 0 2024-09-12T18:03:22.449 INFO:tasks.workunit.client.0.smithi052.stdout:8/595: truncate d13/d3c/f62 554809 0 2024-09-12T18:03:22.450 INFO:tasks.workunit.client.0.smithi052.stdout:6/593: rename d2/c84 to d2/d21/d6a/d97/cc7 0 2024-09-12T18:03:22.451 INFO:tasks.workunit.client.0.smithi052.stdout:0/463: dread d2/f29 [0,4194304] 0 2024-09-12T18:03:22.451 INFO:tasks.workunit.client.0.smithi052.stdout:5/492: dread d7/d1c/d1e/f52 [0,4194304] 0 2024-09-12T18:03:22.451 INFO:tasks.workunit.client.0.smithi052.stdout:6/594: fdatasync d2/dc6/f1f 0 2024-09-12T18:03:22.451 INFO:tasks.workunit.client.0.smithi052.stdout:1/389: creat d3/d1d/d22/d27/f81 x:0 0 0 2024-09-12T18:03:22.451 INFO:tasks.workunit.client.0.smithi052.stdout:4/575: truncate d11/d17/d1b/f5b 1949702 0 2024-09-12T18:03:22.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/596: mkdir d13/d18/d38/dbf/dc5 0 2024-09-12T18:03:22.453 INFO:tasks.workunit.client.0.smithi052.stdout:0/464: fdatasync d2/d6/dd/d21/d26/f40 0 2024-09-12T18:03:22.453 INFO:tasks.workunit.client.0.smithi052.stdout:1/390: write d3/d1d/d22/d3f/d56/f79 [505289,27383] 0 2024-09-12T18:03:22.455 INFO:tasks.workunit.client.0.smithi052.stdout:6/595: truncate d2/d3f/d5f/f68 2194766 0 2024-09-12T18:03:22.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/391: chown d3/le 13361614 1 2024-09-12T18:03:22.455 INFO:tasks.workunit.client.0.smithi052.stdout:6/596: sync 2024-09-12T18:03:22.455 INFO:tasks.workunit.client.0.smithi052.stdout:0/465: getdents d2/d1b/d72/d69 0 2024-09-12T18:03:22.456 INFO:tasks.workunit.client.0.smithi052.stdout:6/597: mknod d2/d21/d9f/cc8 0 2024-09-12T18:03:22.457 INFO:tasks.workunit.client.0.smithi052.stdout:0/466: readlink d2/d6/l28 0 2024-09-12T18:03:22.457 INFO:tasks.workunit.client.0.smithi052.stdout:1/392: dread d3/d1d/d22/d66/f6e [0,4194304] 0 2024-09-12T18:03:22.459 INFO:tasks.workunit.client.0.smithi052.stdout:4/576: dread d11/d46/fb2 [0,4194304] 0 2024-09-12T18:03:22.459 INFO:tasks.workunit.client.0.smithi052.stdout:0/467: creat d2/d8/f8e x:0 0 0 2024-09-12T18:03:22.460 INFO:tasks.workunit.client.0.smithi052.stdout:1/393: chown d3/d10/c5a 16138792 1 2024-09-12T18:03:22.463 INFO:tasks.workunit.client.0.smithi052.stdout:0/468: rename d2/d57/d5b/f7e to d2/d57/d5b/d7a/f8f 0 2024-09-12T18:03:22.463 INFO:tasks.workunit.client.0.smithi052.stdout:8/597: dwrite d13/d18/d5b/f76 [0,4194304] 0 2024-09-12T18:03:22.464 INFO:tasks.workunit.client.0.smithi052.stdout:5/493: dwrite d7/fc [0,4194304] 0 2024-09-12T18:03:22.464 INFO:tasks.workunit.client.0.smithi052.stdout:1/394: dread d3/d10/f33 [0,4194304] 0 2024-09-12T18:03:22.464 INFO:tasks.workunit.client.0.smithi052.stdout:4/577: truncate d11/d65/dc6/d95/dbf/d8e/fc1 880006 0 2024-09-12T18:03:22.465 INFO:tasks.workunit.client.0.smithi052.stdout:4/578: sync 2024-09-12T18:03:22.466 INFO:tasks.workunit.client.0.smithi052.stdout:8/598: readlink d13/d35/lbe 0 2024-09-12T18:03:22.466 INFO:tasks.workunit.client.0.smithi052.stdout:5/494: mkdir d7/d51/d8b/da3 0 2024-09-12T18:03:22.468 INFO:tasks.workunit.client.0.smithi052.stdout:7/450: dread d6/d12/d1e/d29/d5d/f78 [0,4194304] 0 2024-09-12T18:03:22.472 INFO:tasks.workunit.client.0.smithi052.stdout:3/519: dread d0/d4/f27 [0,4194304] 0 2024-09-12T18:03:22.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/599: symlink d13/d35/d9c/lc6 0 2024-09-12T18:03:22.472 INFO:tasks.workunit.client.0.smithi052.stdout:1/395: mknod d3/d1d/d22/d27/d28/d2f/d74/c82 0 2024-09-12T18:03:22.472 INFO:tasks.workunit.client.0.smithi052.stdout:4/579: chown d11/d65/dc6/d95/dbf/d2f/f39 15680825 1 2024-09-12T18:03:22.473 INFO:tasks.workunit.client.0.smithi052.stdout:4/580: truncate d11/d46/f8d 858903 0 2024-09-12T18:03:22.474 INFO:tasks.workunit.client.0.smithi052.stdout:7/451: write d6/dc/d1a/d6a/f8a [1406600,90111] 0 2024-09-12T18:03:22.474 INFO:tasks.workunit.client.0.smithi052.stdout:5/495: getdents d7/d1c 0 2024-09-12T18:03:22.475 INFO:tasks.workunit.client.0.smithi052.stdout:8/600: creat d13/d18/fc7 x:0 0 0 2024-09-12T18:03:22.475 INFO:tasks.workunit.client.0.smithi052.stdout:1/396: fdatasync d3/d1d/d22/d27/d28/d2f/f46 0 2024-09-12T18:03:22.475 INFO:tasks.workunit.client.0.smithi052.stdout:3/520: write d0/d4/d25/d2a/d6/d7/d34/fb1 [525229,18317] 0 2024-09-12T18:03:22.475 INFO:tasks.workunit.client.0.smithi052.stdout:0/469: dwrite d2/d6/f4c [0,4194304] 0 2024-09-12T18:03:22.475 INFO:tasks.workunit.client.0.smithi052.stdout:8/601: readlink l12 0 2024-09-12T18:03:22.475 INFO:tasks.workunit.client.0.smithi052.stdout:8/602: sync 2024-09-12T18:03:22.476 INFO:tasks.workunit.client.0.smithi052.stdout:8/603: stat d13/d18/d5b/fb6 0 2024-09-12T18:03:22.477 INFO:tasks.workunit.client.0.smithi052.stdout:1/397: write d3/d1d/d22/d27/d28/f7c [912141,60841] 0 2024-09-12T18:03:22.478 INFO:tasks.workunit.client.0.smithi052.stdout:4/581: rename d11/d17/d1b/d2a/d82/f9a to d11/d17/d1b/d2a/d82/fcc 0 2024-09-12T18:03:22.479 INFO:tasks.workunit.client.0.smithi052.stdout:2/494: dread da/dc/f82 [0,4194304] 0 2024-09-12T18:03:22.479 INFO:tasks.workunit.client.0.smithi052.stdout:4/582: chown d11/d17/d1b/d2a/d82/f53 62863 1 2024-09-12T18:03:22.480 INFO:tasks.workunit.client.0.smithi052.stdout:1/398: mkdir d3/d1d/d83 0 2024-09-12T18:03:22.481 INFO:tasks.workunit.client.0.smithi052.stdout:7/452: symlink d6/d12/d1e/d29/d5d/d71/d3a/l9d 0 2024-09-12T18:03:22.482 INFO:tasks.workunit.client.0.smithi052.stdout:9/467: dread d0/d18/d26/f92 [0,4194304] 0 2024-09-12T18:03:22.482 INFO:tasks.workunit.client.0.smithi052.stdout:4/583: creat d11/d17/d1b/fcd x:0 0 0 2024-09-12T18:03:22.483 INFO:tasks.workunit.client.0.smithi052.stdout:3/521: getdents d0/d4/d25/d2a/d6/d7/d34 0 2024-09-12T18:03:22.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/453: dread d6/f76 [0,4194304] 0 2024-09-12T18:03:22.484 INFO:tasks.workunit.client.0.smithi052.stdout:1/399: write d3/d1d/d22/d27/f5c [4132554,65626] 0 2024-09-12T18:03:22.487 INFO:tasks.workunit.client.0.smithi052.stdout:6/598: dread d2/d3f/f52 [0,4194304] 0 2024-09-12T18:03:22.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/496: dwrite d7/d1f/d3a/d49/d54/d6b/fa1 [0,4194304] 0 2024-09-12T18:03:22.488 INFO:tasks.workunit.client.0.smithi052.stdout:7/454: fsync d6/d12/d1e/d29/d5d/d71/d3a/f84 0 2024-09-12T18:03:22.488 INFO:tasks.workunit.client.0.smithi052.stdout:9/468: symlink d0/d6/d3a/d42/d61/d85/la1 0 2024-09-12T18:03:22.491 INFO:tasks.workunit.client.0.smithi052.stdout:0/470: dwrite d2/d6/dd/d21/d41/f75 [0,4194304] 0 2024-09-12T18:03:22.492 INFO:tasks.workunit.client.0.smithi052.stdout:2/495: dwrite da/f17 [0,4194304] 0 2024-09-12T18:03:22.492 INFO:tasks.workunit.client.0.smithi052.stdout:9/469: chown d0/d6/d3a/f6e 434357 1 2024-09-12T18:03:22.492 INFO:tasks.workunit.client.0.smithi052.stdout:6/599: truncate d2/d80/f8c 2054067 0 2024-09-12T18:03:22.492 INFO:tasks.workunit.client.0.smithi052.stdout:5/497: write d7/d1f/d3a/d49/f87 [5074605,70943] 0 2024-09-12T18:03:22.492 INFO:tasks.workunit.client.0.smithi052.stdout:8/604: dwrite d13/d35/f85 [0,4194304] 0 2024-09-12T18:03:22.492 INFO:tasks.workunit.client.0.smithi052.stdout:6/600: write d2/d3f/d58/fa8 [63497,70990] 0 2024-09-12T18:03:22.493 INFO:tasks.workunit.client.0.smithi052.stdout:1/400: fsync d3/d1d/d22/d27/d28/f7c 0 2024-09-12T18:03:22.493 INFO:tasks.workunit.client.0.smithi052.stdout:3/522: creat d0/d4/d25/d2a/d6/d7/fba x:0 0 0 2024-09-12T18:03:22.493 INFO:tasks.workunit.client.0.smithi052.stdout:8/605: stat d13/d18/d38/dbf/fc4 0 2024-09-12T18:03:22.494 INFO:tasks.workunit.client.0.smithi052.stdout:5/498: symlink d7/d1f/d45/la4 0 2024-09-12T18:03:22.494 INFO:tasks.workunit.client.0.smithi052.stdout:9/470: symlink d0/d6/d3a/d42/la2 0 2024-09-12T18:03:22.495 INFO:tasks.workunit.client.0.smithi052.stdout:4/584: getdents d11/d65/dc6/d95/dbf/d2f/d3b/d6f 0 2024-09-12T18:03:22.495 INFO:tasks.workunit.client.0.smithi052.stdout:9/471: write d0/fb [575058,76711] 0 2024-09-12T18:03:22.495 INFO:tasks.workunit.client.0.smithi052.stdout:6/601: mknod d2/d3f/d58/cc9 0 2024-09-12T18:03:22.495 INFO:tasks.workunit.client.0.smithi052.stdout:5/499: mkdir d7/d1c/d1e/da5 0 2024-09-12T18:03:22.496 INFO:tasks.workunit.client.0.smithi052.stdout:3/523: mkdir d0/d4/dbb 0 2024-09-12T18:03:22.498 INFO:tasks.workunit.client.0.smithi052.stdout:0/471: link d2/d6/dd/d21/d41/d44/d48/c5a d2/d6/dd/c90 0 2024-09-12T18:03:22.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/472: stat d0/d6/d3a/d43 0 2024-09-12T18:03:22.498 INFO:tasks.workunit.client.0.smithi052.stdout:8/606: rename d13/d18/d5b/f63 to d13/fc8 0 2024-09-12T18:03:22.498 INFO:tasks.workunit.client.0.smithi052.stdout:5/500: symlink d7/d51/d8d/la6 0 2024-09-12T18:03:22.498 INFO:tasks.workunit.client.0.smithi052.stdout:6/602: symlink d2/d21/lca 0 2024-09-12T18:03:22.499 INFO:tasks.workunit.client.0.smithi052.stdout:3/524: write d0/d4/d33/f5c [290458,92890] 0 2024-09-12T18:03:22.500 INFO:tasks.workunit.client.0.smithi052.stdout:9/473: read d0/d6/d3a/d43/f7a [3480819,103197] 0 2024-09-12T18:03:22.500 INFO:tasks.workunit.client.0.smithi052.stdout:0/472: rmdir d2/d6/dd/d21/d41/d44 39 2024-09-12T18:03:22.501 INFO:tasks.workunit.client.0.smithi052.stdout:8/607: getdents d13/d18 0 2024-09-12T18:03:22.501 INFO:tasks.workunit.client.0.smithi052.stdout:5/501: getdents d7/d1c 0 2024-09-12T18:03:22.501 INFO:tasks.workunit.client.0.smithi052.stdout:6/603: mknod d2/d21/d76/ccb 0 2024-09-12T18:03:22.502 INFO:tasks.workunit.client.0.smithi052.stdout:2/496: dwrite da/dc/f5e [0,4194304] 0 2024-09-12T18:03:22.505 INFO:tasks.workunit.client.0.smithi052.stdout:5/502: write d7/ff [4231364,18834] 0 2024-09-12T18:03:22.505 INFO:tasks.workunit.client.0.smithi052.stdout:3/525: truncate d0/d4b/d4c/d6b/fae 844841 0 2024-09-12T18:03:22.505 INFO:tasks.workunit.client.0.smithi052.stdout:9/474: write d0/d18/d26/d33/f52 [499846,97677] 0 2024-09-12T18:03:22.505 INFO:tasks.workunit.client.0.smithi052.stdout:1/401: dwrite d3/d10/d38/f4a [0,4194304] 0 2024-09-12T18:03:22.505 INFO:tasks.workunit.client.0.smithi052.stdout:6/604: write d2/d3f/d5f/f85 [4933716,118099] 0 2024-09-12T18:03:22.505 INFO:tasks.workunit.client.0.smithi052.stdout:5/503: creat d7/d59/fa7 x:0 0 0 2024-09-12T18:03:22.506 INFO:tasks.workunit.client.0.smithi052.stdout:2/497: read da/d1d/f1e [116933,107168] 0 2024-09-12T18:03:22.506 INFO:tasks.workunit.client.0.smithi052.stdout:8/608: getdents d13/d18 0 2024-09-12T18:03:22.506 INFO:tasks.workunit.client.0.smithi052.stdout:9/475: write d0/d6/f80 [3520999,97353] 0 2024-09-12T18:03:22.506 INFO:tasks.workunit.client.0.smithi052.stdout:8/609: mknod d13/d35/d9c/d9f/cc9 0 2024-09-12T18:03:22.507 INFO:tasks.workunit.client.0.smithi052.stdout:2/498: mkdir da/d1d/daa 0 2024-09-12T18:03:22.507 INFO:tasks.workunit.client.0.smithi052.stdout:4/585: dread d11/d65/dc6/d68/f85 [4194304,4194304] 0 2024-09-12T18:03:22.507 INFO:tasks.workunit.client.0.smithi052.stdout:1/402: truncate d3/d1d/d22/d27/d28/f7a 399462 0 2024-09-12T18:03:22.507 INFO:tasks.workunit.client.0.smithi052.stdout:3/526: chown d0/d4b/d4c/d6b/fae 135096220 1 2024-09-12T18:03:22.507 INFO:tasks.workunit.client.0.smithi052.stdout:9/476: mkdir d0/da3 0 2024-09-12T18:03:22.508 INFO:tasks.workunit.client.0.smithi052.stdout:8/610: symlink d13/d35/lca 0 2024-09-12T18:03:22.509 INFO:tasks.workunit.client.0.smithi052.stdout:4/586: write d11/d17/d1b/d2a/d33/f8c [1884761,9234] 0 2024-09-12T18:03:22.511 INFO:tasks.workunit.client.0.smithi052.stdout:4/587: mknod d11/d17/d1b/d2a/d6a/d7f/d90/cce 0 2024-09-12T18:03:22.512 INFO:tasks.workunit.client.0.smithi052.stdout:6/605: dwrite d2/fb [4194304,4194304] 0 2024-09-12T18:03:22.513 INFO:tasks.workunit.client.0.smithi052.stdout:2/499: dread da/dc/d15/d43/f72 [0,4194304] 0 2024-09-12T18:03:22.517 INFO:tasks.workunit.client.0.smithi052.stdout:9/477: dwrite d0/d18/d26/d33/f9d [0,4194304] 0 2024-09-12T18:03:22.519 INFO:tasks.workunit.client.0.smithi052.stdout:9/478: fdatasync d0/d1c/f20 0 2024-09-12T18:03:22.520 INFO:tasks.workunit.client.0.smithi052.stdout:9/479: rename d0/d6/d3a/f6e to d0/d6/d3a/d42/d93/d96/fa4 0 2024-09-12T18:03:22.521 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:22.519+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:22.522 INFO:tasks.workunit.client.0.smithi052.stdout:2/500: dwrite da/d1d/d35/f3f [0,4194304] 0 2024-09-12T18:03:22.522 INFO:tasks.workunit.client.0.smithi052.stdout:1/403: write d3/d10/f33 [1016604,49463] 0 2024-09-12T18:03:22.523 INFO:tasks.workunit.client.0.smithi052.stdout:8/611: getdents d13/d35 0 2024-09-12T18:03:22.526 INFO:tasks.workunit.client.0.smithi052.stdout:0/473: dwrite d2/d1b/f2e [0,4194304] 0 2024-09-12T18:03:22.528 INFO:tasks.workunit.client.0.smithi052.stdout:6/606: truncate d2/d3f/d58/d5d/d9c/d26/f7c 606194 0 2024-09-12T18:03:22.530 INFO:tasks.workunit.client.0.smithi052.stdout:4/588: dread d11/d17/d1b/f5b [0,4194304] 0 2024-09-12T18:03:22.530 INFO:tasks.workunit.client.0.smithi052.stdout:2/501: dread da/d1d/f29 [0,4194304] 0 2024-09-12T18:03:22.531 INFO:tasks.workunit.client.0.smithi052.stdout:4/589: fdatasync d11/d17/d1b/f20 0 2024-09-12T18:03:22.532 INFO:tasks.workunit.client.0.smithi052.stdout:3/527: dread d0/d4b/d4c/f46 [0,4194304] 0 2024-09-12T18:03:22.533 INFO:tasks.workunit.client.0.smithi052.stdout:3/528: sync 2024-09-12T18:03:22.534 INFO:tasks.workunit.client.0.smithi052.stdout:3/529: stat d0/d4b/d4c/d6b/d48 0 2024-09-12T18:03:22.534 INFO:tasks.workunit.client.0.smithi052.stdout:4/590: creat d11/d17/fcf x:0 0 0 2024-09-12T18:03:22.535 INFO:tasks.workunit.client.0.smithi052.stdout:3/530: rmdir d0/d4b/d4c/d95 0 2024-09-12T18:03:22.535 INFO:tasks.workunit.client.0.smithi052.stdout:9/480: truncate d0/d6/d3a/d42/d61/f82 165112 0 2024-09-12T18:03:22.536 INFO:tasks.workunit.client.0.smithi052.stdout:1/404: truncate d3/d1d/d22/f59 1127503 0 2024-09-12T18:03:22.537 INFO:tasks.workunit.client.0.smithi052.stdout:8/612: dwrite ff [0,4194304] 0 2024-09-12T18:03:22.537 INFO:tasks.workunit.client.0.smithi052.stdout:9/481: mknod d0/d6/d3a/d42/ca5 0 2024-09-12T18:03:22.538 INFO:tasks.workunit.client.0.smithi052.stdout:1/405: dread - d3/d1d/d22/d27/d28/d2f/f46 zero size 2024-09-12T18:03:22.538 INFO:tasks.workunit.client.0.smithi052.stdout:8/613: dread - d13/d18/d38/fb4 zero size 2024-09-12T18:03:22.538 INFO:tasks.workunit.client.0.smithi052.stdout:6/607: truncate d2/d3f/f52 3039142 0 2024-09-12T18:03:22.539 INFO:tasks.workunit.client.0.smithi052.stdout:1/406: readlink d3/d1d/d22/d27/d28/d2f/l73 0 2024-09-12T18:03:22.539 INFO:tasks.workunit.client.0.smithi052.stdout:8/614: chown d13/d35/d9c/d9f/cc9 674949 1 2024-09-12T18:03:22.539 INFO:tasks.workunit.client.0.smithi052.stdout:9/482: rename d0/d6/d3a/d42/d61/d85 to d0/d18/d79/da6 0 2024-09-12T18:03:22.540 INFO:tasks.workunit.client.0.smithi052.stdout:6/608: dread - d2/d3f/d58/d5d/fba zero size 2024-09-12T18:03:22.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/407: mkdir d3/d1d/d22/d27/d28/d2f/d74/d7d/d84 0 2024-09-12T18:03:22.542 INFO:tasks.workunit.client.0.smithi052.stdout:1/408: chown d3/d1d/d22/d3f/l58 201 1 2024-09-12T18:03:22.544 INFO:tasks.workunit.client.0.smithi052.stdout:1/409: link d3/d1d/d22/d27/f4f d3/d10/f85 0 2024-09-12T18:03:22.545 INFO:tasks.workunit.client.0.smithi052.stdout:2/502: dwrite da/f12 [0,4194304] 0 2024-09-12T18:03:22.547 INFO:tasks.workunit.client.0.smithi052.stdout:9/483: dwrite d0/d6/f80 [4194304,4194304] 0 2024-09-12T18:03:22.547 INFO:tasks.workunit.client.0.smithi052.stdout:2/503: mkdir da/dc/d15/d20/d60/d6e/dab 0 2024-09-12T18:03:22.548 INFO:tasks.workunit.client.0.smithi052.stdout:9/484: symlink d0/d18/d26/d4d/la7 0 2024-09-12T18:03:22.548 INFO:tasks.workunit.client.0.smithi052.stdout:2/504: creat da/dc/d15/d22/fac x:0 0 0 2024-09-12T18:03:22.556 INFO:tasks.workunit.client.0.smithi052.stdout:7/455: dread d6/d12/d17/f52 [0,4194304] 0 2024-09-12T18:03:22.556 INFO:tasks.workunit.client.0.smithi052.stdout:2/505: dread da/d1d/d7d/fa4 [0,4194304] 0 2024-09-12T18:03:22.557 INFO:tasks.workunit.client.0.smithi052.stdout:5/504: dread f4 [0,4194304] 0 2024-09-12T18:03:22.559 INFO:tasks.workunit.client.0.smithi052.stdout:7/456: write d6/f89 [1030671,124437] 0 2024-09-12T18:03:22.560 INFO:tasks.workunit.client.0.smithi052.stdout:2/506: fdatasync da/dc/d15/d22/f66 0 2024-09-12T18:03:22.560 INFO:tasks.workunit.client.0.smithi052.stdout:9/485: dwrite d0/d18/d26/d4d/d54/f5b [0,4194304] 0 2024-09-12T18:03:22.561 INFO:tasks.workunit.client.0.smithi052.stdout:3/531: dread d0/d16/f1e [0,4194304] 0 2024-09-12T18:03:22.562 INFO:tasks.workunit.client.0.smithi052.stdout:9/486: fsync d0/d18/d37/d87/f73 0 2024-09-12T18:03:22.563 INFO:tasks.workunit.client.0.smithi052.stdout:6/609: dwrite d2/d21/f95 [0,4194304] 0 2024-09-12T18:03:22.566 INFO:tasks.workunit.client.0.smithi052.stdout:5/505: link d7/f3c d7/d1c/d67/fa8 0 2024-09-12T18:03:22.566 INFO:tasks.workunit.client.0.smithi052.stdout:3/532: creat d0/d4/d25/d2a/d6/d7/dab/fbc x:0 0 0 2024-09-12T18:03:22.566 INFO:tasks.workunit.client.0.smithi052.stdout:6/610: mkdir d2/d15/dcc 0 2024-09-12T18:03:22.568 INFO:tasks.workunit.client.0.smithi052.stdout:6/611: creat d2/d5e/fcd x:0 0 0 2024-09-12T18:03:22.570 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:22.570 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:22.571 INFO:tasks.workunit.client.0.smithi052.stdout:7/457: dwrite d6/dc/d1a/d6a/f8b [0,4194304] 0 2024-09-12T18:03:22.571 INFO:tasks.workunit.client.0.smithi052.stdout:3/533: symlink d0/d16/d7c/d85/lbd 0 2024-09-12T18:03:22.572 INFO:tasks.workunit.client.0.smithi052.stdout:6/612: creat d2/fce x:0 0 0 2024-09-12T18:03:22.572 INFO:tasks.workunit.client.0.smithi052.stdout:3/534: creat d0/daf/fbe x:0 0 0 2024-09-12T18:03:22.573 INFO:tasks.workunit.client.0.smithi052.stdout:3/535: readlink d0/d16/l8a 0 2024-09-12T18:03:22.573 INFO:tasks.workunit.client.0.smithi052.stdout:7/458: write d6/d12/d1e/d29/d5d/d71/d3a/d83/f7a [637616,79945] 0 2024-09-12T18:03:22.573 INFO:tasks.workunit.client.0.smithi052.stdout:6/613: symlink d2/d3f/d58/lcf 0 2024-09-12T18:03:22.574 INFO:tasks.workunit.client.0.smithi052.stdout:3/536: readlink d0/d4/l96 0 2024-09-12T18:03:22.575 INFO:tasks.workunit.client.0.smithi052.stdout:6/614: mkdir d2/d3f/d58/d5d/dd0 0 2024-09-12T18:03:22.576 INFO:tasks.workunit.client.0.smithi052.stdout:9/487: dwrite d0/d6/d3a/d42/d93/d96/f6f [0,4194304] 0 2024-09-12T18:03:22.576 INFO:tasks.workunit.client.0.smithi052.stdout:8/615: sync 2024-09-12T18:03:22.577 INFO:tasks.workunit.client.0.smithi052.stdout:3/537: write d0/d4/d25/d2a/d6/d7/fba [448654,83407] 0 2024-09-12T18:03:22.577 INFO:tasks.workunit.client.0.smithi052.stdout:0/474: dread d2/d6/dd/d21/d41/d44/f4e [0,4194304] 0 2024-09-12T18:03:22.577 INFO:tasks.workunit.client.0.smithi052.stdout:9/488: chown d0/d18/d26/l7b 1652430 1 2024-09-12T18:03:22.578 INFO:tasks.workunit.client.0.smithi052.stdout:5/506: dwrite d7/d59/d5c/d7c/f9b [0,4194304] 0 2024-09-12T18:03:22.579 INFO:tasks.workunit.client.0.smithi052.stdout:9/489: write d0/d6/d3a/f5d [215573,116524] 0 2024-09-12T18:03:22.579 INFO:tasks.workunit.client.0.smithi052.stdout:8/616: creat d13/d35/d9c/d9f/fcb x:0 0 0 2024-09-12T18:03:22.580 INFO:tasks.workunit.client.0.smithi052.stdout:4/591: dread d11/d17/d1b/f9f [0,4194304] 0 2024-09-12T18:03:22.582 INFO:tasks.workunit.client.0.smithi052.stdout:5/507: write d7/d1f/d45/f50 [3622432,32794] 0 2024-09-12T18:03:22.582 INFO:tasks.workunit.client.0.smithi052.stdout:8/617: symlink d13/d35/lcc 0 2024-09-12T18:03:22.585 INFO:tasks.workunit.client.0.smithi052.stdout:9/490: write d0/d6/d3a/d43/f7a [1665004,36484] 0 2024-09-12T18:03:22.588 INFO:tasks.workunit.client.0.smithi052.stdout:3/538: dwrite d0/d16/f1e [0,4194304] 0 2024-09-12T18:03:22.589 INFO:tasks.workunit.client.0.smithi052.stdout:7/459: dread d6/d12/d1e/d29/d5d/d71/f68 [0,4194304] 0 2024-09-12T18:03:22.593 INFO:tasks.workunit.client.0.smithi052.stdout:9/491: link d0/d6/d3a/l3f d0/d18/d26/d4d/d54/la8 0 2024-09-12T18:03:22.593 INFO:tasks.workunit.client.0.smithi052.stdout:3/539: truncate d0/d4/d25/d2a/d6/d7/fba 845362 0 2024-09-12T18:03:22.594 INFO:tasks.workunit.client.0.smithi052.stdout:1/410: truncate d3/d1d/d22/f59 44802 0 2024-09-12T18:03:22.595 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:22.596 INFO:tasks.workunit.client.0.smithi052.stdout:9/492: mkdir d0/d6/d3a/d42/da9 0 2024-09-12T18:03:22.596 INFO:tasks.workunit.client.0.smithi052.stdout:3/540: fdatasync d0/d4b/d4c/d6b/d48/fb9 0 2024-09-12T18:03:22.596 INFO:tasks.workunit.client.0.smithi052.stdout:8/618: symlink d13/d35/lcd 0 2024-09-12T18:03:22.596 INFO:tasks.workunit.client.0.smithi052.stdout:1/411: mknod d3/d10/d38/d44/d49/c86 0 2024-09-12T18:03:22.596 INFO:tasks.workunit.client.0.smithi052.stdout:9/493: symlink d0/d6/d3a/d43/laa 0 2024-09-12T18:03:22.597 INFO:tasks.workunit.client.0.smithi052.stdout:1/412: chown d3/d1d 90 1 2024-09-12T18:03:22.597 INFO:tasks.workunit.client.0.smithi052.stdout:4/592: dwrite d11/d17/d1b/d2a/d6a/f73 [0,4194304] 0 2024-09-12T18:03:22.597 INFO:tasks.workunit.client.0.smithi052.stdout:3/541: fdatasync d0/d4/d25/d2a/d6/d7/de/f9b 0 2024-09-12T18:03:22.597 INFO:tasks.workunit.client.0.smithi052.stdout:9/494: fdatasync d0/d18/d26/d33/f9d 0 2024-09-12T18:03:22.597 INFO:tasks.workunit.client.0.smithi052.stdout:1/413: fdatasync d3/f35 0 2024-09-12T18:03:22.598 INFO:tasks.workunit.client.0.smithi052.stdout:4/593: creat d11/d17/d1b/fd0 x:0 0 0 2024-09-12T18:03:22.598 INFO:tasks.workunit.client.0.smithi052.stdout:4/594: dread - d11/fbb zero size 2024-09-12T18:03:22.599 INFO:tasks.workunit.client.0.smithi052.stdout:4/595: write d11/d17/d1b/d2a/d82/f5e [4459111,120686] 0 2024-09-12T18:03:22.603 INFO:tasks.workunit.client.0.smithi052.stdout:4/596: dread d11/d17/faa [0,4194304] 0 2024-09-12T18:03:22.604 INFO:tasks.workunit.client.0.smithi052.stdout:8/619: dread d13/d18/d21/f28 [0,4194304] 0 2024-09-12T18:03:22.604 INFO:tasks.workunit.client.0.smithi052.stdout:1/414: dwrite d3/d10/f53 [4194304,4194304] 0 2024-09-12T18:03:22.605 INFO:tasks.workunit.client.0.smithi052.stdout:7/460: write d6/dc/f30 [516458,130005] 0 2024-09-12T18:03:22.606 INFO:tasks.workunit.client.0.smithi052.stdout:2/507: dread da/dc/d15/d20/fe [0,4194304] 0 2024-09-12T18:03:22.606 INFO:tasks.workunit.client.0.smithi052.stdout:9/495: dwrite d0/d18/d79/f31 [0,4194304] 0 2024-09-12T18:03:22.608 INFO:tasks.workunit.client.0.smithi052.stdout:4/597: rename d11/d65/dc6/d95/dbf/d2f to d11/d65/dd1 0 2024-09-12T18:03:22.609 INFO:tasks.workunit.client.0.smithi052.stdout:2/508: rmdir da/d1d/d7d 39 2024-09-12T18:03:22.609 INFO:tasks.workunit.client.0.smithi052.stdout:8/620: link d13/d18/d21/d64/ca6 d13/d18/cce 0 2024-09-12T18:03:22.611 INFO:tasks.workunit.client.0.smithi052.stdout:7/461: rename d6/d7d to d6/d12/d1e/d29/d5d/d71/d9e 0 2024-09-12T18:03:22.613 INFO:tasks.workunit.client.0.smithi052.stdout:2/509: symlink da/dc/lad 0 2024-09-12T18:03:22.613 INFO:tasks.workunit.client.0.smithi052.stdout:6/615: dwrite d2/d3f/f99 [0,4194304] 0 2024-09-12T18:03:22.613 INFO:tasks.workunit.client.0.smithi052.stdout:0/475: dwrite d2/f88 [0,4194304] 0 2024-09-12T18:03:22.613 INFO:tasks.workunit.client.0.smithi052.stdout:5/508: dwrite d7/d1c/d1e/f52 [0,4194304] 0 2024-09-12T18:03:22.614 INFO:tasks.workunit.client.0.smithi052.stdout:4/598: chown d11/d65/dd1/cc2 5182 1 2024-09-12T18:03:22.615 INFO:tasks.workunit.client.0.smithi052.stdout:0/476: symlink d2/l91 0 2024-09-12T18:03:22.617 INFO:tasks.workunit.client.0.smithi052.stdout:9/496: dwrite d0/d6/d3a/d42/d93/d96/f53 [0,4194304] 0 2024-09-12T18:03:22.618 INFO:tasks.workunit.client.0.smithi052.stdout:0/477: mknod d2/d6/dd/d21/c92 0 2024-09-12T18:03:22.619 INFO:tasks.workunit.client.0.smithi052.stdout:7/462: dread d6/dc/d1a/d6a/f8b [0,4194304] 0 2024-09-12T18:03:22.619 INFO:tasks.workunit.client.0.smithi052.stdout:4/599: symlink d11/d17/d1b/d2a/dbe/ld2 0 2024-09-12T18:03:22.620 INFO:tasks.workunit.client.0.smithi052.stdout:2/510: rename da/dc/d15/d20/l28 to da/dc/d15/lae 0 2024-09-12T18:03:22.620 INFO:tasks.workunit.client.0.smithi052.stdout:5/509: truncate d7/d1c/d1e/f2b 1851274 0 2024-09-12T18:03:22.621 INFO:tasks.workunit.client.0.smithi052.stdout:4/600: fdatasync d11/d17/d1b/d2a/f93 0 2024-09-12T18:03:22.621 INFO:tasks.workunit.client.0.smithi052.stdout:1/415: write d3/d10/d38/f4d [522353,120372] 0 2024-09-12T18:03:22.621 INFO:tasks.workunit.client.0.smithi052.stdout:0/478: write d2/d57/f82 [19537,10155] 0 2024-09-12T18:03:22.621 INFO:tasks.workunit.client.0.smithi052.stdout:2/511: write da/d71/f94 [794074,14155] 0 2024-09-12T18:03:22.622 INFO:tasks.workunit.client.0.smithi052.stdout:4/601: write d11/d17/d1b/d2a/d33/f8c [1738966,32685] 0 2024-09-12T18:03:22.622 INFO:tasks.workunit.client.0.smithi052.stdout:2/512: rmdir da/dc/d15/d43 39 2024-09-12T18:03:22.622 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:22.617+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:22.623 INFO:tasks.workunit.client.0.smithi052.stdout:2/513: fsync da/dc/d15/d22/f54 0 2024-09-12T18:03:22.624 INFO:tasks.workunit.client.0.smithi052.stdout:2/514: symlink da/dc/d15/d20/laf 0 2024-09-12T18:03:22.624 INFO:tasks.workunit.client.0.smithi052.stdout:4/602: rename d11/d65/d6c/fb5 to d11/d65/dd1/d72/fd3 0 2024-09-12T18:03:22.625 INFO:tasks.workunit.client.0.smithi052.stdout:4/603: readlink d11/d17/d1b/d2a/d32/l48 0 2024-09-12T18:03:22.627 INFO:tasks.workunit.client.0.smithi052.stdout:4/604: mkdir d11/d65/dc6/d95/dbf/d8e/dd4 0 2024-09-12T18:03:22.627 INFO:tasks.workunit.client.0.smithi052.stdout:4/605: fsync d11/d17/fa4 0 2024-09-12T18:03:22.629 INFO:tasks.workunit.client.0.smithi052.stdout:7/463: dwrite d6/d12/d1e/d29/d5d/d71/d3a/f53 [0,4194304] 0 2024-09-12T18:03:22.629 INFO:tasks.workunit.client.0.smithi052.stdout:6/616: dread d2/d21/d76/f7f [0,4194304] 0 2024-09-12T18:03:22.629 INFO:tasks.workunit.client.0.smithi052.stdout:7/464: chown d6/dc/d1a/c70 20767265 1 2024-09-12T18:03:22.629 INFO:tasks.workunit.client.0.smithi052.stdout:6/617: rmdir d2/d3f/d58 39 2024-09-12T18:03:22.630 INFO:tasks.workunit.client.0.smithi052.stdout:2/515: dwrite da/dc/f82 [0,4194304] 0 2024-09-12T18:03:22.634 INFO:tasks.workunit.client.0.smithi052.stdout:1/416: write d3/d1d/d22/d27/d28/f29 [2985427,47898] 0 2024-09-12T18:03:22.634 INFO:tasks.workunit.client.0.smithi052.stdout:8/621: write d13/d18/d38/d7a/f96 [1455089,100768] 0 2024-09-12T18:03:22.635 INFO:tasks.workunit.client.0.smithi052.stdout:5/510: read d7/ff [4713565,22719] 0 2024-09-12T18:03:22.635 INFO:tasks.workunit.client.0.smithi052.stdout:4/606: dwrite d11/d17/fa4 [0,4194304] 0 2024-09-12T18:03:22.636 INFO:tasks.workunit.client.0.smithi052.stdout:1/417: chown d3/d1d/c1f 25 1 2024-09-12T18:03:22.637 INFO:tasks.workunit.client.0.smithi052.stdout:1/418: mknod d3/d10/d38/d44/d49/c87 0 2024-09-12T18:03:22.638 INFO:tasks.workunit.client.0.smithi052.stdout:4/607: creat d11/d17/d1b/d2a/dbe/dc5/dc7/fd5 x:0 0 0 2024-09-12T18:03:22.639 INFO:tasks.workunit.client.0.smithi052.stdout:9/497: dwrite d0/d6/fd [0,4194304] 0 2024-09-12T18:03:22.639 INFO:tasks.workunit.client.0.smithi052.stdout:7/465: dwrite d6/f89 [0,4194304] 0 2024-09-12T18:03:22.640 INFO:tasks.workunit.client.0.smithi052.stdout:9/498: chown d0/d6/l3c 19745701 1 2024-09-12T18:03:22.640 INFO:tasks.workunit.client.0.smithi052.stdout:7/466: readlink d6/d12/d1e/d29/d5d/d71/l4a 0 2024-09-12T18:03:22.641 INFO:tasks.workunit.client.0.smithi052.stdout:4/608: mkdir d11/d17/d1b/d2a/d6a/d7f/dd6 0 2024-09-12T18:03:22.641 INFO:tasks.workunit.client.0.smithi052.stdout:1/419: read d3/d1d/d22/d3f/d56/f79 [344521,125812] 0 2024-09-12T18:03:22.642 INFO:tasks.workunit.client.0.smithi052.stdout:4/609: write d11/d65/dd1/f2b [1275377,94964] 0 2024-09-12T18:03:22.643 INFO:tasks.workunit.client.0.smithi052.stdout:1/420: mkdir d3/d1d/d22/d27/d28/d88 0 2024-09-12T18:03:22.643 INFO:tasks.workunit.client.0.smithi052.stdout:0/479: write d2/d1b/d72/f5d [6541368,126871] 0 2024-09-12T18:03:22.644 INFO:tasks.workunit.client.0.smithi052.stdout:1/421: write d3/d69/f7e [923437,27643] 0 2024-09-12T18:03:22.644 INFO:tasks.workunit.client.0.smithi052.stdout:0/480: fsync d2/d6/dd/d21/f32 0 2024-09-12T18:03:22.644 INFO:tasks.workunit.client.0.smithi052.stdout:1/422: mkdir d3/d69/d89 0 2024-09-12T18:03:22.645 INFO:tasks.workunit.client.0.smithi052.stdout:1/423: mkdir d3/d1d/d8a 0 2024-09-12T18:03:22.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/424: stat d3/d69 0 2024-09-12T18:03:22.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/425: mkdir d3/d10/d38/d8b 0 2024-09-12T18:03:22.649 INFO:tasks.workunit.client.0.smithi052.stdout:1/426: rename d3/d10/d38/d44/d49/c6d to d3/d1d/d22/d3f/c8c 0 2024-09-12T18:03:22.650 INFO:tasks.workunit.client.0.smithi052.stdout:0/481: dwrite d2/f31 [4194304,4194304] 0 2024-09-12T18:03:22.650 INFO:tasks.workunit.client.0.smithi052.stdout:4/610: dwrite d11/d17/d1b/d2a/dbe/dc5/dc7/fd5 [0,4194304] 0 2024-09-12T18:03:22.650 INFO:tasks.workunit.client.0.smithi052.stdout:1/427: write d3/f35 [2577645,92818] 0 2024-09-12T18:03:22.651 INFO:tasks.workunit.client.0.smithi052.stdout:0/482: symlink d2/d51/l93 0 2024-09-12T18:03:22.651 INFO:tasks.workunit.client.0.smithi052.stdout:1/428: truncate d3/fa 543003 0 2024-09-12T18:03:22.652 INFO:tasks.workunit.client.0.smithi052.stdout:4/611: link d11/d65/dd1/c64 d11/d17/d1b/d2a/cd7 0 2024-09-12T18:03:22.653 INFO:tasks.workunit.client.0.smithi052.stdout:0/483: truncate d2/d6/f10 4410209 0 2024-09-12T18:03:22.653 INFO:tasks.workunit.client.0.smithi052.stdout:3/542: sync 2024-09-12T18:03:22.653 INFO:tasks.workunit.client.0.smithi052.stdout:0/484: chown d2/d8 1740565 1 2024-09-12T18:03:22.653 INFO:tasks.workunit.client.0.smithi052.stdout:1/429: dread d3/d1d/d22/d66/f6e [0,4194304] 0 2024-09-12T18:03:22.654 INFO:tasks.workunit.client.0.smithi052.stdout:4/612: creat d11/d17/d1b/fd8 x:0 0 0 2024-09-12T18:03:22.654 INFO:tasks.workunit.client.0.smithi052.stdout:1/430: chown d3/c15 8779891 1 2024-09-12T18:03:22.654 INFO:tasks.workunit.client.0.smithi052.stdout:4/613: chown d11/fbb 973495 1 2024-09-12T18:03:22.655 INFO:tasks.workunit.client.0.smithi052.stdout:3/543: creat d0/d4b/d4c/d6b/fbf x:0 0 0 2024-09-12T18:03:22.655 INFO:tasks.workunit.client.0.smithi052.stdout:0/485: unlink d2/d6/dd/d21/d26/f78 0 2024-09-12T18:03:22.655 INFO:tasks.workunit.client.0.smithi052.stdout:1/431: rmdir d3/d1d/d8a 0 2024-09-12T18:03:22.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/614: mkdir d11/d46/dd9 0 2024-09-12T18:03:22.656 INFO:tasks.workunit.client.0.smithi052.stdout:2/516: dread da/f13 [0,4194304] 0 2024-09-12T18:03:22.656 INFO:tasks.workunit.client.0.smithi052.stdout:3/544: write d0/d4b/d4c/f97 [410517,92836] 0 2024-09-12T18:03:22.657 INFO:tasks.workunit.client.0.smithi052.stdout:0/486: dread - d2/d6/dd/d21/d47/f67 zero size 2024-09-12T18:03:22.657 INFO:tasks.workunit.client.0.smithi052.stdout:2/517: readlink da/dc/d15/d36/l63 0 2024-09-12T18:03:22.658 INFO:tasks.workunit.client.0.smithi052.stdout:3/545: write d0/daf/fbe [666623,20697] 0 2024-09-12T18:03:22.658 INFO:tasks.workunit.client.0.smithi052.stdout:4/615: unlink d11/d17/d1b/d2a/dbe/l83 0 2024-09-12T18:03:22.658 INFO:tasks.workunit.client.0.smithi052.stdout:1/432: mknod d3/d1d/d22/d76/c8d 0 2024-09-12T18:03:22.659 INFO:tasks.workunit.client.0.smithi052.stdout:2/518: fdatasync da/d1d/d7d/fa4 0 2024-09-12T18:03:22.659 INFO:tasks.workunit.client.0.smithi052.stdout:3/546: readlink d0/d16/d7c/d85/lbd 0 2024-09-12T18:03:22.659 INFO:tasks.workunit.client.0.smithi052.stdout:1/433: creat d3/d10/d38/d44/d49/f8e x:0 0 0 2024-09-12T18:03:22.660 INFO:tasks.workunit.client.0.smithi052.stdout:1/434: chown d3/d1d/l3d 0 1 2024-09-12T18:03:22.660 INFO:tasks.workunit.client.0.smithi052.stdout:6/618: dread d2/d3f/d5f/f68 [0,4194304] 0 2024-09-12T18:03:22.661 INFO:tasks.workunit.client.0.smithi052.stdout:3/547: write d0/d4/d25/d2a/d6/d7/de/f4f [908212,120449] 0 2024-09-12T18:03:22.661 INFO:tasks.workunit.client.0.smithi052.stdout:6/619: readlink d2/d21/d76/l7b 0 2024-09-12T18:03:22.661 INFO:tasks.workunit.client.0.smithi052.stdout:1/435: mkdir d3/d1d/d83/d8f 0 2024-09-12T18:03:22.661 INFO:tasks.workunit.client.0.smithi052.stdout:3/548: chown d0/d4b/d4c/d6b/d48/f56 206869 1 2024-09-12T18:03:22.663 INFO:tasks.workunit.client.0.smithi052.stdout:1/436: write d3/d10/f33 [1078928,29605] 0 2024-09-12T18:03:22.663 INFO:tasks.workunit.client.0.smithi052.stdout:9/499: truncate d0/d6/fd 742530 0 2024-09-12T18:03:22.664 INFO:tasks.workunit.client.0.smithi052.stdout:7/467: write d6/d12/d1e/d29/d5d/d71/f42 [1825718,38590] 0 2024-09-12T18:03:22.665 INFO:tasks.workunit.client.0.smithi052.stdout:9/500: chown d0/d18/f36 4 1 2024-09-12T18:03:22.666 INFO:tasks.workunit.client.0.smithi052.stdout:6/620: rename d2/d3f/d5f to d2/d3f/d58/d5d/d87/dd1 0 2024-09-12T18:03:22.666 INFO:tasks.workunit.client.0.smithi052.stdout:7/468: dread - d6/d12/d1e/f6f zero size 2024-09-12T18:03:22.668 INFO:tasks.workunit.client.0.smithi052.stdout:0/487: dwrite d2/d1b/d72/d69/f7f [0,4194304] 0 2024-09-12T18:03:22.668 INFO:tasks.workunit.client.0.smithi052.stdout:3/549: mkdir d0/d4/d25/d2a/d2c/da9/db8/dc0 0 2024-09-12T18:03:22.669 INFO:tasks.workunit.client.0.smithi052.stdout:2/519: dwrite da/dc/d15/d22/f8d [0,4194304] 0 2024-09-12T18:03:22.670 INFO:tasks.workunit.client.0.smithi052.stdout:7/469: write d6/d12/d1e/f6d [3705925,37018] 0 2024-09-12T18:03:22.670 INFO:tasks.workunit.client.0.smithi052.stdout:8/622: dwrite d13/d35/d9c/da3/fad [0,4194304] 0 2024-09-12T18:03:22.670 INFO:tasks.workunit.client.0.smithi052.stdout:9/501: creat d0/d6/d3a/d42/d61/fab x:0 0 0 2024-09-12T18:03:22.671 INFO:tasks.workunit.client.0.smithi052.stdout:2/520: rename f3 to da/d71/fb0 0 2024-09-12T18:03:22.672 INFO:tasks.workunit.client.0.smithi052.stdout:0/488: fsync d2/d6/dd/d21/d26/d2f/f6b 0 2024-09-12T18:03:22.672 INFO:tasks.workunit.client.0.smithi052.stdout:7/470: mknod d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/c9f 0 2024-09-12T18:03:22.673 INFO:tasks.workunit.client.0.smithi052.stdout:7/471: readlink d6/d12/d1e/l33 0 2024-09-12T18:03:22.673 INFO:tasks.workunit.client.0.smithi052.stdout:0/489: chown d2/d6/dd/d21/d41/f79 3 1 2024-09-12T18:03:22.675 INFO:tasks.workunit.client.0.smithi052.stdout:0/490: creat d2/d6/f94 x:0 0 0 2024-09-12T18:03:22.675 INFO:tasks.workunit.client.0.smithi052.stdout:7/472: creat d6/d12/d1e/d29/fa0 x:0 0 0 2024-09-12T18:03:22.675 INFO:tasks.workunit.client.0.smithi052.stdout:0/491: readlink d2/d51/l93 0 2024-09-12T18:03:22.676 INFO:tasks.workunit.client.0.smithi052.stdout:7/473: chown d6/dc/f2f 4112985 1 2024-09-12T18:03:22.677 INFO:tasks.workunit.client.0.smithi052.stdout:8/623: dwrite d13/d18/d38/f40 [0,4194304] 0 2024-09-12T18:03:22.678 INFO:tasks.workunit.client.0.smithi052.stdout:0/492: link d2/d6/dd/d21/d41/f79 d2/d6/dd/d21/f95 0 2024-09-12T18:03:22.678 INFO:tasks.workunit.client.0.smithi052.stdout:7/474: mkdir d6/d12/d1e/d29/da1 0 2024-09-12T18:03:22.679 INFO:tasks.workunit.client.0.smithi052.stdout:0/493: chown d2/d6/dd/f17 8177 1 2024-09-12T18:03:22.679 INFO:tasks.workunit.client.0.smithi052.stdout:8/624: getdents d13/d18/d38 0 2024-09-12T18:03:22.680 INFO:tasks.workunit.client.0.smithi052.stdout:5/511: dread d7/d59/f7e [0,4194304] 0 2024-09-12T18:03:22.680 INFO:tasks.workunit.client.0.smithi052.stdout:8/625: readlink d13/d18/d21/d64/l74 0 2024-09-12T18:03:22.680 INFO:tasks.workunit.client.0.smithi052.stdout:0/494: fsync d2/d6/dd/d21/d41/d44/f4e 0 2024-09-12T18:03:22.681 INFO:tasks.workunit.client.0.smithi052.stdout:7/475: dread d6/d12/d1e/d29/d5d/d71/f68 [0,4194304] 0 2024-09-12T18:03:22.681 INFO:tasks.workunit.client.0.smithi052.stdout:5/512: link d7/d1f/d34/c69 d7/d1f/d34/ca9 0 2024-09-12T18:03:22.682 INFO:tasks.workunit.client.0.smithi052.stdout:8/626: truncate d13/d18/d21/f23 2520100 0 2024-09-12T18:03:22.682 INFO:tasks.workunit.client.0.smithi052.stdout:7/476: chown d6/dc/l4e 8109 1 2024-09-12T18:03:22.682 INFO:tasks.workunit.client.0.smithi052.stdout:0/495: write d2/d6/dd/d21/d41/d44/f4e [2011061,49266] 0 2024-09-12T18:03:22.683 INFO:tasks.workunit.client.0.smithi052.stdout:7/477: write d6/d12/d1e/d8e/f92 [798326,111443] 0 2024-09-12T18:03:22.683 INFO:tasks.workunit.client.0.smithi052.stdout:0/496: creat d2/d6/dd/d21/d26/d2f/f96 x:0 0 0 2024-09-12T18:03:22.688 INFO:tasks.workunit.client.0.smithi052.stdout:8/627: dwrite d13/d18/d21/f59 [0,4194304] 0 2024-09-12T18:03:22.690 INFO:tasks.workunit.client.0.smithi052.stdout:7/478: dwrite d6/d12/d1e/d29/d5d/f78 [4194304,4194304] 0 2024-09-12T18:03:22.691 INFO:tasks.workunit.client.0.smithi052.stdout:7/479: chown d6/dc/d1a/d6a/f72 117 1 2024-09-12T18:03:22.693 INFO:tasks.workunit.client.0.smithi052.stdout:7/480: write d6/d12/d1e/d29/d5d/d71/f68 [1833836,63557] 0 2024-09-12T18:03:22.694 INFO:tasks.workunit.client.0.smithi052.stdout:7/481: mkdir d6/d12/d1e/d29/d5d/d71/da2 0 2024-09-12T18:03:22.694 INFO:tasks.workunit.client.0.smithi052.stdout:7/482: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3 0 2024-09-12T18:03:22.700 INFO:tasks.workunit.client.0.smithi052.stdout:7/483: dwrite d6/d12/d1e/d29/d5d/f78 [8388608,4194304] 0 2024-09-12T18:03:22.703 INFO:tasks.workunit.client.0.smithi052.stdout:8/628: dread d13/d18/d21/f50 [0,4194304] 0 2024-09-12T18:03:22.704 INFO:tasks.workunit.client.0.smithi052.stdout:8/629: creat d13/d18/d38/dbf/fcf x:0 0 0 2024-09-12T18:03:22.705 INFO:tasks.workunit.client.0.smithi052.stdout:1/437: dread d3/f35 [0,4194304] 0 2024-09-12T18:03:22.705 INFO:tasks.workunit.client.0.smithi052.stdout:1/438: creat d3/d1d/d22/d27/f90 x:0 0 0 2024-09-12T18:03:22.706 INFO:tasks.workunit.client.0.smithi052.stdout:7/484: dwrite d6/d12/f47 [0,4194304] 0 2024-09-12T18:03:22.706 INFO:tasks.workunit.client.0.smithi052.stdout:1/439: chown d3/d10/d38/d44/d49/f52 15335115 1 2024-09-12T18:03:22.707 INFO:tasks.workunit.client.0.smithi052.stdout:1/440: write d3/d1d/d22/f30 [225943,23469] 0 2024-09-12T18:03:22.707 INFO:tasks.workunit.client.0.smithi052.stdout:7/485: write d6/dc/d1a/f5b [3496123,91960] 0 2024-09-12T18:03:22.708 INFO:tasks.workunit.client.0.smithi052.stdout:7/486: symlink d6/d12/d1e/la4 0 2024-09-12T18:03:22.708 INFO:tasks.workunit.client.0.smithi052.stdout:1/441: getdents d3/d1d/d83/d8f 0 2024-09-12T18:03:22.722 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:22.719+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:22.725 INFO:tasks.workunit.client.0.smithi052.stdout:3/550: rename d0/d16/c61 to d0/d4/cc1 0 2024-09-12T18:03:22.725 INFO:tasks.workunit.client.0.smithi052.stdout:0/497: rename d2/d8/l8c to d2/d6/dd/d21/d26/d2f/l97 0 2024-09-12T18:03:22.726 INFO:tasks.workunit.client.0.smithi052.stdout:4/616: sync 2024-09-12T18:03:22.726 INFO:tasks.workunit.client.0.smithi052.stdout:8/630: rename d13/d18/f51 to d13/fd0 0 2024-09-12T18:03:22.726 INFO:tasks.workunit.client.0.smithi052.stdout:1/442: rename d3/d10/f34 to d3/d1d/d22/d27/d28/d2f/d74/f91 0 2024-09-12T18:03:22.727 INFO:tasks.workunit.client.0.smithi052.stdout:4/617: creat d11/d17/d1b/d2a/d82/fda x:0 0 0 2024-09-12T18:03:22.727 INFO:tasks.workunit.client.0.smithi052.stdout:3/551: rename d0/d16/d60/f62 to d0/d4b/fc2 0 2024-09-12T18:03:22.727 INFO:tasks.workunit.client.0.smithi052.stdout:8/631: write d13/d18/d38/d7a/f96 [2411176,112851] 0 2024-09-12T18:03:22.728 INFO:tasks.workunit.client.0.smithi052.stdout:0/498: rename d2/d1b/f52 to d2/d6/dd/d21/f98 0 2024-09-12T18:03:22.729 INFO:tasks.workunit.client.0.smithi052.stdout:0/499: fsync d2/d8/f1c 0 2024-09-12T18:03:22.729 INFO:tasks.workunit.client.0.smithi052.stdout:8/632: truncate d13/d18/d5b/d70/f81 977010 0 2024-09-12T18:03:22.729 INFO:tasks.workunit.client.0.smithi052.stdout:4/618: getdents d11/d65/dd1 0 2024-09-12T18:03:22.729 INFO:tasks.workunit.client.0.smithi052.stdout:3/552: link d0/d4b/c87 d0/d4/d25/d2a/d6/d7/d34/d71/cc3 0 2024-09-12T18:03:22.730 INFO:tasks.workunit.client.0.smithi052.stdout:0/500: mknod d2/d6/dd/d21/d47/c99 0 2024-09-12T18:03:22.730 INFO:tasks.workunit.client.0.smithi052.stdout:8/633: write d13/d18/d5b/d70/f81 [889732,112931] 0 2024-09-12T18:03:22.730 INFO:tasks.workunit.client.0.smithi052.stdout:8/634: fdatasync d13/f9e 0 2024-09-12T18:03:22.732 INFO:tasks.workunit.client.0.smithi052.stdout:0/501: creat d2/d6/dd/d21/d41/d44/d48/f9a x:0 0 0 2024-09-12T18:03:22.733 INFO:tasks.workunit.client.0.smithi052.stdout:0/502: rmdir d2/d6/dd/d21/d26/d2f 39 2024-09-12T18:03:22.733 INFO:tasks.workunit.client.0.smithi052.stdout:2/521: getdents da/d71 0 2024-09-12T18:03:22.733 INFO:tasks.workunit.client.0.smithi052.stdout:9/502: write d0/d6/d3a/d42/d61/f82 [118517,118349] 0 2024-09-12T18:03:22.734 INFO:tasks.workunit.client.0.smithi052.stdout:9/503: stat d0/d58/c8f 0 2024-09-12T18:03:22.734 INFO:tasks.workunit.client.0.smithi052.stdout:2/522: mknod da/dc/d15/d22/cb1 0 2024-09-12T18:03:22.735 INFO:tasks.workunit.client.0.smithi052.stdout:9/504: unlink d0/d6/f80 0 2024-09-12T18:03:22.735 INFO:tasks.workunit.client.0.smithi052.stdout:0/503: symlink d2/d6/dd/d21/d26/d65/l9b 0 2024-09-12T18:03:22.736 INFO:tasks.workunit.client.0.smithi052.stdout:2/523: chown da/d2c/f51 12438274 1 2024-09-12T18:03:22.737 INFO:tasks.workunit.client.0.smithi052.stdout:9/505: write d0/d18/d26/d33/f9d [3369114,19937] 0 2024-09-12T18:03:22.737 INFO:tasks.workunit.client.0.smithi052.stdout:8/635: dwrite d13/d18/d5b/f76 [0,4194304] 0 2024-09-12T18:03:22.738 INFO:tasks.workunit.client.0.smithi052.stdout:0/504: write d2/d6/dd/d21/d26/d65/f7d [2964464,23650] 0 2024-09-12T18:03:22.739 INFO:tasks.workunit.client.0.smithi052.stdout:9/506: creat d0/d18/d26/d4d/fac x:0 0 0 2024-09-12T18:03:22.739 INFO:tasks.workunit.client.0.smithi052.stdout:8/636: write d13/d18/d5b/d70/f90 [4382373,99243] 0 2024-09-12T18:03:22.740 INFO:tasks.workunit.client.0.smithi052.stdout:5/513: dwrite d7/d1c/d1e/f36 [0,4194304] 0 2024-09-12T18:03:22.743 INFO:tasks.workunit.client.0.smithi052.stdout:8/637: mkdir d13/d35/d9c/dd1 0 2024-09-12T18:03:22.744 INFO:tasks.workunit.client.0.smithi052.stdout:2/524: dwrite da/d21/d6b/f8c [0,4194304] 0 2024-09-12T18:03:22.745 INFO:tasks.workunit.client.0.smithi052.stdout:2/525: unlink da/dc/l44 0 2024-09-12T18:03:22.746 INFO:tasks.workunit.client.0.smithi052.stdout:0/505: dwrite d2/d6/dd/d21/d41/d44/f4e [0,4194304] 0 2024-09-12T18:03:22.748 INFO:tasks.workunit.client.0.smithi052.stdout:2/526: rename da/dc/d15/f40 to da/dc/d15/d20/fb2 0 2024-09-12T18:03:22.750 INFO:tasks.workunit.client.0.smithi052.stdout:1/443: dread d3/d1d/d22/d27/f4f [8388608,4194304] 0 2024-09-12T18:03:22.752 INFO:tasks.workunit.client.0.smithi052.stdout:6/621: sync 2024-09-12T18:03:22.753 INFO:tasks.workunit.client.0.smithi052.stdout:0/506: dwrite d2/f29 [0,4194304] 0 2024-09-12T18:03:22.754 INFO:tasks.workunit.client.0.smithi052.stdout:0/507: symlink d2/d57/d5b/d7a/l9c 0 2024-09-12T18:03:22.756 INFO:tasks.workunit.client.0.smithi052.stdout:0/508: creat d2/d6/dd/f9d x:0 0 0 2024-09-12T18:03:22.758 INFO:tasks.workunit.client.0.smithi052.stdout:6/622: dread d2/d21/f95 [0,4194304] 0 2024-09-12T18:03:22.758 INFO:tasks.workunit.client.0.smithi052.stdout:0/509: link d2/d8/f8e d2/d6/dd/d21/d47/f9e 0 2024-09-12T18:03:22.759 INFO:tasks.workunit.client.0.smithi052.stdout:8/638: read d13/d18/d38/dbf/fc4 [3138027,98015] 0 2024-09-12T18:03:22.759 INFO:tasks.workunit.client.0.smithi052.stdout:4/619: truncate d11/d17/fa4 2615053 0 2024-09-12T18:03:22.760 INFO:tasks.workunit.client.0.smithi052.stdout:3/553: truncate d0/d4b/d57/f7d 3300538 0 2024-09-12T18:03:22.760 INFO:tasks.workunit.client.0.smithi052.stdout:1/444: dwrite d3/d10/f53 [0,4194304] 0 2024-09-12T18:03:22.760 INFO:tasks.workunit.client.0.smithi052.stdout:8/639: creat d13/d18/fd2 x:0 0 0 2024-09-12T18:03:22.761 INFO:tasks.workunit.client.0.smithi052.stdout:8/640: chown d13/d3c/c57 20 1 2024-09-12T18:03:22.761 INFO:tasks.workunit.client.0.smithi052.stdout:4/620: rmdir d11/d65/d6c 39 2024-09-12T18:03:22.762 INFO:tasks.workunit.client.0.smithi052.stdout:4/621: fsync d11/f1f 0 2024-09-12T18:03:22.762 INFO:tasks.workunit.client.0.smithi052.stdout:8/641: write d13/d18/d38/f91 [3521079,119312] 0 2024-09-12T18:03:22.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/445: stat d3/c64 0 2024-09-12T18:03:22.763 INFO:tasks.workunit.client.0.smithi052.stdout:8/642: write d13/d18/d38/f91 [3511531,36817] 0 2024-09-12T18:03:22.764 INFO:tasks.workunit.client.0.smithi052.stdout:4/622: mkdir d11/d17/d1b/d2a/d6a/d7f/ddb 0 2024-09-12T18:03:22.764 INFO:tasks.workunit.client.0.smithi052.stdout:8/643: truncate d13/fc8 2827219 0 2024-09-12T18:03:22.764 INFO:tasks.workunit.client.0.smithi052.stdout:1/446: mkdir d3/d1d/d22/d27/d92 0 2024-09-12T18:03:22.764 INFO:tasks.workunit.client.0.smithi052.stdout:4/623: fdatasync d11/d17/d1b/fd0 0 2024-09-12T18:03:22.764 INFO:tasks.workunit.client.0.smithi052.stdout:8/644: rmdir d13/d35/d9c/dd1 0 2024-09-12T18:03:22.766 INFO:tasks.workunit.client.0.smithi052.stdout:4/624: mkdir d11/d17/d1b/d2a/d6a/d7f/ddb/ddc 0 2024-09-12T18:03:22.768 INFO:tasks.workunit.client.0.smithi052.stdout:4/625: write d11/d65/dc6/f87 [2787945,30254] 0 2024-09-12T18:03:22.770 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:22.770 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:22.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/514: dread d7/d1c/d1e/f44 [0,4194304] 0 2024-09-12T18:03:22.770 INFO:tasks.workunit.client.0.smithi052.stdout:4/626: read - d11/d46/d51/f55 zero size 2024-09-12T18:03:22.772 INFO:tasks.workunit.client.0.smithi052.stdout:1/447: dwrite d3/d1d/d22/d27/f90 [0,4194304] 0 2024-09-12T18:03:22.773 INFO:tasks.workunit.client.0.smithi052.stdout:8/645: dwrite d13/f4e [0,4194304] 0 2024-09-12T18:03:22.775 INFO:tasks.workunit.client.0.smithi052.stdout:8/646: unlink d13/d35/c60 0 2024-09-12T18:03:22.777 INFO:tasks.workunit.client.0.smithi052.stdout:5/515: read d7/d51/f9a [1054879,10196] 0 2024-09-12T18:03:22.778 INFO:tasks.workunit.client.0.smithi052.stdout:8/647: mkdir d13/d18/d38/dd3 0 2024-09-12T18:03:22.779 INFO:tasks.workunit.client.0.smithi052.stdout:8/648: write d13/f1f [955585,44821] 0 2024-09-12T18:03:22.780 INFO:tasks.workunit.client.0.smithi052.stdout:9/507: dread d0/d18/f9a [0,4194304] 0 2024-09-12T18:03:22.780 INFO:tasks.workunit.client.0.smithi052.stdout:5/516: mknod d7/d51/caa 0 2024-09-12T18:03:22.780 INFO:tasks.workunit.client.0.smithi052.stdout:4/627: dwrite d11/d65/dc6/d95/dbf/d8e/fc1 [0,4194304] 0 2024-09-12T18:03:22.780 INFO:tasks.workunit.client.0.smithi052.stdout:8/649: mknod d13/d3c/cd4 0 2024-09-12T18:03:22.780 INFO:tasks.workunit.client.0.smithi052.stdout:5/517: write d7/d1f/d45/f50 [3988986,44149] 0 2024-09-12T18:03:22.781 INFO:tasks.workunit.client.0.smithi052.stdout:4/628: read - d11/d65/dc6/d95/f9e zero size 2024-09-12T18:03:22.781 INFO:tasks.workunit.client.0.smithi052.stdout:8/650: mknod d13/d18/d21/dc1/cd5 0 2024-09-12T18:03:22.782 INFO:tasks.workunit.client.0.smithi052.stdout:5/518: mknod d7/d51/d8b/da3/cab 0 2024-09-12T18:03:22.782 INFO:tasks.workunit.client.0.smithi052.stdout:4/629: creat d11/d17/fdd x:0 0 0 2024-09-12T18:03:22.783 INFO:tasks.workunit.client.0.smithi052.stdout:4/630: write d11/d17/d1b/fd8 [857726,29378] 0 2024-09-12T18:03:22.784 INFO:tasks.workunit.client.0.smithi052.stdout:4/631: creat d11/d65/dc6/d95/fde x:0 0 0 2024-09-12T18:03:22.785 INFO:tasks.workunit.client.0.smithi052.stdout:7/487: sync 2024-09-12T18:03:22.785 INFO:tasks.workunit.client.0.smithi052.stdout:9/508: sync 2024-09-12T18:03:22.785 INFO:tasks.workunit.client.0.smithi052.stdout:7/488: fsync d6/f3c 0 2024-09-12T18:03:22.785 INFO:tasks.workunit.client.0.smithi052.stdout:9/509: chown d0/d18/d37/d9e 0 1 2024-09-12T18:03:22.786 INFO:tasks.workunit.client.0.smithi052.stdout:9/510: stat d0/d18/d37/d87/l70 0 2024-09-12T18:03:22.786 INFO:tasks.workunit.client.0.smithi052.stdout:9/511: creat d0/d18/d37/d87/fad x:0 0 0 2024-09-12T18:03:22.787 INFO:tasks.workunit.client.0.smithi052.stdout:9/512: unlink d0/d6/d3a/l5e 0 2024-09-12T18:03:22.789 INFO:tasks.workunit.client.0.smithi052.stdout:7/489: dread d6/f5a [0,4194304] 0 2024-09-12T18:03:22.790 INFO:tasks.workunit.client.0.smithi052.stdout:7/490: chown d6/d12/f47 0 1 2024-09-12T18:03:22.790 INFO:tasks.workunit.client.0.smithi052.stdout:7/491: chown d6/dc/f30 13468040 1 2024-09-12T18:03:22.791 INFO:tasks.workunit.client.0.smithi052.stdout:6/623: dread d2/d21/f4c [0,4194304] 0 2024-09-12T18:03:22.792 INFO:tasks.workunit.client.0.smithi052.stdout:8/651: truncate f7 2984732 0 2024-09-12T18:03:22.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:22.793 INFO:tasks.workunit.client.0.smithi052.stdout:5/519: truncate d7/d59/f7e 3942137 0 2024-09-12T18:03:22.794 INFO:tasks.workunit.client.0.smithi052.stdout:7/492: dread - d6/d12/d1e/d29/f67 zero size 2024-09-12T18:03:22.794 INFO:tasks.workunit.client.0.smithi052.stdout:0/510: sync 2024-09-12T18:03:22.794 INFO:tasks.workunit.client.0.smithi052.stdout:2/527: dread da/dc/d15/d20/f64 [0,4194304] 0 2024-09-12T18:03:22.795 INFO:tasks.workunit.client.0.smithi052.stdout:5/520: creat d7/d1f/d34/fac x:0 0 0 2024-09-12T18:03:22.796 INFO:tasks.workunit.client.0.smithi052.stdout:2/528: sync 2024-09-12T18:03:22.796 INFO:tasks.workunit.client.0.smithi052.stdout:9/513: dwrite d0/d18/d26/d4d/fac [0,4194304] 0 2024-09-12T18:03:22.796 INFO:tasks.workunit.client.0.smithi052.stdout:0/511: chown d2/d1b/l62 370706215 1 2024-09-12T18:03:22.797 INFO:tasks.workunit.client.0.smithi052.stdout:1/448: dread d3/d1d/d22/d3f/f5f [0,4194304] 0 2024-09-12T18:03:22.797 INFO:tasks.workunit.client.0.smithi052.stdout:9/514: fsync d0/d18/f36 0 2024-09-12T18:03:22.798 INFO:tasks.workunit.client.0.smithi052.stdout:3/554: dread d0/d4/d25/d2a/d6/d7/f2b [0,4194304] 0 2024-09-12T18:03:22.798 INFO:tasks.workunit.client.0.smithi052.stdout:5/521: write d7/d1c/f33 [855498,53037] 0 2024-09-12T18:03:22.799 INFO:tasks.workunit.client.0.smithi052.stdout:9/515: readlink d0/d18/d37/d87/l70 0 2024-09-12T18:03:22.801 INFO:tasks.workunit.client.0.smithi052.stdout:3/555: mknod d0/d4/d33/cc4 0 2024-09-12T18:03:22.801 INFO:tasks.workunit.client.0.smithi052.stdout:7/493: rename d6/dc/c94 to d6/d12/d1e/d29/d5d/d71/ca5 0 2024-09-12T18:03:22.802 INFO:tasks.workunit.client.0.smithi052.stdout:8/652: chown d13/d35/c92 115088108 1 2024-09-12T18:03:22.802 INFO:tasks.workunit.client.0.smithi052.stdout:1/449: mknod d3/d1d/d83/d8f/c93 0 2024-09-12T18:03:22.802 INFO:tasks.workunit.client.0.smithi052.stdout:9/516: chown d0/d58/d7f 231786577 1 2024-09-12T18:03:22.802 INFO:tasks.workunit.client.0.smithi052.stdout:1/450: fsync d3/f8 0 2024-09-12T18:03:22.803 INFO:tasks.workunit.client.0.smithi052.stdout:5/522: chown d7/d1f/d3a/d49/d54/d6b/l90 555 1 2024-09-12T18:03:22.803 INFO:tasks.workunit.client.0.smithi052.stdout:3/556: rmdir d0/d4b/d57 39 2024-09-12T18:03:22.803 INFO:tasks.workunit.client.0.smithi052.stdout:6/624: dwrite d2/d21/d76/f7f [0,4194304] 0 2024-09-12T18:03:22.804 INFO:tasks.workunit.client.0.smithi052.stdout:5/523: rmdir d7/d59 39 2024-09-12T18:03:22.804 INFO:tasks.workunit.client.0.smithi052.stdout:9/517: creat d0/d18/fae x:0 0 0 2024-09-12T18:03:22.805 INFO:tasks.workunit.client.0.smithi052.stdout:6/625: readlink d2/d21/l38 0 2024-09-12T18:03:22.806 INFO:tasks.workunit.client.0.smithi052.stdout:2/529: dwrite da/dc/f5e [0,4194304] 0 2024-09-12T18:03:22.807 INFO:tasks.workunit.client.0.smithi052.stdout:5/524: rmdir d7/d51/d8b/da3 39 2024-09-12T18:03:22.807 INFO:tasks.workunit.client.0.smithi052.stdout:1/451: creat d3/d1d/d22/d27/d28/d2f/d74/d7f/f94 x:0 0 0 2024-09-12T18:03:22.808 INFO:tasks.workunit.client.0.smithi052.stdout:4/632: dread d11/d65/dd1/f2b [0,4194304] 0 2024-09-12T18:03:22.808 INFO:tasks.workunit.client.0.smithi052.stdout:7/494: rename d6/d12/d1e/d29/d5d/d71/d3a/f84 to d6/d12/d1e/d29/fa6 0 2024-09-12T18:03:22.808 INFO:tasks.workunit.client.0.smithi052.stdout:3/557: getdents d0/d4b/d57 0 2024-09-12T18:03:22.808 INFO:tasks.workunit.client.0.smithi052.stdout:6/626: mknod d2/d3f/d58/d5d/d9c/cd2 0 2024-09-12T18:03:22.808 INFO:tasks.workunit.client.0.smithi052.stdout:2/530: chown da/dc/d15/d22/l48 12369 1 2024-09-12T18:03:22.809 INFO:tasks.workunit.client.0.smithi052.stdout:9/518: getdents d0/d18/d37/d87 0 2024-09-12T18:03:22.809 INFO:tasks.workunit.client.0.smithi052.stdout:5/525: mkdir d7/d59/dad 0 2024-09-12T18:03:22.810 INFO:tasks.workunit.client.0.smithi052.stdout:2/531: write da/dc/f2e [2229296,44864] 0 2024-09-12T18:03:22.810 INFO:tasks.workunit.client.0.smithi052.stdout:8/653: read d13/f1b [11423209,95911] 0 2024-09-12T18:03:22.811 INFO:tasks.workunit.client.0.smithi052.stdout:9/519: read - d0/d6/d3a/d42/d61/fab zero size 2024-09-12T18:03:22.811 INFO:tasks.workunit.client.0.smithi052.stdout:0/512: dwrite d2/d1b/f2e [0,4194304] 0 2024-09-12T18:03:22.813 INFO:tasks.workunit.client.0.smithi052.stdout:7/495: rename d6/dc/d1a/f5b to d6/d9b/fa7 0 2024-09-12T18:03:22.813 INFO:tasks.workunit.client.0.smithi052.stdout:1/452: write d3/d1d/d22/f59 [88322,23602] 0 2024-09-12T18:03:22.814 INFO:tasks.workunit.client.0.smithi052.stdout:8/654: creat d13/d18/d38/fd6 x:0 0 0 2024-09-12T18:03:22.814 INFO:tasks.workunit.client.0.smithi052.stdout:9/520: mknod d0/d58/caf 0 2024-09-12T18:03:22.815 INFO:tasks.workunit.client.0.smithi052.stdout:0/513: symlink d2/d1b/d72/d8d/l9f 0 2024-09-12T18:03:22.815 INFO:tasks.workunit.client.0.smithi052.stdout:3/558: creat d0/d4/dbb/fc5 x:0 0 0 2024-09-12T18:03:22.816 INFO:tasks.workunit.client.0.smithi052.stdout:5/526: write d7/d1c/f95 [4846240,58047] 0 2024-09-12T18:03:22.818 INFO:tasks.workunit.client.0.smithi052.stdout:0/514: creat d2/d1b/fa0 x:0 0 0 2024-09-12T18:03:22.818 INFO:tasks.workunit.client.0.smithi052.stdout:4/633: dwrite d11/d65/f71 [0,4194304] 0 2024-09-12T18:03:22.818 INFO:tasks.workunit.client.0.smithi052.stdout:0/515: sync 2024-09-12T18:03:22.818 INFO:tasks.workunit.client.0.smithi052.stdout:5/527: chown d7/l9f 0 1 2024-09-12T18:03:22.819 INFO:tasks.workunit.client.0.smithi052.stdout:9/521: chown d0/d6/d3a/f97 1980680 1 2024-09-12T18:03:22.820 INFO:tasks.workunit.client.0.smithi052.stdout:7/496: getdents d6/d12/d1e/d29/d5d 0 2024-09-12T18:03:22.820 INFO:tasks.workunit.client.0.smithi052.stdout:5/528: write d7/d1c/f33 [1409317,24435] 0 2024-09-12T18:03:22.821 INFO:tasks.workunit.client.0.smithi052.stdout:2/532: dwrite da/d1d/d35/f31 [0,4194304] 0 2024-09-12T18:03:22.822 INFO:tasks.workunit.client.0.smithi052.stdout:4/634: mknod d11/d65/dc6/daf/cdf 0 2024-09-12T18:03:22.822 INFO:tasks.workunit.client.0.smithi052.stdout:6/627: dwrite d2/dc6/f1f [0,4194304] 0 2024-09-12T18:03:22.822 INFO:tasks.workunit.client.0.smithi052.stdout:0/516: creat d2/d6/dd/d21/d26/d2f/fa1 x:0 0 0 2024-09-12T18:03:22.824 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:22.819+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:22.824 INFO:tasks.workunit.client.0.smithi052.stdout:8/655: write d13/f17 [1010331,22791] 0 2024-09-12T18:03:22.824 INFO:tasks.workunit.client.0.smithi052.stdout:9/522: write d0/d6/d3a/d43/f4b [399545,82377] 0 2024-09-12T18:03:22.829 INFO:tasks.workunit.client.0.smithi052.stdout:7/497: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8 0 2024-09-12T18:03:22.829 INFO:tasks.workunit.client.0.smithi052.stdout:2/533: mkdir da/d1d/d7d/db3 0 2024-09-12T18:03:22.829 INFO:tasks.workunit.client.0.smithi052.stdout:1/453: dwrite d3/f8 [0,4194304] 0 2024-09-12T18:03:22.829 INFO:tasks.workunit.client.0.smithi052.stdout:8/656: creat d13/d18/d5b/fd7 x:0 0 0 2024-09-12T18:03:22.829 INFO:tasks.workunit.client.0.smithi052.stdout:9/523: write d0/d18/d37/f4c [1482555,37263] 0 2024-09-12T18:03:22.829 INFO:tasks.workunit.client.0.smithi052.stdout:3/559: dwrite d0/d4b/d4c/d6b/d48/fb9 [0,4194304] 0 2024-09-12T18:03:22.829 INFO:tasks.workunit.client.0.smithi052.stdout:1/454: chown d3/d1d/d22/d3f/l58 0 1 2024-09-12T18:03:22.829 INFO:tasks.workunit.client.0.smithi052.stdout:2/534: write da/dc/d15/d22/d87/f90 [303187,23825] 0 2024-09-12T18:03:22.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/498: getdents d6/d12/d1e/d29/da1 0 2024-09-12T18:03:22.831 INFO:tasks.workunit.client.0.smithi052.stdout:9/524: readlink d0/d18/d26/d4d/d54/la8 0 2024-09-12T18:03:22.831 INFO:tasks.workunit.client.0.smithi052.stdout:9/525: sync 2024-09-12T18:03:22.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/560: creat d0/d4b/d4c/d6b/d48/fc6 x:0 0 0 2024-09-12T18:03:22.832 INFO:tasks.workunit.client.0.smithi052.stdout:1/455: write d3/d10/d38/f4a [1996629,35856] 0 2024-09-12T18:03:22.832 INFO:tasks.workunit.client.0.smithi052.stdout:2/535: chown da/dc/d15/d22/f66 102194 1 2024-09-12T18:03:22.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/628: truncate d2/d3f/d58/d5d/d9c/d26/f28 304773 0 2024-09-12T18:03:22.832 INFO:tasks.workunit.client.0.smithi052.stdout:8/657: chown d13/d35/lcd 116209 1 2024-09-12T18:03:22.834 INFO:tasks.workunit.client.0.smithi052.stdout:7/499: creat d6/d12/d1e/d8e/fa9 x:0 0 0 2024-09-12T18:03:22.834 INFO:tasks.workunit.client.0.smithi052.stdout:9/526: truncate d0/d6/d3a/f5d 471548 0 2024-09-12T18:03:22.834 INFO:tasks.workunit.client.0.smithi052.stdout:2/536: symlink da/d1d/d7d/db3/lb4 0 2024-09-12T18:03:22.834 INFO:tasks.workunit.client.0.smithi052.stdout:8/658: creat d13/d9b/fd8 x:0 0 0 2024-09-12T18:03:22.835 INFO:tasks.workunit.client.0.smithi052.stdout:3/561: truncate d0/d4b/d57/d6d/f7b 517943 0 2024-09-12T18:03:22.836 INFO:tasks.workunit.client.0.smithi052.stdout:9/527: chown d0/d1c/f20 279 1 2024-09-12T18:03:22.836 INFO:tasks.workunit.client.0.smithi052.stdout:2/537: fdatasync da/dc/d15/f1f 0 2024-09-12T18:03:22.837 INFO:tasks.workunit.client.0.smithi052.stdout:8/659: creat d13/d35/d9c/da3/fd9 x:0 0 0 2024-09-12T18:03:22.837 INFO:tasks.workunit.client.0.smithi052.stdout:0/517: dwrite d2/f31 [0,4194304] 0 2024-09-12T18:03:22.838 INFO:tasks.workunit.client.0.smithi052.stdout:7/500: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/faa x:0 0 0 2024-09-12T18:03:22.838 INFO:tasks.workunit.client.0.smithi052.stdout:9/528: creat d0/d6/d3a/d42/d93/fb0 x:0 0 0 2024-09-12T18:03:22.838 INFO:tasks.workunit.client.0.smithi052.stdout:0/518: sync 2024-09-12T18:03:22.838 INFO:tasks.workunit.client.0.smithi052.stdout:8/660: chown d13/d9b/fd8 1020478 1 2024-09-12T18:03:22.839 INFO:tasks.workunit.client.0.smithi052.stdout:9/529: mknod d0/d6/d3a/d42/d61/cb1 0 2024-09-12T18:03:22.840 INFO:tasks.workunit.client.0.smithi052.stdout:0/519: write d2/d6/dd/d21/d47/f58 [223339,100019] 0 2024-09-12T18:03:22.841 INFO:tasks.workunit.client.0.smithi052.stdout:1/456: dwrite d3/d1d/f2c [4194304,4194304] 0 2024-09-12T18:03:22.841 INFO:tasks.workunit.client.0.smithi052.stdout:9/530: unlink d0/d6/d3a/d42/d93/d96/f6f 0 2024-09-12T18:03:22.842 INFO:tasks.workunit.client.0.smithi052.stdout:0/520: dread - d2/d1b/d72/f5c zero size 2024-09-12T18:03:22.842 INFO:tasks.workunit.client.0.smithi052.stdout:0/521: chown d2/d1b/f2e 468 1 2024-09-12T18:03:22.844 INFO:tasks.workunit.client.0.smithi052.stdout:4/635: truncate d11/d17/d1b/d2a/f61 1517352 0 2024-09-12T18:03:22.844 INFO:tasks.workunit.client.0.smithi052.stdout:3/562: rename d0/d4/d25/d2a/d6/d7/d34/d72/d83/d91 to d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7 0 2024-09-12T18:03:22.846 INFO:tasks.workunit.client.0.smithi052.stdout:0/522: mknod d2/ca2 0 2024-09-12T18:03:22.847 INFO:tasks.workunit.client.0.smithi052.stdout:9/531: rename d0/d18/d26/d4d/d54/c67 to d0/d6/d3a/d43/d74/cb2 0 2024-09-12T18:03:22.847 INFO:tasks.workunit.client.0.smithi052.stdout:4/636: creat d11/d17/d1b/d2a/d6a/d7f/d90/fe0 x:0 0 0 2024-09-12T18:03:22.848 INFO:tasks.workunit.client.0.smithi052.stdout:4/637: stat d11/f1f 0 2024-09-12T18:03:22.848 INFO:tasks.workunit.client.0.smithi052.stdout:7/501: dwrite d6/dc/d1a/d6a/f72 [0,4194304] 0 2024-09-12T18:03:22.850 INFO:tasks.workunit.client.0.smithi052.stdout:8/661: dwrite d13/d35/d9c/f99 [0,4194304] 0 2024-09-12T18:03:22.850 INFO:tasks.workunit.client.0.smithi052.stdout:8/662: sync 2024-09-12T18:03:22.851 INFO:tasks.workunit.client.0.smithi052.stdout:7/502: write d6/d12/d1e/d8e/fa9 [577279,49259] 0 2024-09-12T18:03:22.851 INFO:tasks.workunit.client.0.smithi052.stdout:6/629: dread d2/d3f/d58/d5d/d9c/d26/f36 [0,4194304] 0 2024-09-12T18:03:22.853 INFO:tasks.workunit.client.0.smithi052.stdout:8/663: read - d13/d3c/fc3 zero size 2024-09-12T18:03:22.854 INFO:tasks.workunit.client.0.smithi052.stdout:7/503: link d6/dc/f8c d6/dc/fab 0 2024-09-12T18:03:22.855 INFO:tasks.workunit.client.0.smithi052.stdout:7/504: chown d6/fd 13381164 1 2024-09-12T18:03:22.855 INFO:tasks.workunit.client.0.smithi052.stdout:3/563: dread d0/d4b/d4c/d6b/d48/f56 [0,4194304] 0 2024-09-12T18:03:22.855 INFO:tasks.workunit.client.0.smithi052.stdout:8/664: creat d13/d18/d5b/d70/fda x:0 0 0 2024-09-12T18:03:22.856 INFO:tasks.workunit.client.0.smithi052.stdout:9/532: dwrite d0/d18/f40 [0,4194304] 0 2024-09-12T18:03:22.857 INFO:tasks.workunit.client.0.smithi052.stdout:1/457: write d3/d1d/d22/f57 [1109572,120048] 0 2024-09-12T18:03:22.857 INFO:tasks.workunit.client.0.smithi052.stdout:7/505: read - d6/d12/d1e/d29/f67 zero size 2024-09-12T18:03:22.858 INFO:tasks.workunit.client.0.smithi052.stdout:0/523: dwrite d2/d6/dd/d21/d26/d38/f3f [0,4194304] 0 2024-09-12T18:03:22.859 INFO:tasks.workunit.client.0.smithi052.stdout:9/533: unlink d0/d6/d3a/d42/ca5 0 2024-09-12T18:03:22.859 INFO:tasks.workunit.client.0.smithi052.stdout:3/564: symlink d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/lc8 0 2024-09-12T18:03:22.859 INFO:tasks.workunit.client.0.smithi052.stdout:7/506: mkdir d6/d12/d17/dac 0 2024-09-12T18:03:22.860 INFO:tasks.workunit.client.0.smithi052.stdout:1/458: write d3/d1d/d22/d27/f90 [4574635,56706] 0 2024-09-12T18:03:22.861 INFO:tasks.workunit.client.0.smithi052.stdout:8/665: link d13/d18/l2b d13/d18/d38/ldb 0 2024-09-12T18:03:22.861 INFO:tasks.workunit.client.0.smithi052.stdout:0/524: chown d2/d6/dd/f9d 2 1 2024-09-12T18:03:22.862 INFO:tasks.workunit.client.0.smithi052.stdout:4/638: dwrite d11/d17/d1b/d2a/d82/fcc [0,4194304] 0 2024-09-12T18:03:22.862 INFO:tasks.workunit.client.0.smithi052.stdout:0/525: chown d2/d6/f10 336 1 2024-09-12T18:03:22.865 INFO:tasks.workunit.client.0.smithi052.stdout:1/459: write d3/d10/d38/f4a [2359249,72584] 0 2024-09-12T18:03:22.865 INFO:tasks.workunit.client.0.smithi052.stdout:4/639: symlink d11/d65/dc6/daf/le1 0 2024-09-12T18:03:22.866 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:03:22.866 INFO:tasks.workunit.client.0.smithi052.stdout:3/565: symlink d0/d4/d25/d2a/d6/d7/d34/lc9 0 2024-09-12T18:03:22.867 INFO:tasks.workunit.client.0.smithi052.stdout:5/529: dread d7/fc [0,4194304] 0 2024-09-12T18:03:22.867 INFO:tasks.workunit.client.0.smithi052.stdout:4/640: mknod d11/d17/d1b/d2a/d6a/d7f/ddb/ce2 0 2024-09-12T18:03:22.868 INFO:tasks.workunit.client.0.smithi052.stdout:3/566: dread - d0/d4/d25/d2a/d6/d7/d34/d72/f93 zero size 2024-09-12T18:03:22.869 INFO:tasks.workunit.client.0.smithi052.stdout:4/641: chown d11/d17/d1b/d2a/d32/c86 27455373 1 2024-09-12T18:03:22.870 INFO:tasks.workunit.client.0.smithi052.stdout:4/642: chown d11/d46/f57 41771 1 2024-09-12T18:03:22.871 INFO:tasks.workunit.client.0.smithi052.stdout:2/538: dread f0 [0,4194304] 0 2024-09-12T18:03:22.871 INFO:tasks.workunit.client.0.smithi052.stdout:9/534: read d0/d18/d37/f4c [2779933,3108] 0 2024-09-12T18:03:22.871 INFO:tasks.workunit.client.0.smithi052.stdout:3/567: creat d0/d16/d60/fca x:0 0 0 2024-09-12T18:03:22.874 INFO:tasks.workunit.client.0.smithi052.stdout:3/568: creat d0/fcb x:0 0 0 2024-09-12T18:03:22.874 INFO:tasks.workunit.client.0.smithi052.stdout:9/535: read d0/d58/f83 [170847,43074] 0 2024-09-12T18:03:22.876 INFO:tasks.workunit.client.0.smithi052.stdout:4/643: symlink d11/d65/dc6/d95/dbf/d8e/le3 0 2024-09-12T18:03:22.878 INFO:tasks.workunit.client.0.smithi052.stdout:4/644: chown d11/d70/dbd/f94 53 1 2024-09-12T18:03:22.878 INFO:tasks.workunit.client.0.smithi052.stdout:7/507: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d83/f7c [0,4194304] 0 2024-09-12T18:03:22.878 INFO:tasks.workunit.client.0.smithi052.stdout:2/539: dread da/dc/d15/d22/d87/f90 [0,4194304] 0 2024-09-12T18:03:22.879 INFO:tasks.workunit.client.0.smithi052.stdout:3/569: mkdir d0/d4/d25/d2a/d6/dcc 0 2024-09-12T18:03:22.879 INFO:tasks.workunit.client.0.smithi052.stdout:5/530: dwrite f4 [0,4194304] 0 2024-09-12T18:03:22.880 INFO:tasks.workunit.client.0.smithi052.stdout:6/630: dwrite d2/d3f/d54/f69 [0,4194304] 0 2024-09-12T18:03:22.881 INFO:tasks.workunit.client.0.smithi052.stdout:4/645: read - d11/d17/d1b/d2a/d6a/d7f/d90/fe0 zero size 2024-09-12T18:03:22.881 INFO:tasks.workunit.client.0.smithi052.stdout:5/531: write d7/d1f/f8c [449978,75550] 0 2024-09-12T18:03:22.881 INFO:tasks.workunit.client.0.smithi052.stdout:4/646: stat d11/d65/dd1/c1d 0 2024-09-12T18:03:22.882 INFO:tasks.workunit.client.0.smithi052.stdout:9/536: mknod d0/d6/d3a/d43/cb3 0 2024-09-12T18:03:22.882 INFO:tasks.workunit.client.0.smithi052.stdout:2/540: creat da/dc/d76/fb5 x:0 0 0 2024-09-12T18:03:22.882 INFO:tasks.workunit.client.0.smithi052.stdout:9/537: mknod d0/d18/d26/cb4 0 2024-09-12T18:03:22.883 INFO:tasks.workunit.client.0.smithi052.stdout:2/541: creat da/dc/d76/fb6 x:0 0 0 2024-09-12T18:03:22.883 INFO:tasks.workunit.client.0.smithi052.stdout:5/532: symlink d7/d51/d8b/da3/lae 0 2024-09-12T18:03:22.883 INFO:tasks.workunit.client.0.smithi052.stdout:4/647: mknod d11/d65/dc6/d95/dbf/d8e/ce4 0 2024-09-12T18:03:22.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/508: link d6/d12/d1e/d29/d5d/d71/d3a/d8f/c63 d6/d12/d1e/d29/cad 0 2024-09-12T18:03:22.884 INFO:tasks.workunit.client.0.smithi052.stdout:2/542: write da/dc/d15/f1f [515840,88751] 0 2024-09-12T18:03:22.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/538: getdents d0/d6/d94 0 2024-09-12T18:03:22.885 INFO:tasks.workunit.client.0.smithi052.stdout:5/533: mkdir d7/d51/d8b/daf 0 2024-09-12T18:03:22.885 INFO:tasks.workunit.client.0.smithi052.stdout:7/509: readlink d6/d12/d1e/d29/d5d/l5e 0 2024-09-12T18:03:22.885 INFO:tasks.workunit.client.0.smithi052.stdout:4/648: mknod d11/d65/dc6/d95/dbf/d8e/ce5 0 2024-09-12T18:03:22.886 INFO:tasks.workunit.client.0.smithi052.stdout:9/539: stat d0/d18/d26/d4d/f8a 0 2024-09-12T18:03:22.887 INFO:tasks.workunit.client.0.smithi052.stdout:6/631: truncate d2/dc6/f45 1411115 0 2024-09-12T18:03:22.888 INFO:tasks.workunit.client.0.smithi052.stdout:9/540: creat d0/fb5 x:0 0 0 2024-09-12T18:03:22.888 INFO:tasks.workunit.client.0.smithi052.stdout:4/649: getdents d11/d65/dc6/d95 0 2024-09-12T18:03:22.889 INFO:tasks.workunit.client.0.smithi052.stdout:6/632: unlink d2/fa 0 2024-09-12T18:03:22.891 INFO:tasks.workunit.client.0.smithi052.stdout:2/543: dread da/dc/d15/f79 [0,4194304] 0 2024-09-12T18:03:22.892 INFO:tasks.workunit.client.0.smithi052.stdout:4/650: symlink d11/d17/d1b/d2a/d6a/d7f/dd6/le6 0 2024-09-12T18:03:22.893 INFO:tasks.workunit.client.0.smithi052.stdout:7/510: dwrite d6/dc/f34 [0,4194304] 0 2024-09-12T18:03:22.893 INFO:tasks.workunit.client.0.smithi052.stdout:5/534: dwrite d7/d59/d5c/f99 [0,4194304] 0 2024-09-12T18:03:22.893 INFO:tasks.workunit.client.0.smithi052.stdout:4/651: dread - d11/d65/dd1/d72/fd3 zero size 2024-09-12T18:03:22.894 INFO:tasks.workunit.client.0.smithi052.stdout:4/652: chown d11/d17/d1b/d2a/f7d 493272 1 2024-09-12T18:03:22.895 INFO:tasks.workunit.client.0.smithi052.stdout:7/511: mkdir d6/d12/d1e/dae 0 2024-09-12T18:03:22.895 INFO:tasks.workunit.client.0.smithi052.stdout:5/535: rmdir d7/d1c/d1e 39 2024-09-12T18:03:22.897 INFO:tasks.workunit.client.0.smithi052.stdout:9/541: dwrite d0/d18/d26/d4d/d54/f5b [0,4194304] 0 2024-09-12T18:03:22.897 INFO:tasks.workunit.client.0.smithi052.stdout:4/653: link d11/d70/dbd/f94 d11/d17/d1b/d2a/d32/fe7 0 2024-09-12T18:03:22.898 INFO:tasks.workunit.client.0.smithi052.stdout:5/536: dread d7/d1c/f61 [0,4194304] 0 2024-09-12T18:03:22.898 INFO:tasks.workunit.client.0.smithi052.stdout:9/542: chown d0/d1c/f51 325907247 1 2024-09-12T18:03:22.899 INFO:tasks.workunit.client.0.smithi052.stdout:5/537: stat d7/d1f/d45/l4a 0 2024-09-12T18:03:22.900 INFO:tasks.workunit.client.0.smithi052.stdout:4/654: creat d11/d65/dc6/d95/fe8 x:0 0 0 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi052.stdout:5/538: write d7/f21 [733511,40218] 0 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi052.stdout:2/544: truncate da/d1d/d7d/fa7 7644878 0 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi052.stdout:4/655: write d11/f1f [2574851,125136] 0 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi052.stdout:7/512: dread d6/d12/d1e/d29/d5d/d71/d3a/d83/f7c [0,4194304] 0 2024-09-12T18:03:22.903 INFO:tasks.workunit.client.0.smithi052.stdout:5/539: write d7/d51/f9a [226057,120049] 0 2024-09-12T18:03:22.903 INFO:tasks.workunit.client.0.smithi052.stdout:7/513: rmdir d6/d12/d1e/d29/d5d/d71 39 2024-09-12T18:03:22.903 INFO:tasks.workunit.client.0.smithi052.stdout:2/545: link da/dc/d15/d20/c49 da/d1d/d35/cb7 0 2024-09-12T18:03:22.904 INFO:tasks.workunit.client.0.smithi052.stdout:4/656: link d11/d17/d1b/d2a/dbe/c9b d11/d65/dd1/d72/ce9 0 2024-09-12T18:03:22.904 INFO:tasks.workunit.client.0.smithi052.stdout:2/546: fdatasync da/dc/f2b 0 2024-09-12T18:03:22.905 INFO:tasks.workunit.client.0.smithi052.stdout:7/514: mkdir d6/d12/d1e/d29/daf 0 2024-09-12T18:03:22.905 INFO:tasks.workunit.client.0.smithi052.stdout:4/657: mknod d11/d65/dd1/d3b/d3f/cea 0 2024-09-12T18:03:22.906 INFO:tasks.workunit.client.0.smithi052.stdout:2/547: creat da/dc/d15/d43/fb8 x:0 0 0 2024-09-12T18:03:22.907 INFO:tasks.workunit.client.0.smithi052.stdout:9/543: dwrite d0/d6/fd [0,4194304] 0 2024-09-12T18:03:22.907 INFO:tasks.workunit.client.0.smithi052.stdout:2/548: fsync da/d1d/d7d/fa4 0 2024-09-12T18:03:22.908 INFO:tasks.workunit.client.0.smithi052.stdout:4/658: mknod d11/d65/dc6/d95/dbf/ceb 0 2024-09-12T18:03:22.908 INFO:tasks.workunit.client.0.smithi052.stdout:2/549: unlink da/d71/l7e 0 2024-09-12T18:03:22.909 INFO:tasks.workunit.client.0.smithi052.stdout:4/659: readlink d11/d70/la2 0 2024-09-12T18:03:22.909 INFO:tasks.workunit.client.0.smithi052.stdout:7/515: rename d6/d12/c46 to d6/d12/d1e/d29/d5d/d71/cb0 0 2024-09-12T18:03:22.909 INFO:tasks.workunit.client.0.smithi052.stdout:2/550: mknod da/dc/d15/d20/d60/d6e/cb9 0 2024-09-12T18:03:22.910 INFO:tasks.workunit.client.0.smithi052.stdout:9/544: rename d0/d18/d26/d33/l84 to d0/d58/d7f/lb6 0 2024-09-12T18:03:22.910 INFO:tasks.workunit.client.0.smithi052.stdout:4/660: mkdir d11/d65/dc6/d95/dbf/dec 0 2024-09-12T18:03:22.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/551: write f0 [361336,77441] 0 2024-09-12T18:03:22.910 INFO:tasks.workunit.client.0.smithi052.stdout:7/516: unlink d6/d12/d1e/d29/d5d/d71/ca5 0 2024-09-12T18:03:22.911 INFO:tasks.workunit.client.0.smithi052.stdout:2/552: truncate da/f12 4213807 0 2024-09-12T18:03:22.911 INFO:tasks.workunit.client.0.smithi052.stdout:4/661: link d11/fa7 d11/d17/d1b/d2a/d82/fed 0 2024-09-12T18:03:22.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/662: mknod d11/cee 0 2024-09-12T18:03:22.912 INFO:tasks.workunit.client.0.smithi052.stdout:7/517: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/fb1 x:0 0 0 2024-09-12T18:03:22.913 INFO:tasks.workunit.client.0.smithi052.stdout:9/545: read d0/d18/d79/f2f [4533748,106603] 0 2024-09-12T18:03:22.913 INFO:tasks.workunit.client.0.smithi052.stdout:2/553: rename da/dc/d15/lae to da/dc/d15/d20/d60/d6e/lba 0 2024-09-12T18:03:22.914 INFO:tasks.workunit.client.0.smithi052.stdout:4/663: write d11/d65/dc6/d68/f85 [6741717,75089] 0 2024-09-12T18:03:22.914 INFO:tasks.workunit.client.0.smithi052.stdout:7/518: dread - d6/d12/f99 zero size 2024-09-12T18:03:22.914 INFO:tasks.workunit.client.0.smithi052.stdout:4/664: chown d11/c1e 665663 1 2024-09-12T18:03:22.914 INFO:tasks.workunit.client.0.smithi052.stdout:2/554: rename da/dc/d15/d36 to da/dc/d15/da6/dbb 0 2024-09-12T18:03:22.915 INFO:tasks.workunit.client.0.smithi052.stdout:8/666: sync 2024-09-12T18:03:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:6/633: dread d2/d5e/f9d [0,4194304] 0 2024-09-12T18:03:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:2/555: dread da/dc/d15/f19 [0,4194304] 0 2024-09-12T18:03:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:6/634: creat d2/d3f/fd3 x:0 0 0 2024-09-12T18:03:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:2/556: stat da/d1d/d35/c4b 0 2024-09-12T18:03:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:2/557: chown da/dc/d15/f65 16224 1 2024-09-12T18:03:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:4/665: dread d11/d17/d1b/d2a/d32/fe7 [0,4194304] 0 2024-09-12T18:03:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:6/635: link d2/d21/f2a d2/d3f/d58/d5d/d87/dd1/fd4 0 2024-09-12T18:03:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:2/558: read da/d1d/f29 [618007,41871] 0 2024-09-12T18:03:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:9/546: truncate d0/d18/f40 1197464 0 2024-09-12T18:03:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:4/666: mknod d11/d46/d51/cef 0 2024-09-12T18:03:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:6/636: mkdir d2/d3f/d54/dd5 0 2024-09-12T18:03:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:8/667: dread d13/fc8 [0,4194304] 0 2024-09-12T18:03:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:7/519: truncate d6/d12/f15 625663 0 2024-09-12T18:03:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:4/667: unlink d11/d17/d1b/d2a/d82/c58 0 2024-09-12T18:03:22.924 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:22.919+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:7/520: chown d6/d12/d1e/f6f 8406 1 2024-09-12T18:03:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:8/668: unlink d13/d35/fb2 0 2024-09-12T18:03:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:4/668: write d11/d65/dd1/d3b/f4e [2372358,84777] 0 2024-09-12T18:03:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:7/521: fdatasync d6/d12/f99 0 2024-09-12T18:03:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:7/522: creat d6/d12/d1e/d29/da1/fb2 x:0 0 0 2024-09-12T18:03:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:7/523: mkdir d6/d12/d1e/dae/db3 0 2024-09-12T18:03:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:6/637: dwrite d2/d21/d6a/d97/fc0 [0,4194304] 0 2024-09-12T18:03:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:2/559: dwrite da/dc/d15/d43/f5c [0,4194304] 0 2024-09-12T18:03:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:7/524: truncate d6/d12/f47 4245993 0 2024-09-12T18:03:22.931 INFO:tasks.workunit.client.0.smithi052.stdout:4/669: dread d11/d17/d1b/d2a/d32/f75 [0,4194304] 0 2024-09-12T18:03:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:2/560: symlink da/d1d/d35/d8e/lbc 0 2024-09-12T18:03:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:6/638: mknod d2/d3f/cd6 0 2024-09-12T18:03:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:7/525: chown d6/d12/d1e/d29/d5d/d71/d9e/l7e 259389413 1 2024-09-12T18:03:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:8/669: dwrite d13/f1b [4194304,4194304] 0 2024-09-12T18:03:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:7/526: dread d6/f5a [0,4194304] 0 2024-09-12T18:03:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:8/670: fsync d13/d3c/f62 0 2024-09-12T18:03:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:4/670: fdatasync d11/d17/d1b/d2a/d32/fe7 0 2024-09-12T18:03:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:8/671: chown d13/d18/d5b/d70/f97 38 1 2024-09-12T18:03:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:8/672: stat d13/d18/d21/f59 0 2024-09-12T18:03:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:6/639: getdents d2/d49 0 2024-09-12T18:03:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:7/527: truncate d6/d12/d1e/f6f 798739 0 2024-09-12T18:03:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:4/671: truncate d11/d17/fa4 2632289 0 2024-09-12T18:03:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:8/673: mkdir d13/ddc 0 2024-09-12T18:03:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:4/672: readlink d11/d65/dd1/l26 0 2024-09-12T18:03:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:7/528: write d6/d12/d1e/d29/d5d/f78 [13082595,99311] 0 2024-09-12T18:03:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:8/674: truncate d13/f9e 257054 0 2024-09-12T18:03:22.938 INFO:tasks.workunit.client.0.smithi052.stdout:4/673: fdatasync d11/d17/d1b/d2a/d32/f75 0 2024-09-12T18:03:22.938 INFO:tasks.workunit.client.0.smithi052.stdout:7/529: chown d6/d12/d1e/f6d 29886495 1 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi052.stdout:8/675: mkdir d13/d18/d21/ddd 0 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi052.stdout:7/530: fdatasync d6/d12/d1e/d29/f67 0 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi052.stdout:8/676: mkdir d13/d18/d38/dd3/dde 0 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi052.stdout:7/531: stat d6/d12/l69 0 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi052.stdout:4/674: creat d11/d17/d1b/d2a/d6a/d7f/d90/ff0 x:0 0 0 2024-09-12T18:03:22.940 INFO:tasks.workunit.client.0.smithi052.stdout:6/640: read d2/fb [848742,782] 0 2024-09-12T18:03:22.940 INFO:tasks.workunit.client.0.smithi052.stdout:4/675: dread - d11/d17/d1b/d2a/d6a/d7f/d90/fa1 zero size 2024-09-12T18:03:22.940 INFO:tasks.workunit.client.0.smithi052.stdout:6/641: mkdir d2/d21/d9f/dd7 0 2024-09-12T18:03:22.941 INFO:tasks.workunit.client.0.smithi052.stdout:4/676: creat d11/d65/dd1/ff1 x:0 0 0 2024-09-12T18:03:22.942 INFO:tasks.workunit.client.0.smithi052.stdout:4/677: unlink d11/d65/d6c/f6e 0 2024-09-12T18:03:22.943 INFO:tasks.workunit.client.0.smithi052.stdout:4/678: mknod d11/d17/d1b/d2a/d32/cf2 0 2024-09-12T18:03:22.944 INFO:tasks.workunit.client.0.smithi052.stdout:7/532: dread d6/d12/d1e/d29/d5d/d71/d3a/d83/f7c [0,4194304] 0 2024-09-12T18:03:22.944 INFO:tasks.workunit.client.0.smithi052.stdout:7/533: chown d6 530917826 1 2024-09-12T18:03:22.945 INFO:tasks.workunit.client.0.smithi052.stdout:8/677: dwrite d13/d18/d38/fb4 [0,4194304] 0 2024-09-12T18:03:22.947 INFO:tasks.workunit.client.0.smithi052.stdout:2/561: truncate f0 2492183 0 2024-09-12T18:03:22.948 INFO:tasks.workunit.client.0.smithi052.stdout:8/678: creat d13/d18/d38/dd3/fdf x:0 0 0 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi052.stdout:2/562: truncate da/dc/d15/d20/d60/f70 814992 0 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi052.stdout:6/642: dwrite d2/d21/d76/f7f [4194304,4194304] 0 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi052.stdout:8/679: creat d13/d18/d38/dbf/fe0 x:0 0 0 2024-09-12T18:03:22.951 INFO:tasks.workunit.client.0.smithi052.stdout:6/643: symlink d2/d3f/d54/ld8 0 2024-09-12T18:03:22.951 INFO:tasks.workunit.client.0.smithi052.stdout:2/563: symlink da/dc/d15/d20/d60/d6e/dab/lbd 0 2024-09-12T18:03:22.952 INFO:tasks.workunit.client.0.smithi052.stdout:6/644: unlink d2/d3f/d58/d5d/f9b 0 2024-09-12T18:03:22.953 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:22.953 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:22.953 INFO:tasks.workunit.client.0.smithi052.stdout:2/564: write da/d1d/d35/f31 [977898,38834] 0 2024-09-12T18:03:22.954 INFO:tasks.workunit.client.0.smithi052.stdout:2/565: mkdir da/d21/dbe 0 2024-09-12T18:03:22.954 INFO:tasks.workunit.client.0.smithi052.stdout:7/534: dwrite d6/d12/d1e/d29/d5d/f78 [4194304,4194304] 0 2024-09-12T18:03:22.959 INFO:tasks.workunit.client.0.smithi052.stdout:8/680: dwrite d13/d18/d21/f5d [0,4194304] 0 2024-09-12T18:03:22.961 INFO:tasks.workunit.client.0.smithi052.stdout:7/535: dwrite d6/d12/d1e/d29/f45 [0,4194304] 0 2024-09-12T18:03:22.964 INFO:tasks.workunit.client.0.smithi052.stdout:7/536: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb4 x:0 0 0 2024-09-12T18:03:22.965 INFO:tasks.workunit.client.0.smithi052.stdout:6/645: dwrite d2/d21/d6a/f72 [0,4194304] 0 2024-09-12T18:03:22.967 INFO:tasks.workunit.client.0.smithi052.stdout:8/681: dwrite d13/d18/d38/dbf/fe0 [0,4194304] 0 2024-09-12T18:03:22.969 INFO:tasks.workunit.client.0.smithi052.stdout:8/682: rename d13/d18/d38/d7a to d13/d35/de1 0 2024-09-12T18:03:22.971 INFO:tasks.workunit.client.0.smithi052.stdout:8/683: read d13/d18/d38/f91 [1681086,18904] 0 2024-09-12T18:03:22.971 INFO:tasks.workunit.client.0.smithi052.stdout:7/537: dwrite d6/d12/d1e/d29/da1/fb2 [0,4194304] 0 2024-09-12T18:03:22.972 INFO:tasks.workunit.client.0.smithi052.stdout:7/538: fdatasync d6/d12/d1e/d29/f91 0 2024-09-12T18:03:22.972 INFO:tasks.workunit.client.0.smithi052.stdout:8/684: write d13/d3c/f72 [609716,130820] 0 2024-09-12T18:03:22.976 INFO:tasks.workunit.client.0.smithi052.stdout:6/646: dwrite d2/d3f/f92 [4194304,4194304] 0 2024-09-12T18:03:22.977 INFO:tasks.workunit.client.0.smithi052.stdout:7/539: unlink d6/d12/d1e/d29/d5d/d71/d3a/f53 0 2024-09-12T18:03:22.978 INFO:tasks.workunit.client.0.smithi052.stdout:7/540: readlink d6/d12/l95 0 2024-09-12T18:03:22.978 INFO:tasks.workunit.client.0.smithi052.stdout:6/647: truncate d2/dc6/f45 1337228 0 2024-09-12T18:03:22.978 INFO:tasks.workunit.client.0.smithi052.stdout:7/541: fdatasync d6/d12/d1e/d8e/fa9 0 2024-09-12T18:03:22.978 INFO:tasks.workunit.client.0.smithi052.stdout:7/542: fsync d6/d12/d1e/d8e/f92 0 2024-09-12T18:03:22.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:22.981 INFO:tasks.workunit.client.0.smithi052.stdout:0/526: sync 2024-09-12T18:03:22.981 INFO:tasks.workunit.client.0.smithi052.stdout:8/685: dwrite d13/d18/d38/f40 [0,4194304] 0 2024-09-12T18:03:22.981 INFO:tasks.workunit.client.0.smithi052.stdout:2/566: truncate da/dc/f82 3038140 0 2024-09-12T18:03:22.981 INFO:tasks.workunit.client.0.smithi052.stdout:4/679: dread d11/d17/d1b/d2a/d82/f53 [0,4194304] 0 2024-09-12T18:03:22.983 INFO:tasks.workunit.client.0.smithi052.stdout:8/686: creat d13/d18/d5b/d70/fe2 x:0 0 0 2024-09-12T18:03:22.983 INFO:tasks.workunit.client.0.smithi052.stdout:2/567: read da/dc/d15/f19 [191250,97229] 0 2024-09-12T18:03:22.983 INFO:tasks.workunit.client.0.smithi052.stdout:2/568: mkdir da/d2c/dbf 0 2024-09-12T18:03:22.983 INFO:tasks.workunit.client.0.smithi052.stdout:8/687: dread - d13/d18/d21/dc1/f94 zero size 2024-09-12T18:03:22.984 INFO:tasks.workunit.client.0.smithi052.stdout:2/569: creat da/dc/d15/d20/fc0 x:0 0 0 2024-09-12T18:03:22.984 INFO:tasks.workunit.client.0.smithi052.stdout:8/688: creat d13/fe3 x:0 0 0 2024-09-12T18:03:22.985 INFO:tasks.workunit.client.0.smithi052.stdout:2/570: creat da/d1d/d7d/fc1 x:0 0 0 2024-09-12T18:03:22.985 INFO:tasks.workunit.client.0.smithi052.stdout:2/571: write da/dc/d15/d22/f8d [3788011,41204] 0 2024-09-12T18:03:22.985 INFO:tasks.workunit.client.0.smithi052.stdout:8/689: truncate d13/d35/d9c/da3/fd9 829850 0 2024-09-12T18:03:22.997 INFO:tasks.workunit.client.0.smithi052.stdout:6/648: write d2/d3f/d58/d5d/d87/dd1/f68 [2892886,30187] 0 2024-09-12T18:03:22.997 INFO:tasks.workunit.client.0.smithi052.stdout:0/527: truncate d2/d6/f23 1266035 0 2024-09-12T18:03:22.999 INFO:tasks.workunit.client.0.smithi052.stdout:6/649: write d2/d3f/d58/d5d/d87/dd1/f94 [308987,126823] 0 2024-09-12T18:03:22.999 INFO:tasks.workunit.client.0.smithi052.stdout:6/650: chown d2/d3f/d54/f62 836042 1 2024-09-12T18:03:23.000 INFO:tasks.workunit.client.0.smithi052.stdout:4/680: dread d11/d65/dd1/d3b/d3f/f4c [0,4194304] 0 2024-09-12T18:03:23.001 INFO:tasks.workunit.client.0.smithi052.stdout:7/543: dwrite d6/f5a [0,4194304] 0 2024-09-12T18:03:23.001 INFO:tasks.workunit.client.0.smithi052.stdout:4/681: readlink d11/d17/d1b/d2a/d82/lb6 0 2024-09-12T18:03:23.003 INFO:tasks.workunit.client.0.smithi052.stdout:4/682: symlink d11/d17/d1b/d2a/lf3 0 2024-09-12T18:03:23.005 INFO:tasks.workunit.client.0.smithi052.stdout:4/683: creat d11/d17/d1b/d2a/d6a/d7f/dd6/ff4 x:0 0 0 2024-09-12T18:03:23.005 INFO:tasks.workunit.client.0.smithi052.stdout:4/684: readlink d11/d70/la2 0 2024-09-12T18:03:23.007 INFO:tasks.workunit.client.0.smithi052.stdout:7/544: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb4 [0,4194304] 0 2024-09-12T18:03:23.014 INFO:tasks.workunit.client.0.smithi052.stdout:2/572: dread da/dc/d15/d43/f67 [0,4194304] 0 2024-09-12T18:03:23.014 INFO:tasks.workunit.client.0.smithi052.stdout:2/573: dread - da/d1d/f7b zero size 2024-09-12T18:03:23.015 INFO:tasks.workunit.client.0.smithi052.stdout:2/574: link da/dc/d15/d22/l47 da/d2c/lc2 0 2024-09-12T18:03:23.016 INFO:tasks.workunit.client.0.smithi052.stdout:4/685: dread d11/d17/d1b/d2a/f52 [0,4194304] 0 2024-09-12T18:03:23.016 INFO:tasks.workunit.client.0.smithi052.stdout:4/686: write d11/d65/dd1/f2b [3086728,97790] 0 2024-09-12T18:03:23.020 INFO:tasks.workunit.client.0.smithi052.stdout:2/575: dwrite da/dc/d15/d43/fb8 [0,4194304] 0 2024-09-12T18:03:23.022 INFO:tasks.workunit.client.0.smithi052.stdout:4/687: dwrite d11/d17/d1b/d2a/d6a/d7f/d90/fa1 [0,4194304] 0 2024-09-12T18:03:23.024 INFO:tasks.workunit.client.0.smithi052.stdout:7/545: truncate d6/d12/f47 2686363 0 2024-09-12T18:03:23.025 INFO:tasks.workunit.client.0.smithi052.stdout:4/688: chown d11/c1e 380857 1 2024-09-12T18:03:23.025 INFO:tasks.workunit.client.0.smithi052.stdout:4/689: write d11/d17/d1b/f2e [754041,83424] 0 2024-09-12T18:03:23.025 INFO:tasks.workunit.client.0.smithi052.stdout:7/546: symlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/lb5 0 2024-09-12T18:03:23.026 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:23.023+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:23.026 INFO:tasks.workunit.client.0.smithi052.stdout:4/690: write d11/d17/d1b/d2a/d82/f4a [4824972,89116] 0 2024-09-12T18:03:23.027 INFO:tasks.workunit.client.0.smithi052.stdout:4/691: chown d11/d65/dc6/f97 2061917 1 2024-09-12T18:03:23.028 INFO:tasks.workunit.client.0.smithi052.stdout:7/547: getdents d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3 0 2024-09-12T18:03:23.029 INFO:tasks.workunit.client.0.smithi052.stdout:4/692: truncate d11/d46/db8/fc0 1323803 0 2024-09-12T18:03:23.029 INFO:tasks.workunit.client.0.smithi052.stdout:4/693: read d11/d17/d1b/d2a/f7d [703764,38758] 0 2024-09-12T18:03:23.030 INFO:tasks.workunit.client.0.smithi052.stdout:0/528: dwrite d2/d6/dd/f17 [0,4194304] 0 2024-09-12T18:03:23.030 INFO:tasks.workunit.client.0.smithi052.stdout:4/694: fdatasync d11/d17/d1b/d2a/d82/fda 0 2024-09-12T18:03:23.031 INFO:tasks.workunit.client.0.smithi052.stdout:0/529: mkdir d2/d1b/d80/da3 0 2024-09-12T18:03:23.031 INFO:tasks.workunit.client.0.smithi052.stdout:7/548: dread d6/d12/d1e/d29/d5d/d71/d3a/d8f/f93 [0,4194304] 0 2024-09-12T18:03:23.032 INFO:tasks.workunit.client.0.smithi052.stdout:0/530: truncate d2/d57/f82 1050882 0 2024-09-12T18:03:23.032 INFO:tasks.workunit.client.0.smithi052.stdout:7/549: chown d6/d9b/fa7 372 1 2024-09-12T18:03:23.032 INFO:tasks.workunit.client.0.smithi052.stdout:0/531: chown d2/d6/dd/d21/d41/d44/d48/f4d 90 1 2024-09-12T18:03:23.033 INFO:tasks.workunit.client.0.smithi052.stdout:7/550: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb6 x:0 0 0 2024-09-12T18:03:23.034 INFO:tasks.workunit.client.0.smithi052.stdout:0/532: chown d2/d6/dd/d21/d26/d2f/f5e 770378 1 2024-09-12T18:03:23.034 INFO:tasks.workunit.client.0.smithi052.stdout:7/551: mknod d6/d12/d1e/d8e/cb7 0 2024-09-12T18:03:23.035 INFO:tasks.workunit.client.0.smithi052.stdout:0/533: dread - d2/d1b/d72/d69/f7b zero size 2024-09-12T18:03:23.036 INFO:tasks.workunit.client.0.smithi052.stdout:7/552: symlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/lb8 0 2024-09-12T18:03:23.036 INFO:tasks.workunit.client.0.smithi052.stdout:4/695: dwrite d11/fbb [0,4194304] 0 2024-09-12T18:03:23.037 INFO:tasks.workunit.client.0.smithi052.stdout:0/534: rename d2/d8/c45 to d2/d6/dd/d21/d41/d44/d48/ca4 0 2024-09-12T18:03:23.037 INFO:tasks.workunit.client.0.smithi052.stdout:0/535: chown d2/d1b/l62 5 1 2024-09-12T18:03:23.038 INFO:tasks.workunit.client.0.smithi052.stdout:7/553: getdents d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85 0 2024-09-12T18:03:23.038 INFO:tasks.workunit.client.0.smithi052.stdout:0/536: fdatasync d2/d6/f94 0 2024-09-12T18:03:23.038 INFO:tasks.workunit.client.0.smithi052.stdout:7/554: mknod d6/d9b/cb9 0 2024-09-12T18:03:23.038 INFO:tasks.workunit.client.0.smithi052.stdout:0/537: creat d2/d6/dd/d21/d26/d38/d4a/fa5 x:0 0 0 2024-09-12T18:03:23.039 INFO:tasks.workunit.client.0.smithi052.stdout:0/538: unlink d2/d6/l2c 0 2024-09-12T18:03:23.043 INFO:tasks.workunit.client.0.smithi052.stdout:0/539: dwrite d2/d8/f1c [0,4194304] 0 2024-09-12T18:03:23.045 INFO:tasks.workunit.client.0.smithi052.stdout:0/540: creat d2/d6/dd/d21/d41/fa6 x:0 0 0 2024-09-12T18:03:23.045 INFO:tasks.workunit.client.0.smithi052.stdout:0/541: stat d2/d6/dd/d21/d47/c74 0 2024-09-12T18:03:23.046 INFO:tasks.workunit.client.0.smithi052.stdout:0/542: creat d2/d6/dd/fa7 x:0 0 0 2024-09-12T18:03:23.046 INFO:tasks.workunit.client.0.smithi052.stdout:0/543: dread - d2/d6/dd/fa7 zero size 2024-09-12T18:03:23.047 INFO:tasks.workunit.client.0.smithi052.stdout:0/544: creat d2/d8/fa8 x:0 0 0 2024-09-12T18:03:23.048 INFO:tasks.workunit.client.0.smithi052.stdout:0/545: truncate d2/f31 8871261 0 2024-09-12T18:03:23.048 INFO:tasks.workunit.client.0.smithi052.stdout:4/696: write d11/d17/fa4 [473306,44971] 0 2024-09-12T18:03:23.048 INFO:tasks.workunit.client.0.smithi052.stdout:0/546: mknod d2/d51/ca9 0 2024-09-12T18:03:23.048 INFO:tasks.workunit.client.0.smithi052.stdout:0/547: dread - d2/d6/dd/d21/f5f zero size 2024-09-12T18:03:23.049 INFO:tasks.workunit.client.0.smithi052.stdout:4/697: creat d11/d17/d1b/d2a/d32/ff5 x:0 0 0 2024-09-12T18:03:23.050 INFO:tasks.workunit.client.0.smithi052.stdout:4/698: truncate d11/d17/d1b/d2a/d32/fe7 1529542 0 2024-09-12T18:03:23.053 INFO:tasks.workunit.client.0.smithi052.stdout:0/548: dwrite d2/d6/dd/d21/d26/d65/f7d [0,4194304] 0 2024-09-12T18:03:23.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/549: unlink d2/d6/dd/d21/d47/l61 0 2024-09-12T18:03:23.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/550: write d2/f4f [911413,68971] 0 2024-09-12T18:03:23.056 INFO:tasks.workunit.client.0.smithi052.stdout:0/551: symlink d2/d6/dd/d21/d26/d38/d4a/d86/laa 0 2024-09-12T18:03:23.056 INFO:tasks.workunit.client.0.smithi052.stdout:7/555: chown d6/d12/f47 108675 1 2024-09-12T18:03:23.057 INFO:tasks.workunit.client.0.smithi052.stdout:0/552: dread - d2/d6/dd/d21/d41/f79 zero size 2024-09-12T18:03:23.057 INFO:tasks.workunit.client.0.smithi052.stdout:7/556: rename d6/d12/f15 to d6/dc/fba 0 2024-09-12T18:03:23.058 INFO:tasks.workunit.client.0.smithi052.stdout:4/699: dread d11/d17/d1b/d2a/d32/fe7 [0,4194304] 0 2024-09-12T18:03:23.058 INFO:tasks.workunit.client.0.smithi052.stdout:0/553: creat d2/d6/dd/d21/d41/d59/fab x:0 0 0 2024-09-12T18:03:23.059 INFO:tasks.workunit.client.0.smithi052.stdout:0/554: creat d2/d57/fac x:0 0 0 2024-09-12T18:03:23.059 INFO:tasks.workunit.client.0.smithi052.stdout:0/555: mkdir d2/d6/dd/dad 0 2024-09-12T18:03:23.064 INFO:tasks.workunit.client.0.smithi052.stdout:7/557: dwrite d6/dc/f30 [4194304,4194304] 0 2024-09-12T18:03:23.065 INFO:tasks.workunit.client.0.smithi052.stdout:4/700: dwrite d11/d17/d1b/fd0 [0,4194304] 0 2024-09-12T18:03:23.066 INFO:tasks.workunit.client.0.smithi052.stdout:4/701: rmdir d11/d70/dbd 39 2024-09-12T18:03:23.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/558: write d6/d12/d1e/d29/d5d/d71/d3a/d8f/f93 [709668,16447] 0 2024-09-12T18:03:23.067 INFO:tasks.workunit.client.0.smithi052.stdout:0/556: dwrite d2/d1b/f2e [4194304,4194304] 0 2024-09-12T18:03:23.067 INFO:tasks.workunit.client.0.smithi052.stdout:4/702: fsync d11/d17/d1b/d2a/f93 0 2024-09-12T18:03:23.070 INFO:tasks.workunit.client.0.smithi052.stdout:0/557: write d2/d6/dd/f39 [480993,14338] 0 2024-09-12T18:03:23.071 INFO:tasks.workunit.client.0.smithi052.stdout:0/558: unlink d2/d1b/fa0 0 2024-09-12T18:03:23.071 INFO:tasks.workunit.client.0.smithi052.stdout:0/559: readlink d2/d51/l93 0 2024-09-12T18:03:23.071 INFO:tasks.workunit.client.0.smithi052.stdout:7/559: rename d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/faa to d6/d12/d17/fbb 0 2024-09-12T18:03:23.071 INFO:tasks.workunit.client.0.smithi052.stdout:4/703: getdents d11/d17/d1b/d2a/d6a/d7f/d90 0 2024-09-12T18:03:23.072 INFO:tasks.workunit.client.0.smithi052.stdout:4/704: dread - d11/d17/fa6 zero size 2024-09-12T18:03:23.072 INFO:tasks.workunit.client.0.smithi052.stdout:0/560: rename d2/d1b/f2e to d2/d6/dd/d21/d26/d38/d4a/fae 0 2024-09-12T18:03:23.072 INFO:tasks.workunit.client.0.smithi052.stdout:7/560: link d6/dc/fe d6/d12/fbc 0 2024-09-12T18:03:23.072 INFO:tasks.workunit.client.0.smithi052.stdout:7/561: readlink d6/d12/l95 0 2024-09-12T18:03:23.073 INFO:tasks.workunit.client.0.smithi052.stdout:0/561: truncate d2/d8/fa 937890 0 2024-09-12T18:03:23.074 INFO:tasks.workunit.client.0.smithi052.stdout:7/562: rmdir d6/d12/d1e/d29/d5d/d71/da2 0 2024-09-12T18:03:23.076 INFO:tasks.workunit.client.0.smithi052.stdout:1/460: sync 2024-09-12T18:03:23.077 INFO:tasks.workunit.client.0.smithi052.stdout:5/540: sync 2024-09-12T18:03:23.077 INFO:tasks.workunit.client.0.smithi052.stdout:3/570: sync 2024-09-12T18:03:23.077 INFO:tasks.workunit.client.0.smithi052.stdout:4/705: sync 2024-09-12T18:03:23.077 INFO:tasks.workunit.client.0.smithi052.stdout:1/461: chown d3/d10/d38/f40 21952 1 2024-09-12T18:03:23.078 INFO:tasks.workunit.client.0.smithi052.stdout:4/706: write d11/f15 [2118478,17262] 0 2024-09-12T18:03:23.079 INFO:tasks.workunit.client.0.smithi052.stdout:4/707: fsync d11/fbb 0 2024-09-12T18:03:23.079 INFO:tasks.workunit.client.0.smithi052.stdout:1/462: stat d3/d1d/d22/d27/d28/d2f/d74/d7d 0 2024-09-12T18:03:23.080 INFO:tasks.workunit.client.0.smithi052.stdout:3/571: dread d0/d4b/d57/d6d/f7b [0,4194304] 0 2024-09-12T18:03:23.080 INFO:tasks.workunit.client.0.smithi052.stdout:4/708: symlink d11/d65/dd1/d72/lf6 0 2024-09-12T18:03:23.080 INFO:tasks.workunit.client.0.smithi052.stdout:7/563: dwrite d6/d12/d1e/d29/f91 [0,4194304] 0 2024-09-12T18:03:23.080 INFO:tasks.workunit.client.0.smithi052.stdout:1/463: creat d3/d69/d89/f95 x:0 0 0 2024-09-12T18:03:23.081 INFO:tasks.workunit.client.0.smithi052.stdout:4/709: rmdir d11/d65/dc6/daf 39 2024-09-12T18:03:23.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/710: truncate d11/f1f 5926712 0 2024-09-12T18:03:23.082 INFO:tasks.workunit.client.0.smithi052.stdout:3/572: rename d0/d4/d25/d2a/d6/f15 to d0/d4/d25/d2a/d2c/da9/fcd 0 2024-09-12T18:03:23.082 INFO:tasks.workunit.client.0.smithi052.stdout:1/464: creat d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/f96 x:0 0 0 2024-09-12T18:03:23.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/711: creat d11/d17/d1b/d2a/d6a/ff7 x:0 0 0 2024-09-12T18:03:23.083 INFO:tasks.workunit.client.0.smithi052.stdout:3/573: chown d0/d4/d25/d2a/d6/d41/c92 100 1 2024-09-12T18:03:23.083 INFO:tasks.workunit.client.0.smithi052.stdout:4/712: write d11/d46/fb2 [1894487,43572] 0 2024-09-12T18:03:23.084 INFO:tasks.workunit.client.0.smithi052.stdout:4/713: unlink d11/d65/dd1/d3b/c69 0 2024-09-12T18:03:23.084 INFO:tasks.workunit.client.0.smithi052.stdout:1/465: truncate d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/f96 919483 0 2024-09-12T18:03:23.085 INFO:tasks.workunit.client.0.smithi052.stdout:1/466: rmdir d3/d1d/d22/d27/d92 0 2024-09-12T18:03:23.085 INFO:tasks.workunit.client.0.smithi052.stdout:4/714: truncate d11/d17/d1b/f20 967770 0 2024-09-12T18:03:23.086 INFO:tasks.workunit.client.0.smithi052.stdout:4/715: creat d11/d17/d1b/d2a/d6a/ff8 x:0 0 0 2024-09-12T18:03:23.086 INFO:tasks.workunit.client.0.smithi052.stdout:2/576: sync 2024-09-12T18:03:23.086 INFO:tasks.workunit.client.0.smithi052.stdout:9/547: sync 2024-09-12T18:03:23.086 INFO:tasks.workunit.client.0.smithi052.stdout:6/651: sync 2024-09-12T18:03:23.086 INFO:tasks.workunit.client.0.smithi052.stdout:8/690: sync 2024-09-12T18:03:23.086 INFO:tasks.workunit.client.0.smithi052.stdout:7/564: sync 2024-09-12T18:03:23.087 INFO:tasks.workunit.client.0.smithi052.stdout:1/467: getdents d3/d1d/d22/d27/d28/d2f/d74 0 2024-09-12T18:03:23.087 INFO:tasks.workunit.client.0.smithi052.stdout:4/716: mkdir d11/d17/d1b/df9 0 2024-09-12T18:03:23.087 INFO:tasks.workunit.client.0.smithi052.stdout:9/548: symlink d0/d6/d3a/d43/d74/lb7 0 2024-09-12T18:03:23.088 INFO:tasks.workunit.client.0.smithi052.stdout:7/565: chown d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8 35542 1 2024-09-12T18:03:23.088 INFO:tasks.workunit.client.0.smithi052.stdout:9/549: sync 2024-09-12T18:03:23.089 INFO:tasks.workunit.client.0.smithi052.stdout:4/717: truncate d11/d65/dc6/d68/fb9 994194 0 2024-09-12T18:03:23.089 INFO:tasks.workunit.client.0.smithi052.stdout:4/718: sync 2024-09-12T18:03:23.089 INFO:tasks.workunit.client.0.smithi052.stdout:9/550: rename d0/d6/d3a/d42/d93/d96 to d0/da3/db8 0 2024-09-12T18:03:23.090 INFO:tasks.workunit.client.0.smithi052.stdout:9/551: fdatasync d0/d1c/f32 0 2024-09-12T18:03:23.090 INFO:tasks.workunit.client.0.smithi052.stdout:4/719: readlink d11/d17/d1b/d2a/dbe/ld2 0 2024-09-12T18:03:23.092 INFO:tasks.workunit.client.0.smithi052.stdout:4/720: chown d11/d65/dc6/d95/dbf/dae 7344 1 2024-09-12T18:03:23.093 INFO:tasks.workunit.client.0.smithi052.stdout:9/552: read d0/d18/d26/d4d/d54/f5b [2215573,50590] 0 2024-09-12T18:03:23.095 INFO:tasks.workunit.client.0.smithi052.stdout:2/577: dwrite da/d1d/d7d/f91 [0,4194304] 0 2024-09-12T18:03:23.095 INFO:tasks.workunit.client.0.smithi052.stdout:4/721: symlink d11/d17/d1b/d2a/lfa 0 2024-09-12T18:03:23.096 INFO:tasks.workunit.client.0.smithi052.stdout:9/553: truncate d0/d1c/f8e 869248 0 2024-09-12T18:03:23.097 INFO:tasks.workunit.client.0.smithi052.stdout:5/541: truncate d7/d1f/d3a/d49/d54/f5b 3665735 0 2024-09-12T18:03:23.097 INFO:tasks.workunit.client.0.smithi052.stdout:1/468: dwrite d3/d69/f7e [0,4194304] 0 2024-09-12T18:03:23.098 INFO:tasks.workunit.client.0.smithi052.stdout:6/652: dwrite d2/d3f/d58/d5d/fba [0,4194304] 0 2024-09-12T18:03:23.099 INFO:tasks.workunit.client.0.smithi052.stdout:2/578: mkdir da/dc/d15/d22/d87/dc3 0 2024-09-12T18:03:23.100 INFO:tasks.workunit.client.0.smithi052.stdout:9/554: readlink d0/d58/d7f/lb6 0 2024-09-12T18:03:23.100 INFO:tasks.workunit.client.0.smithi052.stdout:2/579: fdatasync da/dc/d15/d22/f8d 0 2024-09-12T18:03:23.100 INFO:tasks.workunit.client.0.smithi052.stdout:1/469: creat d3/d1d/d22/d66/f97 x:0 0 0 2024-09-12T18:03:23.101 INFO:tasks.workunit.client.0.smithi052.stdout:6/653: symlink d2/d3f/d58/d5d/d9c/d26/ld9 0 2024-09-12T18:03:23.101 INFO:tasks.workunit.client.0.smithi052.stdout:0/562: link d2/d6/dd/d21/d26/d38/f49 d2/d1b/d72/d69/faf 0 2024-09-12T18:03:23.101 INFO:tasks.workunit.client.0.smithi052.stdout:1/470: readlink d3/d10/l39 0 2024-09-12T18:03:23.101 INFO:tasks.workunit.client.0.smithi052.stdout:2/580: unlink da/d1d/d7d/fa4 0 2024-09-12T18:03:23.102 INFO:tasks.workunit.client.0.smithi052.stdout:3/574: truncate d0/d4/d25/d2a/d2c/da9/fcd 290073 0 2024-09-12T18:03:23.102 INFO:tasks.workunit.client.0.smithi052.stdout:6/654: creat d2/d3f/d54/dd5/fda x:0 0 0 2024-09-12T18:03:23.103 INFO:tasks.workunit.client.0.smithi052.stdout:0/563: symlink d2/d1b/d80/da3/lb0 0 2024-09-12T18:03:23.103 INFO:tasks.workunit.client.0.smithi052.stdout:3/575: fdatasync d0/d4/d25/f2e 0 2024-09-12T18:03:23.103 INFO:tasks.workunit.client.0.smithi052.stdout:1/471: symlink d3/d10/d38/d8b/l98 0 2024-09-12T18:03:23.103 INFO:tasks.workunit.client.0.smithi052.stdout:2/581: chown da/d1d/d35/c4b 6922 1 2024-09-12T18:03:23.104 INFO:tasks.workunit.client.0.smithi052.stdout:6/655: mknod d2/d3f/d58/d5d/d9c/cdb 0 2024-09-12T18:03:23.104 INFO:tasks.workunit.client.0.smithi052.stdout:1/472: mknod d3/d1d/c99 0 2024-09-12T18:03:23.105 INFO:tasks.workunit.client.0.smithi052.stdout:0/564: write d2/d8/fa8 [121969,46240] 0 2024-09-12T18:03:23.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/656: dread - d2/fce zero size 2024-09-12T18:03:23.106 INFO:tasks.workunit.client.0.smithi052.stdout:6/657: creat d2/dc6/fdc x:0 0 0 2024-09-12T18:03:23.106 INFO:tasks.workunit.client.0.smithi052.stdout:3/576: creat d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/fce x:0 0 0 2024-09-12T18:03:23.107 INFO:tasks.workunit.client.0.smithi052.stdout:0/565: readlink d2/d6/dd/d21/d26/d65/l9b 0 2024-09-12T18:03:23.107 INFO:tasks.workunit.client.0.smithi052.stdout:2/582: truncate da/dc/d15/f39 6592264 0 2024-09-12T18:03:23.107 INFO:tasks.workunit.client.0.smithi052.stdout:5/542: write d7/d1c/d1e/f2b [876090,85568] 0 2024-09-12T18:03:23.108 INFO:tasks.workunit.client.0.smithi052.stdout:6/658: write d2/d3f/d58/f66 [983379,49644] 0 2024-09-12T18:03:23.108 INFO:tasks.workunit.client.0.smithi052.stdout:5/543: fdatasync d7/d1f/d3a/d49/f87 0 2024-09-12T18:03:23.108 INFO:tasks.workunit.client.0.smithi052.stdout:3/577: creat d0/d4/d33/fcf x:0 0 0 2024-09-12T18:03:23.109 INFO:tasks.workunit.client.0.smithi052.stdout:2/583: mkdir da/dc/d76/dc4 0 2024-09-12T18:03:23.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/555: dwrite d0/d18/d37/d87/fad [0,4194304] 0 2024-09-12T18:03:23.111 INFO:tasks.workunit.client.0.smithi052.stdout:9/556: creat d0/d18/d26/d4d/fb9 x:0 0 0 2024-09-12T18:03:23.111 INFO:tasks.workunit.client.0.smithi052.stdout:6/659: truncate d2/d3f/d54/dd5/fda 876314 0 2024-09-12T18:03:23.112 INFO:tasks.workunit.client.0.smithi052.stdout:2/584: mkdir da/dc/d15/d22/d87/dc5 0 2024-09-12T18:03:23.112 INFO:tasks.workunit.client.0.smithi052.stdout:5/544: symlink d7/d1c/d1e/da5/lb0 0 2024-09-12T18:03:23.113 INFO:tasks.workunit.client.0.smithi052.stdout:9/557: truncate d0/d58/f83 1848839 0 2024-09-12T18:03:23.114 INFO:tasks.workunit.client.0.smithi052.stdout:6/660: symlink d2/ldd 0 2024-09-12T18:03:23.114 INFO:tasks.workunit.client.0.smithi052.stdout:1/473: dwrite d3/d10/d38/f40 [0,4194304] 0 2024-09-12T18:03:23.117 INFO:tasks.workunit.client.0.smithi052.stdout:9/558: mknod d0/d18/d26/d4d/cba 0 2024-09-12T18:03:23.118 INFO:tasks.workunit.client.0.smithi052.stdout:6/661: creat d2/d3f/d58/d5d/d9c/fde x:0 0 0 2024-09-12T18:03:23.119 INFO:tasks.workunit.client.0.smithi052.stdout:0/566: dwrite d2/d6/f94 [0,4194304] 0 2024-09-12T18:03:23.119 INFO:tasks.workunit.client.0.smithi052.stdout:1/474: mknod d3/d1d/d22/d27/d28/d2f/d74/c9a 0 2024-09-12T18:03:23.119 INFO:tasks.workunit.client.0.smithi052.stdout:8/691: dread d13/d35/d9c/f8d [4194304,4194304] 0 2024-09-12T18:03:23.122 INFO:tasks.workunit.client.0.smithi052.stdout:6/662: stat d2/d15/f23 0 2024-09-12T18:03:23.123 INFO:tasks.workunit.client.0.smithi052.stdout:5/545: dwrite d7/d51/d8d/f8e [0,4194304] 0 2024-09-12T18:03:23.125 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:23.119+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:23.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/567: fdatasync d2/d6/fb 0 2024-09-12T18:03:23.126 INFO:tasks.workunit.client.0.smithi052.stdout:2/585: dwrite da/f16 [0,4194304] 0 2024-09-12T18:03:23.126 INFO:tasks.workunit.client.0.smithi052.stdout:9/559: creat d0/d6/d3a/d42/da9/fbb x:0 0 0 2024-09-12T18:03:23.126 INFO:tasks.workunit.client.0.smithi052.stdout:1/475: rename d3/d1d/d22/d27/f4f to d3/d1d/d22/d27/d28/d88/f9b 0 2024-09-12T18:03:23.127 INFO:tasks.workunit.client.0.smithi052.stdout:7/566: dread d6/d12/d1e/d29/d5d/d71/d3a/d83/f81 [4194304,4194304] 0 2024-09-12T18:03:23.127 INFO:tasks.workunit.client.0.smithi052.stdout:6/663: dread - d2/d3f/d58/d5d/d9c/d26/f42 zero size 2024-09-12T18:03:23.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/568: symlink d2/d6/dd/d21/d26/d38/d4a/lb1 0 2024-09-12T18:03:23.128 INFO:tasks.workunit.client.0.smithi052.stdout:9/560: truncate d0/d6/d3a/d43/d74/f77 428072 0 2024-09-12T18:03:23.129 INFO:tasks.workunit.client.0.smithi052.stdout:2/586: getdents da/d71 0 2024-09-12T18:03:23.129 INFO:tasks.workunit.client.0.smithi052.stdout:1/476: link d3/d1d/d22/f30 d3/d10/d38/f9c 0 2024-09-12T18:03:23.129 INFO:tasks.workunit.client.0.smithi052.stdout:6/664: rename d2/d3f/d58/lcf to d2/d21/ldf 0 2024-09-12T18:03:23.129 INFO:tasks.workunit.client.0.smithi052.stdout:9/561: stat d0/d18/d26/d4d/d54/la8 0 2024-09-12T18:03:23.129 INFO:tasks.workunit.client.0.smithi052.stdout:9/562: stat d0/da3/db8/f69 0 2024-09-12T18:03:23.130 INFO:tasks.workunit.client.0.smithi052.stdout:6/665: write d2/d3f/d58/d5d/d87/dd1/f90 [131533,15109] 0 2024-09-12T18:03:23.130 INFO:tasks.workunit.client.0.smithi052.stdout:1/477: creat d3/d1d/d22/d27/d28/d2f/d74/d7d/f9d x:0 0 0 2024-09-12T18:03:23.130 INFO:tasks.workunit.client.0.smithi052.stdout:9/563: fsync d0/d18/d79/f2f 0 2024-09-12T18:03:23.131 INFO:tasks.workunit.client.0.smithi052.stdout:9/564: write d0/d1c/f51 [2752,69860] 0 2024-09-12T18:03:23.131 INFO:tasks.workunit.client.0.smithi052.stdout:9/565: chown d0/d18/d26/d4d/d54/la8 97 1 2024-09-12T18:03:23.132 INFO:tasks.workunit.client.0.smithi052.stdout:7/567: read d6/d12/d1e/f2c [148713,51277] 0 2024-09-12T18:03:23.133 INFO:tasks.workunit.client.0.smithi052.stdout:9/566: mkdir d0/d1c/dbc 0 2024-09-12T18:03:23.135 INFO:tasks.workunit.client.0.smithi052.stdout:9/567: unlink d0/d18/d79/f31 0 2024-09-12T18:03:23.135 INFO:tasks.workunit.client.0.smithi052.stdout:7/568: stat d6/dc/d1a/d6a/f8b 0 2024-09-12T18:03:23.136 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:23.136 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:23.138 INFO:tasks.workunit.client.0.smithi052.stdout:7/569: read - d6/d12/d17/fbb zero size 2024-09-12T18:03:23.139 INFO:tasks.workunit.client.0.smithi052.stdout:2/587: dwrite da/dc/d15/d22/d87/fa0 [0,4194304] 0 2024-09-12T18:03:23.139 INFO:tasks.workunit.client.0.smithi052.stdout:4/722: dread d11/d65/dd1/f3a [0,4194304] 0 2024-09-12T18:03:23.139 INFO:tasks.workunit.client.0.smithi052.stdout:6/666: dwrite d2/d5e/f9d [0,4194304] 0 2024-09-12T18:03:23.139 INFO:tasks.workunit.client.0.smithi052.stdout:7/570: readlink d6/l19 0 2024-09-12T18:03:23.139 INFO:tasks.workunit.client.0.smithi052.stdout:1/478: dwrite d3/d1d/d22/d27/d28/d2f/f80 [0,4194304] 0 2024-09-12T18:03:23.141 INFO:tasks.workunit.client.0.smithi052.stdout:2/588: readlink da/dc/l9e 0 2024-09-12T18:03:23.142 INFO:tasks.workunit.client.0.smithi052.stdout:4/723: creat d11/d65/dc6/d95/dbf/d8e/ffb x:0 0 0 2024-09-12T18:03:23.142 INFO:tasks.workunit.client.0.smithi052.stdout:7/571: mknod d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/cbd 0 2024-09-12T18:03:23.142 INFO:tasks.workunit.client.0.smithi052.stdout:9/568: link d0/d1c/f32 d0/da3/fbd 0 2024-09-12T18:03:23.143 INFO:tasks.workunit.client.0.smithi052.stdout:6/667: creat d2/d15/fe0 x:0 0 0 2024-09-12T18:03:23.143 INFO:tasks.workunit.client.0.smithi052.stdout:2/589: chown da/dc/d15/f65 63477 1 2024-09-12T18:03:23.144 INFO:tasks.workunit.client.0.smithi052.stdout:1/479: getdents d3/d1d/d22/d3f/d56 0 2024-09-12T18:03:23.144 INFO:tasks.workunit.client.0.smithi052.stdout:1/480: sync 2024-09-12T18:03:23.144 INFO:tasks.workunit.client.0.smithi052.stdout:7/572: chown d6/dc 11624516 1 2024-09-12T18:03:23.145 INFO:tasks.workunit.client.0.smithi052.stdout:9/569: symlink d0/d18/d26/d33/lbe 0 2024-09-12T18:03:23.145 INFO:tasks.workunit.client.0.smithi052.stdout:1/481: write d3/f25 [3486969,111081] 0 2024-09-12T18:03:23.146 INFO:tasks.workunit.client.0.smithi052.stdout:9/570: mknod d0/da3/db8/cbf 0 2024-09-12T18:03:23.147 INFO:tasks.workunit.client.0.smithi052.stdout:1/482: creat d3/d1d/d72/f9e x:0 0 0 2024-09-12T18:03:23.147 INFO:tasks.workunit.client.0.smithi052.stdout:3/578: dwrite d0/d4/d25/d2a/d6/d7/de/f26 [0,4194304] 0 2024-09-12T18:03:23.148 INFO:tasks.workunit.client.0.smithi052.stdout:1/483: rmdir d3/d10/d38/d8b 39 2024-09-12T18:03:23.148 INFO:tasks.workunit.client.0.smithi052.stdout:3/579: symlink d0/d4/ld0 0 2024-09-12T18:03:23.149 INFO:tasks.workunit.client.0.smithi052.stdout:1/484: symlink d3/d1d/d22/d27/d28/d2f/d74/d7d/l9f 0 2024-09-12T18:03:23.155 INFO:tasks.workunit.client.0.smithi052.stdout:1/485: dwrite d3/f77 [0,4194304] 0 2024-09-12T18:03:23.156 INFO:tasks.workunit.client.0.smithi052.stdout:1/486: chown d3/c15 60619 1 2024-09-12T18:03:23.157 INFO:tasks.workunit.client.0.smithi052.stdout:7/573: truncate d6/dc/f34 1221317 0 2024-09-12T18:03:23.157 INFO:tasks.workunit.client.0.smithi052.stdout:1/487: rmdir d3 39 2024-09-12T18:03:23.157 INFO:tasks.workunit.client.0.smithi052.stdout:5/546: fdatasync d7/d51/d8d/f8e 0 2024-09-12T18:03:23.157 INFO:tasks.workunit.client.0.smithi052.stdout:1/488: sync 2024-09-12T18:03:23.157 INFO:tasks.workunit.client.0.smithi052.stdout:0/569: dread d2/f29 [0,4194304] 0 2024-09-12T18:03:23.157 INFO:tasks.workunit.client.0.smithi052.stdout:7/574: readlink d6/d12/d1e/la4 0 2024-09-12T18:03:23.158 INFO:tasks.workunit.client.0.smithi052.stdout:5/547: chown d7/d1f/d34/l3b 831811339 1 2024-09-12T18:03:23.159 INFO:tasks.workunit.client.0.smithi052.stdout:5/548: write d7/d1f/d34/f48 [2371731,12789] 0 2024-09-12T18:03:23.159 INFO:tasks.workunit.client.0.smithi052.stdout:7/575: mknod d6/d12/d1e/d29/d5d/d71/d3a/cbe 0 2024-09-12T18:03:23.159 INFO:tasks.workunit.client.0.smithi052.stdout:5/549: fdatasync d7/d1f/d3a/d49/d54/d6b/fa1 0 2024-09-12T18:03:23.160 INFO:tasks.workunit.client.0.smithi052.stdout:6/668: truncate d2/d3f/d58/d5d/d9c/d26/f28 239139 0 2024-09-12T18:03:23.160 INFO:tasks.workunit.client.0.smithi052.stdout:5/550: rmdir d7/d1c/d1e/d98 39 2024-09-12T18:03:23.162 INFO:tasks.workunit.client.0.smithi052.stdout:5/551: rename d7/d1c/d67/c8f to d7/d59/d5c/cb1 0 2024-09-12T18:03:23.162 INFO:tasks.workunit.client.0.smithi052.stdout:6/669: getdents d2/d3f/d58/d5d/d9c 0 2024-09-12T18:03:23.163 INFO:tasks.workunit.client.0.smithi052.stdout:6/670: mknod d2/d5e/ce1 0 2024-09-12T18:03:23.163 INFO:tasks.workunit.client.0.smithi052.stdout:5/552: rename d7/d1f/f47 to d7/d59/fb2 0 2024-09-12T18:03:23.163 INFO:tasks.workunit.client.0.smithi052.stdout:6/671: chown d2/d15/c8b 103 1 2024-09-12T18:03:23.164 INFO:tasks.workunit.client.0.smithi052.stdout:5/553: symlink d7/d1f/d3a/lb3 0 2024-09-12T18:03:23.164 INFO:tasks.workunit.client.0.smithi052.stdout:6/672: chown d2/d3f/fd3 34176 1 2024-09-12T18:03:23.165 INFO:tasks.workunit.client.0.smithi052.stdout:5/554: creat d7/d59/d5c/d7c/fb4 x:0 0 0 2024-09-12T18:03:23.165 INFO:tasks.workunit.client.0.smithi052.stdout:6/673: symlink d2/d15/le2 0 2024-09-12T18:03:23.165 INFO:tasks.workunit.client.0.smithi052.stdout:5/555: dread - d7/d59/f97 zero size 2024-09-12T18:03:23.165 INFO:tasks.workunit.client.0.smithi052.stdout:6/674: rmdir d2/d3f 39 2024-09-12T18:03:23.166 INFO:tasks.workunit.client.0.smithi052.stdout:3/580: truncate d0/d4/d25/fb5 589109 0 2024-09-12T18:03:23.167 INFO:tasks.workunit.client.0.smithi052.stdout:6/675: rename d2/d49/caa to d2/d49/ce3 0 2024-09-12T18:03:23.168 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:23.169 INFO:tasks.workunit.client.0.smithi052.stdout:3/581: unlink d0/d4/d25/d2a/d6/d41/c92 0 2024-09-12T18:03:23.170 INFO:tasks.workunit.client.0.smithi052.stdout:6/676: rename d2/c34 to d2/d3f/d58/ce4 0 2024-09-12T18:03:23.170 INFO:tasks.workunit.client.0.smithi052.stdout:3/582: creat d0/d4/d25/d2a/d6/d7/dab/fd1 x:0 0 0 2024-09-12T18:03:23.170 INFO:tasks.workunit.client.0.smithi052.stdout:3/583: unlink d0/d4b/cb6 0 2024-09-12T18:03:23.171 INFO:tasks.workunit.client.0.smithi052.stdout:8/692: dread d13/f1f [0,4194304] 0 2024-09-12T18:03:23.172 INFO:tasks.workunit.client.0.smithi052.stdout:8/693: mknod d13/d35/d9c/da3/ce4 0 2024-09-12T18:03:23.172 INFO:tasks.workunit.client.0.smithi052.stdout:3/584: creat d0/d4/d25/d2a/fd2 x:0 0 0 2024-09-12T18:03:23.173 INFO:tasks.workunit.client.0.smithi052.stdout:8/694: symlink d13/d3c/le5 0 2024-09-12T18:03:23.174 INFO:tasks.workunit.client.0.smithi052.stdout:9/571: dread d0/da3/db8/f53 [0,4194304] 0 2024-09-12T18:03:23.174 INFO:tasks.workunit.client.0.smithi052.stdout:5/556: dread d7/f38 [0,4194304] 0 2024-09-12T18:03:23.175 INFO:tasks.workunit.client.0.smithi052.stdout:1/489: truncate d3/d10/d38/f4a 3280253 0 2024-09-12T18:03:23.175 INFO:tasks.workunit.client.0.smithi052.stdout:3/585: mkdir d0/d4/d25/d2a/d6/d7/d34/d71/dd3 0 2024-09-12T18:03:23.177 INFO:tasks.workunit.client.0.smithi052.stdout:8/695: getdents d13/d18/d38 0 2024-09-12T18:03:23.177 INFO:tasks.workunit.client.0.smithi052.stdout:9/572: fdatasync d0/d18/d26/d4d/d54/f5b 0 2024-09-12T18:03:23.181 INFO:tasks.workunit.client.0.smithi052.stdout:2/590: dread da/dc/d15/d20/f4f [0,4194304] 0 2024-09-12T18:03:23.181 INFO:tasks.workunit.client.0.smithi052.stdout:8/696: symlink d13/d18/d21/le6 0 2024-09-12T18:03:23.181 INFO:tasks.workunit.client.0.smithi052.stdout:0/570: dread d2/d1b/d72/f5d [4194304,4194304] 0 2024-09-12T18:03:23.182 INFO:tasks.workunit.client.0.smithi052.stdout:9/573: creat d0/fc0 x:0 0 0 2024-09-12T18:03:23.182 INFO:tasks.workunit.client.0.smithi052.stdout:2/591: fsync da/dc/d15/d43/f4e 0 2024-09-12T18:03:23.182 INFO:tasks.workunit.client.0.smithi052.stdout:9/574: mknod d0/d6/d3a/d43/d74/cc1 0 2024-09-12T18:03:23.182 INFO:tasks.workunit.client.0.smithi052.stdout:0/571: rename d2/d51/ca9 to d2/d1b/d80/cb2 0 2024-09-12T18:03:23.182 INFO:tasks.workunit.client.0.smithi052.stdout:2/592: chown da/dc/d15/d20/laf 16319098 1 2024-09-12T18:03:23.182 INFO:tasks.workunit.client.0.smithi052.stdout:9/575: creat d0/d18/d26/d4d/fc2 x:0 0 0 2024-09-12T18:03:23.182 INFO:tasks.workunit.client.0.smithi052.stdout:9/576: sync 2024-09-12T18:03:23.182 INFO:tasks.workunit.client.0.smithi052.stdout:2/593: write da/d71/fb0 [2449270,67283] 0 2024-09-12T18:03:23.183 INFO:tasks.workunit.client.0.smithi052.stdout:9/577: dread - d0/d18/d26/d4d/fb9 zero size 2024-09-12T18:03:23.183 INFO:tasks.workunit.client.0.smithi052.stdout:9/578: creat d0/d18/fc3 x:0 0 0 2024-09-12T18:03:23.183 INFO:tasks.workunit.client.0.smithi052.stdout:4/724: dread d11/d17/d1b/d2a/d82/f4a [0,4194304] 0 2024-09-12T18:03:23.184 INFO:tasks.workunit.client.0.smithi052.stdout:9/579: creat d0/da3/db8/fc4 x:0 0 0 2024-09-12T18:03:23.185 INFO:tasks.workunit.client.0.smithi052.stdout:8/697: dwrite d13/d18/f19 [0,4194304] 0 2024-09-12T18:03:23.185 INFO:tasks.workunit.client.0.smithi052.stdout:6/677: truncate d2/d3f/d58/d5d/d9c/d26/f61 661272 0 2024-09-12T18:03:23.187 INFO:tasks.workunit.client.0.smithi052.stdout:4/725: dread d11/d17/d1b/d2a/d82/fed [0,4194304] 0 2024-09-12T18:03:23.188 INFO:tasks.workunit.client.0.smithi052.stdout:4/726: chown d11/d17/d1b/d2a/d32/f3e 1404739730 1 2024-09-12T18:03:23.189 INFO:tasks.workunit.client.0.smithi052.stdout:4/727: chown d11/d65/dd1/c1d 169 1 2024-09-12T18:03:23.190 INFO:tasks.workunit.client.0.smithi052.stdout:7/576: dread d6/dc/fab [0,4194304] 0 2024-09-12T18:03:23.190 INFO:tasks.workunit.client.0.smithi052.stdout:5/557: write d7/f1a [831775,92999] 0 2024-09-12T18:03:23.191 INFO:tasks.workunit.client.0.smithi052.stdout:8/698: dwrite fb [0,4194304] 0 2024-09-12T18:03:23.192 INFO:tasks.workunit.client.0.smithi052.stdout:7/577: write d6/d12/d1e/d29/d5d/d71/d3a/d8f/f93 [88597,40860] 0 2024-09-12T18:03:23.192 INFO:tasks.workunit.client.0.smithi052.stdout:5/558: fdatasync d7/d1f/d45/f94 0 2024-09-12T18:03:23.193 INFO:tasks.workunit.client.0.smithi052.stdout:5/559: chown d7/f16 43968 1 2024-09-12T18:03:23.195 INFO:tasks.workunit.client.0.smithi052.stdout:7/578: unlink d6/dc/l4e 0 2024-09-12T18:03:23.195 INFO:tasks.workunit.client.0.smithi052.stdout:1/490: dwrite d3/d10/f85 [4194304,4194304] 0 2024-09-12T18:03:23.195 INFO:tasks.workunit.client.0.smithi052.stdout:3/586: truncate d0/d4b/d4c/d6b/fae 468373 0 2024-09-12T18:03:23.196 INFO:tasks.workunit.client.0.smithi052.stdout:0/572: dread d2/d6/dd/d21/d26/d2f/f6b [0,4194304] 0 2024-09-12T18:03:23.196 INFO:tasks.workunit.client.0.smithi052.stdout:3/587: write d0/d4/d25/fa8 [166140,108196] 0 2024-09-12T18:03:23.197 INFO:tasks.workunit.client.0.smithi052.stdout:9/580: truncate d0/d18/d37/d87/fad 2349343 0 2024-09-12T18:03:23.197 INFO:tasks.workunit.client.0.smithi052.stdout:8/699: rename d13/d35/d9c/d9f/fa0 to d13/fe7 0 2024-09-12T18:03:23.197 INFO:tasks.workunit.client.0.smithi052.stdout:7/579: unlink d6/dc/l1b 0 2024-09-12T18:03:23.198 INFO:tasks.workunit.client.0.smithi052.stdout:1/491: write d3/d1d/d22/d27/f50 [485220,130879] 0 2024-09-12T18:03:23.198 INFO:tasks.workunit.client.0.smithi052.stdout:4/728: dwrite d11/d17/d1b/d2a/d6a/da8/fcb [0,4194304] 0 2024-09-12T18:03:23.199 INFO:tasks.workunit.client.0.smithi052.stdout:0/573: write d2/d6/f4c [2295870,34053] 0 2024-09-12T18:03:23.199 INFO:tasks.workunit.client.0.smithi052.stdout:5/560: rename d7/f21 to d7/d59/d5c/d7c/fb5 0 2024-09-12T18:03:23.199 INFO:tasks.workunit.client.0.smithi052.stdout:3/588: dread - d0/d4/d25/d2a/d6/d7/dab/fd1 zero size 2024-09-12T18:03:23.200 INFO:tasks.workunit.client.0.smithi052.stdout:7/580: write d6/d12/d1e/f6d [2109237,10307] 0 2024-09-12T18:03:23.200 INFO:tasks.workunit.client.0.smithi052.stdout:5/561: chown d7/d51/d8b/daf 2295 1 2024-09-12T18:03:23.200 INFO:tasks.workunit.client.0.smithi052.stdout:4/729: write d11/d17/fb7 [154685,97807] 0 2024-09-12T18:03:23.201 INFO:tasks.workunit.client.0.smithi052.stdout:8/700: truncate d13/d18/d21/f41 1112461 0 2024-09-12T18:03:23.201 INFO:tasks.workunit.client.0.smithi052.stdout:5/562: stat d7/d1f/d3a/d49/d54/c80 0 2024-09-12T18:03:23.201 INFO:tasks.workunit.client.0.smithi052.stdout:3/589: write d0/d4b/f64 [3954831,116074] 0 2024-09-12T18:03:23.202 INFO:tasks.workunit.client.0.smithi052.stdout:3/590: sync 2024-09-12T18:03:23.202 INFO:tasks.workunit.client.0.smithi052.stdout:1/492: truncate d3/d10/d38/f9c 3906661 0 2024-09-12T18:03:23.203 INFO:tasks.workunit.client.0.smithi052.stdout:8/701: read d13/d18/f75 [26193,123433] 0 2024-09-12T18:03:23.203 INFO:tasks.workunit.client.0.smithi052.stdout:1/493: creat d3/d10/fa0 x:0 0 0 2024-09-12T18:03:23.204 INFO:tasks.workunit.client.0.smithi052.stdout:9/581: rename d0/da3/fbd to d0/d6/fc5 0 2024-09-12T18:03:23.205 INFO:tasks.workunit.client.0.smithi052.stdout:5/563: read d7/d1f/f4b [2262400,108804] 0 2024-09-12T18:03:23.205 INFO:tasks.workunit.client.0.smithi052.stdout:6/678: truncate d2/d80/fa5 7042 0 2024-09-12T18:03:23.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/581: rename d6/d9b/cb9 to d6/d12/d1e/dae/db3/cbf 0 2024-09-12T18:03:23.205 INFO:tasks.workunit.client.0.smithi052.stdout:0/574: dread d2/d6/f94 [0,4194304] 0 2024-09-12T18:03:23.206 INFO:tasks.workunit.client.0.smithi052.stdout:8/702: creat d13/d35/de1/fe8 x:0 0 0 2024-09-12T18:03:23.206 INFO:tasks.workunit.client.0.smithi052.stdout:3/591: creat d0/d4/d25/d2a/d6/d7/fd4 x:0 0 0 2024-09-12T18:03:23.206 INFO:tasks.workunit.client.0.smithi052.stdout:5/564: creat d7/d51/fb6 x:0 0 0 2024-09-12T18:03:23.207 INFO:tasks.workunit.client.0.smithi052.stdout:4/730: read d11/d17/d1b/d2a/d82/fcc [3833537,52666] 0 2024-09-12T18:03:23.207 INFO:tasks.workunit.client.0.smithi052.stdout:5/565: write d7/d1c/f95 [2212612,79892] 0 2024-09-12T18:03:23.209 INFO:tasks.workunit.client.0.smithi052.stdout:7/582: mknod d6/cc0 0 2024-09-12T18:03:23.209 INFO:tasks.workunit.client.0.smithi052.stdout:0/575: creat d2/d6/dd/dad/fb3 x:0 0 0 2024-09-12T18:03:23.210 INFO:tasks.workunit.client.0.smithi052.stdout:3/592: rename d0/d4b/d57/d6d/f7e to d0/d4b/d4c/fd5 0 2024-09-12T18:03:23.210 INFO:tasks.workunit.client.0.smithi052.stdout:6/679: symlink d2/d3f/d58/d5d/dd0/le5 0 2024-09-12T18:03:23.211 INFO:tasks.workunit.client.0.smithi052.stdout:7/583: symlink d6/d12/lc1 0 2024-09-12T18:03:23.212 INFO:tasks.workunit.client.0.smithi052.stdout:7/584: fdatasync d6/f62 0 2024-09-12T18:03:23.212 INFO:tasks.workunit.client.0.smithi052.stdout:3/593: symlink d0/d4b/ld6 0 2024-09-12T18:03:23.213 INFO:tasks.workunit.client.0.smithi052.stdout:6/680: rename d2/d80/fbb to d2/d15/dcc/fe6 0 2024-09-12T18:03:23.217 INFO:tasks.workunit.client.0.smithi052.stdout:2/594: dread da/dc/d15/d22/f8d [0,4194304] 0 2024-09-12T18:03:23.217 INFO:tasks.workunit.client.0.smithi052.stdout:7/585: fdatasync d6/d12/d1e/d29/d5d/d71/f68 0 2024-09-12T18:03:23.217 INFO:tasks.workunit.client.0.smithi052.stdout:9/582: dwrite d0/d6/d3a/f5d [0,4194304] 0 2024-09-12T18:03:23.219 INFO:tasks.workunit.client.0.smithi052.stdout:8/703: dwrite d13/d18/d38/f40 [4194304,4194304] 0 2024-09-12T18:03:23.219 INFO:tasks.workunit.client.0.smithi052.stdout:1/494: dwrite d3/d1d/d22/d3f/f45 [0,4194304] 0 2024-09-12T18:03:23.220 INFO:tasks.workunit.client.0.smithi052.stdout:5/566: dwrite d7/d1c/d1e/f52 [4194304,4194304] 0 2024-09-12T18:03:23.222 INFO:tasks.workunit.client.0.smithi052.stdout:8/704: write d13/d18/d38/f40 [4679480,73107] 0 2024-09-12T18:03:23.222 INFO:tasks.workunit.client.0.smithi052.stdout:1/495: dread - d3/d1d/d22/d27/f62 zero size 2024-09-12T18:03:23.222 INFO:tasks.workunit.client.0.smithi052.stdout:5/567: chown d7/d1c/d1e/c78 1721 1 2024-09-12T18:03:23.222 INFO:tasks.workunit.client.0.smithi052.stdout:6/681: rename d2/d3f to d2/d21/d9f/dd7/de7 0 2024-09-12T18:03:23.222 INFO:tasks.workunit.client.0.smithi052.stdout:9/583: rename d0 to d0/d6/d3a/d42/dc6 22 2024-09-12T18:03:23.224 INFO:tasks.workunit.client.0.smithi052.stdout:1/496: readlink d3/lb 0 2024-09-12T18:03:23.224 INFO:tasks.workunit.client.0.smithi052.stdout:1/497: sync 2024-09-12T18:03:23.224 INFO:tasks.workunit.client.0.smithi052.stdout:5/568: write d7/d1c/d6f/f89 [970853,61096] 0 2024-09-12T18:03:23.225 INFO:tasks.workunit.client.0.smithi052.stdout:5/569: chown d7/d1c/d67/fa8 1 1 2024-09-12T18:03:23.225 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:23.221+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:23.226 INFO:tasks.workunit.client.0.smithi052.stdout:9/584: symlink d0/d18/d79/da6/lc7 0 2024-09-12T18:03:23.226 INFO:tasks.workunit.client.0.smithi052.stdout:5/570: rename d7/c35 to d7/d59/dad/cb7 0 2024-09-12T18:03:23.227 INFO:tasks.workunit.client.0.smithi052.stdout:6/682: symlink d2/d21/d9f/dd7/de7/d58/d5d/le8 0 2024-09-12T18:03:23.227 INFO:tasks.workunit.client.0.smithi052.stdout:3/594: dwrite d0/d16/d7c/fa6 [0,4194304] 0 2024-09-12T18:03:23.227 INFO:tasks.workunit.client.0.smithi052.stdout:1/498: rename d3/d1d/d22/d27/d28/d88/f9b to d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/fa1 0 2024-09-12T18:03:23.228 INFO:tasks.workunit.client.0.smithi052.stdout:6/683: mknod d2/d21/d9f/dd7/ce9 0 2024-09-12T18:03:23.228 INFO:tasks.workunit.client.0.smithi052.stdout:3/595: symlink d0/d4/d25/d2a/d6/d7/d34/d71/ld7 0 2024-09-12T18:03:23.229 INFO:tasks.workunit.client.0.smithi052.stdout:6/684: rmdir d2/d21/d9f/dd7/de7/d58/d5d/d9c 39 2024-09-12T18:03:23.230 INFO:tasks.workunit.client.0.smithi052.stdout:1/499: mkdir d3/da2 0 2024-09-12T18:03:23.230 INFO:tasks.workunit.client.0.smithi052.stdout:3/596: rmdir d0/d4/d25/d2a/d6/d7/d34/d72 39 2024-09-12T18:03:23.231 INFO:tasks.workunit.client.0.smithi052.stdout:1/500: stat d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/f96 0 2024-09-12T18:03:23.233 INFO:tasks.workunit.client.0.smithi052.stdout:1/501: rmdir d3/d10/d38/d44/d49 39 2024-09-12T18:03:23.233 INFO:tasks.workunit.client.0.smithi052.stdout:9/585: dwrite d0/fb5 [0,4194304] 0 2024-09-12T18:03:23.234 INFO:tasks.workunit.client.0.smithi052.stdout:1/502: write d3/d1d/d22/d27/f62 [636757,94470] 0 2024-09-12T18:03:23.234 INFO:tasks.workunit.client.0.smithi052.stdout:1/503: sync 2024-09-12T18:03:23.236 INFO:tasks.workunit.client.0.smithi052.stdout:9/586: unlink d0/d6/d3a/d42/d61/cb1 0 2024-09-12T18:03:23.236 INFO:tasks.workunit.client.0.smithi052.stdout:0/576: truncate d2/d1b/d72/d69/f7f 1363598 0 2024-09-12T18:03:23.237 INFO:tasks.workunit.client.0.smithi052.stdout:0/577: read - d2/d6/dd/d21/d26/d65/f7c zero size 2024-09-12T18:03:23.238 INFO:tasks.workunit.client.0.smithi052.stdout:6/685: dwrite d2/d15/f2c [0,4194304] 0 2024-09-12T18:03:23.238 INFO:tasks.workunit.client.0.smithi052.stdout:3/597: dwrite d0/d4/d25/f2e [4194304,4194304] 0 2024-09-12T18:03:23.239 INFO:tasks.workunit.client.0.smithi052.stdout:0/578: unlink d2/f88 0 2024-09-12T18:03:23.241 INFO:tasks.workunit.client.0.smithi052.stdout:1/504: mkdir d3/d1d/d22/d27/d28/d2f/d74/da3 0 2024-09-12T18:03:23.242 INFO:tasks.workunit.client.0.smithi052.stdout:2/595: truncate da/dc/f2b 17468 0 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi052.stdout:7/586: truncate d6/d12/d1e/d29/f45 189623 0 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi052.stdout:3/598: chown d0/d4b/d4c/c31 108 1 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi052.stdout:2/596: fsync da/d71/f94 0 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi052.stdout:0/579: chown d2/d6/l7 34305667 1 2024-09-12T18:03:23.244 INFO:tasks.workunit.client.0.smithi052.stdout:1/505: chown d3/d10/f33 5 1 2024-09-12T18:03:23.246 INFO:tasks.workunit.client.0.smithi052.stdout:0/580: symlink d2/d1b/d80/lb4 0 2024-09-12T18:03:23.246 INFO:tasks.workunit.client.0.smithi052.stdout:2/597: rmdir da/dc/d15/d20/d60/d6e 39 2024-09-12T18:03:23.246 INFO:tasks.workunit.client.0.smithi052.stdout:1/506: symlink d3/d1d/d22/d27/d28/d2f/d74/d7d/la4 0 2024-09-12T18:03:23.246 INFO:tasks.workunit.client.0.smithi052.stdout:9/587: truncate d0/d18/d37/d87/fad 108464 0 2024-09-12T18:03:23.247 INFO:tasks.workunit.client.0.smithi052.stdout:3/599: mkdir d0/d4/d25/d2a/d6/dd8 0 2024-09-12T18:03:23.247 INFO:tasks.workunit.client.0.smithi052.stdout:0/581: read - d2/d6/dd/d21/d26/d2f/fa1 zero size 2024-09-12T18:03:23.247 INFO:tasks.workunit.client.0.smithi052.stdout:9/588: readlink d0/da3/db8/l60 0 2024-09-12T18:03:23.248 INFO:tasks.workunit.client.0.smithi052.stdout:2/598: creat da/dc/d15/d22/d87/fc6 x:0 0 0 2024-09-12T18:03:23.250 INFO:tasks.workunit.client.0.smithi052.stdout:0/582: fdatasync d2/d6/dd/d21/d41/f75 0 2024-09-12T18:03:23.250 INFO:tasks.workunit.client.0.smithi052.stdout:3/600: mknod d0/d4/cd9 0 2024-09-12T18:03:23.251 INFO:tasks.workunit.client.0.smithi052.stdout:1/507: rename d3/d10/l39 to d3/d1d/d22/d66/la5 0 2024-09-12T18:03:23.252 INFO:tasks.workunit.client.0.smithi052.stdout:0/583: write d2/d8/f43 [2005200,65127] 0 2024-09-12T18:03:23.253 INFO:tasks.workunit.client.0.smithi052.stdout:4/731: dread d11/f15 [0,4194304] 0 2024-09-12T18:03:23.254 INFO:tasks.workunit.client.0.smithi052.stdout:0/584: dread - d2/d6/dd/d21/d26/d2f/f96 zero size 2024-09-12T18:03:23.255 INFO:tasks.workunit.client.0.smithi052.stdout:5/571: dread d7/f19 [0,4194304] 0 2024-09-12T18:03:23.256 INFO:tasks.workunit.client.0.smithi052.stdout:0/585: write d2/f4f [297324,73791] 0 2024-09-12T18:03:23.256 INFO:tasks.workunit.client.0.smithi052.stdout:4/732: creat d11/d65/dc6/d95/dbf/dec/ffc x:0 0 0 2024-09-12T18:03:23.256 INFO:tasks.workunit.client.0.smithi052.stdout:9/589: dwrite d0/d1c/f22 [0,4194304] 0 2024-09-12T18:03:23.257 INFO:tasks.workunit.client.0.smithi052.stdout:2/599: dwrite da/dc/d15/d22/fac [0,4194304] 0 2024-09-12T18:03:23.259 INFO:tasks.workunit.client.0.smithi052.stdout:6/686: dread d2/d21/d9f/dd7/de7/f99 [0,4194304] 0 2024-09-12T18:03:23.264 INFO:tasks.workunit.client.0.smithi052.stdout:8/705: dread d13/d35/d9c/fa7 [0,4194304] 0 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi052.stdout:3/601: write d0/d4b/d57/d6d/f7b [658033,93643] 0 2024-09-12T18:03:23.267 INFO:tasks.workunit.client.0.smithi052.stdout:5/572: dwrite d7/d1c/f6c [0,4194304] 0 2024-09-12T18:03:23.268 INFO:tasks.workunit.client.0.smithi052.stdout:4/733: dread d11/d17/d1b/d2a/d6a/d7f/d90/fa1 [0,4194304] 0 2024-09-12T18:03:23.269 INFO:tasks.workunit.client.0.smithi052.stdout:6/687: mkdir d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea 0 2024-09-12T18:03:23.269 INFO:tasks.workunit.client.0.smithi052.stdout:9/590: dwrite d0/f1d [0,4194304] 0 2024-09-12T18:03:23.270 INFO:tasks.workunit.client.0.smithi052.stdout:1/508: dread d3/d1d/d22/d27/f50 [0,4194304] 0 2024-09-12T18:03:23.270 INFO:tasks.workunit.client.0.smithi052.stdout:3/602: write d0/d4b/d4c/d6b/d48/fb9 [4084176,121566] 0 2024-09-12T18:03:23.271 INFO:tasks.workunit.client.0.smithi052.stdout:6/688: dread - d2/d5e/fc3 zero size 2024-09-12T18:03:23.271 INFO:tasks.workunit.client.0.smithi052.stdout:7/587: dwrite d6/d12/fbc [0,4194304] 0 2024-09-12T18:03:23.272 INFO:tasks.workunit.client.0.smithi052.stdout:6/689: fdatasync d2/f10 0 2024-09-12T18:03:23.273 INFO:tasks.workunit.client.0.smithi052.stdout:0/586: dwrite d2/d6/dd/d21/f95 [0,4194304] 0 2024-09-12T18:03:23.274 INFO:tasks.workunit.client.0.smithi052.stdout:9/591: rename d0/da3/db8/f9b to d0/d6/d3a/d42/da9/fc8 0 2024-09-12T18:03:23.274 INFO:tasks.workunit.client.0.smithi052.stdout:8/706: getdents d13/d18/d38 0 2024-09-12T18:03:23.275 INFO:tasks.workunit.client.0.smithi052.stdout:0/587: write d2/f31 [4348889,21700] 0 2024-09-12T18:03:23.276 INFO:tasks.workunit.client.0.smithi052.stdout:8/707: chown d13/d3c/l78 10646901 1 2024-09-12T18:03:23.276 INFO:tasks.workunit.client.0.smithi052.stdout:7/588: link d6/dc/d1a/c82 d6/d12/d1e/d8e/cc2 0 2024-09-12T18:03:23.276 INFO:tasks.workunit.client.0.smithi052.stdout:2/600: dwrite da/d1d/d35/f31 [0,4194304] 0 2024-09-12T18:03:23.278 INFO:tasks.workunit.client.0.smithi052.stdout:4/734: rename d11/d17/d1b/d2a/d32 to d11/d17/d1b/df9/dfd 0 2024-09-12T18:03:23.278 INFO:tasks.workunit.client.0.smithi052.stdout:0/588: unlink d2/d6/dd/fa7 0 2024-09-12T18:03:23.278 INFO:tasks.workunit.client.0.smithi052.stdout:8/708: symlink d13/d18/d38/dd3/le9 0 2024-09-12T18:03:23.279 INFO:tasks.workunit.client.0.smithi052.stdout:2/601: creat da/d71/fc7 x:0 0 0 2024-09-12T18:03:23.279 INFO:tasks.workunit.client.0.smithi052.stdout:3/603: getdents d0/d4/d25/d2a/d2c/da9 0 2024-09-12T18:03:23.280 INFO:tasks.workunit.client.0.smithi052.stdout:1/509: rename d3/d1d/d22/d27/l2e to d3/d1d/d22/d66/la6 0 2024-09-12T18:03:23.281 INFO:tasks.workunit.client.0.smithi052.stdout:8/709: chown d13/d18/lba 8530344 1 2024-09-12T18:03:23.281 INFO:tasks.workunit.client.0.smithi052.stdout:6/690: link d2/d21/d9f/dd7/de7/d58/d5d/d9c/lb2 d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea/leb 0 2024-09-12T18:03:23.282 INFO:tasks.workunit.client.0.smithi052.stdout:4/735: fsync d11/d65/f71 0 2024-09-12T18:03:23.284 INFO:tasks.workunit.client.0.smithi052.stdout:6/691: write d2/d21/d9f/dd7/de7/d58/fbf [552923,82519] 0 2024-09-12T18:03:23.284 INFO:tasks.workunit.client.0.smithi052.stdout:2/602: fdatasync da/d1d/d7d/fa7 0 2024-09-12T18:03:23.285 INFO:tasks.workunit.client.0.smithi052.stdout:0/589: rename d2/d1b/l62 to d2/d1b/d80/lb5 0 2024-09-12T18:03:23.287 INFO:tasks.workunit.client.0.smithi052.stdout:0/590: dread - d2/d6/dd/d21/f98 zero size 2024-09-12T18:03:23.288 INFO:tasks.workunit.client.0.smithi052.stdout:9/592: dwrite d0/d1c/f22 [0,4194304] 0 2024-09-12T18:03:23.290 INFO:tasks.workunit.client.0.smithi052.stdout:5/573: dwrite d7/d1c/f61 [0,4194304] 0 2024-09-12T18:03:23.290 INFO:tasks.workunit.client.0.smithi052.stdout:9/593: readlink d0/d6/l24 0 2024-09-12T18:03:23.291 INFO:tasks.workunit.client.0.smithi052.stdout:0/591: mkdir d2/d1b/d72/d69/db6 0 2024-09-12T18:03:23.291 INFO:tasks.workunit.client.0.smithi052.stdout:7/589: dwrite d6/d12/d17/fbb [0,4194304] 0 2024-09-12T18:03:23.293 INFO:tasks.workunit.client.0.smithi052.stdout:3/604: dwrite d0/d16/fb4 [0,4194304] 0 2024-09-12T18:03:23.293 INFO:tasks.workunit.client.0.smithi052.stdout:8/710: write d13/d18/d21/f28 [766043,20052] 0 2024-09-12T18:03:23.293 INFO:tasks.workunit.client.0.smithi052.stdout:5/574: truncate d7/d59/f60 1011628 0 2024-09-12T18:03:23.294 INFO:tasks.workunit.client.0.smithi052.stdout:1/510: dwrite d3/d10/fa0 [0,4194304] 0 2024-09-12T18:03:23.294 INFO:tasks.workunit.client.0.smithi052.stdout:0/592: mknod d2/d6/dd/d21/d26/d38/d4a/d86/cb7 0 2024-09-12T18:03:23.294 INFO:tasks.workunit.client.0.smithi052.stdout:7/590: chown d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/lb5 54571 1 2024-09-12T18:03:23.295 INFO:tasks.workunit.client.0.smithi052.stdout:3/605: chown d0/d4/cd9 522205 1 2024-09-12T18:03:23.296 INFO:tasks.workunit.client.0.smithi052.stdout:3/606: creat d0/d4/dbb/fda x:0 0 0 2024-09-12T18:03:23.298 INFO:tasks.workunit.client.0.smithi052.stdout:7/591: creat d6/d12/fc3 x:0 0 0 2024-09-12T18:03:23.298 INFO:tasks.workunit.client.0.smithi052.stdout:5/575: getdents d7/d51/d8b 0 2024-09-12T18:03:23.298 INFO:tasks.workunit.client.0.smithi052.stdout:7/592: symlink d6/d12/d17/lc4 0 2024-09-12T18:03:23.298 INFO:tasks.workunit.client.0.smithi052.stdout:3/607: creat d0/d4/d25/d2a/fdb x:0 0 0 2024-09-12T18:03:23.299 INFO:tasks.workunit.client.0.smithi052.stdout:3/608: readlink d0/d4/l23 0 2024-09-12T18:03:23.299 INFO:tasks.workunit.client.0.smithi052.stdout:5/576: mknod d7/d1c/d1e/da5/cb8 0 2024-09-12T18:03:23.299 INFO:tasks.workunit.client.0.smithi052.stdout:7/593: write d6/dc/f30 [1038234,110432] 0 2024-09-12T18:03:23.300 INFO:tasks.workunit.client.0.smithi052.stdout:5/577: write d7/d1f/d34/fac [612980,73605] 0 2024-09-12T18:03:23.301 INFO:tasks.workunit.client.0.smithi052.stdout:0/593: dwrite d2/d57/d5b/f64 [0,4194304] 0 2024-09-12T18:03:23.302 INFO:tasks.workunit.client.0.smithi052.stdout:3/609: rmdir d0/d4/d25/d2a/d2c/da9 39 2024-09-12T18:03:23.303 INFO:tasks.workunit.client.0.smithi052.stdout:5/578: creat d7/d51/d8b/fb9 x:0 0 0 2024-09-12T18:03:23.303 INFO:tasks.workunit.client.0.smithi052.stdout:7/594: unlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/fb1 0 2024-09-12T18:03:23.305 INFO:tasks.workunit.client.0.smithi052.stdout:0/594: write d2/d6/dd/d21/d26/d2f/f96 [349357,117041] 0 2024-09-12T18:03:23.308 INFO:tasks.workunit.client.0.smithi052.stdout:0/595: write d2/d6/dd/d21/d47/f67 [543291,107543] 0 2024-09-12T18:03:23.309 INFO:tasks.workunit.client.0.smithi052.stdout:0/596: chown d2/d6/dd/d21/d41/fa6 472126 1 2024-09-12T18:03:23.309 INFO:tasks.workunit.client.0.smithi052.stdout:5/579: dwrite d7/d1c/f3f [0,4194304] 0 2024-09-12T18:03:23.310 INFO:tasks.workunit.client.0.smithi052.stdout:0/597: chown d2/d6/dd/d21/d26/d2f/f50 1 1 2024-09-12T18:03:23.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/736: truncate d11/d65/dc6/f97 232383 0 2024-09-12T18:03:23.311 INFO:tasks.workunit.client.0.smithi052.stdout:4/737: write d11/d65/dd1/f3a [6310066,2514] 0 2024-09-12T18:03:23.316 INFO:tasks.workunit.client.0.smithi052.stdout:1/511: write d3/d1d/d22/d66/f6e [429942,54002] 0 2024-09-12T18:03:23.316 INFO:tasks.workunit.client.0.smithi052.stdout:8/711: truncate d13/d18/d38/dbf/fc4 2232004 0 2024-09-12T18:03:23.316 INFO:tasks.workunit.client.0.smithi052.stdout:5/580: dwrite d7/d1f/d45/f62 [0,4194304] 0 2024-09-12T18:03:23.317 INFO:tasks.workunit.client.0.smithi052.stdout:8/712: unlink d13/d18/c6c 0 2024-09-12T18:03:23.317 INFO:tasks.workunit.client.0.smithi052.stdout:8/713: rmdir d13/d18/d21 39 2024-09-12T18:03:23.319 INFO:tasks.workunit.client.0.smithi052.stdout:8/714: write d13/fe7 [1568856,82503] 0 2024-09-12T18:03:23.319 INFO:tasks.workunit.client.0.smithi052.stdout:4/738: dwrite d11/d17/d1b/d2a/f7d [0,4194304] 0 2024-09-12T18:03:23.320 INFO:tasks.workunit.client.0.smithi052.stdout:4/739: chown d11/d65/dd1/d3b/d3f/f59 5600824 1 2024-09-12T18:03:23.321 INFO:tasks.workunit.client.0.smithi052.stdout:5/581: read d7/d1f/f4b [3137606,48455] 0 2024-09-12T18:03:23.321 INFO:tasks.workunit.client.0.smithi052.stdout:4/740: mkdir d11/d17/d1b/d2a/dbe/dc5/dfe 0 2024-09-12T18:03:23.322 INFO:tasks.workunit.client.0.smithi052.stdout:4/741: mknod d11/d17/d1b/d2a/d6a/d7f/dd6/cff 0 2024-09-12T18:03:23.323 INFO:tasks.workunit.client.0.smithi052.stdout:5/582: rename d7/d1c/d1e/f46 to d7/d51/d8b/daf/fba 0 2024-09-12T18:03:23.323 INFO:tasks.workunit.client.0.smithi052.stdout:4/742: creat d11/d17/d1b/d2a/dbe/dc5/f100 x:0 0 0 2024-09-12T18:03:23.324 INFO:tasks.workunit.client.0.smithi052.stdout:5/583: chown d7/d1c/c41 895 1 2024-09-12T18:03:23.324 INFO:tasks.workunit.client.0.smithi052.stdout:6/692: dread d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f28 [0,4194304] 0 2024-09-12T18:03:23.325 INFO:tasks.workunit.client.0.smithi052.stdout:5/584: stat d7/d1f/d34/c68 0 2024-09-12T18:03:23.326 INFO:tasks.workunit.client.0.smithi052.stdout:6/693: creat d2/d21/fec x:0 0 0 2024-09-12T18:03:23.326 INFO:tasks.workunit.client.0.smithi052.stdout:5/585: chown d7/d1f/d34 0 1 2024-09-12T18:03:23.326 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:23.323+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:23.327 INFO:tasks.workunit.client.0.smithi052.stdout:5/586: read d7/d1f/d34/fac [527755,25192] 0 2024-09-12T18:03:23.327 INFO:tasks.workunit.client.0.smithi052.stdout:0/598: dread d2/f4f [0,4194304] 0 2024-09-12T18:03:23.328 INFO:tasks.workunit.client.0.smithi052.stdout:5/587: creat d7/d1f/d3a/fbb x:0 0 0 2024-09-12T18:03:23.328 INFO:tasks.workunit.client.0.smithi052.stdout:0/599: rmdir d2/d6/dd/d21/d26/d38 39 2024-09-12T18:03:23.329 INFO:tasks.workunit.client.0.smithi052.stdout:0/600: chown d2/d6/dd/d21/d47 111684 1 2024-09-12T18:03:23.330 INFO:tasks.workunit.client.0.smithi052.stdout:0/601: creat d2/d1b/d80/da3/fb8 x:0 0 0 2024-09-12T18:03:23.331 INFO:tasks.workunit.client.0.smithi052.stdout:0/602: write d2/d57/d5b/f64 [5203648,4651] 0 2024-09-12T18:03:23.332 INFO:tasks.workunit.client.0.smithi052.stdout:0/603: mkdir d2/d57/d5b/db9 0 2024-09-12T18:03:23.334 INFO:tasks.workunit.client.0.smithi052.stdout:0/604: write d2/d6/f23 [3780434,70131] 0 2024-09-12T18:03:23.335 INFO:tasks.workunit.client.0.smithi052.stdout:8/715: dwrite d13/d18/d21/f41 [0,4194304] 0 2024-09-12T18:03:23.335 INFO:tasks.workunit.client.0.smithi052.stdout:0/605: stat d2/d1b/d80/cb2 0 2024-09-12T18:03:23.336 INFO:tasks.workunit.client.0.smithi052.stdout:8/716: rename d13/f1c to d13/d3c/fea 0 2024-09-12T18:03:23.338 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:23.338 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:23.339 INFO:tasks.workunit.client.0.smithi052.stdout:7/595: dread d6/f89 [0,4194304] 0 2024-09-12T18:03:23.340 INFO:tasks.workunit.client.0.smithi052.stdout:4/743: truncate d11/d17/d1b/d2a/d6a/d7f/d90/fa1 565808 0 2024-09-12T18:03:23.340 INFO:tasks.workunit.client.0.smithi052.stdout:4/744: rename d11 to d11/d17/d1b/d101 22 2024-09-12T18:03:23.341 INFO:tasks.workunit.client.0.smithi052.stdout:5/588: write d7/d1f/f2a [1987536,77858] 0 2024-09-12T18:03:23.342 INFO:tasks.workunit.client.0.smithi052.stdout:4/745: mkdir d11/d65/dc6/daf/d102 0 2024-09-12T18:03:23.342 INFO:tasks.workunit.client.0.smithi052.stdout:5/589: readlink d7/d1c/d6f/l93 0 2024-09-12T18:03:23.343 INFO:tasks.workunit.client.0.smithi052.stdout:3/610: dread d0/d4b/d57/d7a/fac [0,4194304] 0 2024-09-12T18:03:23.344 INFO:tasks.workunit.client.0.smithi052.stdout:5/590: rename d7/d59/d5c/c96 to d7/d1c/d6f/cbc 0 2024-09-12T18:03:23.344 INFO:tasks.workunit.client.0.smithi052.stdout:3/611: write d0/d4/d25/d2a/d6/d41/f45 [9114858,126183] 0 2024-09-12T18:03:23.344 INFO:tasks.workunit.client.0.smithi052.stdout:4/746: link d11/d65/dd1/d3b/f4e d11/d17/d1b/d2a/dbe/dc5/f103 0 2024-09-12T18:03:23.345 INFO:tasks.workunit.client.0.smithi052.stdout:6/694: dread d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f2d [0,4194304] 0 2024-09-12T18:03:23.345 INFO:tasks.workunit.client.0.smithi052.stdout:0/606: write d2/d6/dd/d21/d26/d38/f49 [40534,113113] 0 2024-09-12T18:03:23.345 INFO:tasks.workunit.client.0.smithi052.stdout:7/596: write d6/dc/fba [46024,86091] 0 2024-09-12T18:03:23.346 INFO:tasks.workunit.client.0.smithi052.stdout:4/747: mkdir d11/d17/d1b/d2a/dbe/d104 0 2024-09-12T18:03:23.346 INFO:tasks.workunit.client.0.smithi052.stdout:3/612: symlink d0/d4/d25/d2a/d6/d7/dab/ldc 0 2024-09-12T18:03:23.347 INFO:tasks.workunit.client.0.smithi052.stdout:0/607: readlink d2/d6/dd/d21/d41/d44/l84 0 2024-09-12T18:03:23.348 INFO:tasks.workunit.client.0.smithi052.stdout:7/597: creat d6/d12/fc5 x:0 0 0 2024-09-12T18:03:23.348 INFO:tasks.workunit.client.0.smithi052.stdout:1/512: dread d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/fa1 [8388608,4194304] 0 2024-09-12T18:03:23.349 INFO:tasks.workunit.client.0.smithi052.stdout:7/598: readlink d6/dc/d1a/l77 0 2024-09-12T18:03:23.349 INFO:tasks.workunit.client.0.smithi052.stdout:5/591: dread d7/d1f/f8c [0,4194304] 0 2024-09-12T18:03:23.350 INFO:tasks.workunit.client.0.smithi052.stdout:7/599: fsync d6/d12/d1e/d29/d5d/f65 0 2024-09-12T18:03:23.350 INFO:tasks.workunit.client.0.smithi052.stdout:6/695: truncate d2/fb 6228499 0 2024-09-12T18:03:23.351 INFO:tasks.workunit.client.0.smithi052.stdout:0/608: truncate d2/d6/dd/d21/d26/d2f/f6b 1670052 0 2024-09-12T18:03:23.351 INFO:tasks.workunit.client.0.smithi052.stdout:6/696: mkdir d2/d21/ded 0 2024-09-12T18:03:23.352 INFO:tasks.workunit.client.0.smithi052.stdout:0/609: fsync d2/f29 0 2024-09-12T18:03:23.352 INFO:tasks.workunit.client.0.smithi052.stdout:5/592: getdents d7/d1f/d3a/d49/d54 0 2024-09-12T18:03:23.353 INFO:tasks.workunit.client.0.smithi052.stdout:7/600: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/fc6 x:0 0 0 2024-09-12T18:03:23.354 INFO:tasks.workunit.client.0.smithi052.stdout:1/513: truncate d3/d1d/d22/d27/d28/f7a 325162 0 2024-09-12T18:03:23.355 INFO:tasks.workunit.client.0.smithi052.stdout:0/610: rmdir d2/d6/dd 39 2024-09-12T18:03:23.355 INFO:tasks.workunit.client.0.smithi052.stdout:5/593: mknod d7/d59/d84/cbd 0 2024-09-12T18:03:23.356 INFO:tasks.workunit.client.0.smithi052.stdout:7/601: rename d6/cc0 to d6/d12/d1e/d29/da1/cc7 0 2024-09-12T18:03:23.357 INFO:tasks.workunit.client.0.smithi052.stdout:0/611: symlink d2/d1b/lba 0 2024-09-12T18:03:23.357 INFO:tasks.workunit.client.0.smithi052.stdout:6/697: write d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/faf [624525,102879] 0 2024-09-12T18:03:23.358 INFO:tasks.workunit.client.0.smithi052.stdout:2/603: dread da/dc/d15/d43/fb8 [0,4194304] 0 2024-09-12T18:03:23.359 INFO:tasks.workunit.client.0.smithi052.stdout:3/613: dwrite d0/d4b/d4c/d6b/d48/f56 [0,4194304] 0 2024-09-12T18:03:23.359 INFO:tasks.workunit.client.0.smithi052.stdout:4/748: dwrite d11/d65/dd1/d3b/d3f/f59 [0,4194304] 0 2024-09-12T18:03:23.359 INFO:tasks.workunit.client.0.smithi052.stdout:6/698: read - d2/d21/d9f/dd7/de7/fd3 zero size 2024-09-12T18:03:23.360 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:23.361 INFO:tasks.workunit.client.0.smithi052.stdout:2/604: truncate da/d21/d6b/f8c 5233945 0 2024-09-12T18:03:23.361 INFO:tasks.workunit.client.0.smithi052.stdout:5/594: rename d7/d1f/d3a/d49/d54 to d7/d59/dbe 0 2024-09-12T18:03:23.362 INFO:tasks.workunit.client.0.smithi052.stdout:6/699: creat d2/d21/d6a/fee x:0 0 0 2024-09-12T18:03:23.362 INFO:tasks.workunit.client.0.smithi052.stdout:2/605: rmdir da/d1d/d35 39 2024-09-12T18:03:23.362 INFO:tasks.workunit.client.0.smithi052.stdout:3/614: rename d0/d4/d25 to d0/d4/d25/d2a/d6/d7/ddd 22 2024-09-12T18:03:23.363 INFO:tasks.workunit.client.0.smithi052.stdout:5/595: creat d7/d59/d5c/fbf x:0 0 0 2024-09-12T18:03:23.363 INFO:tasks.workunit.client.0.smithi052.stdout:3/615: readlink d0/d16/l5f 0 2024-09-12T18:03:23.363 INFO:tasks.workunit.client.0.smithi052.stdout:6/700: truncate d2/fb 6713800 0 2024-09-12T18:03:23.364 INFO:tasks.workunit.client.0.smithi052.stdout:3/616: dread - d0/d4/d25/f81 zero size 2024-09-12T18:03:23.364 INFO:tasks.workunit.client.0.smithi052.stdout:9/594: dread d0/d18/d26/d33/f62 [0,4194304] 0 2024-09-12T18:03:23.364 INFO:tasks.workunit.client.0.smithi052.stdout:3/617: chown d0/d4/d25/d2a/d6/d7/d34/d71/dd3 1227 1 2024-09-12T18:03:23.366 INFO:tasks.workunit.client.0.smithi052.stdout:1/514: truncate d3/f8 2418413 0 2024-09-12T18:03:23.367 INFO:tasks.workunit.client.0.smithi052.stdout:4/749: write d11/d65/dc6/f97 [895296,123933] 0 2024-09-12T18:03:23.367 INFO:tasks.workunit.client.0.smithi052.stdout:7/602: link d6/d12/d1e/d29/d5d/d71/d3a/d8f/c63 d6/d12/d17/dac/cc8 0 2024-09-12T18:03:23.367 INFO:tasks.workunit.client.0.smithi052.stdout:6/701: mknod d2/d5e/cef 0 2024-09-12T18:03:23.367 INFO:tasks.workunit.client.0.smithi052.stdout:2/606: creat da/dc/d15/fc8 x:0 0 0 2024-09-12T18:03:23.368 INFO:tasks.workunit.client.0.smithi052.stdout:3/618: mkdir d0/d4/d25/d2a/d6/d7/d34/d71/dde 0 2024-09-12T18:03:23.369 INFO:tasks.workunit.client.0.smithi052.stdout:4/750: chown d11/d17/d1b/df9/dfd/l7c 137996 1 2024-09-12T18:03:23.369 INFO:tasks.workunit.client.0.smithi052.stdout:7/603: creat d6/d12/d1e/d29/d5d/d71/d9e/fc9 x:0 0 0 2024-09-12T18:03:23.370 INFO:tasks.workunit.client.0.smithi052.stdout:2/607: mkdir da/d21/da2/dc9 0 2024-09-12T18:03:23.370 INFO:tasks.workunit.client.0.smithi052.stdout:1/515: rename d3/d1d/d22/d27/d28/d2f/c65 to d3/d1d/d22/d27/ca7 0 2024-09-12T18:03:23.371 INFO:tasks.workunit.client.0.smithi052.stdout:7/604: chown d6/d12/fbc 53 1 2024-09-12T18:03:23.371 INFO:tasks.workunit.client.0.smithi052.stdout:6/702: rename d2/d21/d9f/dd7/de7/f99 to d2/d5e/ff0 0 2024-09-12T18:03:23.371 INFO:tasks.workunit.client.0.smithi052.stdout:5/596: dwrite d7/d51/f9a [0,4194304] 0 2024-09-12T18:03:23.371 INFO:tasks.workunit.client.0.smithi052.stdout:4/751: chown d11/d17/d1b/f20 242493997 1 2024-09-12T18:03:23.373 INFO:tasks.workunit.client.0.smithi052.stdout:2/608: creat da/dc/d15/d43/fca x:0 0 0 2024-09-12T18:03:23.373 INFO:tasks.workunit.client.0.smithi052.stdout:5/597: mknod d7/d1f/d3a/d49/cc0 0 2024-09-12T18:03:23.373 INFO:tasks.workunit.client.0.smithi052.stdout:6/703: symlink d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea/lf1 0 2024-09-12T18:03:23.374 INFO:tasks.workunit.client.0.smithi052.stdout:4/752: link d11/d17/d1b/d2a/dbe/dc5/dc7/cca d11/d46/dd9/c105 0 2024-09-12T18:03:23.376 INFO:tasks.workunit.client.0.smithi052.stdout:5/598: chown d7/d1c/d1e/l5e 230969 1 2024-09-12T18:03:23.376 INFO:tasks.workunit.client.0.smithi052.stdout:0/612: dread d2/f31 [0,4194304] 0 2024-09-12T18:03:23.377 INFO:tasks.workunit.client.0.smithi052.stdout:8/717: sync 2024-09-12T18:03:23.377 INFO:tasks.workunit.client.0.smithi052.stdout:6/704: rename d2/d80/c39 to d2/d21/d9f/dd7/de7/d58/d5d/d87/cf2 0 2024-09-12T18:03:23.378 INFO:tasks.workunit.client.0.smithi052.stdout:3/619: dread d0/d4/d25/d2a/f32 [4194304,4194304] 0 2024-09-12T18:03:23.378 INFO:tasks.workunit.client.0.smithi052.stdout:5/599: write d7/f1a [703365,2598] 0 2024-09-12T18:03:23.379 INFO:tasks.workunit.client.0.smithi052.stdout:0/613: write d2/d6/dd/f60 [1502237,118966] 0 2024-09-12T18:03:23.379 INFO:tasks.workunit.client.0.smithi052.stdout:8/718: creat d13/d35/de1/feb x:0 0 0 2024-09-12T18:03:23.380 INFO:tasks.workunit.client.0.smithi052.stdout:1/516: dwrite d3/d10/f26 [0,4194304] 0 2024-09-12T18:03:23.380 INFO:tasks.workunit.client.0.smithi052.stdout:4/753: truncate d11/d17/d1b/d2a/d6a/d7f/d90/ff0 1026268 0 2024-09-12T18:03:23.381 INFO:tasks.workunit.client.0.smithi052.stdout:3/620: readlink d0/d16/d7c/d85/lbd 0 2024-09-12T18:03:23.381 INFO:tasks.workunit.client.0.smithi052.stdout:4/754: fdatasync d11/d65/dc6/f81 0 2024-09-12T18:03:23.382 INFO:tasks.workunit.client.0.smithi052.stdout:6/705: mkdir d2/d21/d9f/dd7/de7/d54/dd5/df3 0 2024-09-12T18:03:23.383 INFO:tasks.workunit.client.0.smithi052.stdout:1/517: mknod d3/d1d/d22/d3f/ca8 0 2024-09-12T18:03:23.383 INFO:tasks.workunit.client.0.smithi052.stdout:2/609: dwrite da/dc/d15/d22/f84 [0,4194304] 0 2024-09-12T18:03:23.383 INFO:tasks.workunit.client.0.smithi052.stdout:0/614: mknod d2/d1b/d72/cbb 0 2024-09-12T18:03:23.384 INFO:tasks.workunit.client.0.smithi052.stdout:6/706: write d2/d21/d6a/fa7 [157403,2612] 0 2024-09-12T18:03:23.385 INFO:tasks.workunit.client.0.smithi052.stdout:4/755: rename d11/d65/dc6/f81 to d11/d17/d1b/d2a/d6a/d7f/f106 0 2024-09-12T18:03:23.388 INFO:tasks.workunit.client.0.smithi052.stdout:2/610: fsync da/d1d/f1e 0 2024-09-12T18:03:23.389 INFO:tasks.workunit.client.0.smithi052.stdout:6/707: fsync d2/d49/f7a 0 2024-09-12T18:03:23.389 INFO:tasks.workunit.client.0.smithi052.stdout:0/615: truncate d2/f4f 1025037 0 2024-09-12T18:03:23.389 INFO:tasks.workunit.client.0.smithi052.stdout:6/708: read - d2/d5e/fc3 zero size 2024-09-12T18:03:23.389 INFO:tasks.workunit.client.0.smithi052.stdout:0/616: chown d2/d1b/d80/lb5 145129123 1 2024-09-12T18:03:23.389 INFO:tasks.workunit.client.0.smithi052.stdout:0/617: mknod d2/d1b/d72/cbc 0 2024-09-12T18:03:23.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/518: dread d3/d1d/d22/d3f/f5f [0,4194304] 0 2024-09-12T18:03:23.389 INFO:tasks.workunit.client.0.smithi052.stdout:5/600: dwrite d7/d1c/f95 [0,4194304] 0 2024-09-12T18:03:23.390 INFO:tasks.workunit.client.0.smithi052.stdout:6/709: write d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f2d [25569,58664] 0 2024-09-12T18:03:23.390 INFO:tasks.workunit.client.0.smithi052.stdout:4/756: rename d11/d17/d1b/d2a/dbe to d11/d65/dc6/daf/d107 0 2024-09-12T18:03:23.390 INFO:tasks.workunit.client.0.smithi052.stdout:1/519: chown d3/d69/d89/f95 556929 1 2024-09-12T18:03:23.391 INFO:tasks.workunit.client.0.smithi052.stdout:5/601: fdatasync d7/d1f/d34/fac 0 2024-09-12T18:03:23.392 INFO:tasks.workunit.client.0.smithi052.stdout:4/757: chown d11/d17/d1b/d2a/l79 21776316 1 2024-09-12T18:03:23.392 INFO:tasks.workunit.client.0.smithi052.stdout:5/602: chown d7/d59/dbe 671418 1 2024-09-12T18:03:23.393 INFO:tasks.workunit.client.0.smithi052.stdout:6/710: read - d2/d21/d9f/dd7/de7/d58/d5d/d9c/fde zero size 2024-09-12T18:03:23.394 INFO:tasks.workunit.client.0.smithi052.stdout:0/618: rename d2/d6/dd/d21/d26/d2f/l97 to d2/d6/dd/d21/d26/d2f/lbd 0 2024-09-12T18:03:23.394 INFO:tasks.workunit.client.0.smithi052.stdout:4/758: mknod d11/d46/db8/c108 0 2024-09-12T18:03:23.394 INFO:tasks.workunit.client.0.smithi052.stdout:5/603: dread - d7/d59/f97 zero size 2024-09-12T18:03:23.395 INFO:tasks.workunit.client.0.smithi052.stdout:9/595: dread d0/f10 [0,4194304] 0 2024-09-12T18:03:23.395 INFO:tasks.workunit.client.0.smithi052.stdout:0/619: readlink d2/l3 0 2024-09-12T18:03:23.395 INFO:tasks.workunit.client.0.smithi052.stdout:2/611: dwrite da/d2c/f9a [0,4194304] 0 2024-09-12T18:03:23.395 INFO:tasks.workunit.client.0.smithi052.stdout:9/596: stat d0/d18/f9a 0 2024-09-12T18:03:23.395 INFO:tasks.workunit.client.0.smithi052.stdout:1/520: truncate d3/d1d/d22/d27/d28/d2f/f46 586044 0 2024-09-12T18:03:23.396 INFO:tasks.workunit.client.0.smithi052.stdout:5/604: symlink d7/d59/d5c/d7c/lc1 0 2024-09-12T18:03:23.396 INFO:tasks.workunit.client.0.smithi052.stdout:6/711: dread - d2/d21/d9f/dd7/de7/d58/d5d/d9c/fde zero size 2024-09-12T18:03:23.396 INFO:tasks.workunit.client.0.smithi052.stdout:0/620: creat d2/d6/dd/fbe x:0 0 0 2024-09-12T18:03:23.397 INFO:tasks.workunit.client.0.smithi052.stdout:1/521: chown d3/d1d/d22/d27/d28/d2f/l73 80265 1 2024-09-12T18:03:23.397 INFO:tasks.workunit.client.0.smithi052.stdout:9/597: rename d0/da3/db8/fc4 to d0/d6/d94/fc9 0 2024-09-12T18:03:23.398 INFO:tasks.workunit.client.0.smithi052.stdout:6/712: mknod d2/d21/d6a/d97/cf4 0 2024-09-12T18:03:23.398 INFO:tasks.workunit.client.0.smithi052.stdout:5/605: dread - d7/d1c/d1e/d98/fa2 zero size 2024-09-12T18:03:23.398 INFO:tasks.workunit.client.0.smithi052.stdout:2/612: truncate da/dc/d15/d22/d87/fc6 782014 0 2024-09-12T18:03:23.398 INFO:tasks.workunit.client.0.smithi052.stdout:0/621: creat d2/d1b/d80/da3/fbf x:0 0 0 2024-09-12T18:03:23.398 INFO:tasks.workunit.client.0.smithi052.stdout:1/522: fsync d3/d1d/d22/d66/f97 0 2024-09-12T18:03:23.399 INFO:tasks.workunit.client.0.smithi052.stdout:5/606: mknod d7/d1f/d34/cc2 0 2024-09-12T18:03:23.399 INFO:tasks.workunit.client.0.smithi052.stdout:6/713: mkdir d2/d21/ded/df5 0 2024-09-12T18:03:23.403 INFO:tasks.workunit.client.0.smithi052.stdout:1/523: link d3/d10/d38/d44/c63 d3/d1d/d83/ca9 0 2024-09-12T18:03:23.403 INFO:tasks.workunit.client.0.smithi052.stdout:7/605: dread d6/d12/d17/f52 [0,4194304] 0 2024-09-12T18:03:23.404 INFO:tasks.workunit.client.0.smithi052.stdout:6/714: link d2/dc6/l6d d2/d21/d9f/dd7/lf6 0 2024-09-12T18:03:23.406 INFO:tasks.workunit.client.0.smithi052.stdout:1/524: read - d3/d69/d89/f95 zero size 2024-09-12T18:03:23.406 INFO:tasks.workunit.client.0.smithi052.stdout:2/613: dread da/dc/d15/d22/fac [0,4194304] 0 2024-09-12T18:03:23.407 INFO:tasks.workunit.client.0.smithi052.stdout:4/759: dwrite d11/d17/d1b/d2a/d33/f8c [0,4194304] 0 2024-09-12T18:03:23.408 INFO:tasks.workunit.client.0.smithi052.stdout:0/622: dwrite d2/d6/dd/d21/d41/d44/d48/f9a [0,4194304] 0 2024-09-12T18:03:23.408 INFO:tasks.workunit.client.0.smithi052.stdout:5/607: dread d7/d1c/f95 [0,4194304] 0 2024-09-12T18:03:23.409 INFO:tasks.workunit.client.0.smithi052.stdout:7/606: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca 0 2024-09-12T18:03:23.409 INFO:tasks.workunit.client.0.smithi052.stdout:4/760: fsync d11/d17/d1b/f20 0 2024-09-12T18:03:23.409 INFO:tasks.workunit.client.0.smithi052.stdout:5/608: creat d7/d1c/d6f/fc3 x:0 0 0 2024-09-12T18:03:23.411 INFO:tasks.workunit.client.0.smithi052.stdout:5/609: creat d7/d51/d8b/fc4 x:0 0 0 2024-09-12T18:03:23.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/614: dwrite da/d21/d6b/f8c [4194304,4194304] 0 2024-09-12T18:03:23.417 INFO:tasks.workunit.client.0.smithi052.stdout:0/623: dwrite d2/d6/dd/d21/d41/d59/fab [0,4194304] 0 2024-09-12T18:03:23.418 INFO:tasks.workunit.client.0.smithi052.stdout:8/719: dread d13/d3c/f3d [0,4194304] 0 2024-09-12T18:03:23.419 INFO:tasks.workunit.client.0.smithi052.stdout:2/615: write da/d1d/d7d/fc1 [923360,115729] 0 2024-09-12T18:03:23.420 INFO:tasks.workunit.client.0.smithi052.stdout:5/610: dread d7/d51/f9a [0,4194304] 0 2024-09-12T18:03:23.420 INFO:tasks.workunit.client.0.smithi052.stdout:7/607: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d83/f7c [0,4194304] 0 2024-09-12T18:03:23.421 INFO:tasks.workunit.client.0.smithi052.stdout:8/720: creat d13/fec x:0 0 0 2024-09-12T18:03:23.421 INFO:tasks.workunit.client.0.smithi052.stdout:7/608: fdatasync d6/dc/d1a/d6a/f8a 0 2024-09-12T18:03:23.422 INFO:tasks.workunit.client.0.smithi052.stdout:5/611: write d7/d1f/f4b [998434,7571] 0 2024-09-12T18:03:23.422 INFO:tasks.workunit.client.0.smithi052.stdout:8/721: chown d13/d18/d21/c87 69972168 1 2024-09-12T18:03:23.422 INFO:tasks.workunit.client.0.smithi052.stdout:4/761: write d11/d17/d1b/d2a/f61 [84879,15406] 0 2024-09-12T18:03:23.423 INFO:tasks.workunit.client.0.smithi052.stdout:7/609: mkdir d6/d12/d1e/d8e/dcb 0 2024-09-12T18:03:23.423 INFO:tasks.workunit.client.0.smithi052.stdout:8/722: symlink d13/d18/d21/d64/led 0 2024-09-12T18:03:23.424 INFO:tasks.workunit.client.0.smithi052.stdout:8/723: stat d13/d18/d21/f54 0 2024-09-12T18:03:23.424 INFO:tasks.workunit.client.0.smithi052.stdout:7/610: fsync d6/d12/d1e/d29/d5d/d71/d9e/fc9 0 2024-09-12T18:03:23.424 INFO:tasks.workunit.client.0.smithi052.stdout:5/612: write d7/d1c/d1e/d98/fa2 [771898,6915] 0 2024-09-12T18:03:23.426 INFO:tasks.workunit.client.0.smithi052.stdout:7/611: symlink d6/dc/lcc 0 2024-09-12T18:03:23.427 INFO:tasks.workunit.client.0.smithi052.stdout:8/724: rename d13/fec to d13/d3c/fee 0 2024-09-12T18:03:23.427 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:23.423+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:23.428 INFO:tasks.workunit.client.0.smithi052.stdout:3/621: sync 2024-09-12T18:03:23.429 INFO:tasks.workunit.client.0.smithi052.stdout:6/715: sync 2024-09-12T18:03:23.429 INFO:tasks.workunit.client.0.smithi052.stdout:0/624: dwrite d2/d57/d5b/f64 [4194304,4194304] 0 2024-09-12T18:03:23.429 INFO:tasks.workunit.client.0.smithi052.stdout:8/725: write d13/d18/f3e [648787,109726] 0 2024-09-12T18:03:23.429 INFO:tasks.workunit.client.0.smithi052.stdout:6/716: unlink d2/d21/f95 0 2024-09-12T18:03:23.430 INFO:tasks.workunit.client.0.smithi052.stdout:0/625: mknod d2/d1b/d80/cc0 0 2024-09-12T18:03:23.430 INFO:tasks.workunit.client.0.smithi052.stdout:8/726: stat d13/d18/d38/f46 0 2024-09-12T18:03:23.430 INFO:tasks.workunit.client.0.smithi052.stdout:0/626: chown d2/d51 511420 1 2024-09-12T18:03:23.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/525: dread d3/f25 [0,4194304] 0 2024-09-12T18:03:23.431 INFO:tasks.workunit.client.0.smithi052.stdout:3/622: rename d0/d4b/d57/d7a to d0/d16/d60/ddf 0 2024-09-12T18:03:23.431 INFO:tasks.workunit.client.0.smithi052.stdout:6/717: unlink d2/dc6/f45 0 2024-09-12T18:03:23.432 INFO:tasks.workunit.client.0.smithi052.stdout:5/613: read d7/d59/dbe/f5b [1714454,109045] 0 2024-09-12T18:03:23.432 INFO:tasks.workunit.client.0.smithi052.stdout:4/762: dwrite d11/d17/d1b/d2a/d33/f8c [0,4194304] 0 2024-09-12T18:03:23.432 INFO:tasks.workunit.client.0.smithi052.stdout:6/718: truncate d2/d15/fe0 249742 0 2024-09-12T18:03:23.432 INFO:tasks.workunit.client.0.smithi052.stdout:4/763: truncate d11/d17/d1b/df9/dfd/ff5 408973 0 2024-09-12T18:03:23.433 INFO:tasks.workunit.client.0.smithi052.stdout:4/764: write d11/d17/d1b/d2a/d6a/da8/fcb [2148535,392] 0 2024-09-12T18:03:23.435 INFO:tasks.workunit.client.0.smithi052.stdout:3/623: rmdir d0/d4/d25/d2a/d6/d7/de/da1 39 2024-09-12T18:03:23.436 INFO:tasks.workunit.client.0.smithi052.stdout:0/627: creat d2/d6/dd/d21/d41/d44/fc1 x:0 0 0 2024-09-12T18:03:23.436 INFO:tasks.workunit.client.0.smithi052.stdout:5/614: getdents d7/d1f/d34 0 2024-09-12T18:03:23.437 INFO:tasks.workunit.client.0.smithi052.stdout:6/719: getdents d2/d21/d9f 0 2024-09-12T18:03:23.437 INFO:tasks.workunit.client.0.smithi052.stdout:4/765: creat d11/d17/d1b/d2a/d6a/d7f/dd6/f109 x:0 0 0 2024-09-12T18:03:23.437 INFO:tasks.workunit.client.0.smithi052.stdout:1/526: truncate d3/d10/d38/d44/d49/f8e 239598 0 2024-09-12T18:03:23.438 INFO:tasks.workunit.client.0.smithi052.stdout:0/628: read d2/d6/dd/d21/f35 [2354362,47301] 0 2024-09-12T18:03:23.439 INFO:tasks.workunit.client.0.smithi052.stdout:2/616: dread da/dc/d15/f92 [0,4194304] 0 2024-09-12T18:03:23.439 INFO:tasks.workunit.client.0.smithi052.stdout:1/527: write d3/d69/f7e [3716329,113054] 0 2024-09-12T18:03:23.439 INFO:tasks.workunit.client.0.smithi052.stdout:6/720: write d2/d21/d9f/dd7/de7/fd3 [574359,18257] 0 2024-09-12T18:03:23.440 INFO:tasks.workunit.client.0.smithi052.stdout:3/624: mkdir d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/de0 0 2024-09-12T18:03:23.440 INFO:tasks.workunit.client.0.smithi052.stdout:0/629: chown d2/d1b/d80/da3/fb8 18976 1 2024-09-12T18:03:23.440 INFO:tasks.workunit.client.0.smithi052.stdout:8/727: dwrite d13/d18/d21/f23 [0,4194304] 0 2024-09-12T18:03:23.441 INFO:tasks.workunit.client.0.smithi052.stdout:6/721: chown d2/d21/d9f/dd7/de7/d58/cc5 119 1 2024-09-12T18:03:23.441 INFO:tasks.workunit.client.0.smithi052.stdout:7/612: truncate d6/dc/f50 2898494 0 2024-09-12T18:03:23.442 INFO:tasks.workunit.client.0.smithi052.stdout:8/728: rename d13/d3c/cd4 to d13/d18/d21/d64/cef 0 2024-09-12T18:03:23.442 INFO:tasks.workunit.client.0.smithi052.stdout:0/630: rmdir d2/d6/dd/d81 0 2024-09-12T18:03:23.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/613: creat d6/d9b/fcd x:0 0 0 2024-09-12T18:03:23.443 INFO:tasks.workunit.client.0.smithi052.stdout:8/729: fsync d13/d18/d21/f50 0 2024-09-12T18:03:23.444 INFO:tasks.workunit.client.0.smithi052.stdout:7/614: readlink d6/d12/d1e/d29/d5d/d71/d3a/l60 0 2024-09-12T18:03:23.444 INFO:tasks.workunit.client.0.smithi052.stdout:9/598: sync 2024-09-12T18:03:23.444 INFO:tasks.workunit.client.0.smithi052.stdout:4/766: sync 2024-09-12T18:03:23.446 INFO:tasks.workunit.client.0.smithi052.stdout:8/730: creat d13/d18/d21/ff0 x:0 0 0 2024-09-12T18:03:23.446 INFO:tasks.workunit.client.0.smithi052.stdout:9/599: mknod d0/d6/d3a/d43/cca 0 2024-09-12T18:03:23.447 INFO:tasks.workunit.client.0.smithi052.stdout:4/767: write d11/d65/dc6/d95/dbf/d8e/fc1 [532427,42017] 0 2024-09-12T18:03:23.451 INFO:tasks.workunit.client.0.smithi052.stdout:8/731: link d13/d18/d21/fb7 d13/d18/d21/ddd/ff1 0 2024-09-12T18:03:23.451 INFO:tasks.workunit.client.0.smithi052.stdout:6/722: dwrite d2/d80/fa4 [0,4194304] 0 2024-09-12T18:03:23.451 INFO:tasks.workunit.client.0.smithi052.stdout:3/625: dwrite d0/d4/d25/d2a/d6/d7/f2b [0,4194304] 0 2024-09-12T18:03:23.452 INFO:tasks.workunit.client.0.smithi052.stdout:4/768: write d11/d17/d1b/d2a/d6a/ff8 [688675,32212] 0 2024-09-12T18:03:23.453 INFO:tasks.workunit.client.0.smithi052.stdout:8/732: fsync d13/d35/de1/fe8 0 2024-09-12T18:03:23.457 INFO:tasks.workunit.client.0.smithi052.stdout:7/615: dwrite d6/d12/d1e/f6d [4194304,4194304] 0 2024-09-12T18:03:23.457 INFO:tasks.workunit.client.0.smithi052.stdout:4/769: symlink d11/d17/d1b/d2a/d6a/d7f/d90/l10a 0 2024-09-12T18:03:23.457 INFO:tasks.workunit.client.0.smithi052.stdout:6/723: rmdir d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1 39 2024-09-12T18:03:23.459 INFO:tasks.workunit.client.0.smithi052.stdout:3/626: getdents d0/d4/d25/d2a/d6/d7/d34/d71 0 2024-09-12T18:03:23.459 INFO:tasks.workunit.client.0.smithi052.stdout:7/616: write d6/f89 [1490738,81343] 0 2024-09-12T18:03:23.459 INFO:tasks.workunit.client.0.smithi052.stdout:4/770: creat d11/d17/d1b/d2a/d33/f10b x:0 0 0 2024-09-12T18:03:23.460 INFO:tasks.workunit.client.0.smithi052.stdout:6/724: mknod d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea/cf7 0 2024-09-12T18:03:23.460 INFO:tasks.workunit.client.0.smithi052.stdout:9/600: dwrite d0/d18/fae [0,4194304] 0 2024-09-12T18:03:23.460 INFO:tasks.workunit.client.0.smithi052.stdout:4/771: mknod d11/d65/dd1/d72/c10c 0 2024-09-12T18:03:23.461 INFO:tasks.workunit.client.0.smithi052.stdout:7/617: chown d6/d12/d1e/d29/d5d/d71/d3a/d83 8 1 2024-09-12T18:03:23.462 INFO:tasks.workunit.client.0.smithi052.stdout:4/772: mkdir d11/d65/dd1/d72/d10d 0 2024-09-12T18:03:23.464 INFO:tasks.workunit.client.0.smithi052.stdout:4/773: fsync d11/d65/dc6/f97 0 2024-09-12T18:03:23.464 INFO:tasks.workunit.client.0.smithi052.stdout:1/528: dread d3/d10/d38/f9c [0,4194304] 0 2024-09-12T18:03:23.465 INFO:tasks.workunit.client.0.smithi052.stdout:4/774: symlink d11/d65/dc6/daf/d102/l10e 0 2024-09-12T18:03:23.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/733: truncate d13/d18/d5b/d70/f97 56446 0 2024-09-12T18:03:23.467 INFO:tasks.workunit.client.0.smithi052.stdout:4/775: unlink d11/d17/d1b/df9/dfd/l9d 0 2024-09-12T18:03:23.468 INFO:tasks.workunit.client.0.smithi052.stdout:9/601: write d0/d6/fc5 [3684132,49780] 0 2024-09-12T18:03:23.469 INFO:tasks.workunit.client.0.smithi052.stdout:4/776: mknod d11/d17/d1b/c10f 0 2024-09-12T18:03:23.469 INFO:tasks.workunit.client.0.smithi052.stdout:8/734: read d13/fe7 [1175251,100356] 0 2024-09-12T18:03:23.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/725: dwrite d2/d21/d6a/d97/fc0 [0,4194304] 0 2024-09-12T18:03:23.470 INFO:tasks.workunit.client.0.smithi052.stdout:9/602: dread - d0/d1c/f99 zero size 2024-09-12T18:03:23.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/735: readlink d13/d18/d5b/d70/l98 0 2024-09-12T18:03:23.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/603: fdatasync d0/f10 0 2024-09-12T18:03:23.472 INFO:tasks.workunit.client.0.smithi052.stdout:7/618: dwrite d6/dc/d1a/d6a/f8b [0,4194304] 0 2024-09-12T18:03:23.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/736: dread - d13/d9b/fd8 zero size 2024-09-12T18:03:23.473 INFO:tasks.workunit.client.0.smithi052.stdout:4/777: creat d11/d65/dd1/d3b/f110 x:0 0 0 2024-09-12T18:03:23.473 INFO:tasks.workunit.client.0.smithi052.stdout:2/617: dread da/d71/fb0 [0,4194304] 0 2024-09-12T18:03:23.473 INFO:tasks.workunit.client.0.smithi052.stdout:4/778: sync 2024-09-12T18:03:23.473 INFO:tasks.workunit.client.0.smithi052.stdout:6/726: rmdir d2/d21/d9f/dd7/de7/d58/d5d 39 2024-09-12T18:03:23.474 INFO:tasks.workunit.client.0.smithi052.stdout:7/619: chown d6/d12/d1e/la4 4272 1 2024-09-12T18:03:23.474 INFO:tasks.workunit.client.0.smithi052.stdout:2/618: symlink da/dc/d76/lcb 0 2024-09-12T18:03:23.475 INFO:tasks.workunit.client.0.smithi052.stdout:1/529: dwrite d3/d10/fa0 [0,4194304] 0 2024-09-12T18:03:23.475 INFO:tasks.workunit.client.0.smithi052.stdout:3/627: dread d0/d4b/d4c/d6b/d48/f51 [0,4194304] 0 2024-09-12T18:03:23.475 INFO:tasks.workunit.client.0.smithi052.stdout:3/628: sync 2024-09-12T18:03:23.475 INFO:tasks.workunit.client.0.smithi052.stdout:9/604: write d0/da3/db8/fa4 [2449812,12165] 0 2024-09-12T18:03:23.476 INFO:tasks.workunit.client.0.smithi052.stdout:4/779: write d11/d17/d1b/d2a/d33/f10b [431300,111627] 0 2024-09-12T18:03:23.477 INFO:tasks.workunit.client.0.smithi052.stdout:5/615: dread d7/d1f/d3a/d49/f87 [0,4194304] 0 2024-09-12T18:03:23.479 INFO:tasks.workunit.client.0.smithi052.stdout:6/727: mknod d2/cf8 0 2024-09-12T18:03:23.480 INFO:tasks.workunit.client.0.smithi052.stdout:4/780: creat d11/d17/d1b/df9/f111 x:0 0 0 2024-09-12T18:03:23.480 INFO:tasks.workunit.client.0.smithi052.stdout:3/629: mkdir d0/d4/d25/d2a/d6/d7/d79/de1 0 2024-09-12T18:03:23.480 INFO:tasks.workunit.client.0.smithi052.stdout:1/530: rename d3/d1d/d22/d3f/d56/l61 to d3/d10/d38/d44/d49/laa 0 2024-09-12T18:03:23.480 INFO:tasks.workunit.client.0.smithi052.stdout:5/616: readlink d7/d1f/d45/l4a 0 2024-09-12T18:03:23.482 INFO:tasks.workunit.client.0.smithi052.stdout:7/620: link d6/dc/d1a/d6a/f8a d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/fce 0 2024-09-12T18:03:23.482 INFO:tasks.workunit.client.0.smithi052.stdout:1/531: unlink d3/d1d/d22/d27/d28/d2f/c3b 0 2024-09-12T18:03:23.483 INFO:tasks.workunit.client.0.smithi052.stdout:5/617: mknod d7/d1c/d1e/cc5 0 2024-09-12T18:03:23.483 INFO:tasks.workunit.client.0.smithi052.stdout:7/621: symlink d6/d12/d1e/dae/lcf 0 2024-09-12T18:03:23.483 INFO:tasks.workunit.client.0.smithi052.stdout:5/618: chown d7/d1f/d34/l5f 1032 1 2024-09-12T18:03:23.484 INFO:tasks.workunit.client.0.smithi052.stdout:5/619: mkdir d7/d51/dc6 0 2024-09-12T18:03:23.486 INFO:tasks.workunit.client.0.smithi052.stdout:4/781: dwrite d11/d17/d1b/f2d [8388608,4194304] 0 2024-09-12T18:03:23.486 INFO:tasks.workunit.client.0.smithi052.stdout:5/620: link d7/d1c/c74 d7/d1c/d67/cc7 0 2024-09-12T18:03:23.487 INFO:tasks.workunit.client.0.smithi052.stdout:4/782: dread - d11/d65/dc6/d95/fe8 zero size 2024-09-12T18:03:23.488 INFO:tasks.workunit.client.0.smithi052.stdout:6/728: dread d2/d21/d9f/dd7/de7/d54/f62 [0,4194304] 0 2024-09-12T18:03:23.488 INFO:tasks.workunit.client.0.smithi052.stdout:4/783: mknod d11/d65/c112 0 2024-09-12T18:03:23.489 INFO:tasks.workunit.client.0.smithi052.stdout:6/729: mknod d2/d5e/cf9 0 2024-09-12T18:03:23.489 INFO:tasks.workunit.client.0.smithi052.stdout:4/784: fsync f8 0 2024-09-12T18:03:23.489 INFO:tasks.workunit.client.0.smithi052.stdout:0/631: dread d2/d8/f1c [0,4194304] 0 2024-09-12T18:03:23.491 INFO:tasks.workunit.client.0.smithi052.stdout:0/632: symlink d2/d6/dd/dad/lc2 0 2024-09-12T18:03:23.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/621: dread d7/d51/f9a [0,4194304] 0 2024-09-12T18:03:23.492 INFO:tasks.workunit.client.0.smithi052.stdout:4/785: rename d11/d65/dc6/d68/fb9 to d11/d17/d1b/d2a/f113 0 2024-09-12T18:03:23.493 INFO:tasks.workunit.client.0.smithi052.stdout:5/622: creat d7/d1c/d1e/d98/fc8 x:0 0 0 2024-09-12T18:03:23.493 INFO:tasks.workunit.client.0.smithi052.stdout:7/622: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb4 [0,4194304] 0 2024-09-12T18:03:23.493 INFO:tasks.workunit.client.0.smithi052.stdout:4/786: write d11/fbb [3062872,15844] 0 2024-09-12T18:03:23.494 INFO:tasks.workunit.client.0.smithi052.stdout:5/623: fdatasync d7/d59/d5c/d7c/f9b 0 2024-09-12T18:03:23.494 INFO:tasks.workunit.client.0.smithi052.stdout:7/623: stat d6/d12/d1e/dae/lcf 0 2024-09-12T18:03:23.495 INFO:tasks.workunit.client.0.smithi052.stdout:4/787: mkdir d11/d65/d114 0 2024-09-12T18:03:23.496 INFO:tasks.workunit.client.0.smithi052.stdout:6/730: dwrite d2/dc6/fdc [0,4194304] 0 2024-09-12T18:03:23.499 INFO:tasks.workunit.client.0.smithi052.stdout:8/737: truncate d13/fe7 1076653 0 2024-09-12T18:03:23.499 INFO:tasks.workunit.client.0.smithi052.stdout:2/619: truncate da/d2c/f3b 2703407 0 2024-09-12T18:03:23.500 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:23.500 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:23.500 INFO:tasks.workunit.client.0.smithi052.stdout:3/630: dread d0/d4/d25/fa8 [0,4194304] 0 2024-09-12T18:03:23.500 INFO:tasks.workunit.client.0.smithi052.stdout:6/731: mknod d2/d21/d9f/dd7/de7/cfa 0 2024-09-12T18:03:23.500 INFO:tasks.workunit.client.0.smithi052.stdout:8/738: fdatasync d13/d35/d9c/da3/fad 0 2024-09-12T18:03:23.501 INFO:tasks.workunit.client.0.smithi052.stdout:0/633: dwrite d2/d6/dd/f17 [0,4194304] 0 2024-09-12T18:03:23.502 INFO:tasks.workunit.client.0.smithi052.stdout:6/732: mknod d2/dc6/cfb 0 2024-09-12T18:03:23.502 INFO:tasks.workunit.client.0.smithi052.stdout:5/624: dwrite d7/d51/fb6 [0,4194304] 0 2024-09-12T18:03:23.502 INFO:tasks.workunit.client.0.smithi052.stdout:2/620: creat da/dc/fcc x:0 0 0 2024-09-12T18:03:23.503 INFO:tasks.workunit.client.0.smithi052.stdout:8/739: mknod d13/d18/d5b/cf2 0 2024-09-12T18:03:23.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/532: write d3/f8 [2451929,59948] 0 2024-09-12T18:03:23.504 INFO:tasks.workunit.client.0.smithi052.stdout:8/740: getdents d13/ddc 0 2024-09-12T18:03:23.504 INFO:tasks.workunit.client.0.smithi052.stdout:2/621: mknod da/d1d/ccd 0 2024-09-12T18:03:23.505 INFO:tasks.workunit.client.0.smithi052.stdout:7/624: dread d6/d12/d1e/f6f [0,4194304] 0 2024-09-12T18:03:23.506 INFO:tasks.workunit.client.0.smithi052.stdout:8/741: truncate d13/d18/d21/fac 656603 0 2024-09-12T18:03:23.506 INFO:tasks.workunit.client.0.smithi052.stdout:3/631: mkdir d0/d4/d25/d2a/d6/d7/d34/d72/d83/de2 0 2024-09-12T18:03:23.507 INFO:tasks.workunit.client.0.smithi052.stdout:6/733: mknod d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea/cfc 0 2024-09-12T18:03:23.509 INFO:tasks.workunit.client.0.smithi052.stdout:7/625: fdatasync d6/dc/f50 0 2024-09-12T18:03:23.510 INFO:tasks.workunit.client.0.smithi052.stdout:5/625: write d7/d1f/f76 [1041289,29385] 0 2024-09-12T18:03:23.511 INFO:tasks.workunit.client.0.smithi052.stdout:4/788: truncate d11/d17/d1b/fd8 672939 0 2024-09-12T18:03:23.512 INFO:tasks.workunit.client.0.smithi052.stdout:1/533: dwrite d3/d1d/d22/d27/f81 [0,4194304] 0 2024-09-12T18:03:23.512 INFO:tasks.workunit.client.0.smithi052.stdout:7/626: mknod d6/d12/d1e/d8e/dcb/cd0 0 2024-09-12T18:03:23.513 INFO:tasks.workunit.client.0.smithi052.stdout:6/734: getdents d2/d21/d9f/dd7/de7/d54/dd5 0 2024-09-12T18:03:23.513 INFO:tasks.workunit.client.0.smithi052.stdout:3/632: rename d0/d4/d25/d2a/d6/d7/de/da1/fb2 to d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/de0/fe3 0 2024-09-12T18:03:23.513 INFO:tasks.workunit.client.0.smithi052.stdout:5/626: truncate d7/d59/fa7 836347 0 2024-09-12T18:03:23.514 INFO:tasks.workunit.client.0.smithi052.stdout:0/634: dwrite d2/d6/dd/d21/d41/d44/d48/f6a [0,4194304] 0 2024-09-12T18:03:23.514 INFO:tasks.workunit.client.0.smithi052.stdout:6/735: write d2/d5e/f93 [54762,80781] 0 2024-09-12T18:03:23.515 INFO:tasks.workunit.client.0.smithi052.stdout:3/633: chown d0/d4/d25/d2a/d6/d7/d34/l4d 0 1 2024-09-12T18:03:23.515 INFO:tasks.workunit.client.0.smithi052.stdout:0/635: fdatasync d2/d1b/d72/d69/f7b 0 2024-09-12T18:03:23.516 INFO:tasks.workunit.client.0.smithi052.stdout:3/634: chown d0/d4/d25/d2a/d2c 699 1 2024-09-12T18:03:23.516 INFO:tasks.workunit.client.0.smithi052.stdout:6/736: chown d2/d15/cab 47 1 2024-09-12T18:03:23.517 INFO:tasks.workunit.client.0.smithi052.stdout:8/742: truncate d13/d18/d5b/fb1 43156 0 2024-09-12T18:03:23.517 INFO:tasks.workunit.client.0.smithi052.stdout:1/534: creat d3/d1d/d22/d27/d28/d2f/fab x:0 0 0 2024-09-12T18:03:23.518 INFO:tasks.workunit.client.0.smithi052.stdout:5/627: getdents d7/d59/dbe 0 2024-09-12T18:03:23.518 INFO:tasks.workunit.client.0.smithi052.stdout:3/635: dread d0/d4b/d4c/f46 [0,4194304] 0 2024-09-12T18:03:23.518 INFO:tasks.workunit.client.0.smithi052.stdout:0/636: write d2/d6/dd/d21/d26/d2f/f5e [447215,48773] 0 2024-09-12T18:03:23.518 INFO:tasks.workunit.client.0.smithi052.stdout:1/535: unlink d3/d1d/f6f 0 2024-09-12T18:03:23.519 INFO:tasks.workunit.client.0.smithi052.stdout:0/637: chown d2/l2d 67749 1 2024-09-12T18:03:23.519 INFO:tasks.workunit.client.0.smithi052.stdout:1/536: mkdir d3/d10/d38/d44/dac 0 2024-09-12T18:03:23.521 INFO:tasks.workunit.client.0.smithi052.stdout:8/743: write d13/d18/d21/f59 [4672262,19107] 0 2024-09-12T18:03:23.522 INFO:tasks.workunit.client.0.smithi052.stdout:1/537: write d3/d1d/d22/d27/f90 [4236643,79734] 0 2024-09-12T18:03:23.523 INFO:tasks.workunit.client.0.smithi052.stdout:9/605: dread d0/d18/d26/d4d/d54/f5b [0,4194304] 0 2024-09-12T18:03:23.524 INFO:tasks.workunit.client.0.smithi052.stdout:9/606: sync 2024-09-12T18:03:23.524 INFO:tasks.workunit.client.0.smithi052.stdout:8/744: mkdir d13/ddc/df3 0 2024-09-12T18:03:23.524 INFO:tasks.workunit.client.0.smithi052.stdout:1/538: stat d3/d10/d38/d44/dac 0 2024-09-12T18:03:23.524 INFO:tasks.workunit.client.0.smithi052.stdout:7/627: write d6/dc/d1a/d6a/f8a [1930855,63852] 0 2024-09-12T18:03:23.525 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:23.526 INFO:tasks.workunit.client.0.smithi052.stdout:8/745: write d13/d35/de1/feb [148407,81576] 0 2024-09-12T18:03:23.526 INFO:tasks.workunit.client.0.smithi052.stdout:9/607: creat d0/d18/d26/d4d/fcb x:0 0 0 2024-09-12T18:03:23.526 INFO:tasks.workunit.client.0.smithi052.stdout:7/628: chown d6/dc/d1a/f54 28 1 2024-09-12T18:03:23.526 INFO:tasks.workunit.client.0.smithi052.stdout:0/638: dread d2/d6/dd/d21/d41/d59/fab [0,4194304] 0 2024-09-12T18:03:23.528 INFO:tasks.workunit.client.0.smithi052.stdout:8/746: rmdir d13/d18/d38 39 2024-09-12T18:03:23.528 INFO:tasks.workunit.client.0.smithi052.stdout:5/628: dwrite d7/d59/f65 [0,4194304] 0 2024-09-12T18:03:23.528 INFO:tasks.workunit.client.0.smithi052.stdout:1/539: write d3/d10/f85 [7310963,41587] 0 2024-09-12T18:03:23.528 INFO:tasks.workunit.client.0.smithi052.stdout:3/636: truncate d0/d4b/fc2 5983 0 2024-09-12T18:03:23.528 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:23.525+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:23.529 INFO:tasks.workunit.client.0.smithi052.stdout:8/747: chown d13/d18/d5b 15 1 2024-09-12T18:03:23.529 INFO:tasks.workunit.client.0.smithi052.stdout:9/608: write d0/d6/d3a/d43/f7a [3701659,39057] 0 2024-09-12T18:03:23.530 INFO:tasks.workunit.client.0.smithi052.stdout:5/629: chown d7/d51/d8d/la6 15321 1 2024-09-12T18:03:23.533 INFO:tasks.workunit.client.0.smithi052.stdout:0/639: rename d2/d57/d5b/d7a/f8f to d2/d6/dd/d21/d41/fc3 0 2024-09-12T18:03:23.535 INFO:tasks.workunit.client.0.smithi052.stdout:5/630: getdents d7/d59 0 2024-09-12T18:03:23.536 INFO:tasks.workunit.client.0.smithi052.stdout:1/540: creat d3/d10/d38/d8b/fad x:0 0 0 2024-09-12T18:03:23.536 INFO:tasks.workunit.client.0.smithi052.stdout:9/609: link d0/d18/d26/d4d/d54/l71 d0/da3/db8/lcc 0 2024-09-12T18:03:23.536 INFO:tasks.workunit.client.0.smithi052.stdout:0/640: creat d2/d6/dd/d21/d26/d38/d4a/fc4 x:0 0 0 2024-09-12T18:03:23.538 INFO:tasks.workunit.client.0.smithi052.stdout:9/610: fsync d0/d1c/f22 0 2024-09-12T18:03:23.538 INFO:tasks.workunit.client.0.smithi052.stdout:7/629: dwrite d6/dc/d1a/d6a/f8a [0,4194304] 0 2024-09-12T18:03:23.538 INFO:tasks.workunit.client.0.smithi052.stdout:5/631: write d7/d1f/d34/fac [1017400,16220] 0 2024-09-12T18:03:23.539 INFO:tasks.workunit.client.0.smithi052.stdout:0/641: creat d2/d51/fc5 x:0 0 0 2024-09-12T18:03:23.540 INFO:tasks.workunit.client.0.smithi052.stdout:2/622: dread da/f16 [0,4194304] 0 2024-09-12T18:03:23.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/541: rename d3/d10/d38/l5d to d3/d1d/d72/lae 0 2024-09-12T18:03:23.541 INFO:tasks.workunit.client.0.smithi052.stdout:3/637: dwrite d0/d16/d60/fca [0,4194304] 0 2024-09-12T18:03:23.541 INFO:tasks.workunit.client.0.smithi052.stdout:2/623: stat da/f12 0 2024-09-12T18:03:23.543 INFO:tasks.workunit.client.0.smithi052.stdout:7/630: write d6/dc/fe [3037744,54602] 0 2024-09-12T18:03:23.544 INFO:tasks.workunit.client.0.smithi052.stdout:1/542: dread - d3/d1d/d22/d27/d28/d2f/d74/d7f/f94 zero size 2024-09-12T18:03:23.545 INFO:tasks.workunit.client.0.smithi052.stdout:4/789: dread d11/d65/dc6/d95/dbf/f27 [0,4194304] 0 2024-09-12T18:03:23.545 INFO:tasks.workunit.client.0.smithi052.stdout:6/737: dread d2/d49/fc2 [0,4194304] 0 2024-09-12T18:03:23.545 INFO:tasks.workunit.client.0.smithi052.stdout:6/738: fdatasync d2/d80/f48 0 2024-09-12T18:03:23.547 INFO:tasks.workunit.client.0.smithi052.stdout:0/642: creat d2/d6/dd/d21/d41/d59/fc6 x:0 0 0 2024-09-12T18:03:23.547 INFO:tasks.workunit.client.0.smithi052.stdout:4/790: stat d11/d65/dd1/f2b 0 2024-09-12T18:03:23.548 INFO:tasks.workunit.client.0.smithi052.stdout:9/611: truncate d0/d18/d26/f92 3573595 0 2024-09-12T18:03:23.548 INFO:tasks.workunit.client.0.smithi052.stdout:8/748: dwrite d13/d18/d38/dbf/fc4 [0,4194304] 0 2024-09-12T18:03:23.548 INFO:tasks.workunit.client.0.smithi052.stdout:2/624: truncate f0 2381130 0 2024-09-12T18:03:23.548 INFO:tasks.workunit.client.0.smithi052.stdout:1/543: symlink d3/d1d/d22/d27/d28/d2f/d74/d7f/laf 0 2024-09-12T18:03:23.548 INFO:tasks.workunit.client.0.smithi052.stdout:3/638: dread d0/d4b/d4c/f58 [0,4194304] 0 2024-09-12T18:03:23.551 INFO:tasks.workunit.client.0.smithi052.stdout:4/791: rmdir d11/d65/dd1 39 2024-09-12T18:03:23.551 INFO:tasks.workunit.client.0.smithi052.stdout:8/749: creat d13/d18/d5b/ff4 x:0 0 0 2024-09-12T18:03:23.551 INFO:tasks.workunit.client.0.smithi052.stdout:1/544: mkdir d3/d1d/d22/d3f/db0 0 2024-09-12T18:03:23.551 INFO:tasks.workunit.client.0.smithi052.stdout:3/639: symlink d0/daf/le4 0 2024-09-12T18:03:23.551 INFO:tasks.workunit.client.0.smithi052.stdout:2/625: stat da/d1d/d35/l56 0 2024-09-12T18:03:23.552 INFO:tasks.workunit.client.0.smithi052.stdout:7/631: rename d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/l8d to d6/d12/d1e/d29/d5d/ld1 0 2024-09-12T18:03:23.552 INFO:tasks.workunit.client.0.smithi052.stdout:4/792: fsync d11/d17/d1b/d2a/d6a/da8/fcb 0 2024-09-12T18:03:23.553 INFO:tasks.workunit.client.0.smithi052.stdout:3/640: symlink d0/d16/d60/le5 0 2024-09-12T18:03:23.553 INFO:tasks.workunit.client.0.smithi052.stdout:8/750: chown d13/c6b 868560 1 2024-09-12T18:03:23.553 INFO:tasks.workunit.client.0.smithi052.stdout:0/643: rename d2/d57/f6f to d2/d6/dd/d21/d41/fc7 0 2024-09-12T18:03:23.554 INFO:tasks.workunit.client.0.smithi052.stdout:7/632: write d6/d12/d1e/d29/d5d/f65 [473682,61032] 0 2024-09-12T18:03:23.555 INFO:tasks.workunit.client.0.smithi052.stdout:0/644: write d2/d51/fc5 [165681,126201] 0 2024-09-12T18:03:23.555 INFO:tasks.workunit.client.0.smithi052.stdout:3/641: creat d0/d4/d25/d2a/fe6 x:0 0 0 2024-09-12T18:03:23.558 INFO:tasks.workunit.client.0.smithi052.stdout:1/545: dread d3/d1d/d22/d27/d28/f7c [0,4194304] 0 2024-09-12T18:03:23.558 INFO:tasks.workunit.client.0.smithi052.stdout:0/645: symlink d2/d1b/d72/d69/db6/lc8 0 2024-09-12T18:03:23.558 INFO:tasks.workunit.client.0.smithi052.stdout:7/633: unlink d6/d12/d1e/d29/d5d/d71/d3a/d83/f81 0 2024-09-12T18:03:23.558 INFO:tasks.workunit.client.0.smithi052.stdout:6/739: dwrite d2/d21/f2a [0,4194304] 0 2024-09-12T18:03:23.561 INFO:tasks.workunit.client.0.smithi052.stdout:0/646: symlink d2/d6/dd/dad/lc9 0 2024-09-12T18:03:23.561 INFO:tasks.workunit.client.0.smithi052.stdout:6/740: fdatasync d2/d21/d9f/dd7/de7/d54/f62 0 2024-09-12T18:03:23.561 INFO:tasks.workunit.client.0.smithi052.stdout:1/546: mknod d3/cb1 0 2024-09-12T18:03:23.561 INFO:tasks.workunit.client.0.smithi052.stdout:9/612: truncate d0/d6/d3a/d42/da9/fc8 2241601 0 2024-09-12T18:03:23.562 INFO:tasks.workunit.client.0.smithi052.stdout:7/634: chown d6/d12/d1e/d29/d5d/d71/d3a/d83/f7a 799 1 2024-09-12T18:03:23.562 INFO:tasks.workunit.client.0.smithi052.stdout:3/642: link d0/d4/d25/d2a/d2c/c82 d0/d4b/d57/d6d/ce7 0 2024-09-12T18:03:23.563 INFO:tasks.workunit.client.0.smithi052.stdout:5/632: dread d7/d59/d5c/d7c/fb5 [0,4194304] 0 2024-09-12T18:03:23.564 INFO:tasks.workunit.client.0.smithi052.stdout:8/751: dwrite d13/f9d [0,4194304] 0 2024-09-12T18:03:23.566 INFO:tasks.workunit.client.0.smithi052.stdout:1/547: symlink d3/d1d/d83/d8f/lb2 0 2024-09-12T18:03:23.566 INFO:tasks.workunit.client.0.smithi052.stdout:9/613: creat d0/d6/d3a/d43/fcd x:0 0 0 2024-09-12T18:03:23.566 INFO:tasks.workunit.client.0.smithi052.stdout:6/741: creat d2/d21/d9f/dd7/ffd x:0 0 0 2024-09-12T18:03:23.567 INFO:tasks.workunit.client.0.smithi052.stdout:1/548: readlink d3/d1d/d22/d3f/l58 0 2024-09-12T18:03:23.568 INFO:tasks.workunit.client.0.smithi052.stdout:8/752: creat d13/ff5 x:0 0 0 2024-09-12T18:03:23.568 INFO:tasks.workunit.client.0.smithi052.stdout:9/614: readlink d0/da3/db8/lcc 0 2024-09-12T18:03:23.569 INFO:tasks.workunit.client.0.smithi052.stdout:6/742: mkdir d2/d21/d9f/dd7/de7/d54/dfe 0 2024-09-12T18:03:23.570 INFO:tasks.workunit.client.0.smithi052.stdout:9/615: mknod d0/d6/d3a/d43/cce 0 2024-09-12T18:03:23.571 INFO:tasks.workunit.client.0.smithi052.stdout:1/549: link d3/d10/d38/f40 d3/fb3 0 2024-09-12T18:03:23.572 INFO:tasks.workunit.client.0.smithi052.stdout:5/633: dwrite d7/f8 [4194304,4194304] 0 2024-09-12T18:03:23.572 INFO:tasks.workunit.client.0.smithi052.stdout:4/793: dwrite d11/d17/d1b/d2a/d6a/d7f/d90/fa1 [0,4194304] 0 2024-09-12T18:03:23.572 INFO:tasks.workunit.client.0.smithi052.stdout:8/753: rename d13/d18/d21/ddd to d13/d18/d21/df6 0 2024-09-12T18:03:23.572 INFO:tasks.workunit.client.0.smithi052.stdout:9/616: chown d0/d18/d26/d4d/d54/l59 0 1 2024-09-12T18:03:23.575 INFO:tasks.workunit.client.0.smithi052.stdout:4/794: fsync d11/d17/d1b/fd0 0 2024-09-12T18:03:23.575 INFO:tasks.workunit.client.0.smithi052.stdout:5/634: rename d7/d1c/d1e/l8a to d7/d51/d8d/lc9 0 2024-09-12T18:03:23.577 INFO:tasks.workunit.client.0.smithi052.stdout:9/617: rename d0/d6/l3c to d0/d18/d37/lcf 0 2024-09-12T18:03:23.577 INFO:tasks.workunit.client.0.smithi052.stdout:5/635: creat d7/d1f/d34/fca x:0 0 0 2024-09-12T18:03:23.580 INFO:tasks.workunit.client.0.smithi052.stdout:5/636: truncate d7/d1f/d45/f7a 4606699 0 2024-09-12T18:03:23.581 INFO:tasks.workunit.client.0.smithi052.stdout:8/754: read d13/d18/d21/fac [535900,69624] 0 2024-09-12T18:03:23.581 INFO:tasks.workunit.client.0.smithi052.stdout:6/743: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/f85 [0,4194304] 0 2024-09-12T18:03:23.582 INFO:tasks.workunit.client.0.smithi052.stdout:4/795: dread d11/d17/d1b/df9/dfd/ff5 [0,4194304] 0 2024-09-12T18:03:23.582 INFO:tasks.workunit.client.0.smithi052.stdout:9/618: mknod d0/d18/d37/d9e/cd0 0 2024-09-12T18:03:23.582 INFO:tasks.workunit.client.0.smithi052.stdout:3/643: dwrite d0/d4/d25/d2a/f32 [4194304,4194304] 0 2024-09-12T18:03:23.584 INFO:tasks.workunit.client.0.smithi052.stdout:5/637: dread - d7/d59/d5c/fbf zero size 2024-09-12T18:03:23.584 INFO:tasks.workunit.client.0.smithi052.stdout:1/550: dwrite d3/d1d/d22/d27/d28/d2f/f80 [0,4194304] 0 2024-09-12T18:03:23.586 INFO:tasks.workunit.client.0.smithi052.stdout:9/619: rmdir d0/d6/d3a/d43/d74 39 2024-09-12T18:03:23.586 INFO:tasks.workunit.client.0.smithi052.stdout:3/644: chown d0/d4/d25/d2a/d6/d7/f2b 310625007 1 2024-09-12T18:03:23.586 INFO:tasks.workunit.client.0.smithi052.stdout:1/551: chown d3/d69/f7e 119 1 2024-09-12T18:03:23.587 INFO:tasks.workunit.client.0.smithi052.stdout:3/645: write d0/d4/f50 [412676,30116] 0 2024-09-12T18:03:23.587 INFO:tasks.workunit.client.0.smithi052.stdout:1/552: chown d3/d10/d38/f40 219915 1 2024-09-12T18:03:23.587 INFO:tasks.workunit.client.0.smithi052.stdout:5/638: symlink d7/d1f/d3a/lcb 0 2024-09-12T18:03:23.587 INFO:tasks.workunit.client.0.smithi052.stdout:3/646: mkdir d0/d4b/d57/d6d/de8 0 2024-09-12T18:03:23.587 INFO:tasks.workunit.client.0.smithi052.stdout:3/647: mknod d0/d4b/d57/d6d/de8/ce9 0 2024-09-12T18:03:23.588 INFO:tasks.workunit.client.0.smithi052.stdout:1/553: fsync d3/d1d/d22/d27/d28/d2f/d74/d7d/f9d 0 2024-09-12T18:03:23.589 INFO:tasks.workunit.client.0.smithi052.stdout:4/796: creat d11/d65/dd1/d3b/f115 x:0 0 0 2024-09-12T18:03:23.593 INFO:tasks.workunit.client.0.smithi052.stdout:4/797: fdatasync d11/d65/dc6/daf/d107/dc5/f100 0 2024-09-12T18:03:23.593 INFO:tasks.workunit.client.0.smithi052.stdout:2/626: dwrite f0 [0,4194304] 0 2024-09-12T18:03:23.593 INFO:tasks.workunit.client.0.smithi052.stdout:2/627: readlink da/d1d/d35/l56 0 2024-09-12T18:03:23.593 INFO:tasks.workunit.client.0.smithi052.stdout:4/798: chown d11/d65/dc6/d95/dbf/d8e/ce4 29287 1 2024-09-12T18:03:23.593 INFO:tasks.workunit.client.0.smithi052.stdout:6/744: read d2/dc6/f1f [3575529,39167] 0 2024-09-12T18:03:23.593 INFO:tasks.workunit.client.0.smithi052.stdout:2/628: write da/dc/d15/d22/d87/fa0 [2028977,1338] 0 2024-09-12T18:03:23.595 INFO:tasks.workunit.client.0.smithi052.stdout:6/745: write d2/d21/d9f/dd7/de7/d54/f6f [338857,71218] 0 2024-09-12T18:03:23.595 INFO:tasks.workunit.client.0.smithi052.stdout:2/629: rename da/d1d/d35/f5a to da/dc/d15/d20/d60/d6e/fce 0 2024-09-12T18:03:23.595 INFO:tasks.workunit.client.0.smithi052.stdout:1/554: dwrite d3/d1d/d22/d27/f5c [0,4194304] 0 2024-09-12T18:03:23.596 INFO:tasks.workunit.client.0.smithi052.stdout:6/746: stat d2/d21/d9f/dd7/de7/d58/cc9 0 2024-09-12T18:03:23.596 INFO:tasks.workunit.client.0.smithi052.stdout:1/555: chown d3/d1d/d22 3 1 2024-09-12T18:03:23.598 INFO:tasks.workunit.client.0.smithi052.stdout:2/630: mknod da/dc/d15/d43/ccf 0 2024-09-12T18:03:23.599 INFO:tasks.workunit.client.0.smithi052.stdout:6/747: getdents d2/d21/d9f/dd7/de7/d58/d5d/dd0 0 2024-09-12T18:03:23.600 INFO:tasks.workunit.client.0.smithi052.stdout:4/799: read d11/d17/d1b/df9/dfd/f75 [83289,26003] 0 2024-09-12T18:03:23.601 INFO:tasks.workunit.client.0.smithi052.stdout:3/648: write d0/f13 [2804363,41158] 0 2024-09-12T18:03:23.605 INFO:tasks.workunit.client.0.smithi052.stdout:1/556: dread d3/d1d/d22/d27/d28/f7a [0,4194304] 0 2024-09-12T18:03:23.605 INFO:tasks.workunit.client.0.smithi052.stdout:0/647: dread d2/d6/dd/d21/d26/f2b [0,4194304] 0 2024-09-12T18:03:23.606 INFO:tasks.workunit.client.0.smithi052.stdout:3/649: link d0/d4/d25/d2a/d6/d7/d34/d71/cc3 d0/d4/d25/d2a/d6/dcc/cea 0 2024-09-12T18:03:23.607 INFO:tasks.workunit.client.0.smithi052.stdout:8/755: dwrite d13/d18/d5b/d70/f97 [0,4194304] 0 2024-09-12T18:03:23.607 INFO:tasks.workunit.client.0.smithi052.stdout:1/557: creat d3/d1d/d83/d8f/fb4 x:0 0 0 2024-09-12T18:03:23.608 INFO:tasks.workunit.client.0.smithi052.stdout:7/635: dread d6/d12/d1e/d29/fa6 [0,4194304] 0 2024-09-12T18:03:23.610 INFO:tasks.workunit.client.0.smithi052.stdout:0/648: truncate d2/d6/dd/d21/d41/d59/f71 4426341 0 2024-09-12T18:03:23.610 INFO:tasks.workunit.client.0.smithi052.stdout:4/800: dwrite d11/d17/d1b/d2a/d6a/d7f/d90/fa1 [0,4194304] 0 2024-09-12T18:03:23.611 INFO:tasks.workunit.client.0.smithi052.stdout:0/649: write d2/d8/f30 [3424954,43916] 0 2024-09-12T18:03:23.613 INFO:tasks.workunit.client.0.smithi052.stdout:0/650: write d2/d1b/d72/f5c [549578,6554] 0 2024-09-12T18:03:23.614 INFO:tasks.workunit.client.0.smithi052.stdout:3/650: dread d0/d4/d25/d2a/d2c/f67 [0,4194304] 0 2024-09-12T18:03:23.614 INFO:tasks.workunit.client.0.smithi052.stdout:4/801: rmdir d11/d65/dc6/d95 39 2024-09-12T18:03:23.615 INFO:tasks.workunit.client.0.smithi052.stdout:5/639: dread d7/d1c/f6c [0,4194304] 0 2024-09-12T18:03:23.616 INFO:tasks.workunit.client.0.smithi052.stdout:3/651: stat d0/d4b/d57/c9c 0 2024-09-12T18:03:23.616 INFO:tasks.workunit.client.0.smithi052.stdout:7/636: symlink d6/d12/d1e/d29/d5d/d71/d9e/ld2 0 2024-09-12T18:03:23.616 INFO:tasks.workunit.client.0.smithi052.stdout:0/651: chown d2/d6/dd/d21/d26/d38/f49 161224184 1 2024-09-12T18:03:23.617 INFO:tasks.workunit.client.0.smithi052.stdout:4/802: chown d11/d65/dd1/l26 6376 1 2024-09-12T18:03:23.618 INFO:tasks.workunit.client.0.smithi052.stdout:1/558: dwrite d3/f8 [0,4194304] 0 2024-09-12T18:03:23.618 INFO:tasks.workunit.client.0.smithi052.stdout:5/640: write d7/d1f/d3a/d49/f87 [4984486,43263] 0 2024-09-12T18:03:23.619 INFO:tasks.workunit.client.0.smithi052.stdout:3/652: stat d0/d4/d25/d2a/d6/d7/dab/fd1 0 2024-09-12T18:03:23.619 INFO:tasks.workunit.client.0.smithi052.stdout:8/756: dwrite d13/d18/d21/f37 [0,4194304] 0 2024-09-12T18:03:23.619 INFO:tasks.workunit.client.0.smithi052.stdout:0/652: write d2/d6/dd/d21/d47/f67 [1332372,29474] 0 2024-09-12T18:03:23.620 INFO:tasks.workunit.client.0.smithi052.stdout:3/653: chown d0/d4b/d4c/f97 1268963910 1 2024-09-12T18:03:23.621 INFO:tasks.workunit.client.0.smithi052.stdout:7/637: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/fd3 x:0 0 0 2024-09-12T18:03:23.621 INFO:tasks.workunit.client.0.smithi052.stdout:5/641: creat d7/d1f/d3a/d49/fcc x:0 0 0 2024-09-12T18:03:23.621 INFO:tasks.workunit.client.0.smithi052.stdout:4/803: mknod d11/d17/d1b/d2a/d6a/da8/c116 0 2024-09-12T18:03:23.621 INFO:tasks.workunit.client.0.smithi052.stdout:3/654: write d0/d4/d25/d2a/d6/d7/fd4 [461455,18991] 0 2024-09-12T18:03:23.623 INFO:tasks.workunit.client.0.smithi052.stdout:7/638: dread - d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb6 zero size 2024-09-12T18:03:23.623 INFO:tasks.workunit.client.0.smithi052.stdout:8/757: write d13/d18/d21/f5d [2442724,75473] 0 2024-09-12T18:03:23.623 INFO:tasks.workunit.client.0.smithi052.stdout:4/804: creat d11/d65/dc6/d95/dbf/d8e/f117 x:0 0 0 2024-09-12T18:03:23.624 INFO:tasks.workunit.client.0.smithi052.stdout:5/642: truncate d7/f3c 2838648 0 2024-09-12T18:03:23.625 INFO:tasks.workunit.client.0.smithi052.stdout:6/748: dread d2/dc6/f1f [0,4194304] 0 2024-09-12T18:03:23.625 INFO:tasks.workunit.client.0.smithi052.stdout:8/758: symlink d13/d18/d21/dc1/lf7 0 2024-09-12T18:03:23.626 INFO:tasks.workunit.client.0.smithi052.stdout:7/639: creat d6/d12/d1e/d29/fd4 x:0 0 0 2024-09-12T18:03:23.627 INFO:tasks.workunit.client.0.smithi052.stdout:5/643: write d7/d1c/f95 [744740,4765] 0 2024-09-12T18:03:23.628 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:23.623+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:23.629 INFO:tasks.workunit.client.0.smithi052.stdout:1/559: dwrite d3/d69/f7e [4194304,4194304] 0 2024-09-12T18:03:23.631 INFO:tasks.workunit.client.0.smithi052.stdout:7/640: write d6/d12/d1e/f6d [6394963,45032] 0 2024-09-12T18:03:23.632 INFO:tasks.workunit.client.0.smithi052.stdout:5/644: creat d7/d1f/d45/fcd x:0 0 0 2024-09-12T18:03:23.632 INFO:tasks.workunit.client.0.smithi052.stdout:0/653: dwrite d2/d6/dd/d21/d41/d59/f71 [4194304,4194304] 0 2024-09-12T18:03:23.632 INFO:tasks.workunit.client.0.smithi052.stdout:6/749: chown d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea/leb 26 1 2024-09-12T18:03:23.633 INFO:tasks.workunit.client.0.smithi052.stdout:3/655: dwrite d0/d4b/d4c/d6b/fbf [0,4194304] 0 2024-09-12T18:03:23.634 INFO:tasks.workunit.client.0.smithi052.stdout:6/750: fsync d2/d21/d9f/dd7/de7/d58/d5d/fba 0 2024-09-12T18:03:23.635 INFO:tasks.workunit.client.0.smithi052.stdout:5/645: mkdir d7/d59/dad/dce 0 2024-09-12T18:03:23.636 INFO:tasks.workunit.client.0.smithi052.stdout:7/641: rmdir d6/d12/d1e/d29/da1 39 2024-09-12T18:03:23.636 INFO:tasks.workunit.client.0.smithi052.stdout:6/751: symlink d2/d21/d6a/d97/lff 0 2024-09-12T18:03:23.636 INFO:tasks.workunit.client.0.smithi052.stdout:0/654: symlink d2/d6/lca 0 2024-09-12T18:03:23.638 INFO:tasks.workunit.client.0.smithi052.stdout:5/646: mknod d7/d1c/d1e/ccf 0 2024-09-12T18:03:23.639 INFO:tasks.workunit.client.0.smithi052.stdout:6/752: symlink d2/d21/d9f/dd7/de7/d58/d5d/l100 0 2024-09-12T18:03:23.641 INFO:tasks.workunit.client.0.smithi052.stdout:7/642: write d6/dc/d1a/f54 [1290440,98976] 0 2024-09-12T18:03:23.641 INFO:tasks.workunit.client.0.smithi052.stdout:8/759: write d13/d18/f75 [913850,74230] 0 2024-09-12T18:03:23.642 INFO:tasks.workunit.client.0.smithi052.stdout:5/647: truncate d7/d59/f97 374044 0 2024-09-12T18:03:23.644 INFO:tasks.workunit.client.0.smithi052.stdout:1/560: dwrite d3/f35 [0,4194304] 0 2024-09-12T18:03:23.644 INFO:tasks.workunit.client.0.smithi052.stdout:7/643: truncate d6/d12/d1e/d8e/fa9 1580297 0 2024-09-12T18:03:23.646 INFO:tasks.workunit.client.0.smithi052.stdout:8/760: rename d13/d3c/cc2 to d13/d3c/cf8 0 2024-09-12T18:03:23.647 INFO:tasks.workunit.client.0.smithi052.stdout:2/631: dread da/dc/d15/f1f [0,4194304] 0 2024-09-12T18:03:23.649 INFO:tasks.workunit.client.0.smithi052.stdout:0/655: dwrite d2/d6/dd/d21/d41/d59/fab [0,4194304] 0 2024-09-12T18:03:23.650 INFO:tasks.workunit.client.0.smithi052.stdout:1/561: mknod d3/d1d/cb5 0 2024-09-12T18:03:23.651 INFO:tasks.workunit.client.0.smithi052.stdout:7/644: write d6/d12/d1e/d29/d5d/d71/d3a/d83/f7a [1599655,2305] 0 2024-09-12T18:03:23.651 INFO:tasks.workunit.client.0.smithi052.stdout:8/761: chown d13/d18/d5b/cf2 8572553 1 2024-09-12T18:03:23.652 INFO:tasks.workunit.client.0.smithi052.stdout:9/620: dread d0/da3/db8/f69 [0,4194304] 0 2024-09-12T18:03:23.653 INFO:tasks.workunit.client.0.smithi052.stdout:1/562: write d3/f25 [2397838,116582] 0 2024-09-12T18:03:23.655 INFO:tasks.workunit.client.0.smithi052.stdout:5/648: dwrite d7/d1c/d1e/f36 [0,4194304] 0 2024-09-12T18:03:23.655 INFO:tasks.workunit.client.0.smithi052.stdout:8/762: symlink d13/d18/d38/dd3/dde/lf9 0 2024-09-12T18:03:23.656 INFO:tasks.workunit.client.0.smithi052.stdout:4/805: dread d11/d17/d1b/d2a/d82/fcc [0,4194304] 0 2024-09-12T18:03:23.656 INFO:tasks.workunit.client.0.smithi052.stdout:9/621: mknod d0/d18/d37/d87/cd1 0 2024-09-12T18:03:23.657 INFO:tasks.workunit.client.0.smithi052.stdout:5/649: readlink d7/d1f/d3a/l42 0 2024-09-12T18:03:23.657 INFO:tasks.workunit.client.0.smithi052.stdout:9/622: fsync d0/d1c/f99 0 2024-09-12T18:03:23.658 INFO:tasks.workunit.client.0.smithi052.stdout:8/763: rmdir d13/d18/d5b/d70 39 2024-09-12T18:03:23.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/753: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f61 [0,4194304] 0 2024-09-12T18:03:23.659 INFO:tasks.workunit.client.0.smithi052.stdout:0/656: link d2/d6/dd/dad/lc2 d2/d6/dd/d21/d41/d44/lcb 0 2024-09-12T18:03:23.659 INFO:tasks.workunit.client.0.smithi052.stdout:1/563: rename d3/d1d/d22/d27/d28/d2f/c4c to d3/d10/cb6 0 2024-09-12T18:03:23.661 INFO:tasks.workunit.client.0.smithi052.stdout:8/764: creat d13/ddc/df3/ffa x:0 0 0 2024-09-12T18:03:23.662 INFO:tasks.workunit.client.0.smithi052.stdout:4/806: getdents d11/d17/d1b/d2a/d6a/d7f/dd6 0 2024-09-12T18:03:23.662 INFO:tasks.workunit.client.0.smithi052.stdout:1/564: creat d3/d1d/d22/d76/fb7 x:0 0 0 2024-09-12T18:03:23.663 INFO:tasks.workunit.client.0.smithi052.stdout:6/754: link d2/d21/d9f/dd7/de7/d54/dd5/fda d2/d21/f101 0 2024-09-12T18:03:23.663 INFO:tasks.workunit.client.0.smithi052.stdout:7/645: write d6/d12/d1e/d29/f45 [202135,109429] 0 2024-09-12T18:03:23.663 INFO:tasks.workunit.client.0.smithi052.stdout:0/657: link d2/d6/dd/d21/d26/d2f/f5e d2/d57/d5b/d7a/fcc 0 2024-09-12T18:03:23.664 INFO:tasks.workunit.client.0.smithi052.stdout:8/765: mkdir d13/d18/d38/dfb 0 2024-09-12T18:03:23.664 INFO:tasks.workunit.client.0.smithi052.stdout:7/646: fdatasync d6/d12/f99 0 2024-09-12T18:03:23.665 INFO:tasks.workunit.client.0.smithi052.stdout:3/656: dread d0/d4b/d4c/d6b/d48/fb9 [0,4194304] 0 2024-09-12T18:03:23.665 INFO:tasks.workunit.client.0.smithi052.stdout:8/766: mknod d13/d18/d38/cfc 0 2024-09-12T18:03:23.666 INFO:tasks.workunit.client.0.smithi052.stdout:1/565: symlink d3/d1d/d22/d27/d28/d2f/d74/d7f/lb8 0 2024-09-12T18:03:23.666 INFO:tasks.workunit.client.0.smithi052.stdout:5/650: dwrite d7/d59/dbe/d6b/fa1 [0,4194304] 0 2024-09-12T18:03:23.666 INFO:tasks.workunit.client.0.smithi052.stdout:6/755: chown d2/d15/l83 150826 1 2024-09-12T18:03:23.667 INFO:tasks.workunit.client.0.smithi052.stdout:1/566: write d3/d1d/d22/d27/f62 [1541887,80788] 0 2024-09-12T18:03:23.667 INFO:tasks.workunit.client.0.smithi052.stdout:9/623: dwrite d0/d18/d37/d87/f73 [0,4194304] 0 2024-09-12T18:03:23.668 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:23.668 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:23.668 INFO:tasks.workunit.client.0.smithi052.stdout:0/658: rename d2/d8/c42 to d2/d57/d5b/d7a/ccd 0 2024-09-12T18:03:23.668 INFO:tasks.workunit.client.0.smithi052.stdout:8/767: symlink d13/d18/d38/dd3/lfd 0 2024-09-12T18:03:23.669 INFO:tasks.workunit.client.0.smithi052.stdout:7/647: mknod d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/cd5 0 2024-09-12T18:03:23.669 INFO:tasks.workunit.client.0.smithi052.stdout:5/651: chown d7/d1c/d1e/l92 22420 1 2024-09-12T18:03:23.669 INFO:tasks.workunit.client.0.smithi052.stdout:6/756: symlink d2/l102 0 2024-09-12T18:03:23.670 INFO:tasks.workunit.client.0.smithi052.stdout:0/659: fsync d2/d6/dd/d21/d41/d59/f71 0 2024-09-12T18:03:23.670 INFO:tasks.workunit.client.0.smithi052.stdout:9/624: mkdir d0/d18/d26/dd2 0 2024-09-12T18:03:23.670 INFO:tasks.workunit.client.0.smithi052.stdout:1/567: creat d3/d10/d38/d44/d49/fb9 x:0 0 0 2024-09-12T18:03:23.671 INFO:tasks.workunit.client.0.smithi052.stdout:7/648: symlink d6/dc/ld6 0 2024-09-12T18:03:23.671 INFO:tasks.workunit.client.0.smithi052.stdout:8/768: mknod d13/d18/d38/dbf/dc5/cfe 0 2024-09-12T18:03:23.674 INFO:tasks.workunit.client.0.smithi052.stdout:8/769: stat d13/d18/d21/f39 0 2024-09-12T18:03:23.674 INFO:tasks.workunit.client.0.smithi052.stdout:5/652: mknod d7/d51/d8b/daf/cd0 0 2024-09-12T18:03:23.674 INFO:tasks.workunit.client.0.smithi052.stdout:6/757: dread - d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f42 zero size 2024-09-12T18:03:23.674 INFO:tasks.workunit.client.0.smithi052.stdout:1/568: write d3/d1d/d22/d76/fb7 [861232,80901] 0 2024-09-12T18:03:23.674 INFO:tasks.workunit.client.0.smithi052.stdout:7/649: chown d6/d12/d1e/d29/da1/cc7 105 1 2024-09-12T18:03:23.674 INFO:tasks.workunit.client.0.smithi052.stdout:8/770: write d13/d18/d38/dd3/fdf [618246,80531] 0 2024-09-12T18:03:23.675 INFO:tasks.workunit.client.0.smithi052.stdout:5/653: rename d7/d59/d84/cbd to d7/d59/d84/cd1 0 2024-09-12T18:03:23.675 INFO:tasks.workunit.client.0.smithi052.stdout:8/771: mkdir d13/d9b/dff 0 2024-09-12T18:03:23.676 INFO:tasks.workunit.client.0.smithi052.stdout:4/807: write d11/d17/d1b/df9/dfd/fe7 [1811032,91721] 0 2024-09-12T18:03:23.676 INFO:tasks.workunit.client.0.smithi052.stdout:1/569: symlink d3/d1d/d22/d27/d28/d2f/d74/d7f/lba 0 2024-09-12T18:03:23.677 INFO:tasks.workunit.client.0.smithi052.stdout:5/654: mknod d7/d51/cd2 0 2024-09-12T18:03:23.678 INFO:tasks.workunit.client.0.smithi052.stdout:8/772: creat d13/ddc/df3/f100 x:0 0 0 2024-09-12T18:03:23.678 INFO:tasks.workunit.client.0.smithi052.stdout:3/657: dwrite d0/d4/d25/f2e [0,4194304] 0 2024-09-12T18:03:23.679 INFO:tasks.workunit.client.0.smithi052.stdout:7/650: link d6/d12/d1e/l20 d6/d12/d1e/d29/ld7 0 2024-09-12T18:03:23.679 INFO:tasks.workunit.client.0.smithi052.stdout:8/773: chown d13/d3c/f95 587548 1 2024-09-12T18:03:23.681 INFO:tasks.workunit.client.0.smithi052.stdout:5/655: mknod d7/d51/d8b/da3/cd3 0 2024-09-12T18:03:23.681 INFO:tasks.workunit.client.0.smithi052.stdout:1/570: mkdir d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/dbb 0 2024-09-12T18:03:23.681 INFO:tasks.workunit.client.0.smithi052.stdout:9/625: dwrite d0/da3/db8/f53 [0,4194304] 0 2024-09-12T18:03:23.681 INFO:tasks.workunit.client.0.smithi052.stdout:6/758: rename d2/d15/c53 to d2/d21/d9f/dd7/de7/c103 0 2024-09-12T18:03:23.681 INFO:tasks.workunit.client.0.smithi052.stdout:0/660: dwrite d2/d6/dd/d21/d41/d59/fab [0,4194304] 0 2024-09-12T18:03:23.682 INFO:tasks.workunit.client.0.smithi052.stdout:4/808: mkdir d11/d65/dc6/d95/dbf/d118 0 2024-09-12T18:03:23.682 INFO:tasks.workunit.client.0.smithi052.stdout:6/759: chown d2/d5e/f9d 13 1 2024-09-12T18:03:23.682 INFO:tasks.workunit.client.0.smithi052.stdout:8/774: creat d13/d18/d21/df6/f101 x:0 0 0 2024-09-12T18:03:23.683 INFO:tasks.workunit.client.0.smithi052.stdout:7/651: symlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/ld8 0 2024-09-12T18:03:23.683 INFO:tasks.workunit.client.0.smithi052.stdout:2/632: dread da/dc/f2e [0,4194304] 0 2024-09-12T18:03:23.684 INFO:tasks.workunit.client.0.smithi052.stdout:6/760: readlink d2/d21/d76/l91 0 2024-09-12T18:03:23.684 INFO:tasks.workunit.client.0.smithi052.stdout:4/809: stat d11/d65/dd1/d3b/f115 0 2024-09-12T18:03:23.684 INFO:tasks.workunit.client.0.smithi052.stdout:9/626: symlink d0/d18/d79/da6/ld3 0 2024-09-12T18:03:23.685 INFO:tasks.workunit.client.0.smithi052.stdout:5/656: symlink d7/d59/dbe/d6b/ld4 0 2024-09-12T18:03:23.685 INFO:tasks.workunit.client.0.smithi052.stdout:0/661: write d2/d6/dd/d21/d26/d38/d4a/fa5 [412165,14775] 0 2024-09-12T18:03:23.686 INFO:tasks.workunit.client.0.smithi052.stdout:7/652: read - d6/d12/d1e/d29/d5d/d71/d9e/fc9 zero size 2024-09-12T18:03:23.686 INFO:tasks.workunit.client.0.smithi052.stdout:8/775: read - d13/d18/d5b/d70/fda zero size 2024-09-12T18:03:23.686 INFO:tasks.workunit.client.0.smithi052.stdout:6/761: truncate d2/d80/fa3 975002 0 2024-09-12T18:03:23.686 INFO:tasks.workunit.client.0.smithi052.stdout:9/627: fsync d0/da3/db8/fa4 0 2024-09-12T18:03:23.686 INFO:tasks.workunit.client.0.smithi052.stdout:4/810: chown d11/d65/dc6/daf/d107/ld2 0 1 2024-09-12T18:03:23.687 INFO:tasks.workunit.client.0.smithi052.stdout:2/633: symlink da/dc/d15/d20/da5/ld0 0 2024-09-12T18:03:23.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:23.689 INFO:tasks.workunit.client.0.smithi052.stdout:8/776: creat d13/d18/d38/f102 x:0 0 0 2024-09-12T18:03:23.689 INFO:tasks.workunit.client.0.smithi052.stdout:0/662: chown d2/d1b/d80/da3/lb0 4665998 1 2024-09-12T18:03:23.689 INFO:tasks.workunit.client.0.smithi052.stdout:2/634: chown da/dc/d15/d20/l58 10710559 1 2024-09-12T18:03:23.689 INFO:tasks.workunit.client.0.smithi052.stdout:3/658: dwrite d0/daf/fbe [0,4194304] 0 2024-09-12T18:03:23.689 INFO:tasks.workunit.client.0.smithi052.stdout:8/777: dread - d13/d18/d21/d64/f83 zero size 2024-09-12T18:03:23.691 INFO:tasks.workunit.client.0.smithi052.stdout:2/635: link da/l1a da/d71/ld1 0 2024-09-12T18:03:23.691 INFO:tasks.workunit.client.0.smithi052.stdout:8/778: mkdir d13/d35/d9c/d103 0 2024-09-12T18:03:23.692 INFO:tasks.workunit.client.0.smithi052.stdout:8/779: creat d13/d35/de1/f104 x:0 0 0 2024-09-12T18:03:23.693 INFO:tasks.workunit.client.0.smithi052.stdout:8/780: write d13/d3c/fc3 [602282,97689] 0 2024-09-12T18:03:23.696 INFO:tasks.workunit.client.0.smithi052.stdout:8/781: rename d13/d35/d9c/l89 to d13/ddc/df3/l105 0 2024-09-12T18:03:23.696 INFO:tasks.workunit.client.0.smithi052.stdout:3/659: dwrite d0/d4/d25/d2a/d6/d7/d34/f5b [0,4194304] 0 2024-09-12T18:03:23.696 INFO:tasks.workunit.client.0.smithi052.stdout:5/657: truncate d7/d1f/d45/f7a 580261 0 2024-09-12T18:03:23.697 INFO:tasks.workunit.client.0.smithi052.stdout:5/658: dread - d7/d1f/d3a/d49/fcc zero size 2024-09-12T18:03:23.697 INFO:tasks.workunit.client.0.smithi052.stdout:8/782: getdents d13/ddc 0 2024-09-12T18:03:23.698 INFO:tasks.workunit.client.0.smithi052.stdout:5/659: creat d7/d59/d5c/d7c/fd5 x:0 0 0 2024-09-12T18:03:23.699 INFO:tasks.workunit.client.0.smithi052.stdout:8/783: rename d13/d18/d21/f28 to d13/d35/d9c/d103/f106 0 2024-09-12T18:03:23.700 INFO:tasks.workunit.client.0.smithi052.stdout:0/663: dwrite d2/d6/dd/f1d [0,4194304] 0 2024-09-12T18:03:23.701 INFO:tasks.workunit.client.0.smithi052.stdout:6/762: dread d2/d21/d9f/dd7/de7/d58/fa8 [0,4194304] 0 2024-09-12T18:03:23.701 INFO:tasks.workunit.client.0.smithi052.stdout:8/784: symlink d13/d35/d9c/d103/l107 0 2024-09-12T18:03:23.701 INFO:tasks.workunit.client.0.smithi052.stdout:5/660: read d7/f38 [567214,103346] 0 2024-09-12T18:03:23.701 INFO:tasks.workunit.client.0.smithi052.stdout:0/664: stat d2/d6/dd/d21/d41/f79 0 2024-09-12T18:03:23.702 INFO:tasks.workunit.client.0.smithi052.stdout:3/660: dread d0/d4/d25/d2a/d2c/f63 [0,4194304] 0 2024-09-12T18:03:23.703 INFO:tasks.workunit.client.0.smithi052.stdout:5/661: chown d7/d59/dbe/d6b/fa1 2369768 1 2024-09-12T18:03:23.703 INFO:tasks.workunit.client.0.smithi052.stdout:8/785: creat d13/d18/f108 x:0 0 0 2024-09-12T18:03:23.703 INFO:tasks.workunit.client.0.smithi052.stdout:0/665: truncate d2/d57/fac 269850 0 2024-09-12T18:03:23.703 INFO:tasks.workunit.client.0.smithi052.stdout:7/653: dread d6/d12/d1e/d8e/fa9 [0,4194304] 0 2024-09-12T18:03:23.704 INFO:tasks.workunit.client.0.smithi052.stdout:6/763: getdents d2/d21/d9f/dd7/de7/d54/dd5/df3 0 2024-09-12T18:03:23.704 INFO:tasks.workunit.client.0.smithi052.stdout:3/661: write d0/d4/d25/d2a/d6/d7/d34/f5b [2465197,63714] 0 2024-09-12T18:03:23.706 INFO:tasks.workunit.client.0.smithi052.stdout:3/662: read - d0/d4/d25/d2a/d6/d7/dab/fbc zero size 2024-09-12T18:03:23.706 INFO:tasks.workunit.client.0.smithi052.stdout:8/786: creat d13/d18/d5b/d70/f109 x:0 0 0 2024-09-12T18:03:23.706 INFO:tasks.workunit.client.0.smithi052.stdout:0/666: rename d2/d6/dd/d21/d41/d44 to d2/d8/dce 0 2024-09-12T18:03:23.706 INFO:tasks.workunit.client.0.smithi052.stdout:7/654: write d6/d12/d1e/d29/fa6 [4144769,130970] 0 2024-09-12T18:03:23.708 INFO:tasks.workunit.client.0.smithi052.stdout:3/663: symlink d0/d4/d33/d89/leb 0 2024-09-12T18:03:23.708 INFO:tasks.workunit.client.0.smithi052.stdout:6/764: rename d2/d5e/fcd to d2/d21/d9f/dd7/de7/f104 0 2024-09-12T18:03:23.709 INFO:tasks.workunit.client.0.smithi052.stdout:0/667: write d2/d8/dce/fc1 [628550,373] 0 2024-09-12T18:03:23.709 INFO:tasks.workunit.client.0.smithi052.stdout:6/765: rmdir d2/d21 39 2024-09-12T18:03:23.710 INFO:tasks.workunit.client.0.smithi052.stdout:7/655: getdents d6/d12/d1e/d29 0 2024-09-12T18:03:23.710 INFO:tasks.workunit.client.0.smithi052.stdout:3/664: mkdir d0/d4/d25/d2a/d2c/dec 0 2024-09-12T18:03:23.711 INFO:tasks.workunit.client.0.smithi052.stdout:5/662: dwrite d7/d51/d8b/fb9 [0,4194304] 0 2024-09-12T18:03:23.712 INFO:tasks.workunit.client.0.smithi052.stdout:6/766: symlink d2/d21/d9f/dd7/de7/d54/dd5/df3/l105 0 2024-09-12T18:03:23.713 INFO:tasks.workunit.client.0.smithi052.stdout:3/665: mknod d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/ced 0 2024-09-12T18:03:23.714 INFO:tasks.workunit.client.0.smithi052.stdout:6/767: creat d2/d21/d9f/dd7/de7/d54/dd5/f106 x:0 0 0 2024-09-12T18:03:23.715 INFO:tasks.workunit.client.0.smithi052.stdout:3/666: creat d0/d4/d25/d2a/d6/d7/d34/d71/fee x:0 0 0 2024-09-12T18:03:23.715 INFO:tasks.workunit.client.0.smithi052.stdout:6/768: chown d2/d80 81 1 2024-09-12T18:03:23.715 INFO:tasks.workunit.client.0.smithi052.stdout:5/663: dread d7/d1c/f3f [4194304,4194304] 0 2024-09-12T18:03:23.717 INFO:tasks.workunit.client.0.smithi052.stdout:7/656: dread d6/dc/d1a/d6a/f8a [0,4194304] 0 2024-09-12T18:03:23.717 INFO:tasks.workunit.client.0.smithi052.stdout:5/664: write d7/d1f/d34/fca [534099,86301] 0 2024-09-12T18:03:23.718 INFO:tasks.workunit.client.0.smithi052.stdout:7/657: readlink d6/dc/ld6 0 2024-09-12T18:03:23.718 INFO:tasks.workunit.client.0.smithi052.stdout:6/769: mkdir d2/d21/d9f/dd7/de7/d58/d5d/d107 0 2024-09-12T18:03:23.718 INFO:tasks.workunit.client.0.smithi052.stdout:9/628: dread d0/d18/d26/d4d/fac [0,4194304] 0 2024-09-12T18:03:23.719 INFO:tasks.workunit.client.0.smithi052.stdout:4/811: dread d11/d65/dc6/d68/f85 [0,4194304] 0 2024-09-12T18:03:23.719 INFO:tasks.workunit.client.0.smithi052.stdout:5/665: creat d7/d1c/d1e/da5/fd6 x:0 0 0 2024-09-12T18:03:23.720 INFO:tasks.workunit.client.0.smithi052.stdout:9/629: chown d0/d18/d26/d4d 9 1 2024-09-12T18:03:23.720 INFO:tasks.workunit.client.0.smithi052.stdout:4/812: fdatasync d11/d65/dc6/d95/dbf/d8e/fc1 0 2024-09-12T18:03:23.721 INFO:tasks.workunit.client.0.smithi052.stdout:3/667: dread d0/d4/d25/f2e [0,4194304] 0 2024-09-12T18:03:23.722 INFO:tasks.workunit.client.0.smithi052.stdout:7/658: rename d6/d12/d17/fbb to d6/d12/d17/dac/fd9 0 2024-09-12T18:03:23.722 INFO:tasks.workunit.client.0.smithi052.stdout:6/770: getdents d2/d21/d9f 0 2024-09-12T18:03:23.722 INFO:tasks.workunit.client.0.smithi052.stdout:8/787: truncate d13/f1f 3226798 0 2024-09-12T18:03:23.722 INFO:tasks.workunit.client.0.smithi052.stdout:3/668: unlink d0/c84 0 2024-09-12T18:03:23.723 INFO:tasks.workunit.client.0.smithi052.stdout:6/771: creat d2/d49/f108 x:0 0 0 2024-09-12T18:03:23.724 INFO:tasks.workunit.client.0.smithi052.stdout:7/659: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/fda x:0 0 0 2024-09-12T18:03:23.724 INFO:tasks.workunit.client.0.smithi052.stdout:8/788: truncate d13/d3c/f6d 26636 0 2024-09-12T18:03:23.724 INFO:tasks.workunit.client.0.smithi052.stdout:6/772: mkdir d2/d21/d9f/dd7/d109 0 2024-09-12T18:03:23.725 INFO:tasks.workunit.client.0.smithi052.stdout:8/789: dread - d13/d18/d5b/d70/f109 zero size 2024-09-12T18:03:23.725 INFO:tasks.workunit.client.0.smithi052.stdout:6/773: write d2/f10 [6113227,5353] 0 2024-09-12T18:03:23.726 INFO:tasks.workunit.client.0.smithi052.stdout:5/666: dwrite d7/f8 [0,4194304] 0 2024-09-12T18:03:23.726 INFO:tasks.workunit.client.0.smithi052.stdout:7/660: write d6/d12/d1e/d29/d5d/d71/d9e/fc9 [994572,107978] 0 2024-09-12T18:03:23.726 INFO:tasks.workunit.client.0.smithi052.stdout:8/790: chown d13/d35/de1/f96 204895 1 2024-09-12T18:03:23.727 INFO:tasks.workunit.client.0.smithi052.stdout:6/774: chown d2/d21/d9f/dd7/de7/d58/d5d/d9c 67457414 1 2024-09-12T18:03:23.728 INFO:tasks.workunit.client.0.smithi052.stdout:8/791: write d13/d3c/f95 [926724,10265] 0 2024-09-12T18:03:23.728 INFO:tasks.workunit.client.0.smithi052.stdout:7/661: fdatasync d6/d12/d1e/d29/d5d/f78 0 2024-09-12T18:03:23.728 INFO:tasks.workunit.client.0.smithi052.stdout:5/667: symlink d7/d59/dbe/ld7 0 2024-09-12T18:03:23.728 INFO:tasks.workunit.client.0.smithi052.stdout:3/669: dread d0/d4/d25/d2a/d6/d41/f59 [0,4194304] 0 2024-09-12T18:03:23.729 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:23.727+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:23.730 INFO:tasks.workunit.client.0.smithi052.stdout:7/662: unlink d6/d12/d1e/d29/d5d/d71/f68 0 2024-09-12T18:03:23.731 INFO:tasks.workunit.client.0.smithi052.stdout:7/663: truncate d6/d12/d1e/d29/fd4 579830 0 2024-09-12T18:03:23.731 INFO:tasks.workunit.client.0.smithi052.stdout:8/792: creat d13/d18/f10a x:0 0 0 2024-09-12T18:03:23.731 INFO:tasks.workunit.client.0.smithi052.stdout:8/793: chown d13/d18/l1d 1083 1 2024-09-12T18:03:23.733 INFO:tasks.workunit.client.0.smithi052.stdout:7/664: symlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/ldb 0 2024-09-12T18:03:23.733 INFO:tasks.workunit.client.0.smithi052.stdout:8/794: getdents d13/d9b/dff 0 2024-09-12T18:03:23.734 INFO:tasks.workunit.client.0.smithi052.stdout:8/795: mknod d13/d35/d9c/d9f/c10b 0 2024-09-12T18:03:23.735 INFO:tasks.workunit.client.0.smithi052.stdout:9/630: write d0/d6/d3a/f5d [5237742,37905] 0 2024-09-12T18:03:23.740 INFO:tasks.workunit.client.0.smithi052.stdout:8/796: dwrite d13/d18/fd2 [0,4194304] 0 2024-09-12T18:03:23.741 INFO:tasks.workunit.client.0.smithi052.stdout:8/797: chown d13/l5e 48 1 2024-09-12T18:03:23.741 INFO:tasks.workunit.client.0.smithi052.stdout:8/798: chown d13/d18/d21/dc1 678350 1 2024-09-12T18:03:23.743 INFO:tasks.workunit.client.0.smithi052.stdout:8/799: rename d13/d18/d38/f55 to d13/d18/f10c 0 2024-09-12T18:03:23.743 INFO:tasks.workunit.client.0.smithi052.stdout:8/800: readlink d13/d18/lba 0 2024-09-12T18:03:23.744 INFO:tasks.workunit.client.0.smithi052.stdout:8/801: mknod d13/d35/d9c/c10d 0 2024-09-12T18:03:23.744 INFO:tasks.workunit.client.0.smithi052.stdout:0/668: dread d2/d6/dd/d21/d41/f79 [0,4194304] 0 2024-09-12T18:03:23.745 INFO:tasks.workunit.client.0.smithi052.stdout:0/669: dread - d2/d6/dd/d21/d41/fc3 zero size 2024-09-12T18:03:23.745 INFO:tasks.workunit.client.0.smithi052.stdout:5/668: truncate d7/f16 3416700 0 2024-09-12T18:03:23.745 INFO:tasks.workunit.client.0.smithi052.stdout:0/670: rmdir d2/d1b/d72/d69 39 2024-09-12T18:03:23.746 INFO:tasks.workunit.client.0.smithi052.stdout:3/670: write d0/d4b/d4c/d6b/fae [486919,69463] 0 2024-09-12T18:03:23.747 INFO:tasks.workunit.client.0.smithi052.stdout:3/671: creat d0/fef x:0 0 0 2024-09-12T18:03:23.748 INFO:tasks.workunit.client.0.smithi052.stdout:0/671: link d2/d6/dd/f39 d2/d6/dd/d21/d26/d65/fcf 0 2024-09-12T18:03:23.748 INFO:tasks.workunit.client.0.smithi052.stdout:3/672: fdatasync d0/d4/d25/d2a/fdb 0 2024-09-12T18:03:23.749 INFO:tasks.workunit.client.0.smithi052.stdout:1/571: sync 2024-09-12T18:03:23.750 INFO:tasks.workunit.client.0.smithi052.stdout:3/673: write d0/d4b/d4c/f46 [1450354,22634] 0 2024-09-12T18:03:23.750 INFO:tasks.workunit.client.0.smithi052.stdout:0/672: mkdir d2/d6/dd/d21/d26/d38/dd0 0 2024-09-12T18:03:23.750 INFO:tasks.workunit.client.0.smithi052.stdout:7/665: dwrite d6/d12/f47 [0,4194304] 0 2024-09-12T18:03:23.750 INFO:tasks.workunit.client.0.smithi052.stdout:3/674: fsync d0/d16/d60/fca 0 2024-09-12T18:03:23.751 INFO:tasks.workunit.client.0.smithi052.stdout:0/673: creat d2/d6/dd/d21/d26/d38/dd0/fd1 x:0 0 0 2024-09-12T18:03:23.754 INFO:tasks.workunit.client.0.smithi052.stdout:3/675: dread d0/d4/d25/fa8 [0,4194304] 0 2024-09-12T18:03:23.754 INFO:tasks.workunit.client.0.smithi052.stdout:0/674: creat d2/d6/dd/dad/fd2 x:0 0 0 2024-09-12T18:03:23.756 INFO:tasks.workunit.client.0.smithi052.stdout:0/675: fdatasync d2/d1b/d72/f5c 0 2024-09-12T18:03:23.757 INFO:tasks.workunit.client.0.smithi052.stdout:3/676: creat d0/d4/d25/d2a/d6/d7/ff0 x:0 0 0 2024-09-12T18:03:23.758 INFO:tasks.workunit.client.0.smithi052.stdout:7/666: dwrite d6/d12/d17/f52 [0,4194304] 0 2024-09-12T18:03:23.758 INFO:tasks.workunit.client.0.smithi052.stdout:1/572: dwrite d3/d1d/d22/d27/f5c [4194304,4194304] 0 2024-09-12T18:03:23.759 INFO:tasks.workunit.client.0.smithi052.stdout:3/677: truncate d0/d4/d25/f81 180495 0 2024-09-12T18:03:23.761 INFO:tasks.workunit.client.0.smithi052.stdout:1/573: creat d3/d1d/d22/d3f/d56/fbc x:0 0 0 2024-09-12T18:03:23.761 INFO:tasks.workunit.client.0.smithi052.stdout:0/676: rename d2/l2d to d2/d6/dd/d21/d41/ld3 0 2024-09-12T18:03:23.761 INFO:tasks.workunit.client.0.smithi052.stdout:3/678: creat d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/de0/ff1 x:0 0 0 2024-09-12T18:03:23.761 INFO:tasks.workunit.client.0.smithi052.stdout:0/677: chown d2/d6/dd/dad 136 1 2024-09-12T18:03:23.762 INFO:tasks.workunit.client.0.smithi052.stdout:7/667: getdents d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3 0 2024-09-12T18:03:23.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/574: readlink d3/d1d/d22/d66/la5 0 2024-09-12T18:03:23.762 INFO:tasks.workunit.client.0.smithi052.stdout:3/679: chown d0/d4/d25/d2a/f55 421733367 1 2024-09-12T18:03:23.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/575: mknod d3/d69/d89/cbd 0 2024-09-12T18:03:23.763 INFO:tasks.workunit.client.0.smithi052.stdout:1/576: chown d3/f77 4333766 1 2024-09-12T18:03:23.765 INFO:tasks.workunit.client.0.smithi052.stdout:1/577: mkdir d3/da2/dbe 0 2024-09-12T18:03:23.767 INFO:tasks.workunit.client.0.smithi052.stdout:9/631: dread d0/da3/db8/fa4 [0,4194304] 0 2024-09-12T18:03:23.767 INFO:tasks.workunit.client.0.smithi052.stdout:1/578: creat d3/d1d/d22/fbf x:0 0 0 2024-09-12T18:03:23.767 INFO:tasks.workunit.client.0.smithi052.stdout:5/669: dread d7/d1f/d3a/d49/f5a [0,4194304] 0 2024-09-12T18:03:23.768 INFO:tasks.workunit.client.0.smithi052.stdout:0/678: rename d2/d6/dd/d21/d26/d38/f3f to d2/d8/dce/fd4 0 2024-09-12T18:03:23.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/670: creat d7/d1c/d1e/fd8 x:0 0 0 2024-09-12T18:03:23.770 INFO:tasks.workunit.client.0.smithi052.stdout:1/579: read d3/d1d/d22/d27/f90 [651421,59146] 0 2024-09-12T18:03:23.771 INFO:tasks.workunit.client.0.smithi052.stdout:3/680: dwrite d0/d4/d25/d2a/d6/d7/d34/d72/f93 [0,4194304] 0 2024-09-12T18:03:23.771 INFO:tasks.workunit.client.0.smithi052.stdout:7/668: dwrite d6/d12/d1e/d29/f67 [0,4194304] 0 2024-09-12T18:03:23.771 INFO:tasks.workunit.client.0.smithi052.stdout:0/679: truncate d2/d6/dd/d21/d47/f67 1506815 0 2024-09-12T18:03:23.772 INFO:tasks.workunit.client.0.smithi052.stdout:5/671: mknod d7/d51/d8b/daf/cd9 0 2024-09-12T18:03:23.772 INFO:tasks.workunit.client.0.smithi052.stdout:1/580: write d3/d1d/d22/d3f/f5f [1112898,122643] 0 2024-09-12T18:03:23.773 INFO:tasks.workunit.client.0.smithi052.stdout:3/681: stat d0/d4/d25/d2a/d6/d7/d34/d72/d83/de2 0 2024-09-12T18:03:23.773 INFO:tasks.workunit.client.0.smithi052.stdout:5/672: stat d7/d51/d8d/lc9 0 2024-09-12T18:03:23.773 INFO:tasks.workunit.client.0.smithi052.stdout:1/581: fsync d3/d1d/d22/d3f/f45 0 2024-09-12T18:03:23.774 INFO:tasks.workunit.client.0.smithi052.stdout:1/582: mkdir d3/d69/d89/dc0 0 2024-09-12T18:03:23.777 INFO:tasks.workunit.client.0.smithi052.stdout:8/802: dread d13/fd0 [0,4194304] 0 2024-09-12T18:03:23.777 INFO:tasks.workunit.client.0.smithi052.stdout:1/583: readlink d3/d1d/d22/l6c 0 2024-09-12T18:03:23.778 INFO:tasks.workunit.client.0.smithi052.stdout:3/682: creat d0/d4/d25/d2a/d6/d7/de/da1/ff2 x:0 0 0 2024-09-12T18:03:23.779 INFO:tasks.workunit.client.0.smithi052.stdout:3/683: dread - d0/d4/d25/d2a/d6/d7/de/f9b zero size 2024-09-12T18:03:23.780 INFO:tasks.workunit.client.0.smithi052.stdout:7/669: dwrite d6/f62 [0,4194304] 0 2024-09-12T18:03:23.782 INFO:tasks.workunit.client.0.smithi052.stdout:7/670: chown d6/f3c 5705154 1 2024-09-12T18:03:23.782 INFO:tasks.workunit.client.0.smithi052.stdout:3/684: rmdir d0/d4/d25/d2a/d2c/da9/db8/dc0 0 2024-09-12T18:03:23.783 INFO:tasks.workunit.client.0.smithi052.stdout:7/671: fdatasync d6/fd 0 2024-09-12T18:03:23.783 INFO:tasks.workunit.client.0.smithi052.stdout:1/584: read d3/d69/f7e [3373322,19223] 0 2024-09-12T18:03:23.784 INFO:tasks.workunit.client.0.smithi052.stdout:1/585: chown d3/d10/c5a 133597 1 2024-09-12T18:03:23.784 INFO:tasks.workunit.client.0.smithi052.stdout:3/685: rmdir d0/d4/d25/d2a/d6/d7/d34/d71/dd3 0 2024-09-12T18:03:23.784 INFO:tasks.workunit.client.0.smithi052.stdout:1/586: mknod d3/d1d/d22/d27/cc1 0 2024-09-12T18:03:23.785 INFO:tasks.workunit.client.0.smithi052.stdout:3/686: unlink d0/d4/d25/d2a/d6/d7/l7f 0 2024-09-12T18:03:23.785 INFO:tasks.workunit.client.0.smithi052.stdout:8/803: dwrite d13/d18/d38/dd3/fdf [0,4194304] 0 2024-09-12T18:03:23.786 INFO:tasks.workunit.client.0.smithi052.stdout:6/775: sync 2024-09-12T18:03:23.786 INFO:tasks.workunit.client.0.smithi052.stdout:4/813: sync 2024-09-12T18:03:23.787 INFO:tasks.workunit.client.0.smithi052.stdout:2/636: sync 2024-09-12T18:03:23.787 INFO:tasks.workunit.client.0.smithi052.stdout:3/687: sync 2024-09-12T18:03:23.787 INFO:tasks.workunit.client.0.smithi052.stdout:7/672: sync 2024-09-12T18:03:23.787 INFO:tasks.workunit.client.0.smithi052.stdout:8/804: symlink d13/d18/l10e 0 2024-09-12T18:03:23.788 INFO:tasks.workunit.client.0.smithi052.stdout:0/680: truncate d2/d6/dd/d21/d26/d38/f49 719020 0 2024-09-12T18:03:23.788 INFO:tasks.workunit.client.0.smithi052.stdout:3/688: creat d0/d4/dbb/ff3 x:0 0 0 2024-09-12T18:03:23.788 INFO:tasks.workunit.client.0.smithi052.stdout:7/673: creat d6/d12/d1e/d8e/fdc x:0 0 0 2024-09-12T18:03:23.788 INFO:tasks.workunit.client.0.smithi052.stdout:4/814: symlink d11/d17/d1b/d2a/d82/l119 0 2024-09-12T18:03:23.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/681: unlink d2/d51/l93 0 2024-09-12T18:03:23.789 INFO:tasks.workunit.client.0.smithi052.stdout:3/689: chown d0/d4b/d4c/fd5 680 1 2024-09-12T18:03:23.789 INFO:tasks.workunit.client.0.smithi052.stdout:8/805: symlink d13/d18/d38/dfb/l10f 0 2024-09-12T18:03:23.789 INFO:tasks.workunit.client.0.smithi052.stdout:7/674: write d6/fd [1852685,2677] 0 2024-09-12T18:03:23.789 INFO:tasks.workunit.client.0.smithi052.stdout:6/776: mknod d2/d21/d9f/dd7/de7/d54/dd5/c10a 0 2024-09-12T18:03:23.790 INFO:tasks.workunit.client.0.smithi052.stdout:5/673: dread d7/d1c/d1e/f2b [0,4194304] 0 2024-09-12T18:03:23.790 INFO:tasks.workunit.client.0.smithi052.stdout:4/815: creat d11/d65/dd1/f11a x:0 0 0 2024-09-12T18:03:23.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/777: write d2/d80/fa3 [150416,129415] 0 2024-09-12T18:03:23.790 INFO:tasks.workunit.client.0.smithi052.stdout:0/682: mknod d2/d1b/d80/da3/cd5 0 2024-09-12T18:03:23.792 INFO:tasks.workunit.client.0.smithi052.stdout:3/690: rename d0/d4b/d57/d6d/ca5 to d0/d4/d33/cf4 0 2024-09-12T18:03:23.792 INFO:tasks.workunit.client.0.smithi052.stdout:5/674: symlink d7/d1f/lda 0 2024-09-12T18:03:23.792 INFO:tasks.workunit.client.0.smithi052.stdout:0/683: chown d2/d6/dd/d21/f95 12329984 1 2024-09-12T18:03:23.792 INFO:tasks.workunit.client.0.smithi052.stdout:6/778: creat d2/d21/d9f/dd7/de7/f10b x:0 0 0 2024-09-12T18:03:23.797 INFO:tasks.workunit.client.0.smithi052.stdout:5/675: creat d7/d59/dad/fdb x:0 0 0 2024-09-12T18:03:23.797 INFO:tasks.workunit.client.0.smithi052.stdout:0/684: chown d2/d6/dd/c3d 55 1 2024-09-12T18:03:23.797 INFO:tasks.workunit.client.0.smithi052.stdout:5/676: fdatasync d7/d1c/f61 0 2024-09-12T18:03:23.797 INFO:tasks.workunit.client.0.smithi052.stdout:6/779: rmdir d2/d21/d9f/dd7/de7/d58/d5d/d9c 39 2024-09-12T18:03:23.797 INFO:tasks.workunit.client.0.smithi052.stdout:5/677: getdents d7/d51/d8b/daf 0 2024-09-12T18:03:23.797 INFO:tasks.workunit.client.0.smithi052.stdout:1/587: truncate d3/d1d/d22/f57 501385 0 2024-09-12T18:03:23.798 INFO:tasks.workunit.client.0.smithi052.stdout:5/678: dread - d7/d1c/d1e/fd8 zero size 2024-09-12T18:03:23.798 INFO:tasks.workunit.client.0.smithi052.stdout:6/780: read d2/d21/d9f/dd7/de7/d54/f6f [966651,117202] 0 2024-09-12T18:03:23.798 INFO:tasks.workunit.client.0.smithi052.stdout:1/588: mknod d3/d10/d38/cc2 0 2024-09-12T18:03:23.798 INFO:tasks.workunit.client.0.smithi052.stdout:7/675: dwrite d6/d12/d1e/d29/d5d/d71/f42 [0,4194304] 0 2024-09-12T18:03:23.798 INFO:tasks.workunit.client.0.smithi052.stdout:4/816: dwrite d11/d17/d1b/d2a/d82/f5e [0,4194304] 0 2024-09-12T18:03:23.801 INFO:tasks.workunit.client.0.smithi052.stdout:8/806: truncate d13/d35/d9c/f8d 7756678 0 2024-09-12T18:03:23.801 INFO:tasks.workunit.client.0.smithi052.stdout:5/679: symlink d7/d59/d5c/d7c/ldc 0 2024-09-12T18:03:23.802 INFO:tasks.workunit.client.0.smithi052.stdout:1/589: rename d3/d1d/d22/d27/d28/d2f/fab to d3/d1d/d22/d27/d28/d2f/d74/d7f/fc3 0 2024-09-12T18:03:23.802 INFO:tasks.workunit.client.0.smithi052.stdout:8/807: write d13/f1b [11347829,33813] 0 2024-09-12T18:03:23.803 INFO:tasks.workunit.client.0.smithi052.stdout:7/676: creat d6/d12/d1e/d29/d5d/d71/d9e/fdd x:0 0 0 2024-09-12T18:03:23.805 INFO:tasks.workunit.client.0.smithi052.stdout:0/685: truncate d2/d6/dd/d21/f35 4181688 0 2024-09-12T18:03:23.807 INFO:tasks.workunit.client.0.smithi052.stdout:7/677: creat d6/d12/d1e/d29/daf/fde x:0 0 0 2024-09-12T18:03:23.807 INFO:tasks.workunit.client.0.smithi052.stdout:8/808: creat d13/d18/d21/f110 x:0 0 0 2024-09-12T18:03:23.807 INFO:tasks.workunit.client.0.smithi052.stdout:3/691: dwrite d0/d4/d25/d2a/d2c/da9/fcd [0,4194304] 0 2024-09-12T18:03:23.808 INFO:tasks.workunit.client.0.smithi052.stdout:6/781: dwrite d2/d5e/fc3 [0,4194304] 0 2024-09-12T18:03:23.808 INFO:tasks.workunit.client.0.smithi052.stdout:8/809: dread - d13/fe3 zero size 2024-09-12T18:03:23.811 INFO:tasks.workunit.client.0.smithi052.stdout:3/692: rmdir d0/d4/d25/d2a/d6/dcc 39 2024-09-12T18:03:23.811 INFO:tasks.workunit.client.0.smithi052.stdout:8/810: truncate d13/d9b/fd8 204254 0 2024-09-12T18:03:23.813 INFO:tasks.workunit.client.0.smithi052.stdout:5/680: dwrite d7/d59/f65 [4194304,4194304] 0 2024-09-12T18:03:23.813 INFO:tasks.workunit.client.0.smithi052.stdout:1/590: dwrite d3/d1d/d22/d3f/d56/fbc [0,4194304] 0 2024-09-12T18:03:23.814 INFO:tasks.workunit.client.0.smithi052.stdout:6/782: creat d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f10c x:0 0 0 2024-09-12T18:03:23.814 INFO:tasks.workunit.client.0.smithi052.stdout:2/637: sync 2024-09-12T18:03:23.815 INFO:tasks.workunit.client.0.smithi052.stdout:3/693: write d0/d4b/d4c/d6b/d48/fb9 [1064880,123069] 0 2024-09-12T18:03:23.816 INFO:tasks.workunit.client.0.smithi052.stdout:1/591: mkdir d3/d10/dc4 0 2024-09-12T18:03:23.816 INFO:tasks.workunit.client.0.smithi052.stdout:5/681: creat d7/d51/d8d/fdd x:0 0 0 2024-09-12T18:03:23.817 INFO:tasks.workunit.client.0.smithi052.stdout:2/638: symlink da/dc/d15/d20/d60/d6e/ld2 0 2024-09-12T18:03:23.817 INFO:tasks.workunit.client.0.smithi052.stdout:7/678: dread d6/d12/d1e/d29/fa6 [0,4194304] 0 2024-09-12T18:03:23.817 INFO:tasks.workunit.client.0.smithi052.stdout:8/811: rename d13/ddc/df3/l105 to d13/d18/d21/l111 0 2024-09-12T18:03:23.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/592: rmdir d3/d1d/d72 39 2024-09-12T18:03:23.817 INFO:tasks.workunit.client.0.smithi052.stdout:8/812: chown d13/d18/d5b/d70/f97 0 1 2024-09-12T18:03:23.818 INFO:tasks.workunit.client.0.smithi052.stdout:7/679: mkdir d6/d12/d1e/d29/da1/ddf 0 2024-09-12T18:03:23.819 INFO:tasks.workunit.client.0.smithi052.stdout:8/813: rmdir d13/ddc/df3 39 2024-09-12T18:03:23.819 INFO:tasks.workunit.client.0.smithi052.stdout:5/682: rename d7/d51/d8b/daf/cd9 to d7/d1c/cde 0 2024-09-12T18:03:23.819 INFO:tasks.workunit.client.0.smithi052.stdout:3/694: mknod d0/d4/d25/d2a/d6/d7/d34/d72/cf5 0 2024-09-12T18:03:23.819 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:03:23.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:03:23.821 INFO:tasks.workunit.client.0.smithi052.stdout:8/814: chown d13/d3c/c6f 642 1 2024-09-12T18:03:23.821 INFO:tasks.workunit.client.0.smithi052.stdout:7/680: symlink d6/d12/d1e/d29/d5d/le0 0 2024-09-12T18:03:23.821 INFO:tasks.workunit.client.0.smithi052.stdout:5/683: creat d7/d1c/d6f/fdf x:0 0 0 2024-09-12T18:03:23.821 INFO:tasks.workunit.client.0.smithi052.stdout:8/815: write d13/d18/d21/dc1/f94 [921289,81605] 0 2024-09-12T18:03:23.821 INFO:tasks.workunit.client.0.smithi052.stdout:1/593: mknod d3/d10/d38/d8b/cc5 0 2024-09-12T18:03:23.824 INFO:tasks.workunit.client.0.smithi052.stdout:1/594: rename d3/d10/l6b to d3/d1d/d83/d8f/lc6 0 2024-09-12T18:03:23.825 INFO:tasks.workunit.client.0.smithi052.stdout:3/695: link d0/d4/d25/d2a/d6/d7/d34/d71/ld7 d0/d4/d25/d2a/d6/d7/d34/d71/lf6 0 2024-09-12T18:03:23.826 INFO:tasks.workunit.client.0.smithi052.stdout:9/632: dread d0/d1c/f22 [0,4194304] 0 2024-09-12T18:03:23.826 INFO:tasks.workunit.client.0.smithi052.stdout:6/783: dwrite d2/d21/d9f/dd7/de7/d58/d5d/f7d [0,4194304] 0 2024-09-12T18:03:23.827 INFO:tasks.workunit.client.0.smithi052.stdout:9/633: read - d0/d18/fc3 zero size 2024-09-12T18:03:23.827 INFO:tasks.workunit.client.0.smithi052.stdout:6/784: dread - d2/d21/d9f/dd7/ffd zero size 2024-09-12T18:03:23.827 INFO:tasks.workunit.client.0.smithi052.stdout:2/639: dwrite da/dc/d15/d22/f66 [0,4194304] 0 2024-09-12T18:03:23.828 INFO:tasks.workunit.client.0.smithi052.stdout:0/686: truncate d2/d1b/d72/f5d 1063712 0 2024-09-12T18:03:23.828 INFO:tasks.workunit.client.0.smithi052.stdout:3/696: creat d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/ff7 x:0 0 0 2024-09-12T18:03:23.828 INFO:tasks.workunit.client.0.smithi052.stdout:1/595: mknod d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/dbb/cc7 0 2024-09-12T18:03:23.828 INFO:tasks.workunit.client.0.smithi052.stdout:2/640: truncate da/dc/d15/f19 779527 0 2024-09-12T18:03:23.829 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:23.825+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:23.829 INFO:tasks.workunit.client.0.smithi052.stdout:6/785: write d2/d21/d9f/fb5 [4023645,57874] 0 2024-09-12T18:03:23.830 INFO:tasks.workunit.client.0.smithi052.stdout:1/596: write d3/d1d/d22/d76/fb7 [1888499,52037] 0 2024-09-12T18:03:23.830 INFO:tasks.workunit.client.0.smithi052.stdout:3/697: write d0/d4/d25/d2a/f55 [783846,62178] 0 2024-09-12T18:03:23.831 INFO:tasks.workunit.client.0.smithi052.stdout:2/641: symlink da/dc/d15/d22/d87/ld3 0 2024-09-12T18:03:23.831 INFO:tasks.workunit.client.0.smithi052.stdout:5/684: read d7/d1f/f8c [124756,115118] 0 2024-09-12T18:03:23.831 INFO:tasks.workunit.client.0.smithi052.stdout:5/685: fdatasync d7/d1f/f76 0 2024-09-12T18:03:23.832 INFO:tasks.workunit.client.0.smithi052.stdout:1/597: mkdir d3/d1d/d22/d27/d28/d2f/d74/dc8 0 2024-09-12T18:03:23.832 INFO:tasks.workunit.client.0.smithi052.stdout:2/642: mknod da/dc/d15/d22/d87/cd4 0 2024-09-12T18:03:23.834 INFO:tasks.workunit.client.0.smithi052.stdout:6/786: rename d2/d80/fa5 to d2/d21/d9f/dd7/de7/d58/d5d/f10d 0 2024-09-12T18:03:23.834 INFO:tasks.workunit.client.0.smithi052.stdout:1/598: rmdir d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/dbb 39 2024-09-12T18:03:23.835 INFO:tasks.workunit.client.0.smithi052.stdout:0/687: dwrite d2/d6/dd/f9d [0,4194304] 0 2024-09-12T18:03:23.836 INFO:tasks.workunit.client.0.smithi052.stdout:0/688: stat d2/d6/dd/d21/d47/c74 0 2024-09-12T18:03:23.836 INFO:tasks.workunit.client.0.smithi052.stdout:1/599: link d3/d1d/d22/d27/d28/f29 d3/da2/dbe/fc9 0 2024-09-12T18:03:23.837 INFO:tasks.workunit.client.0.smithi052.stdout:0/689: creat d2/d57/d5b/d7a/fd6 x:0 0 0 2024-09-12T18:03:23.838 INFO:tasks.workunit.client.0.smithi052.stdout:1/600: truncate d3/d1d/d22/d27/d28/d2f/d74/d7f/f94 462609 0 2024-09-12T18:03:23.838 INFO:tasks.workunit.client.0.smithi052.stdout:1/601: unlink d3/d69/d89/f95 0 2024-09-12T18:03:23.841 INFO:tasks.workunit.client.0.smithi052.stdout:1/602: getdents d3/d1d/d72 0 2024-09-12T18:03:23.841 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:23.842 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:23.842 INFO:tasks.workunit.client.0.smithi052.stdout:0/690: rename d2/d6/dd/d21/d41/d59/fab to d2/d6/dd/d21/d26/fd7 0 2024-09-12T18:03:23.842 INFO:tasks.workunit.client.0.smithi052.stdout:1/603: write d3/d1d/d22/d66/f6e [1432360,40097] 0 2024-09-12T18:03:23.842 INFO:tasks.workunit.client.0.smithi052.stdout:7/681: truncate d6/d12/d17/dac/fd9 3284618 0 2024-09-12T18:03:23.842 INFO:tasks.workunit.client.0.smithi052.stdout:9/634: write d0/d6/d3a/d42/da9/fc8 [3067754,14661] 0 2024-09-12T18:03:23.843 INFO:tasks.workunit.client.0.smithi052.stdout:0/691: fdatasync d2/d6/dd/f1d 0 2024-09-12T18:03:23.843 INFO:tasks.workunit.client.0.smithi052.stdout:2/643: write f8 [1659016,53254] 0 2024-09-12T18:03:23.843 INFO:tasks.workunit.client.0.smithi052.stdout:7/682: chown d6/dc/f2f 260812919 1 2024-09-12T18:03:23.843 INFO:tasks.workunit.client.0.smithi052.stdout:1/604: creat d3/d1d/d22/d3f/db0/fca x:0 0 0 2024-09-12T18:03:23.844 INFO:tasks.workunit.client.0.smithi052.stdout:9/635: chown d0/d18/d26/d4d/d54/la8 104 1 2024-09-12T18:03:23.844 INFO:tasks.workunit.client.0.smithi052.stdout:2/644: write da/dc/d15/fc8 [176812,91317] 0 2024-09-12T18:03:23.844 INFO:tasks.workunit.client.0.smithi052.stdout:7/683: mkdir d6/d12/d1e/d29/d5d/d71/de1 0 2024-09-12T18:03:23.845 INFO:tasks.workunit.client.0.smithi052.stdout:2/645: rmdir da/d1d/d7d/db3 39 2024-09-12T18:03:23.847 INFO:tasks.workunit.client.0.smithi052.stdout:1/605: getdents d3/d1d/d22/d27/d28/d2f/d74/d7d/d84/dbb 0 2024-09-12T18:03:23.847 INFO:tasks.workunit.client.0.smithi052.stdout:7/684: chown d6/d12/d1e/d29/d5d/d71/d3a/d8f/c63 3 1 2024-09-12T18:03:23.848 INFO:tasks.workunit.client.0.smithi052.stdout:4/817: dread d11/f1f [4194304,4194304] 0 2024-09-12T18:03:23.848 INFO:tasks.workunit.client.0.smithi052.stdout:0/692: dread d2/d8/dce/fc1 [0,4194304] 0 2024-09-12T18:03:23.849 INFO:tasks.workunit.client.0.smithi052.stdout:2/646: rename da/dc/d15/d43/fb8 to da/dc/d15/d20/d60/d6e/dab/fd5 0 2024-09-12T18:03:23.849 INFO:tasks.workunit.client.0.smithi052.stdout:1/606: dread - d3/d10/d38/d44/d49/fb9 zero size 2024-09-12T18:03:23.849 INFO:tasks.workunit.client.0.smithi052.stdout:8/816: truncate d13/f67 6400406 0 2024-09-12T18:03:23.850 INFO:tasks.workunit.client.0.smithi052.stdout:7/685: creat d6/d12/d1e/d8e/dcb/fe2 x:0 0 0 2024-09-12T18:03:23.850 INFO:tasks.workunit.client.0.smithi052.stdout:0/693: readlink d2/d1b/d80/lb5 0 2024-09-12T18:03:23.850 INFO:tasks.workunit.client.0.smithi052.stdout:9/636: dread d0/d18/d37/d87/f73 [0,4194304] 0 2024-09-12T18:03:23.850 INFO:tasks.workunit.client.0.smithi052.stdout:4/818: creat d11/d65/dd1/d3b/d6f/f11b x:0 0 0 2024-09-12T18:03:23.851 INFO:tasks.workunit.client.0.smithi052.stdout:8/817: fsync d13/d35/f8b 0 2024-09-12T18:03:23.852 INFO:tasks.workunit.client.0.smithi052.stdout:0/694: mkdir d2/d6/dd/dd8 0 2024-09-12T18:03:23.852 INFO:tasks.workunit.client.0.smithi052.stdout:1/607: rename d3/d1d/d22/d27/d28/d2f to d3/dcb 0 2024-09-12T18:03:23.852 INFO:tasks.workunit.client.0.smithi052.stdout:7/686: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/fe3 x:0 0 0 2024-09-12T18:03:23.852 INFO:tasks.workunit.client.0.smithi052.stdout:8/818: unlink d13/d18/d38/f46 0 2024-09-12T18:03:23.853 INFO:tasks.workunit.client.0.smithi052.stdout:4/819: truncate d11/d17/d1b/df9/f111 577939 0 2024-09-12T18:03:23.853 INFO:tasks.workunit.client.0.smithi052.stdout:7/687: readlink d6/d12/d1e/l88 0 2024-09-12T18:03:23.853 INFO:tasks.workunit.client.0.smithi052.stdout:8/819: creat d13/d35/de1/f112 x:0 0 0 2024-09-12T18:03:23.854 INFO:tasks.workunit.client.0.smithi052.stdout:0/695: creat d2/d8/dce/d48/fd9 x:0 0 0 2024-09-12T18:03:23.854 INFO:tasks.workunit.client.0.smithi052.stdout:1/608: write d3/d1d/d22/d27/d28/f7c [1861065,43135] 0 2024-09-12T18:03:23.855 INFO:tasks.workunit.client.0.smithi052.stdout:7/688: stat d6/d12/d1e/f6f 0 2024-09-12T18:03:23.855 INFO:tasks.workunit.client.0.smithi052.stdout:8/820: dread - d13/d35/de1/f112 zero size 2024-09-12T18:03:23.855 INFO:tasks.workunit.client.0.smithi052.stdout:4/820: symlink d11/d65/dd1/d3b/d6f/l11c 0 2024-09-12T18:03:23.856 INFO:tasks.workunit.client.0.smithi052.stdout:8/821: write d13/d18/d5b/d70/fe2 [516673,37296] 0 2024-09-12T18:03:23.858 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:23.859 INFO:tasks.workunit.client.0.smithi052.stdout:4/821: creat d11/d17/d1b/df9/dfd/f11d x:0 0 0 2024-09-12T18:03:23.860 INFO:tasks.workunit.client.0.smithi052.stdout:7/689: read d6/d12/d1e/f6f [111104,62542] 0 2024-09-12T18:03:23.860 INFO:tasks.workunit.client.0.smithi052.stdout:4/822: mknod d11/d17/d1b/d2a/d82/c11e 0 2024-09-12T18:03:23.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/647: dread da/d2c/f3b [0,4194304] 0 2024-09-12T18:03:23.863 INFO:tasks.workunit.client.0.smithi052.stdout:1/609: dwrite d3/dcb/d74/d7d/d84/f96 [0,4194304] 0 2024-09-12T18:03:23.865 INFO:tasks.workunit.client.0.smithi052.stdout:0/696: write d2/d8/fa [1706169,96517] 0 2024-09-12T18:03:23.866 INFO:tasks.workunit.client.0.smithi052.stdout:4/823: symlink d11/d65/dd1/d3b/d3f/l11f 0 2024-09-12T18:03:23.866 INFO:tasks.workunit.client.0.smithi052.stdout:8/822: dwrite d13/d35/d9c/da3/fad [0,4194304] 0 2024-09-12T18:03:23.867 INFO:tasks.workunit.client.0.smithi052.stdout:2/648: mkdir da/dc/d15/da6/dbb/dd6 0 2024-09-12T18:03:23.867 INFO:tasks.workunit.client.0.smithi052.stdout:5/686: dread d7/d59/d5c/f99 [0,4194304] 0 2024-09-12T18:03:23.867 INFO:tasks.workunit.client.0.smithi052.stdout:0/697: stat d2/d6/f94 0 2024-09-12T18:03:23.868 INFO:tasks.workunit.client.0.smithi052.stdout:2/649: mknod da/d71/cd7 0 2024-09-12T18:03:23.869 INFO:tasks.workunit.client.0.smithi052.stdout:0/698: fdatasync d2/d6/f23 0 2024-09-12T18:03:23.869 INFO:tasks.workunit.client.0.smithi052.stdout:7/690: dread d6/d12/f47 [0,4194304] 0 2024-09-12T18:03:23.869 INFO:tasks.workunit.client.0.smithi052.stdout:4/824: mkdir d11/d17/d1b/d2a/d6a/d7f/d120 0 2024-09-12T18:03:23.869 INFO:tasks.workunit.client.0.smithi052.stdout:5/687: rmdir d7/d51/d8b/daf 39 2024-09-12T18:03:23.871 INFO:tasks.workunit.client.0.smithi052.stdout:2/650: mkdir da/d1d/d35/dd8 0 2024-09-12T18:03:23.871 INFO:tasks.workunit.client.0.smithi052.stdout:1/610: dread d3/fa [0,4194304] 0 2024-09-12T18:03:23.872 INFO:tasks.workunit.client.0.smithi052.stdout:4/825: creat d11/d65/dc6/d68/f121 x:0 0 0 2024-09-12T18:03:23.873 INFO:tasks.workunit.client.0.smithi052.stdout:2/651: truncate da/d2c/f3b 3008544 0 2024-09-12T18:03:23.874 INFO:tasks.workunit.client.0.smithi052.stdout:5/688: write d7/d59/d5c/d7c/fb5 [3833919,57499] 0 2024-09-12T18:03:23.874 INFO:tasks.workunit.client.0.smithi052.stdout:4/826: chown d11/d65/dc6/d95/cb1 475009 1 2024-09-12T18:03:23.875 INFO:tasks.workunit.client.0.smithi052.stdout:7/691: symlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/le4 0 2024-09-12T18:03:23.876 INFO:tasks.workunit.client.0.smithi052.stdout:9/637: dread d0/d6/d3a/d42/f76 [0,4194304] 0 2024-09-12T18:03:23.876 INFO:tasks.workunit.client.0.smithi052.stdout:4/827: write d11/d17/fa4 [1630293,57822] 0 2024-09-12T18:03:23.877 INFO:tasks.workunit.client.0.smithi052.stdout:7/692: symlink d6/d12/d1e/d29/daf/le5 0 2024-09-12T18:03:23.878 INFO:tasks.workunit.client.0.smithi052.stdout:1/611: write d3/d1d/d22/d3f/db0/fca [790023,73960] 0 2024-09-12T18:03:23.878 INFO:tasks.workunit.client.0.smithi052.stdout:9/638: creat d0/d18/d26/d4d/d54/fd4 x:0 0 0 2024-09-12T18:03:23.879 INFO:tasks.workunit.client.0.smithi052.stdout:4/828: creat d11/d65/dc6/daf/d107/dc5/dc7/f122 x:0 0 0 2024-09-12T18:03:23.879 INFO:tasks.workunit.client.0.smithi052.stdout:1/612: chown d3/dcb/d74/da3 69 1 2024-09-12T18:03:23.879 INFO:tasks.workunit.client.0.smithi052.stdout:8/823: dwrite d13/d18/d21/d64/fb5 [0,4194304] 0 2024-09-12T18:03:23.880 INFO:tasks.workunit.client.0.smithi052.stdout:9/639: mkdir d0/d6/d3a/d43/dd5 0 2024-09-12T18:03:23.881 INFO:tasks.workunit.client.0.smithi052.stdout:7/693: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/fe6 x:0 0 0 2024-09-12T18:03:23.881 INFO:tasks.workunit.client.0.smithi052.stdout:4/829: write d11/d65/dd1/d72/fd3 [123241,78254] 0 2024-09-12T18:03:23.881 INFO:tasks.workunit.client.0.smithi052.stdout:8/824: symlink d13/d18/d38/dd3/dde/l113 0 2024-09-12T18:03:23.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/694: stat d6/d12/l69 0 2024-09-12T18:03:23.884 INFO:tasks.workunit.client.0.smithi052.stdout:9/640: unlink d0/d1c/c21 0 2024-09-12T18:03:23.884 INFO:tasks.workunit.client.0.smithi052.stdout:8/825: write d13/f9d [2561187,29362] 0 2024-09-12T18:03:23.884 INFO:tasks.workunit.client.0.smithi052.stdout:5/689: dwrite d7/d1c/f3f [4194304,4194304] 0 2024-09-12T18:03:23.884 INFO:tasks.workunit.client.0.smithi052.stdout:1/613: write d3/d1d/d22/d27/f62 [1987888,67896] 0 2024-09-12T18:03:23.884 INFO:tasks.workunit.client.0.smithi052.stdout:9/641: chown d0/d6/d3a/d42/da9 10713 1 2024-09-12T18:03:23.885 INFO:tasks.workunit.client.0.smithi052.stdout:4/830: rename d11/d17/d1b/d2a/f93 to d11/d46/d51/f123 0 2024-09-12T18:03:23.885 INFO:tasks.workunit.client.0.smithi052.stdout:8/826: chown d13/d18/d5b/d70/fe2 207 1 2024-09-12T18:03:23.885 INFO:tasks.workunit.client.0.smithi052.stdout:7/695: chown d6/d12/d1e/d29/d5d/d71/d3a/d83/l9a 64986 1 2024-09-12T18:03:23.885 INFO:tasks.workunit.client.0.smithi052.stdout:4/831: stat d11/d65/dd1/d3b/l56 0 2024-09-12T18:03:23.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/642: write d0/d18/d37/f47 [64752,116935] 0 2024-09-12T18:03:23.885 INFO:tasks.workunit.client.0.smithi052.stdout:5/690: creat d7/d51/d8b/fe0 x:0 0 0 2024-09-12T18:03:23.886 INFO:tasks.workunit.client.0.smithi052.stdout:9/643: creat d0/d18/fd6 x:0 0 0 2024-09-12T18:03:23.886 INFO:tasks.workunit.client.0.smithi052.stdout:5/691: write d7/f19 [7281499,93402] 0 2024-09-12T18:03:23.886 INFO:tasks.workunit.client.0.smithi052.stdout:7/696: mkdir d6/d12/d1e/de7 0 2024-09-12T18:03:23.886 INFO:tasks.workunit.client.0.smithi052.stdout:4/832: mkdir d11/d17/d1b/d124 0 2024-09-12T18:03:23.888 INFO:tasks.workunit.client.0.smithi052.stdout:4/833: symlink d11/d70/l125 0 2024-09-12T18:03:23.888 INFO:tasks.workunit.client.0.smithi052.stdout:5/692: symlink d7/d1f/d3a/d49/le1 0 2024-09-12T18:03:23.888 INFO:tasks.workunit.client.0.smithi052.stdout:9/644: mkdir d0/d6/d3a/d43/dd7 0 2024-09-12T18:03:23.889 INFO:tasks.workunit.client.0.smithi052.stdout:4/834: readlink d11/d17/d1b/d2a/d6a/d7f/l88 0 2024-09-12T18:03:23.890 INFO:tasks.workunit.client.0.smithi052.stdout:8/827: dread d13/d35/d9c/d103/f106 [0,4194304] 0 2024-09-12T18:03:23.890 INFO:tasks.workunit.client.0.smithi052.stdout:9/645: readlink d0/d18/d79/da6/lc7 0 2024-09-12T18:03:23.892 INFO:tasks.workunit.client.0.smithi052.stdout:4/835: rename d11/d65/dc6/d95/dbf/dae to d11/d46/db8/d126 0 2024-09-12T18:03:23.893 INFO:tasks.workunit.client.0.smithi052.stdout:1/614: dwrite d3/f35 [0,4194304] 0 2024-09-12T18:03:23.893 INFO:tasks.workunit.client.0.smithi052.stdout:9/646: unlink d0/d6/d3a/d42/la2 0 2024-09-12T18:03:23.894 INFO:tasks.workunit.client.0.smithi052.stdout:4/836: fsync d11/d65/dc6/d95/fe8 0 2024-09-12T18:03:23.895 INFO:tasks.workunit.client.0.smithi052.stdout:9/647: write d0/d18/f98 [852216,88240] 0 2024-09-12T18:03:23.895 INFO:tasks.workunit.client.0.smithi052.stdout:5/693: dwrite d7/d59/fa7 [0,4194304] 0 2024-09-12T18:03:23.897 INFO:tasks.workunit.client.0.smithi052.stdout:4/837: mknod d11/d17/d1b/d2a/d82/c127 0 2024-09-12T18:03:23.899 INFO:tasks.workunit.client.0.smithi052.stdout:4/838: creat d11/d17/d1b/d2a/f128 x:0 0 0 2024-09-12T18:03:23.899 INFO:tasks.workunit.client.0.smithi052.stdout:7/697: dread d6/f3c [0,4194304] 0 2024-09-12T18:03:23.900 INFO:tasks.workunit.client.0.smithi052.stdout:7/698: creat d6/dc/fe8 x:0 0 0 2024-09-12T18:03:23.900 INFO:tasks.workunit.client.0.smithi052.stdout:4/839: mkdir d11/d17/d1b/d2a/d82/d129 0 2024-09-12T18:03:23.901 INFO:tasks.workunit.client.0.smithi052.stdout:4/840: readlink d11/d65/dc6/daf/le1 0 2024-09-12T18:03:23.902 INFO:tasks.workunit.client.0.smithi052.stdout:7/699: chown d6/c8 1550646216 1 2024-09-12T18:03:23.903 INFO:tasks.workunit.client.0.smithi052.stdout:6/787: sync 2024-09-12T18:03:23.903 INFO:tasks.workunit.client.0.smithi052.stdout:3/698: sync 2024-09-12T18:03:23.904 INFO:tasks.workunit.client.0.smithi052.stdout:0/699: sync 2024-09-12T18:03:23.904 INFO:tasks.workunit.client.0.smithi052.stdout:9/648: dwrite d0/da3/db8/f5f [4194304,4194304] 0 2024-09-12T18:03:23.904 INFO:tasks.workunit.client.0.smithi052.stdout:7/700: dread - d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb6 zero size 2024-09-12T18:03:23.904 INFO:tasks.workunit.client.0.smithi052.stdout:2/652: dread da/dc/d15/d22/f8d [0,4194304] 0 2024-09-12T18:03:23.905 INFO:tasks.workunit.client.0.smithi052.stdout:4/841: write d11/d17/d1b/d2a/d6a/ff7 [656349,104468] 0 2024-09-12T18:03:23.906 INFO:tasks.workunit.client.0.smithi052.stdout:0/700: creat d2/d57/d5b/fda x:0 0 0 2024-09-12T18:03:23.906 INFO:tasks.workunit.client.0.smithi052.stdout:0/701: fdatasync d2/d8/f30 0 2024-09-12T18:03:23.907 INFO:tasks.workunit.client.0.smithi052.stdout:6/788: fsync d2/d21/d9f/dd7/de7/f104 0 2024-09-12T18:03:23.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/699: dread d0/d4/d25/d2a/d6/d41/f59 [0,4194304] 0 2024-09-12T18:03:23.907 INFO:tasks.workunit.client.0.smithi052.stdout:6/789: chown d2/d49/c81 0 1 2024-09-12T18:03:23.909 INFO:tasks.workunit.client.0.smithi052.stdout:1/615: truncate d3/d1d/d22/d3f/d56/f79 280666 0 2024-09-12T18:03:23.909 INFO:tasks.workunit.client.0.smithi052.stdout:6/790: mknod d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/c10e 0 2024-09-12T18:03:23.909 INFO:tasks.workunit.client.0.smithi052.stdout:2/653: write da/dc/d15/d20/d60/d6e/fce [628542,84738] 0 2024-09-12T18:03:23.910 INFO:tasks.workunit.client.0.smithi052.stdout:0/702: rename d2/d6/f10 to d2/d1b/fdb 0 2024-09-12T18:03:23.910 INFO:tasks.workunit.client.0.smithi052.stdout:4/842: unlink d11/d17/d1b/d2a/d33/f8c 0 2024-09-12T18:03:23.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/654: readlink da/d21/d6b/l9f 0 2024-09-12T18:03:23.910 INFO:tasks.workunit.client.0.smithi052.stdout:1/616: write d3/dcb/d74/d7d/d84/f96 [101506,89628] 0 2024-09-12T18:03:23.911 INFO:tasks.workunit.client.0.smithi052.stdout:9/649: link d0/d18/d37/d9e/cd0 d0/d18/d79/da6/cd8 0 2024-09-12T18:03:23.912 INFO:tasks.workunit.client.0.smithi052.stdout:6/791: creat d2/d21/d9f/dd7/de7/d58/d5d/f10f x:0 0 0 2024-09-12T18:03:23.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/843: truncate d11/d17/d1b/d2a/d82/fda 290917 0 2024-09-12T18:03:23.913 INFO:tasks.workunit.client.0.smithi052.stdout:0/703: symlink d2/d6/dd/d21/ldc 0 2024-09-12T18:03:23.913 INFO:tasks.workunit.client.0.smithi052.stdout:2/655: mkdir da/d1d/dd9 0 2024-09-12T18:03:23.913 INFO:tasks.workunit.client.0.smithi052.stdout:9/650: write d0/d58/f83 [1562159,84774] 0 2024-09-12T18:03:23.914 INFO:tasks.workunit.client.0.smithi052.stdout:0/704: write d2/f29 [2109332,107466] 0 2024-09-12T18:03:23.915 INFO:tasks.workunit.client.0.smithi052.stdout:1/617: rename d3/d1d/d22/d27/d28/f7c to d3/d10/d38/d44/dac/fcc 0 2024-09-12T18:03:23.915 INFO:tasks.workunit.client.0.smithi052.stdout:6/792: symlink d2/d21/d9f/dd7/de7/l110 0 2024-09-12T18:03:23.915 INFO:tasks.workunit.client.0.smithi052.stdout:3/700: dwrite d0/d4/d25/d2a/fdb [0,4194304] 0 2024-09-12T18:03:23.917 INFO:tasks.workunit.client.0.smithi052.stdout:4/844: symlink d11/d65/dc6/d95/dbf/d8e/dd4/l12a 0 2024-09-12T18:03:23.917 INFO:tasks.workunit.client.0.smithi052.stdout:2/656: symlink da/d1d/lda 0 2024-09-12T18:03:23.917 INFO:tasks.workunit.client.0.smithi052.stdout:6/793: write d2/d21/d6a/f96 [606894,126760] 0 2024-09-12T18:03:23.917 INFO:tasks.workunit.client.0.smithi052.stdout:2/657: fdatasync da/dc/d15/d20/fc0 0 2024-09-12T18:03:23.917 INFO:tasks.workunit.client.0.smithi052.stdout:4/845: stat d11/d65/dc6/daf/d107/fba 0 2024-09-12T18:03:23.918 INFO:tasks.workunit.client.0.smithi052.stdout:6/794: mknod d2/d49/c111 0 2024-09-12T18:03:23.918 INFO:tasks.workunit.client.0.smithi052.stdout:3/701: mkdir d0/d4/d25/d2a/d6/d7/de/da1/da4/df8 0 2024-09-12T18:03:23.918 INFO:tasks.workunit.client.0.smithi052.stdout:0/705: mknod d2/cdd 0 2024-09-12T18:03:23.918 INFO:tasks.workunit.client.0.smithi052.stdout:2/658: creat da/dc/d15/d20/d60/d6e/fdb x:0 0 0 2024-09-12T18:03:23.919 INFO:tasks.workunit.client.0.smithi052.stdout:0/706: chown d2/d6/dd/d21/d26/d38/l46 1040843 1 2024-09-12T18:03:23.919 INFO:tasks.workunit.client.0.smithi052.stdout:3/702: creat d0/d4b/d4c/ff9 x:0 0 0 2024-09-12T18:03:23.920 INFO:tasks.workunit.client.0.smithi052.stdout:0/707: mknod d2/d1b/d72/d8d/cde 0 2024-09-12T18:03:23.921 INFO:tasks.workunit.client.0.smithi052.stdout:3/703: write d0/d4b/d4c/fd5 [2811376,5271] 0 2024-09-12T18:03:23.922 INFO:tasks.workunit.client.0.smithi052.stdout:0/708: dread - d2/d6/dd/d21/d41/fa6 zero size 2024-09-12T18:03:23.923 INFO:tasks.workunit.client.0.smithi052.stdout:3/704: creat d0/d4b/d4c/d6b/d48/ffa x:0 0 0 2024-09-12T18:03:23.924 INFO:tasks.workunit.client.0.smithi052.stdout:5/694: truncate d7/d59/d5c/f99 75012 0 2024-09-12T18:03:23.925 INFO:tasks.workunit.client.0.smithi052.stdout:1/618: dwrite d3/d10/d38/d44/dac/fcc [0,4194304] 0 2024-09-12T18:03:23.925 INFO:tasks.workunit.client.0.smithi052.stdout:4/846: dwrite d11/d65/dd1/d72/fd3 [0,4194304] 0 2024-09-12T18:03:23.926 INFO:tasks.workunit.client.0.smithi052.stdout:0/709: creat d2/d1b/d80/da3/fdf x:0 0 0 2024-09-12T18:03:23.927 INFO:tasks.workunit.client.0.smithi052.stdout:8/828: dread d13/d18/d21/f59 [0,4194304] 0 2024-09-12T18:03:23.927 INFO:tasks.workunit.client.0.smithi052.stdout:1/619: chown d3/d1d/d22/d27/d28/c55 1 1 2024-09-12T18:03:23.928 INFO:tasks.workunit.client.0.smithi052.stdout:4/847: mkdir d11/d65/dc6/d95/d12b 0 2024-09-12T18:03:23.929 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:23.923+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:23.930 INFO:tasks.workunit.client.0.smithi052.stdout:7/701: dwrite d6/d12/d17/dac/fd9 [0,4194304] 0 2024-09-12T18:03:23.931 INFO:tasks.workunit.client.0.smithi052.stdout:0/710: symlink d2/d8/dce/d48/le0 0 2024-09-12T18:03:23.931 INFO:tasks.workunit.client.0.smithi052.stdout:4/848: creat d11/d17/d1b/d2a/d82/d129/f12c x:0 0 0 2024-09-12T18:03:23.932 INFO:tasks.workunit.client.0.smithi052.stdout:1/620: rename d3/d10/d38/d8b/fad to d3/d1d/d72/fcd 0 2024-09-12T18:03:23.932 INFO:tasks.workunit.client.0.smithi052.stdout:8/829: creat d13/d18/d5b/d70/f114 x:0 0 0 2024-09-12T18:03:23.933 INFO:tasks.workunit.client.0.smithi052.stdout:3/705: truncate d0/d4/d25/d2a/d6/d41/f45 4145237 0 2024-09-12T18:03:23.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:23.935 INFO:tasks.workunit.client.0.smithi052.stdout:4/849: truncate d11/d65/f71 4461592 0 2024-09-12T18:03:23.935 INFO:tasks.workunit.client.0.smithi052.stdout:1/621: creat d3/d1d/d72/fce x:0 0 0 2024-09-12T18:03:23.935 INFO:tasks.workunit.client.0.smithi052.stdout:0/711: creat d2/d6/dd/d21/d26/d38/d4a/d86/fe1 x:0 0 0 2024-09-12T18:03:23.936 INFO:tasks.workunit.client.0.smithi052.stdout:7/702: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/fe9 x:0 0 0 2024-09-12T18:03:23.936 INFO:tasks.workunit.client.0.smithi052.stdout:5/695: dwrite d7/d1c/d1e/fd8 [0,4194304] 0 2024-09-12T18:03:23.937 INFO:tasks.workunit.client.0.smithi052.stdout:8/830: creat d13/d18/d38/dd3/dde/f115 x:0 0 0 2024-09-12T18:03:23.937 INFO:tasks.workunit.client.0.smithi052.stdout:2/659: dread da/d1d/d7d/fa7 [4194304,4194304] 0 2024-09-12T18:03:23.937 INFO:tasks.workunit.client.0.smithi052.stdout:7/703: write d6/d12/d1e/d29/f91 [3015065,111948] 0 2024-09-12T18:03:23.937 INFO:tasks.workunit.client.0.smithi052.stdout:1/622: chown d3/d1d/d22/d3f/d56/l75 49 1 2024-09-12T18:03:23.938 INFO:tasks.workunit.client.0.smithi052.stdout:3/706: read - d0/d16/d60/ddf/fad zero size 2024-09-12T18:03:23.939 INFO:tasks.workunit.client.0.smithi052.stdout:2/660: stat da/dc/d15/d20/d60/d6e/c9c 0 2024-09-12T18:03:23.940 INFO:tasks.workunit.client.0.smithi052.stdout:7/704: creat d6/d12/d1e/d29/daf/fea x:0 0 0 2024-09-12T18:03:23.940 INFO:tasks.workunit.client.0.smithi052.stdout:5/696: dread - d7/d59/d5c/d7c/fd5 zero size 2024-09-12T18:03:23.941 INFO:tasks.workunit.client.0.smithi052.stdout:4/850: read d11/f1f [1223009,44921] 0 2024-09-12T18:03:23.941 INFO:tasks.workunit.client.0.smithi052.stdout:1/623: getdents d3/d1d/d22/d27/d28 0 2024-09-12T18:03:23.942 INFO:tasks.workunit.client.0.smithi052.stdout:3/707: readlink d0/d4/d25/d2a/d6/d7/d34/lc9 0 2024-09-12T18:03:23.943 INFO:tasks.workunit.client.0.smithi052.stdout:2/661: mknod da/d1d/d7d/db3/cdc 0 2024-09-12T18:03:23.945 INFO:tasks.workunit.client.0.smithi052.stdout:2/662: write da/dc/d15/fc8 [477854,49929] 0 2024-09-12T18:03:23.945 INFO:tasks.workunit.client.0.smithi052.stdout:4/851: write d11/d17/d1b/d2a/d33/f10b [348578,71296] 0 2024-09-12T18:03:23.946 INFO:tasks.workunit.client.0.smithi052.stdout:0/712: dwrite d2/d8/f30 [0,4194304] 0 2024-09-12T18:03:23.947 INFO:tasks.workunit.client.0.smithi052.stdout:5/697: mknod d7/d51/d8b/daf/ce2 0 2024-09-12T18:03:23.947 INFO:tasks.workunit.client.0.smithi052.stdout:4/852: write d11/f15 [4444340,62534] 0 2024-09-12T18:03:23.947 INFO:tasks.workunit.client.0.smithi052.stdout:7/705: rename d6/d12/d1e/l20 to d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/leb 0 2024-09-12T18:03:23.948 INFO:tasks.workunit.client.0.smithi052.stdout:0/713: fsync d2/d6/f94 0 2024-09-12T18:03:23.948 INFO:tasks.workunit.client.0.smithi052.stdout:2/663: creat da/dc/d15/fdd x:0 0 0 2024-09-12T18:03:23.948 INFO:tasks.workunit.client.0.smithi052.stdout:5/698: mknod d7/d59/dbe/ce3 0 2024-09-12T18:03:23.949 INFO:tasks.workunit.client.0.smithi052.stdout:0/714: creat d2/d51/fe2 x:0 0 0 2024-09-12T18:03:23.949 INFO:tasks.workunit.client.0.smithi052.stdout:4/853: mkdir d11/d17/d1b/df9/d12d 0 2024-09-12T18:03:23.950 INFO:tasks.workunit.client.0.smithi052.stdout:5/699: truncate d7/d1f/d3a/fbb 102622 0 2024-09-12T18:03:23.951 INFO:tasks.workunit.client.0.smithi052.stdout:7/706: write d6/dc/d1a/d6a/f8a [3886352,62527] 0 2024-09-12T18:03:23.952 INFO:tasks.workunit.client.0.smithi052.stdout:1/624: dwrite d3/d10/f26 [0,4194304] 0 2024-09-12T18:03:23.953 INFO:tasks.workunit.client.0.smithi052.stdout:0/715: creat d2/d1b/d72/d8d/fe3 x:0 0 0 2024-09-12T18:03:23.953 INFO:tasks.workunit.client.0.smithi052.stdout:4/854: mkdir d11/d65/dc6/daf/d12e 0 2024-09-12T18:03:23.955 INFO:tasks.workunit.client.0.smithi052.stdout:6/795: dread d2/f70 [0,4194304] 0 2024-09-12T18:03:23.956 INFO:tasks.workunit.client.0.smithi052.stdout:4/855: symlink d11/l12f 0 2024-09-12T18:03:23.958 INFO:tasks.workunit.client.0.smithi052.stdout:1/625: creat d3/d10/d38/d44/fcf x:0 0 0 2024-09-12T18:03:23.959 INFO:tasks.workunit.client.0.smithi052.stdout:0/716: read d2/d6/dd/d21/d26/fd7 [2402792,27703] 0 2024-09-12T18:03:23.959 INFO:tasks.workunit.client.0.smithi052.stdout:7/707: write d6/ff [4909189,78191] 0 2024-09-12T18:03:23.961 INFO:tasks.workunit.client.0.smithi052.stdout:8/831: dread d13/d18/d21/d64/f8c [0,4194304] 0 2024-09-12T18:03:23.961 INFO:tasks.workunit.client.0.smithi052.stdout:2/664: dwrite da/dc/d15/d22/f8d [4194304,4194304] 0 2024-09-12T18:03:23.961 INFO:tasks.workunit.client.0.smithi052.stdout:3/708: dread d0/d4/d25/d2a/d6/d7/fd4 [0,4194304] 0 2024-09-12T18:03:23.962 INFO:tasks.workunit.client.0.smithi052.stdout:7/708: fsync d6/d12/d1e/d29/d5d/f78 0 2024-09-12T18:03:23.962 INFO:tasks.workunit.client.0.smithi052.stdout:2/665: stat da/dc/d15/d22/fac 0 2024-09-12T18:03:23.963 INFO:tasks.workunit.client.0.smithi052.stdout:1/626: mknod d3/d1d/d22/d27/d28/d88/cd0 0 2024-09-12T18:03:23.963 INFO:tasks.workunit.client.0.smithi052.stdout:8/832: creat d13/d9b/f116 x:0 0 0 2024-09-12T18:03:23.963 INFO:tasks.workunit.client.0.smithi052.stdout:0/717: write d2/f31 [5958305,14801] 0 2024-09-12T18:03:23.963 INFO:tasks.workunit.client.0.smithi052.stdout:3/709: symlink d0/d4/d25/d2a/d2c/da9/lfb 0 2024-09-12T18:03:23.964 INFO:tasks.workunit.client.0.smithi052.stdout:7/709: unlink d6/dc/d1a/f54 0 2024-09-12T18:03:23.964 INFO:tasks.workunit.client.0.smithi052.stdout:1/627: stat d3/d1d/d22/d3f/f5f 0 2024-09-12T18:03:23.964 INFO:tasks.workunit.client.0.smithi052.stdout:0/718: stat d2/d51 0 2024-09-12T18:03:23.965 INFO:tasks.workunit.client.0.smithi052.stdout:5/700: dwrite d7/d59/d5c/d7c/fb5 [8388608,4194304] 0 2024-09-12T18:03:23.965 INFO:tasks.workunit.client.0.smithi052.stdout:7/710: write d6/d12/d1e/d29/f67 [3123606,110753] 0 2024-09-12T18:03:23.967 INFO:tasks.workunit.client.0.smithi052.stdout:5/701: unlink d7/d51/d8d/f8e 0 2024-09-12T18:03:23.967 INFO:tasks.workunit.client.0.smithi052.stdout:8/833: link d13/d3c/f6d d13/f117 0 2024-09-12T18:03:23.967 INFO:tasks.workunit.client.0.smithi052.stdout:1/628: creat d3/d1d/fd1 x:0 0 0 2024-09-12T18:03:23.967 INFO:tasks.workunit.client.0.smithi052.stdout:3/710: link d0/d16/c1f d0/d4/d25/d2a/d6/d7/d34/d71/dde/cfc 0 2024-09-12T18:03:23.968 INFO:tasks.workunit.client.0.smithi052.stdout:5/702: symlink d7/d51/d8b/da3/le4 0 2024-09-12T18:03:23.969 INFO:tasks.workunit.client.0.smithi052.stdout:1/629: rename d3/d10/d38/d44/d49/f52 to d3/d10/dc4/fd2 0 2024-09-12T18:03:23.969 INFO:tasks.workunit.client.0.smithi052.stdout:1/630: rmdir d3/dcb/d74 39 2024-09-12T18:03:23.969 INFO:tasks.workunit.client.0.smithi052.stdout:5/703: truncate d7/d1c/d6f/fc3 913389 0 2024-09-12T18:03:23.971 INFO:tasks.workunit.client.0.smithi052.stdout:2/666: read da/d1d/d7d/fa7 [2474776,45103] 0 2024-09-12T18:03:23.971 INFO:tasks.workunit.client.0.smithi052.stdout:3/711: rename d0/d16/l8a to d0/d4/d25/d2a/d6/d7/de/lfd 0 2024-09-12T18:03:23.971 INFO:tasks.workunit.client.0.smithi052.stdout:5/704: chown d7/d1c/d1e/l5e 26979179 1 2024-09-12T18:03:23.971 INFO:tasks.workunit.client.0.smithi052.stdout:7/711: read d6/f89 [1977391,72216] 0 2024-09-12T18:03:23.972 INFO:tasks.workunit.client.0.smithi052.stdout:3/712: symlink d0/daf/lfe 0 2024-09-12T18:03:23.972 INFO:tasks.workunit.client.0.smithi052.stdout:7/712: fsync d6/dc/fe8 0 2024-09-12T18:03:23.973 INFO:tasks.workunit.client.0.smithi052.stdout:2/667: truncate da/dc/d15/d22/f9d 826947 0 2024-09-12T18:03:23.973 INFO:tasks.workunit.client.0.smithi052.stdout:7/713: symlink d6/d12/lec 0 2024-09-12T18:03:23.974 INFO:tasks.workunit.client.0.smithi052.stdout:2/668: symlink da/dc/d15/d43/lde 0 2024-09-12T18:03:23.974 INFO:tasks.workunit.client.0.smithi052.stdout:3/713: mknod d0/d4/d25/d2a/d6/d7/de/cff 0 2024-09-12T18:03:23.975 INFO:tasks.workunit.client.0.smithi052.stdout:3/714: chown d0/d4b/d4c/f46 1458535329 1 2024-09-12T18:03:23.977 INFO:tasks.workunit.client.0.smithi052.stdout:3/715: creat d0/d4/d25/d2a/d6/d7/dab/f100 x:0 0 0 2024-09-12T18:03:23.977 INFO:tasks.workunit.client.0.smithi052.stdout:1/631: truncate d3/dcb/f80 800274 0 2024-09-12T18:03:23.977 INFO:tasks.workunit.client.0.smithi052.stdout:3/716: write d0/fef [202959,97494] 0 2024-09-12T18:03:23.979 INFO:tasks.workunit.client.0.smithi052.stdout:7/714: truncate d6/dc/f8c 1755293 0 2024-09-12T18:03:23.980 INFO:tasks.workunit.client.0.smithi052.stdout:3/717: rmdir d0/d4/d25/d2a/d6/d7 39 2024-09-12T18:03:23.980 INFO:tasks.workunit.client.0.smithi052.stdout:1/632: link d3/d1d/d22/d76/c8d d3/dcb/d74/da3/cd3 0 2024-09-12T18:03:23.981 INFO:tasks.workunit.client.0.smithi052.stdout:3/718: chown d0/d4b/c4e 431750 1 2024-09-12T18:03:23.981 INFO:tasks.workunit.client.0.smithi052.stdout:7/715: write d6/d12/d1e/d29/d5d/d71/d9e/fc9 [2031030,14183] 0 2024-09-12T18:03:23.982 INFO:tasks.workunit.client.0.smithi052.stdout:5/705: dwrite d7/d1c/d1e/f52 [0,4194304] 0 2024-09-12T18:03:23.983 INFO:tasks.workunit.client.0.smithi052.stdout:7/716: chown d6/d12/d17/dac/fd9 2320596 1 2024-09-12T18:03:23.983 INFO:tasks.workunit.client.0.smithi052.stdout:2/669: dwrite da/dc/d15/d20/d60/d6e/fdb [0,4194304] 0 2024-09-12T18:03:23.983 INFO:tasks.workunit.client.0.smithi052.stdout:5/706: chown d7/d1f/c6a 102 1 2024-09-12T18:03:23.984 INFO:tasks.workunit.client.0.smithi052.stdout:3/719: write d0/fa0 [720131,39991] 0 2024-09-12T18:03:23.985 INFO:tasks.workunit.client.0.smithi052.stdout:3/720: write d0/d16/d60/fca [867973,87229] 0 2024-09-12T18:03:23.985 INFO:tasks.workunit.client.0.smithi052.stdout:7/717: dread d6/d12/d1e/f6f [0,4194304] 0 2024-09-12T18:03:23.986 INFO:tasks.workunit.client.0.smithi052.stdout:7/718: write d6/d12/fbc [2089424,71618] 0 2024-09-12T18:03:23.987 INFO:tasks.workunit.client.0.smithi052.stdout:1/633: link d3/d10/l2d d3/dcb/d74/d7f/ld4 0 2024-09-12T18:03:23.987 INFO:tasks.workunit.client.0.smithi052.stdout:5/707: creat d7/d59/dbe/fe5 x:0 0 0 2024-09-12T18:03:23.988 INFO:tasks.workunit.client.0.smithi052.stdout:3/721: symlink d0/daf/l101 0 2024-09-12T18:03:23.988 INFO:tasks.workunit.client.0.smithi052.stdout:7/719: write d6/d12/d1e/d29/da1/fb2 [1491497,61787] 0 2024-09-12T18:03:23.988 INFO:tasks.workunit.client.0.smithi052.stdout:3/722: fdatasync d0/fcb 0 2024-09-12T18:03:23.990 INFO:tasks.workunit.client.0.smithi052.stdout:7/720: rmdir d6/d12/d1e/d29 39 2024-09-12T18:03:23.991 INFO:tasks.workunit.client.0.smithi052.stdout:1/634: mkdir d3/d1d/d22/d3f/d56/dd5 0 2024-09-12T18:03:23.991 INFO:tasks.workunit.client.0.smithi052.stdout:7/721: mknod d6/d12/d1e/d29/ced 0 2024-09-12T18:03:23.992 INFO:tasks.workunit.client.0.smithi052.stdout:3/723: dread d0/d4/d25/fb5 [0,4194304] 0 2024-09-12T18:03:23.992 INFO:tasks.workunit.client.0.smithi052.stdout:7/722: stat d6/f76 0 2024-09-12T18:03:23.992 INFO:tasks.workunit.client.0.smithi052.stdout:5/708: getdents d7/d1c/d67 0 2024-09-12T18:03:23.993 INFO:tasks.workunit.client.0.smithi052.stdout:7/723: chown d6/d12/d1e 1009362830 1 2024-09-12T18:03:23.993 INFO:tasks.workunit.client.0.smithi052.stdout:3/724: symlink d0/d4/d25/d2a/d6/l102 0 2024-09-12T18:03:23.993 INFO:tasks.workunit.client.0.smithi052.stdout:5/709: write d7/d59/f97 [1274592,36001] 0 2024-09-12T18:03:23.993 INFO:tasks.workunit.client.0.smithi052.stdout:5/710: write d7/d59/dbe/d6b/fa1 [2151464,53123] 0 2024-09-12T18:03:23.993 INFO:tasks.workunit.client.0.smithi052.stdout:3/725: creat d0/d4b/d4c/d6b/f103 x:0 0 0 2024-09-12T18:03:23.994 INFO:tasks.workunit.client.0.smithi052.stdout:5/711: stat d7/d59 0 2024-09-12T18:03:23.995 INFO:tasks.workunit.client.0.smithi052.stdout:3/726: mknod d0/d4b/d57/d6d/c104 0 2024-09-12T18:03:23.995 INFO:tasks.workunit.client.0.smithi052.stdout:5/712: mkdir d7/d1c/d1e/da5/de6 0 2024-09-12T18:03:24.000 INFO:tasks.workunit.client.0.smithi052.stdout:2/670: dwrite da/dc/d15/d43/f72 [0,4194304] 0 2024-09-12T18:03:24.001 INFO:tasks.workunit.client.0.smithi052.stdout:3/727: truncate d0/f13 2561118 0 2024-09-12T18:03:24.001 INFO:tasks.workunit.client.0.smithi052.stdout:2/671: fdatasync da/d2c/f2d 0 2024-09-12T18:03:24.002 INFO:tasks.workunit.client.0.smithi052.stdout:2/672: truncate da/d21/f26 1155137 0 2024-09-12T18:03:24.002 INFO:tasks.workunit.client.0.smithi052.stdout:0/719: dread d2/d1b/d72/d69/f7f [0,4194304] 0 2024-09-12T18:03:24.003 INFO:tasks.workunit.client.0.smithi052.stdout:5/713: dwrite d7/d59/f97 [0,4194304] 0 2024-09-12T18:03:24.003 INFO:tasks.workunit.client.0.smithi052.stdout:3/728: chown d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/de0/ff1 61068 1 2024-09-12T18:03:24.004 INFO:tasks.workunit.client.0.smithi052.stdout:7/724: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/dee 0 2024-09-12T18:03:24.005 INFO:tasks.workunit.client.0.smithi052.stdout:3/729: chown d0/d4/d25/d2a/d6/d7/d34/d71/dde 965461 1 2024-09-12T18:03:24.005 INFO:tasks.workunit.client.0.smithi052.stdout:7/725: mkdir d6/d12/d1e/dae/db3/def 0 2024-09-12T18:03:24.006 INFO:tasks.workunit.client.0.smithi052.stdout:7/726: chown d6/d12/d17/dac/fd9 18449743 1 2024-09-12T18:03:24.006 INFO:tasks.workunit.client.0.smithi052.stdout:3/730: unlink d0/d4b/d57/d6d/c104 0 2024-09-12T18:03:24.006 INFO:tasks.workunit.client.0.smithi052.stdout:0/720: truncate d2/d6/dd/d21/d26/d38/d4a/fae 2139920 0 2024-09-12T18:03:24.007 INFO:tasks.workunit.client.0.smithi052.stdout:0/721: chown d2/d51/fe2 2 1 2024-09-12T18:03:24.007 INFO:tasks.workunit.client.0.smithi052.stdout:7/727: creat d6/d12/d1e/d29/d5d/d71/ff0 x:0 0 0 2024-09-12T18:03:24.008 INFO:tasks.workunit.client.0.smithi052.stdout:7/728: creat d6/d12/d1e/d8e/dcb/ff1 x:0 0 0 2024-09-12T18:03:24.009 INFO:tasks.workunit.client.0.smithi052.stdout:0/722: link d2/d6/l28 d2/le4 0 2024-09-12T18:03:24.010 INFO:tasks.workunit.client.0.smithi052.stdout:7/729: dread - d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/fe6 zero size 2024-09-12T18:03:24.010 INFO:tasks.workunit.client.0.smithi052.stdout:0/723: chown d2/d57/d5b/d7a 49683 1 2024-09-12T18:03:24.014 INFO:tasks.workunit.client.0.smithi052.stdout:0/724: mkdir d2/d6/dd/d21/d26/d65/de5 0 2024-09-12T18:03:24.016 INFO:tasks.workunit.client.0.smithi052.stdout:0/725: mknod d2/d6/dd/dad/ce6 0 2024-09-12T18:03:24.017 INFO:tasks.workunit.client.0.smithi052.stdout:0/726: creat d2/d1b/fe7 x:0 0 0 2024-09-12T18:03:24.017 INFO:tasks.workunit.client.0.smithi052.stdout:4/856: dread d11/d65/f71 [0,4194304] 0 2024-09-12T18:03:24.018 INFO:tasks.workunit.client.0.smithi052.stdout:7/730: dwrite d6/dc/fe8 [0,4194304] 0 2024-09-12T18:03:24.020 INFO:tasks.workunit.client.0.smithi052.stdout:4/857: mkdir d11/d65/dc6/daf/d107/d130 0 2024-09-12T18:03:24.022 INFO:tasks.workunit.client.0.smithi052.stdout:7/731: write d6/d12/d1e/d29/daf/fea [827988,6049] 0 2024-09-12T18:03:24.022 INFO:tasks.workunit.client.0.smithi052.stdout:4/858: fdatasync d11/d46/db8/fc0 0 2024-09-12T18:03:24.023 INFO:tasks.workunit.client.0.smithi052.stdout:7/732: creat d6/dc/d1a/ff2 x:0 0 0 2024-09-12T18:03:24.023 INFO:tasks.workunit.client.0.smithi052.stdout:4/859: read - d11/d46/d51/f55 zero size 2024-09-12T18:03:24.025 INFO:tasks.workunit.client.0.smithi052.stdout:4/860: write d11/d65/dc6/d95/dbf/d8e/fc1 [4129600,114792] 0 2024-09-12T18:03:24.025 INFO:tasks.workunit.client.0.smithi052.stdout:2/673: dread da/dc/d15/d22/fac [0,4194304] 0 2024-09-12T18:03:24.026 INFO:tasks.workunit.client.0.smithi052.stdout:7/733: rename d6/d12/d17/lc4 to d6/d12/d1e/d29/lf3 0 2024-09-12T18:03:24.026 INFO:tasks.workunit.client.0.smithi052.stdout:4/861: chown d11/d17/d1b/d2a/d6a/c77 579302 1 2024-09-12T18:03:24.026 INFO:tasks.workunit.client.0.smithi052.stdout:2/674: mkdir da/d2c/dbf/ddf 0 2024-09-12T18:03:24.027 INFO:tasks.workunit.client.0.smithi052.stdout:7/734: readlink d6/d12/l18 0 2024-09-12T18:03:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:0/727: read - d2/d6/dd/d21/d26/d38/d4a/fc4 zero size 2024-09-12T18:03:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:4/862: mknod d11/d17/d1b/d2a/c131 0 2024-09-12T18:03:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:4/863: chown d11/d17/fa6 35793373 1 2024-09-12T18:03:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:0/728: stat d2/d6/dd/d21/d47/c74 0 2024-09-12T18:03:24.029 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:24.025+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:3/731: dread d0/d4/d25/d2a/d6/d41/f45 [0,4194304] 0 2024-09-12T18:03:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:4/864: dread - d11/d17/d1b/d2a/d6a/d7f/dd6/ff4 zero size 2024-09-12T18:03:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:4/865: readlink d11/d17/d1b/d2a/d6a/d7f/d90/l10a 0 2024-09-12T18:03:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:3/732: fdatasync d0/d4/d25/fb5 0 2024-09-12T18:03:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:4/866: creat d11/d46/dd9/f132 x:0 0 0 2024-09-12T18:03:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:7/735: dwrite d6/f5a [0,4194304] 0 2024-09-12T18:03:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:4/867: mknod d11/d65/d114/c133 0 2024-09-12T18:03:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:2/675: write da/dc/d15/f39 [6162352,39124] 0 2024-09-12T18:03:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:9/651: sync 2024-09-12T18:03:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:7/736: dread d6/d12/d1e/f6f [0,4194304] 0 2024-09-12T18:03:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:0/729: dwrite d2/d6/fb [4194304,4194304] 0 2024-09-12T18:03:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:7/737: creat d6/d12/d1e/d29/da1/ff4 x:0 0 0 2024-09-12T18:03:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:9/652: creat d0/d6/d3a/fd9 x:0 0 0 2024-09-12T18:03:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:7/738: write d6/dc/fe [5059043,27080] 0 2024-09-12T18:03:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:9/653: write d0/d6/d94/fc9 [601600,26064] 0 2024-09-12T18:03:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:7/739: chown d6/d12/d1e/d29/d5d/d71/ff0 20944 1 2024-09-12T18:03:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:9/654: mknod d0/d6/d3a/d42/cda 0 2024-09-12T18:03:24.045 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:24.045 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:9/655: link d0/d18/d37/lcf d0/d18/d79/da6/ldb 0 2024-09-12T18:03:24.050 INFO:tasks.workunit.client.0.smithi052.stdout:7/740: dread d6/d12/d1e/d8e/f92 [0,4194304] 0 2024-09-12T18:03:24.053 INFO:tasks.workunit.client.0.smithi052.stdout:9/656: dwrite d0/d18/d26/d4d/f8a [0,4194304] 0 2024-09-12T18:03:24.054 INFO:tasks.workunit.client.0.smithi052.stdout:9/657: stat d0/d6/fd 0 2024-09-12T18:03:24.055 INFO:tasks.workunit.client.0.smithi052.stdout:9/658: write d0/d18/d37/f4c [6205310,80324] 0 2024-09-12T18:03:24.062 INFO:tasks.workunit.client.0.smithi052.stdout:9/659: fsync d0/d6/d94/fc9 0 2024-09-12T18:03:24.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/660: write d0/d18/d37/d87/f73 [1552097,10277] 0 2024-09-12T18:03:24.065 INFO:tasks.workunit.client.0.smithi052.stdout:9/661: chown d0/d18/d26/d4d/f8a 2173669 1 2024-09-12T18:03:24.065 INFO:tasks.workunit.client.0.smithi052.stdout:9/662: dread - d0/fc0 zero size 2024-09-12T18:03:24.066 INFO:tasks.workunit.client.0.smithi052.stdout:9/663: mknod d0/d6/d3a/d43/cdc 0 2024-09-12T18:03:24.069 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:24.069 INFO:tasks.workunit.client.0.smithi052.stdout:4/868: dread d11/d17/d1b/d2a/d82/f4a [0,4194304] 0 2024-09-12T18:03:24.069 INFO:tasks.workunit.client.0.smithi052.stdout:7/741: dread d6/d12/d17/f52 [0,4194304] 0 2024-09-12T18:03:24.073 INFO:tasks.workunit.client.0.smithi052.stdout:7/742: creat d6/d12/d1e/d29/daf/ff5 x:0 0 0 2024-09-12T18:03:24.074 INFO:tasks.workunit.client.0.smithi052.stdout:3/733: dread d0/d16/d60/fca [0,4194304] 0 2024-09-12T18:03:24.074 INFO:tasks.workunit.client.0.smithi052.stdout:7/743: chown d6/d12/d17/c3f 0 1 2024-09-12T18:03:24.075 INFO:tasks.workunit.client.0.smithi052.stdout:9/664: dwrite d0/d58/f83 [0,4194304] 0 2024-09-12T18:03:24.076 INFO:tasks.workunit.client.0.smithi052.stdout:2/676: dread da/dc/d15/d43/f5c [0,4194304] 0 2024-09-12T18:03:24.077 INFO:tasks.workunit.client.0.smithi052.stdout:4/869: dwrite d11/d17/d1b/fcd [0,4194304] 0 2024-09-12T18:03:24.077 INFO:tasks.workunit.client.0.smithi052.stdout:2/677: chown da/dc/d15/d22/d87/cd4 1 1 2024-09-12T18:03:24.078 INFO:tasks.workunit.client.0.smithi052.stdout:7/744: symlink d6/dc/lf6 0 2024-09-12T18:03:24.078 INFO:tasks.workunit.client.0.smithi052.stdout:9/665: mknod d0/d1c/cdd 0 2024-09-12T18:03:24.080 INFO:tasks.workunit.client.0.smithi052.stdout:3/734: mkdir d0/d4/d25/d2a/d6/d7/d79/de1/d105 0 2024-09-12T18:03:24.080 INFO:tasks.workunit.client.0.smithi052.stdout:2/678: mknod da/dc/d15/d20/da5/ce0 0 2024-09-12T18:03:24.080 INFO:tasks.workunit.client.0.smithi052.stdout:4/870: rename d11/d17/d1b/d2a/d82/fcc to d11/d65/dd1/d3b/d3f/f134 0 2024-09-12T18:03:24.081 INFO:tasks.workunit.client.0.smithi052.stdout:9/666: creat d0/d18/d26/dd2/fde x:0 0 0 2024-09-12T18:03:24.081 INFO:tasks.workunit.client.0.smithi052.stdout:2/679: creat da/d1d/d35/d7a/fe1 x:0 0 0 2024-09-12T18:03:24.082 INFO:tasks.workunit.client.0.smithi052.stdout:3/735: chown d0/d4/d25/d2a/d2c/c82 15108563 1 2024-09-12T18:03:24.082 INFO:tasks.workunit.client.0.smithi052.stdout:9/667: unlink d0/d18/d37/d87/l70 0 2024-09-12T18:03:24.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/871: getdents d11/d17/d1b/d2a/d6a/d7f/ddb/ddc 0 2024-09-12T18:03:24.084 INFO:tasks.workunit.client.0.smithi052.stdout:4/872: stat d11/d17/d1b/d2a/c4b 0 2024-09-12T18:03:24.084 INFO:tasks.workunit.client.0.smithi052.stdout:3/736: truncate d0/d4/d25/d2a/fdb 4853174 0 2024-09-12T18:03:24.084 INFO:tasks.workunit.client.0.smithi052.stdout:9/668: write d0/d6/d3a/d43/d74/f77 [131479,678] 0 2024-09-12T18:03:24.084 INFO:tasks.workunit.client.0.smithi052.stdout:2/680: write da/dc/d15/d43/f67 [4764829,54493] 0 2024-09-12T18:03:24.085 INFO:tasks.workunit.client.0.smithi052.stdout:3/737: mknod d0/d4/d25/d2a/d2c/c106 0 2024-09-12T18:03:24.085 INFO:tasks.workunit.client.0.smithi052.stdout:4/873: read d11/d17/fb7 [100612,24402] 0 2024-09-12T18:03:24.085 INFO:tasks.workunit.client.0.smithi052.stdout:9/669: rename d0/d18 to d0/d18/d37/d87/ddf 22 2024-09-12T18:03:24.086 INFO:tasks.workunit.client.0.smithi052.stdout:3/738: mkdir d0/d4b/d107 0 2024-09-12T18:03:24.086 INFO:tasks.workunit.client.0.smithi052.stdout:9/670: chown d0/d18/d26/d4d/d54/fd4 0 1 2024-09-12T18:03:24.086 INFO:tasks.workunit.client.0.smithi052.stdout:4/874: symlink d11/d65/dd1/l135 0 2024-09-12T18:03:24.086 INFO:tasks.workunit.client.0.smithi052.stdout:2/681: rename da/dc/d15/d20/da5/ld0 to da/d1d/le2 0 2024-09-12T18:03:24.087 INFO:tasks.workunit.client.0.smithi052.stdout:3/739: write d0/d4/d33/fcf [550816,66478] 0 2024-09-12T18:03:24.087 INFO:tasks.workunit.client.0.smithi052.stdout:4/875: creat d11/d17/d1b/f136 x:0 0 0 2024-09-12T18:03:24.087 INFO:tasks.workunit.client.0.smithi052.stdout:9/671: getdents d0/d18/d26 0 2024-09-12T18:03:24.087 INFO:tasks.workunit.client.0.smithi052.stdout:2/682: symlink da/dc/d15/d22/d87/dc3/le3 0 2024-09-12T18:03:24.088 INFO:tasks.workunit.client.0.smithi052.stdout:4/876: mkdir d11/d70/d137 0 2024-09-12T18:03:24.088 INFO:tasks.workunit.client.0.smithi052.stdout:9/672: write d0/da3/db8/f5f [4972429,31595] 0 2024-09-12T18:03:24.089 INFO:tasks.workunit.client.0.smithi052.stdout:2/683: write da/f17 [5074999,70621] 0 2024-09-12T18:03:24.089 INFO:tasks.workunit.client.0.smithi052.stdout:3/740: truncate d0/f13 1097857 0 2024-09-12T18:03:24.089 INFO:tasks.workunit.client.0.smithi052.stdout:4/877: symlink d11/d17/d1b/df9/d12d/l138 0 2024-09-12T18:03:24.090 INFO:tasks.workunit.client.0.smithi052.stdout:9/673: mkdir d0/d18/d26/de0 0 2024-09-12T18:03:24.090 INFO:tasks.workunit.client.0.smithi052.stdout:4/878: unlink d11/d17/d1b/d2a/d33/c37 0 2024-09-12T18:03:24.090 INFO:tasks.workunit.client.0.smithi052.stdout:3/741: creat d0/d4/d25/d2a/d6/f108 x:0 0 0 2024-09-12T18:03:24.091 INFO:tasks.workunit.client.0.smithi052.stdout:2/684: creat da/dc/d15/d20/d60/fe4 x:0 0 0 2024-09-12T18:03:24.091 INFO:tasks.workunit.client.0.smithi052.stdout:4/879: chown d11/d65/dc6/daf/d107/dc5/dc7 22540764 1 2024-09-12T18:03:24.094 INFO:tasks.workunit.client.0.smithi052.stdout:4/880: write d11/d17/d1b/d2a/d6a/d7f/f106 [4340515,9797] 0 2024-09-12T18:03:24.095 INFO:tasks.workunit.client.0.smithi052.stdout:4/881: write d11/d17/fdd [678564,61386] 0 2024-09-12T18:03:24.096 INFO:tasks.workunit.client.0.smithi052.stdout:4/882: rmdir d11/d17/d1b/d2a/d6a/d7f/dd6 39 2024-09-12T18:03:24.097 INFO:tasks.workunit.client.0.smithi052.stdout:2/685: dwrite f8 [0,4194304] 0 2024-09-12T18:03:24.097 INFO:tasks.workunit.client.0.smithi052.stdout:4/883: write d11/d65/dc6/d95/fe8 [230840,96525] 0 2024-09-12T18:03:24.099 INFO:tasks.workunit.client.0.smithi052.stdout:4/884: write d11/d17/d1b/d2a/d6a/ff7 [1216666,33391] 0 2024-09-12T18:03:24.099 INFO:tasks.workunit.client.0.smithi052.stdout:2/686: unlink da/d1d/d35/c4b 0 2024-09-12T18:03:24.100 INFO:tasks.workunit.client.0.smithi052.stdout:4/885: rmdir d11/d65/dc6/d95 39 2024-09-12T18:03:24.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/745: dread d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb4 [0,4194304] 0 2024-09-12T18:03:24.107 INFO:tasks.workunit.client.0.smithi052.stdout:9/674: dread d0/d6/d3a/d43/f4b [0,4194304] 0 2024-09-12T18:03:24.107 INFO:tasks.workunit.client.0.smithi052.stdout:2/687: dwrite da/dc/d15/fdd [0,4194304] 0 2024-09-12T18:03:24.108 INFO:tasks.workunit.client.0.smithi052.stdout:4/886: dwrite d11/d46/f8d [0,4194304] 0 2024-09-12T18:03:24.109 INFO:tasks.workunit.client.0.smithi052.stdout:4/887: stat d11/d17/d1b/d2a/d6a/d7f/l88 0 2024-09-12T18:03:24.111 INFO:tasks.workunit.client.0.smithi052.stdout:7/746: getdents d6/d12/d1e/dae 0 2024-09-12T18:03:24.112 INFO:tasks.workunit.client.0.smithi052.stdout:2/688: creat da/dc/d15/d20/d60/d6e/dab/fe5 x:0 0 0 2024-09-12T18:03:24.113 INFO:tasks.workunit.client.0.smithi052.stdout:4/888: mknod d11/d65/dc6/daf/d107/dc5/c139 0 2024-09-12T18:03:24.113 INFO:tasks.workunit.client.0.smithi052.stdout:7/747: fdatasync d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb4 0 2024-09-12T18:03:24.113 INFO:tasks.workunit.client.0.smithi052.stdout:2/689: mknod da/ce6 0 2024-09-12T18:03:24.114 INFO:tasks.workunit.client.0.smithi052.stdout:4/889: truncate d11/d17/faa 1528938 0 2024-09-12T18:03:24.117 INFO:tasks.workunit.client.0.smithi052.stdout:9/675: dwrite d0/d18/d37/d87/f7d [0,4194304] 0 2024-09-12T18:03:24.117 INFO:tasks.workunit.client.0.smithi052.stdout:4/890: write d11/d65/dd1/d3b/f115 [726168,79775] 0 2024-09-12T18:03:24.117 INFO:tasks.workunit.client.0.smithi052.stdout:9/676: write d0/d6/d3a/d42/da9/fc8 [1607566,72776] 0 2024-09-12T18:03:24.118 INFO:tasks.workunit.client.0.smithi052.stdout:3/742: write d0/d4b/d57/f7d [1877360,91438] 0 2024-09-12T18:03:24.119 INFO:tasks.workunit.client.0.smithi052.stdout:9/677: mkdir d0/d6/de1 0 2024-09-12T18:03:24.119 INFO:tasks.workunit.client.0.smithi052.stdout:4/891: mkdir d11/d65/dc6/d95/d13a 0 2024-09-12T18:03:24.120 INFO:tasks.workunit.client.0.smithi052.stdout:3/743: unlink d0/f13 0 2024-09-12T18:03:24.121 INFO:tasks.workunit.client.0.smithi052.stdout:2/690: dwrite da/dc/f2b [0,4194304] 0 2024-09-12T18:03:24.121 INFO:tasks.workunit.client.0.smithi052.stdout:3/744: mknod d0/d4/d25/d2a/d6/d7/de/da1/c109 0 2024-09-12T18:03:24.121 INFO:tasks.workunit.client.0.smithi052.stdout:2/691: chown da/dc/d15/f19 101155280 1 2024-09-12T18:03:24.122 INFO:tasks.workunit.client.0.smithi052.stdout:9/678: symlink d0/d18/d26/dd2/le2 0 2024-09-12T18:03:24.122 INFO:tasks.workunit.client.0.smithi052.stdout:4/892: link d11/d65/dd1/d3b/d3f/f50 d11/d65/dc6/daf/d107/d104/f13b 0 2024-09-12T18:03:24.123 INFO:tasks.workunit.client.0.smithi052.stdout:9/679: rmdir d0/d58 39 2024-09-12T18:03:24.123 INFO:tasks.workunit.client.0.smithi052.stdout:2/692: creat da/d1d/d7d/fe7 x:0 0 0 2024-09-12T18:03:24.124 INFO:tasks.workunit.client.0.smithi052.stdout:2/693: symlink da/dc/d15/da6/le8 0 2024-09-12T18:03:24.129 INFO:tasks.workunit.client.0.smithi052.stdout:9/680: dwrite d0/da3/db8/fa4 [4194304,4194304] 0 2024-09-12T18:03:24.129 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:24.123+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:24.130 INFO:tasks.workunit.client.0.smithi052.stdout:9/681: symlink d0/d1c/dbc/le3 0 2024-09-12T18:03:24.131 INFO:tasks.workunit.client.0.smithi052.stdout:3/745: dread d0/d4b/d4c/d6b/f8d [0,4194304] 0 2024-09-12T18:03:24.132 INFO:tasks.workunit.client.0.smithi052.stdout:9/682: write d0/d6/fc5 [8006953,104225] 0 2024-09-12T18:03:24.134 INFO:tasks.workunit.client.0.smithi052.stdout:2/694: dwrite da/dc/d15/d22/f84 [0,4194304] 0 2024-09-12T18:03:24.134 INFO:tasks.workunit.client.0.smithi052.stdout:4/893: dread d11/d65/dc6/d95/f9e [0,4194304] 0 2024-09-12T18:03:24.135 INFO:tasks.workunit.client.0.smithi052.stdout:2/695: chown da/dc/d15/d20/f64 28580839 1 2024-09-12T18:03:24.135 INFO:tasks.workunit.client.0.smithi052.stdout:4/894: dread - d11/d65/dc6/daf/d107/dc5/f100 zero size 2024-09-12T18:03:24.135 INFO:tasks.workunit.client.0.smithi052.stdout:9/683: symlink d0/d18/d37/d87/d72/le4 0 2024-09-12T18:03:24.135 INFO:tasks.workunit.client.0.smithi052.stdout:2/696: rmdir da/d1d/d7d/db3 39 2024-09-12T18:03:24.136 INFO:tasks.workunit.client.0.smithi052.stdout:3/746: dread d0/d4b/d4c/f97 [0,4194304] 0 2024-09-12T18:03:24.137 INFO:tasks.workunit.client.0.smithi052.stdout:9/684: mkdir d0/d18/d26/de5 0 2024-09-12T18:03:24.137 INFO:tasks.workunit.client.0.smithi052.stdout:2/697: creat da/dc/d15/d20/fe9 x:0 0 0 2024-09-12T18:03:24.138 INFO:tasks.workunit.client.0.smithi052.stdout:9/685: write d0/d1c/f99 [644179,49925] 0 2024-09-12T18:03:24.138 INFO:tasks.workunit.client.0.smithi052.stdout:3/747: mkdir d0/d4/d25/d2a/d6/d7/d34/d72/d10a 0 2024-09-12T18:03:24.139 INFO:tasks.workunit.client.0.smithi052.stdout:3/748: creat d0/f10b x:0 0 0 2024-09-12T18:03:24.139 INFO:tasks.workunit.client.0.smithi052.stdout:9/686: rename d0/d18/fd6 to d0/d6/d3a/d42/da9/fe6 0 2024-09-12T18:03:24.140 INFO:tasks.workunit.client.0.smithi052.stdout:9/687: creat d0/d18/d37/d87/d72/fe7 x:0 0 0 2024-09-12T18:03:24.141 INFO:tasks.workunit.client.0.smithi052.stdout:3/749: getdents d0/d4/d25/d2a/d6/d7/d34/d72/d83 0 2024-09-12T18:03:24.141 INFO:tasks.workunit.client.0.smithi052.stdout:9/688: symlink d0/d18/d37/d87/d72/le8 0 2024-09-12T18:03:24.142 INFO:tasks.workunit.client.0.smithi052.stdout:4/895: dread d11/d17/d1b/d2a/d33/f10b [0,4194304] 0 2024-09-12T18:03:24.143 INFO:tasks.workunit.client.0.smithi052.stdout:9/689: creat d0/d6/d3a/d43/d74/fe9 x:0 0 0 2024-09-12T18:03:24.144 INFO:tasks.workunit.client.0.smithi052.stdout:9/690: creat d0/d1c/dbc/fea x:0 0 0 2024-09-12T18:03:24.144 INFO:tasks.workunit.client.0.smithi052.stdout:9/691: symlink d0/d18/d37/d9e/leb 0 2024-09-12T18:03:24.147 INFO:tasks.workunit.client.0.smithi052.stdout:3/750: write d0/daf/fbe [4173240,87772] 0 2024-09-12T18:03:24.148 INFO:tasks.workunit.client.0.smithi052.stdout:3/751: dread - d0/d4/dbb/fc5 zero size 2024-09-12T18:03:24.149 INFO:tasks.workunit.client.0.smithi052.stdout:4/896: dwrite d11/f15 [0,4194304] 0 2024-09-12T18:03:24.150 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:24.150 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:24.151 INFO:tasks.workunit.client.0.smithi052.stdout:9/692: dwrite d0/d6/d3a/d42/f76 [0,4194304] 0 2024-09-12T18:03:24.153 INFO:tasks.workunit.client.0.smithi052.stdout:4/897: creat d11/d17/d1b/d2a/d6a/d7f/f13c x:0 0 0 2024-09-12T18:03:24.153 INFO:tasks.workunit.client.0.smithi052.stdout:6/796: sync 2024-09-12T18:03:24.153 INFO:tasks.workunit.client.0.smithi052.stdout:9/693: write d0/d18/d26/d4d/f8a [114091,90326] 0 2024-09-12T18:03:24.154 INFO:tasks.workunit.client.0.smithi052.stdout:4/898: readlink d11/d17/d1b/d2a/d6a/d7f/l88 0 2024-09-12T18:03:24.155 INFO:tasks.workunit.client.0.smithi052.stdout:4/899: fsync d11/d65/dd1/d72/fd3 0 2024-09-12T18:03:24.156 INFO:tasks.workunit.client.0.smithi052.stdout:6/797: read d2/d21/d9f/dd7/de7/d54/dd5/fda [547835,111458] 0 2024-09-12T18:03:24.156 INFO:tasks.workunit.client.0.smithi052.stdout:9/694: chown d0/d18/d26/d33/lbe 2 1 2024-09-12T18:03:24.157 INFO:tasks.workunit.client.0.smithi052.stdout:4/900: creat d11/d65/dc6/d95/d12b/f13d x:0 0 0 2024-09-12T18:03:24.158 INFO:tasks.workunit.client.0.smithi052.stdout:3/752: dwrite d0/d4b/d4c/f58 [0,4194304] 0 2024-09-12T18:03:24.158 INFO:tasks.workunit.client.0.smithi052.stdout:6/798: rename d2/d21/d9f/dd7/de7/d58/d5d/dd0 to d2/d21/d9f/dd7/de7/d58/d5d/d107/d112 0 2024-09-12T18:03:24.160 INFO:tasks.workunit.client.0.smithi052.stdout:3/753: mknod d0/d4b/d57/c10c 0 2024-09-12T18:03:24.160 INFO:tasks.workunit.client.0.smithi052.stdout:4/901: rmdir d11/d17/d1b/d2a/d6a/d7f/d120 0 2024-09-12T18:03:24.160 INFO:tasks.workunit.client.0.smithi052.stdout:6/799: write d2/d21/d9f/dd7/de7/d58/d5d/d9c/f31 [337261,116894] 0 2024-09-12T18:03:24.161 INFO:tasks.workunit.client.0.smithi052.stdout:3/754: creat d0/d4b/d4c/d6b/d48/f10d x:0 0 0 2024-09-12T18:03:24.161 INFO:tasks.workunit.client.0.smithi052.stdout:4/902: write d11/d65/dd1/d3b/d6f/f89 [1804449,70987] 0 2024-09-12T18:03:24.162 INFO:tasks.workunit.client.0.smithi052.stdout:3/755: chown d0/d4/d25/f2e 10345 1 2024-09-12T18:03:24.163 INFO:tasks.workunit.client.0.smithi052.stdout:4/903: write d11/d17/d1b/df9/dfd/fe7 [2771261,58007] 0 2024-09-12T18:03:24.163 INFO:tasks.workunit.client.0.smithi052.stdout:3/756: chown d0/d4/d25/d2a/d6/d7/d34/d71/cc3 1089 1 2024-09-12T18:03:24.165 INFO:tasks.workunit.client.0.smithi052.stdout:4/904: fdatasync d11/d65/dc6/d95/dbf/f27 0 2024-09-12T18:03:24.165 INFO:tasks.workunit.client.0.smithi052.stdout:2/698: dread da/dc/d15/f39 [0,4194304] 0 2024-09-12T18:03:24.165 INFO:tasks.workunit.client.0.smithi052.stdout:3/757: mkdir d0/d4b/d4c/d10e 0 2024-09-12T18:03:24.166 INFO:tasks.workunit.client.0.smithi052.stdout:2/699: mknod da/d1d/d35/dd8/cea 0 2024-09-12T18:03:24.166 INFO:tasks.workunit.client.0.smithi052.stdout:4/905: write d11/d17/d1b/d2a/d33/f10b [348477,26059] 0 2024-09-12T18:03:24.167 INFO:tasks.workunit.client.0.smithi052.stdout:3/758: chown d0/d4/d25/d2a/d6/d7/d34/d72/f93 3 1 2024-09-12T18:03:24.167 INFO:tasks.workunit.client.0.smithi052.stdout:2/700: fsync da/dc/d15/f1f 0 2024-09-12T18:03:24.168 INFO:tasks.workunit.client.0.smithi052.stdout:4/906: getdents d11/d65/dc6/d95/d13a 0 2024-09-12T18:03:24.168 INFO:tasks.workunit.client.0.smithi052.stdout:3/759: dread - d0/d4/d25/d2a/d6/d7/dab/f100 zero size 2024-09-12T18:03:24.169 INFO:tasks.workunit.client.0.smithi052.stdout:3/760: write d0/d4/d25/fa8 [186967,54925] 0 2024-09-12T18:03:24.169 INFO:tasks.workunit.client.0.smithi052.stdout:4/907: creat d11/d65/dc6/daf/d107/f13e x:0 0 0 2024-09-12T18:03:24.170 INFO:tasks.workunit.client.0.smithi052.stdout:3/761: dread - d0/d4b/d4c/d6b/f103 zero size 2024-09-12T18:03:24.171 INFO:tasks.workunit.client.0.smithi052.stdout:3/762: mknod d0/d4b/d4c/d10e/c10f 0 2024-09-12T18:03:24.172 INFO:tasks.workunit.client.0.smithi052.stdout:9/695: dread d0/d18/d26/d4d/fac [0,4194304] 0 2024-09-12T18:03:24.173 INFO:tasks.workunit.client.0.smithi052.stdout:9/696: creat d0/d18/d37/fec x:0 0 0 2024-09-12T18:03:24.173 INFO:tasks.workunit.client.0.smithi052.stdout:3/763: unlink d0/d4/d25/d2a/d6/d7/d34/d72/f93 0 2024-09-12T18:03:24.173 INFO:tasks.workunit.client.0.smithi052.stdout:9/697: write d0/fc0 [356285,108778] 0 2024-09-12T18:03:24.174 INFO:tasks.workunit.client.0.smithi052.stdout:3/764: write d0/d4/f50 [2781512,48702] 0 2024-09-12T18:03:24.174 INFO:tasks.workunit.client.0.smithi052.stdout:9/698: write d0/d6/d3a/f97 [496111,46429] 0 2024-09-12T18:03:24.175 INFO:tasks.workunit.client.0.smithi052.stdout:3/765: mknod d0/daf/c110 0 2024-09-12T18:03:24.175 INFO:tasks.workunit.client.0.smithi052.stdout:9/699: write d0/d18/f98 [387149,61177] 0 2024-09-12T18:03:24.176 INFO:tasks.workunit.client.0.smithi052.stdout:9/700: chown d0/d18/d37/d9e 2 1 2024-09-12T18:03:24.176 INFO:tasks.workunit.client.0.smithi052.stdout:3/766: write d0/d4/d25/d2a/d6/d7/de/da1/ff2 [906573,106209] 0 2024-09-12T18:03:24.177 INFO:tasks.workunit.client.0.smithi052.stdout:4/908: dread d11/d65/dc6/f97 [0,4194304] 0 2024-09-12T18:03:24.177 INFO:tasks.workunit.client.0.smithi052.stdout:9/701: chown d0/c12 18399 1 2024-09-12T18:03:24.178 INFO:tasks.workunit.client.0.smithi052.stdout:4/909: creat d11/d65/dc6/d95/f13f x:0 0 0 2024-09-12T18:03:24.178 INFO:tasks.workunit.client.0.smithi052.stdout:9/702: symlink d0/d18/d26/d4d/led 0 2024-09-12T18:03:24.178 INFO:tasks.workunit.client.0.smithi052.stdout:4/910: truncate d11/d65/dd1/d3b/f110 319451 0 2024-09-12T18:03:24.179 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:24.179 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:24.180 INFO:tasks.workunit.client.0.smithi052.stdout:9/703: link d0/d18/d37/d9e/cd0 d0/d18/d37/d87/d72/cee 0 2024-09-12T18:03:24.180 INFO:tasks.workunit.client.0.smithi052.stdout:4/911: getdents d11/d65/d114 0 2024-09-12T18:03:24.180 INFO:tasks.workunit.client.0.smithi052.stdout:9/704: read d0/d18/f98 [869353,90289] 0 2024-09-12T18:03:24.181 INFO:tasks.workunit.client.0.smithi052.stdout:4/912: rename f8 to d11/d65/dd1/d3b/f140 0 2024-09-12T18:03:24.182 INFO:tasks.workunit.client.0.smithi052.stdout:9/705: truncate d0/da3/db8/f69 3933023 0 2024-09-12T18:03:24.183 INFO:tasks.workunit.client.0.smithi052.stdout:6/800: dread d2/dc6/f1f [0,4194304] 0 2024-09-12T18:03:24.183 INFO:tasks.workunit.client.0.smithi052.stdout:9/706: chown d0/d18/c50 187 1 2024-09-12T18:03:24.184 INFO:tasks.workunit.client.0.smithi052.stdout:9/707: chown d0/d6/d3a/d43/d74/lb7 341109680 1 2024-09-12T18:03:24.185 INFO:tasks.workunit.client.0.smithi052.stdout:6/801: read d2/d5e/f93 [8858,36355] 0 2024-09-12T18:03:24.185 INFO:tasks.workunit.client.0.smithi052.stdout:9/708: fdatasync d0/d6/d94/fc9 0 2024-09-12T18:03:24.186 INFO:tasks.workunit.client.0.smithi052.stdout:6/802: creat d2/d15/f113 x:0 0 0 2024-09-12T18:03:24.187 INFO:tasks.workunit.client.0.smithi052.stdout:9/709: write d0/d18/f98 [886396,84287] 0 2024-09-12T18:03:24.188 INFO:tasks.workunit.client.0.smithi052.stdout:4/913: dwrite d11/d17/d1b/d2a/f128 [0,4194304] 0 2024-09-12T18:03:24.189 INFO:tasks.workunit.client.0.smithi052.stdout:4/914: dread - d11/d65/dd1/d3b/f99 zero size 2024-09-12T18:03:24.190 INFO:tasks.workunit.client.0.smithi052.stdout:4/915: chown d11/d17/d1b/df9/dfd/fe7 713480 1 2024-09-12T18:03:24.190 INFO:tasks.workunit.client.0.smithi052.stdout:6/803: creat d2/d21/d9f/dd7/de7/d58/f114 x:0 0 0 2024-09-12T18:03:24.193 INFO:tasks.workunit.client.0.smithi052.stdout:9/710: dwrite d0/d18/f36 [4194304,4194304] 0 2024-09-12T18:03:24.195 INFO:tasks.workunit.client.0.smithi052.stdout:9/711: mknod d0/d18/cef 0 2024-09-12T18:03:24.196 INFO:tasks.workunit.client.0.smithi052.stdout:9/712: read d0/d18/d26/d33/f62 [2848344,115075] 0 2024-09-12T18:03:24.197 INFO:tasks.workunit.client.0.smithi052.stdout:9/713: creat d0/d58/d7f/ff0 x:0 0 0 2024-09-12T18:03:24.198 INFO:tasks.workunit.client.0.smithi052.stdout:9/714: fdatasync d0/d18/d26/d4d/d54/fd4 0 2024-09-12T18:03:24.199 INFO:tasks.workunit.client.0.smithi052.stdout:9/715: truncate d0/d18/fc3 740259 0 2024-09-12T18:03:24.205 INFO:tasks.workunit.client.0.smithi052.stdout:9/716: dwrite d0/d6/d3a/f97 [0,4194304] 0 2024-09-12T18:03:24.205 INFO:tasks.workunit.client.0.smithi052.stdout:9/717: read d0/d1c/f51 [123955,5201] 0 2024-09-12T18:03:24.205 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:24.205 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:24.206 INFO:tasks.workunit.client.0.smithi052.stdout:9/718: getdents d0/d18/d37/d87/d72 0 2024-09-12T18:03:24.207 INFO:tasks.workunit.client.0.smithi052.stdout:6/804: truncate d2/d21/d6a/d97/fc0 2531997 0 2024-09-12T18:03:24.207 INFO:tasks.workunit.client.0.smithi052.stdout:6/805: readlink d2/d21/d6a/d97/lff 0 2024-09-12T18:03:24.207 INFO:tasks.workunit.client.0.smithi052.stdout:9/719: mknod d0/d18/d37/d87/cf1 0 2024-09-12T18:03:24.208 INFO:tasks.workunit.client.0.smithi052.stdout:6/806: mkdir d2/d5e/d115 0 2024-09-12T18:03:24.208 INFO:tasks.workunit.client.0.smithi052.stdout:6/807: chown d2/d21/d9f/dd7/de7/d54/dfe 26230 1 2024-09-12T18:03:24.208 INFO:tasks.workunit.client.0.smithi052.stdout:9/720: truncate d0/d18/d37/d87/d72/fe7 861773 0 2024-09-12T18:03:24.209 INFO:tasks.workunit.client.0.smithi052.stdout:6/808: chown d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/l6b 35 1 2024-09-12T18:03:24.210 INFO:tasks.workunit.client.0.smithi052.stdout:9/721: truncate d0/d18/d79/f2f 1143565 0 2024-09-12T18:03:24.211 INFO:tasks.workunit.client.0.smithi052.stdout:9/722: link d0/d18/c39 d0/d6/d3a/d43/cf2 0 2024-09-12T18:03:24.212 INFO:tasks.workunit.client.0.smithi052.stdout:9/723: mknod d0/d6/d3a/d42/d93/cf3 0 2024-09-12T18:03:24.212 INFO:tasks.workunit.client.0.smithi052.stdout:9/724: chown d0/d6/d3a/d43/cb3 3099733 1 2024-09-12T18:03:24.218 INFO:tasks.workunit.client.0.smithi052.stdout:6/809: write d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f28 [1008197,1099] 0 2024-09-12T18:03:24.218 INFO:tasks.workunit.client.0.smithi052.stdout:9/725: dwrite d0/d18/d26/d4d/f8a [0,4194304] 0 2024-09-12T18:03:24.219 INFO:tasks.workunit.client.0.smithi052.stdout:6/810: write d2/d5e/f9d [1479136,39767] 0 2024-09-12T18:03:24.220 INFO:tasks.workunit.client.0.smithi052.stdout:6/811: creat d2/d21/ded/df5/f116 x:0 0 0 2024-09-12T18:03:24.225 INFO:tasks.workunit.client.0.smithi052.stdout:9/726: dwrite d0/d6/d3a/d43/f4b [0,4194304] 0 2024-09-12T18:03:24.226 INFO:tasks.workunit.client.0.smithi052.stdout:6/812: dwrite d2/d21/f98 [0,4194304] 0 2024-09-12T18:03:24.228 INFO:tasks.workunit.client.0.smithi052.stdout:9/727: mknod d0/d58/d7f/cf4 0 2024-09-12T18:03:24.228 INFO:tasks.workunit.client.0.smithi052.stdout:6/813: creat d2/d21/d9f/dd7/de7/d54/dfe/f117 x:0 0 0 2024-09-12T18:03:24.229 INFO:tasks.workunit.client.0.smithi052.stdout:9/728: mknod d0/d18/d26/d33/cf5 0 2024-09-12T18:03:24.229 INFO:tasks.workunit.client.0.smithi052.stdout:6/814: write d2/d21/d9f/dd7/de7/d58/d5d/f10f [42515,21522] 0 2024-09-12T18:03:24.230 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:24.227+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:24.230 INFO:tasks.workunit.client.0.smithi052.stdout:6/815: rename d2/d21/d9f/dd7/de7/d54/dd5/df3/l105 to d2/d49/l118 0 2024-09-12T18:03:24.231 INFO:tasks.workunit.client.0.smithi052.stdout:6/816: link d2/d80/fae d2/d80/f119 0 2024-09-12T18:03:24.232 INFO:tasks.workunit.client.0.smithi052.stdout:6/817: symlink d2/d80/l11a 0 2024-09-12T18:03:24.233 INFO:tasks.workunit.client.0.smithi052.stdout:6/818: rmdir d2/d21/d9f/dd7/d109 0 2024-09-12T18:03:24.233 INFO:tasks.workunit.client.0.smithi052.stdout:6/819: creat d2/d21/d9f/f11b x:0 0 0 2024-09-12T18:03:24.234 INFO:tasks.workunit.client.0.smithi052.stdout:6/820: link d2/f70 d2/d21/d9f/dd7/de7/d58/d5d/f11c 0 2024-09-12T18:03:24.235 INFO:tasks.workunit.client.0.smithi052.stdout:6/821: creat d2/f11d x:0 0 0 2024-09-12T18:03:24.236 INFO:tasks.workunit.client.0.smithi052.stdout:6/822: getdents d2/d21/d6a/d97 0 2024-09-12T18:03:24.237 INFO:tasks.workunit.client.0.smithi052.stdout:9/729: truncate d0/d1c/f32 3515435 0 2024-09-12T18:03:24.238 INFO:tasks.workunit.client.0.smithi052.stdout:6/823: mknod d2/d21/d9f/dd7/de7/d54/c11e 0 2024-09-12T18:03:24.238 INFO:tasks.workunit.client.0.smithi052.stdout:8/834: sync 2024-09-12T18:03:24.238 INFO:tasks.workunit.client.0.smithi052.stdout:5/714: sync 2024-09-12T18:03:24.238 INFO:tasks.workunit.client.0.smithi052.stdout:7/748: sync 2024-09-12T18:03:24.238 INFO:tasks.workunit.client.0.smithi052.stdout:1/635: sync 2024-09-12T18:03:24.238 INFO:tasks.workunit.client.0.smithi052.stdout:0/730: sync 2024-09-12T18:03:24.239 INFO:tasks.workunit.client.0.smithi052.stdout:1/636: mknod d3/d1d/d22/d3f/cd6 0 2024-09-12T18:03:24.239 INFO:tasks.workunit.client.0.smithi052.stdout:9/730: write d0/d6/d3a/d42/d61/f82 [604383,120059] 0 2024-09-12T18:03:24.239 INFO:tasks.workunit.client.0.smithi052.stdout:0/731: chown d2/d8/dce/lcb 497706520 1 2024-09-12T18:03:24.239 INFO:tasks.workunit.client.0.smithi052.stdout:0/732: rmdir d2/d57/d5b 39 2024-09-12T18:03:24.240 INFO:tasks.workunit.client.0.smithi052.stdout:1/637: chown d3/d10/d38/d44/d49/laa 2209 1 2024-09-12T18:03:24.241 INFO:tasks.workunit.client.0.smithi052.stdout:1/638: creat d3/d69/fd7 x:0 0 0 2024-09-12T18:03:24.241 INFO:tasks.workunit.client.0.smithi052.stdout:0/733: rename d2/d8/dce/f4e to d2/d8/dce/d48/fe8 0 2024-09-12T18:03:24.242 INFO:tasks.workunit.client.0.smithi052.stdout:1/639: mkdir d3/dcb/d74/d7f/dd8 0 2024-09-12T18:03:24.244 INFO:tasks.workunit.client.0.smithi052.stdout:8/835: dread d13/fc8 [0,4194304] 0 2024-09-12T18:03:24.245 INFO:tasks.workunit.client.0.smithi052.stdout:5/715: dwrite d7/d1f/d3a/d49/fcc [0,4194304] 0 2024-09-12T18:03:24.245 INFO:tasks.workunit.client.0.smithi052.stdout:1/640: link d3/d1d/d22/f30 d3/d1d/d22/d3f/d56/dd5/fd9 0 2024-09-12T18:03:24.246 INFO:tasks.workunit.client.0.smithi052.stdout:8/836: write d13/d35/de1/f96 [1579773,21849] 0 2024-09-12T18:03:24.247 INFO:tasks.workunit.client.0.smithi052.stdout:9/731: truncate d0/d6/d3a/d42/f76 4586532 0 2024-09-12T18:03:24.248 INFO:tasks.workunit.client.0.smithi052.stdout:1/641: getdents d3/da2/dbe 0 2024-09-12T18:03:24.248 INFO:tasks.workunit.client.0.smithi052.stdout:8/837: fsync d13/d18/d21/ff0 0 2024-09-12T18:03:24.248 INFO:tasks.workunit.client.0.smithi052.stdout:5/716: truncate d7/d1f/d45/f7a 363986 0 2024-09-12T18:03:24.248 INFO:tasks.workunit.client.0.smithi052.stdout:9/732: fdatasync d0/d6/d3a/d43/d74/fe9 0 2024-09-12T18:03:24.249 INFO:tasks.workunit.client.0.smithi052.stdout:8/838: mkdir d13/d18/d38/dbf/dc5/d118 0 2024-09-12T18:03:24.250 INFO:tasks.workunit.client.0.smithi052.stdout:0/734: dwrite d2/d57/d5b/fda [0,4194304] 0 2024-09-12T18:03:24.250 INFO:tasks.workunit.client.0.smithi052.stdout:1/642: link d3/d1d/d22/d3f/c42 d3/d10/dc4/cda 0 2024-09-12T18:03:24.252 INFO:tasks.workunit.client.0.smithi052.stdout:0/735: mkdir d2/d6/dd/d21/d26/d2f/de9 0 2024-09-12T18:03:24.253 INFO:tasks.workunit.client.0.smithi052.stdout:9/733: read d0/d18/fc3 [483281,8121] 0 2024-09-12T18:03:24.255 INFO:tasks.workunit.client.0.smithi052.stdout:0/736: mkdir d2/d6/dd/d21/d41/dea 0 2024-09-12T18:03:24.257 INFO:tasks.workunit.client.0.smithi052.stdout:9/734: dread d0/d1c/f8e [0,4194304] 0 2024-09-12T18:03:24.258 INFO:tasks.workunit.client.0.smithi052.stdout:5/717: dwrite d7/d1c/d1e/f36 [0,4194304] 0 2024-09-12T18:03:24.259 INFO:tasks.workunit.client.0.smithi052.stdout:1/643: dwrite d3/dcb/d74/d7f/f94 [0,4194304] 0 2024-09-12T18:03:24.260 INFO:tasks.workunit.client.0.smithi052.stdout:5/718: mkdir d7/d59/dbe/d6b/de7 0 2024-09-12T18:03:24.261 INFO:tasks.workunit.client.0.smithi052.stdout:1/644: symlink d3/dcb/d74/d7d/d84/dbb/ldb 0 2024-09-12T18:03:24.261 INFO:tasks.workunit.client.0.smithi052.stdout:5/719: readlink d7/d1f/d34/l88 0 2024-09-12T18:03:24.262 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:24.262 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:24.262 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:24.262 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:24.262 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.262 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.262 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:24.262 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.59212183, 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:24.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.592084824000001, 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:24.268 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:24.270 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.271 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.272 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:24.273 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.592041481999999, 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.274 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.275 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:24.276 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:24.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.592003833, 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:24.280 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.281 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:24.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:24.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.284 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:24.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591964124, 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:24.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.289 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:24.290 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591926328, 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:24.292 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.293 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:24.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:24.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.297 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591866336000001, 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:24.298 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.299 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:24.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.301 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.303 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591771252000001, 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.304 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.305 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:24.306 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.307 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:24.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591704924, 2024-09-12T18:03:24.309 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.310 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:24.311 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.312 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591648044999999, 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.315 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:24.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.317 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.318 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.320 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.59159204, 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.321 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.323 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:24.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591526858, 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:24.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:24.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591486076000001, 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.332 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:24.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.336 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.337 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591450419999999, 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:24.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:24.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.342 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.343 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591404378, 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.344 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:24.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:24.347 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.348 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.349 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591366202, 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:24.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:24.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.354 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.355 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.591319746, 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:24.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.360 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.361 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.5506957, 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.362 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:24.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.366 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.550679997, 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.367 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:24.369 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.370 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.371 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:24.372 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 11.542949674999999, 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:24.373 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:24.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:24.376 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.377 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.378 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.379 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.379 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:24.379 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:24.379 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:24.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:24.382 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:24.377+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:24.394 INFO:tasks.workunit.client.0.smithi052.stdout:1/645: dread - d3/d1d/d72/f9e zero size 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:5/720: fsync d7/d59/d5c/d7c/fd5 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:8/839: dwrite d13/d18/f3e [0,4194304] 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:8/840: fsync d13/f1b 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:1/646: readlink d3/d1d/d22/d66/la5 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:1/647: mkdir d3/da2/ddc 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:1/648: read - d3/d1d/d22/fbf zero size 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:5/721: mknod d7/d1c/d1e/da5/de6/ce8 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:1/649: stat d3/d1d/d22/d66/f97 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:5/722: write d7/d1c/d1e/fd8 [3217132,93842] 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:1/650: symlink d3/d1d/d22/d3f/d56/ldd 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:5/723: chown d7/d59/d84/cd1 12622097 1 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:1/651: write d3/f8 [3537605,62360] 0 2024-09-12T18:03:24.395 INFO:tasks.workunit.client.0.smithi052.stdout:5/724: fdatasync d7/d59/d5c/d7c/fb4 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:1/652: mknod d3/d1d/d22/d3f/d56/d7b/cde 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:1/653: mkdir d3/d1d/d83/ddf 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:8/841: dwrite d13/d18/d38/dd3/dde/f115 [0,4194304] 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:0/737: write d2/d6/dd/d21/d26/d65/fcf [522260,85740] 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:8/842: unlink d13/d18/d21/c87 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:9/735: dread d0/d6/d3a/d42/d61/f82 [0,4194304] 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:9/736: mkdir d0/d18/d37/d87/d72/df6 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:9/737: unlink d0/d1c/dbc/fea 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:9/738: truncate d0/d6/d3a/d42/d61/f82 747079 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:9/739: rename d0/d18/d79/da6/la1 to d0/d6/d3a/d42/d61/lf7 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:8/843: dwrite d13/d18/d5b/fd7 [0,4194304] 0 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:9/740: chown d0/d6/d3a/d43 246 1 2024-09-12T18:03:24.396 INFO:tasks.workunit.client.0.smithi052.stdout:8/844: symlink d13/d18/d21/l119 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:9/741: write d0/d6/d3a/d42/d61/fab [223407,108452] 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:0/738: dread d2/d6/dd/d21/d47/f58 [0,4194304] 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:9/742: readlink d0/l1 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:8/845: getdents d13/d9b 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:0/739: chown d2/d6/dd/d21/ldc 2 1 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:9/743: mknod d0/d18/d37/d87/d72/cf8 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:0/740: rmdir d2/d6/dd/d21/d26/d2f 39 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:9/744: fsync d0/d18/d26/d4d/fcb 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:0/741: mknod d2/d8/dce/d48/ceb 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:8/846: write d13/d18/d21/f5d [4823366,81990] 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:5/725: write d7/d1f/d45/f7a [744657,28827] 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:8/847: creat d13/d18/d38/dbf/dc5/f11a x:0 0 0 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi052.stdout:0/742: dwrite d2/d6/dd/d21/d26/d38/d4a/fc4 [0,4194304] 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:0/743: readlink d2/d6/dd/d21/d47/l6d 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:0/744: rename d2/d1b/fe7 to d2/d51/fec 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:9/745: dread d0/da3/db8/fa4 [0,4194304] 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:1/654: dread d3/f77 [0,4194304] 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:1/655: creat d3/d1d/d22/d3f/d56/dd5/fe0 x:0 0 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:9/746: dwrite d0/d58/d7f/ff0 [0,4194304] 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:1/656: link d3/dcb/d74/d7d/d84/dbb/ldb d3/dcb/le1 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:1/657: write d3/d1d/d22/f59 [1242954,50760] 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:9/747: read - d0/d6/d3a/d42/da9/fe6 zero size 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:5/726: dread d7/f16 [0,4194304] 0 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:9/748: dread - d0/d18/d26/d4d/fb9 zero size 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:5/727: chown d7/d1c/d1e/d98/fa2 2 1 2024-09-12T18:03:24.398 INFO:tasks.workunit.client.0.smithi052.stdout:0/745: dread d2/d8/f1c [0,4194304] 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/746: symlink d2/d57/led 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:5/728: dwrite d7/d1f/d3a/fbb [0,4194304] 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/747: write d2/d6/dd/d21/d41/d59/f71 [9089229,40396] 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/748: read - d2/d1b/d80/da3/fbf zero size 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:5/729: symlink d7/d59/dad/dce/le9 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/749: readlink d2/d6/l7 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/750: mkdir d2/d8/dee 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/751: rename d2/d57/d5b/d7a/l9c to d2/d57/d5b/db9/lef 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/752: dwrite d2/d6/dd/fbe [0,4194304] 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:5/730: dread d7/d1c/f33 [0,4194304] 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:1/658: dread d3/d1d/d22/d3f/d56/dd5/fd9 [0,4194304] 0 2024-09-12T18:03:24.399 INFO:tasks.workunit.client.0.smithi052.stdout:3/767: sync 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:4/916: sync 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:2/701: sync 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:1/659: chown d3/d10/d38/d44/d49/l70 6 1 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/768: fsync d0/d16/d7c/fa6 0 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:4/917: creat d11/d17/d1b/f141 x:0 0 0 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:2/702: mkdir da/d1d/d7d/db3/deb 0 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:1/660: getdents d3/d1d/d72 0 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:2/703: fdatasync da/dc/d15/d22/d87/fc6 0 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/769: readlink d0/d4/d25/d2a/d6/d7/d34/d71/lf6 0 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/770: fdatasync d0/d4/d25/d2a/d6/d7/de/da1/ff2 0 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/771: mkdir d0/d16/d7c/d85/d111 0 2024-09-12T18:03:24.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/772: chown d0/d4/d25/d2a/d6/d7/d34/d71/cc3 52550566 1 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:5/731: dwrite d7/d59/f7e [0,4194304] 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:3/773: mknod d0/d4/d25/d2a/d6/d7/de/da1/da4/c112 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/704: dwrite da/dc/d15/d20/fb2 [0,4194304] 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:5/732: truncate d7/d1c/d6f/fdf 321456 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/705: link da/dc/ca3 da/dc/d76/dc4/cec 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/706: mkdir da/dc/d15/d20/d60/ded 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:4/918: dread d11/d65/dc6/daf/d107/d104/f13b [0,4194304] 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/707: truncate da/dc/f37 2862031 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/708: fdatasync da/dc/d15/fdd 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/709: write da/f12 [2802835,964] 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:3/774: dwrite d0/d4b/d4c/d6b/f103 [0,4194304] 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/710: creat da/dc/d15/d20/d60/d6e/dab/fee x:0 0 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:3/775: mknod d0/d4/d25/d2a/d6/d7/d79/de1/d105/c113 0 2024-09-12T18:03:24.401 INFO:tasks.workunit.client.0.smithi052.stdout:2/711: write da/d71/f94 [281828,83413] 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/919: dwrite d11/d17/d1b/d2a/f61 [0,4194304] 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/920: fsync d11/d65/dd1/fab 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/921: creat d11/d65/dc6/daf/d107/d130/f142 x:0 0 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/922: truncate d11/d65/dd1/f11a 1032304 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:2/712: dwrite da/dc/d15/d22/d87/fc6 [0,4194304] 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/923: rename d11/fa7 to d11/d70/d137/f143 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:2/713: chown da/dc/d15/d20/d60/d6e 285 1 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:3/776: dwrite d0/d4/d25/d2a/d6/d7/de/da1/da4/dc7/de0/fe3 [0,4194304] 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:4/924: write d11/d65/dc6/d95/fe8 [457269,77352] 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:2/714: chown da/dc/f5e 993057379 1 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:3/777: stat d0/d4b/d4c/d6b/d48/fc6 0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi052.stdout:5/733: dread d7/f3c [0,4194304] 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:4/925: read d11/d17/d1b/d2a/f61 [936611,30690] 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:2/715: fdatasync da/dc/d15/d20/d60/fe4 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:5/734: creat d7/d1f/d3a/d49/fea x:0 0 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:2/716: rename da/dc/f37 to da/dc/fef 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:2/717: rmdir da/d1d/d7d 39 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:3/778: dread d0/d4b/d4c/f58 [0,4194304] 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:2/718: creat da/d21/ff0 x:0 0 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:4/926: dwrite d11/d65/dc6/daf/d107/f13e [0,4194304] 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:5/735: dwrite d7/f1a [0,4194304] 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:4/927: symlink d11/d65/dd1/d3b/d6f/l144 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:2/719: getdents da/d21/da2 0 2024-09-12T18:03:24.403 INFO:tasks.workunit.client.0.smithi052.stdout:4/928: readlink d11/d65/dd1/d3b/l56 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:4/929: chown d11/d65/dc6/daf/d107/dc5 388470 1 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:3/779: dwrite d0/d4/d25/d2a/d6/d41/f59 [0,4194304] 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:4/930: mkdir d11/d46/db8/d145 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/720: dread f6 [0,4194304] 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:3/780: unlink d0/d4/d25/d2a/d6/l102 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/721: fdatasync da/d1d/d7d/fe7 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:3/781: write d0/d16/d60/fca [4398395,31586] 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/722: mkdir da/dc/d15/da6/df1 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/723: write da/dc/d15/d22/f8d [6738648,41829] 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/724: readlink da/dc/d15/d20/laf 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/725: truncate da/f80 791321 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/726: mknod da/d2c/dbf/ddf/cf2 0 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi052.stdout:5/736: read d7/d1c/d1e/fd8 [2450198,44055] 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:2/727: write da/f16 [1960199,34661] 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:5/737: mknod d7/d59/d5c/d7c/ceb 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:5/738: fdatasync d7/d1c/d1e/f2b 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:3/782: dwrite d0/fef [0,4194304] 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:2/728: creat da/dc/d15/da6/ff3 x:0 0 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:3/783: chown d0/d4/d33/fcf 36171156 1 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:2/729: mkdir da/d1d/d35/d7a/df4 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:5/739: rename d7/d1c/d1e/cc5 to d7/cec 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:2/730: mknod da/d71/cf5 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:5/740: mknod d7/d51/d8b/ced 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:2/731: readlink da/dc/lad 0 2024-09-12T18:03:24.405 INFO:tasks.workunit.client.0.smithi052.stdout:2/732: creat da/d2c/ff6 x:0 0 0 2024-09-12T18:03:24.406 INFO:tasks.workunit.client.0.smithi052.stdout:3/784: read d0/d4/d25/d2a/d6/d7/de/f4f [285361,105283] 0 2024-09-12T18:03:24.408 INFO:tasks.workunit.client.0.smithi052.stdout:2/733: mknod da/dc/d15/d20/d60/cf7 0 2024-09-12T18:03:24.408 INFO:tasks.workunit.client.0.smithi052.stdout:3/785: read d0/d4/d25/d2a/d6/d7/d34/fb1 [194054,44824] 0 2024-09-12T18:03:24.408 INFO:tasks.workunit.client.0.smithi052.stdout:2/734: creat da/d2c/dbf/ddf/ff8 x:0 0 0 2024-09-12T18:03:24.408 INFO:tasks.workunit.client.0.smithi052.stdout:2/735: creat da/d2c/dbf/ff9 x:0 0 0 2024-09-12T18:03:24.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/786: mkdir d0/d4/d25/d2a/d6/dcc/d114 0 2024-09-12T18:03:24.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/787: fdatasync d0/d4/d25/d2a/d6/d7/fba 0 2024-09-12T18:03:24.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/788: readlink d0/d4/d25/d2a/d6/d7/de/lfd 0 2024-09-12T18:03:24.409 INFO:tasks.workunit.client.0.smithi052.stdout:5/741: dread d7/d1c/d1e/d98/fa2 [0,4194304] 0 2024-09-12T18:03:24.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/789: fsync d0/d4/f50 0 2024-09-12T18:03:24.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/790: rename d0/d16/l24 to d0/d4/d25/d2a/d2c/da9/db8/l115 0 2024-09-12T18:03:24.410 INFO:tasks.workunit.client.0.smithi052.stdout:3/791: fdatasync d0/d4/d25/fa8 0 2024-09-12T18:03:24.410 INFO:tasks.workunit.client.0.smithi052.stdout:5/742: dwrite d7/d1c/f3f [0,4194304] 0 2024-09-12T18:03:24.410 INFO:tasks.workunit.client.0.smithi052.stdout:5/743: read d7/d1c/f33 [837602,119229] 0 2024-09-12T18:03:24.410 INFO:tasks.workunit.client.0.smithi052.stdout:5/744: write d7/d59/fa7 [3132616,52102] 0 2024-09-12T18:03:24.410 INFO:tasks.workunit.client.0.smithi052.stdout:5/745: read - d7/d59/dbe/fe5 zero size 2024-09-12T18:03:24.410 INFO:tasks.workunit.client.0.smithi052.stdout:2/736: dread da/d71/f94 [0,4194304] 0 2024-09-12T18:03:24.410 INFO:tasks.workunit.client.0.smithi052.stdout:2/737: write da/dc/d15/d20/fe [3928049,81694] 0 2024-09-12T18:03:24.411 INFO:tasks.workunit.client.0.smithi052.stdout:2/738: symlink da/d1d/lfa 0 2024-09-12T18:03:24.411 INFO:tasks.workunit.client.0.smithi052.stdout:2/739: creat da/d1d/d35/d7a/df4/ffb x:0 0 0 2024-09-12T18:03:24.412 INFO:tasks.workunit.client.0.smithi052.stdout:2/740: stat da/d21/c6d 0 2024-09-12T18:03:24.413 INFO:tasks.workunit.client.0.smithi052.stdout:2/741: creat da/dc/d15/d20/ffc x:0 0 0 2024-09-12T18:03:24.414 INFO:tasks.workunit.client.0.smithi052.stdout:2/742: stat da/dc/d15/d20/fe 0 2024-09-12T18:03:24.414 INFO:tasks.workunit.client.0.smithi052.stdout:3/792: dread d0/d4b/d57/f7d [0,4194304] 0 2024-09-12T18:03:24.414 INFO:tasks.workunit.client.0.smithi052.stdout:2/743: dread - da/dc/d15/d20/ffc zero size 2024-09-12T18:03:24.414 INFO:tasks.workunit.client.0.smithi052.stdout:3/793: stat d0/d4/d25/d2a/d2c/f63 0 2024-09-12T18:03:24.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/744: symlink da/d21/lfd 0 2024-09-12T18:03:24.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/745: chown da/dc/d15/da6/le8 6900663 1 2024-09-12T18:03:24.418 INFO:tasks.workunit.client.0.smithi052.stdout:5/746: dread d7/d1c/f6c [0,4194304] 0 2024-09-12T18:03:24.419 INFO:tasks.workunit.client.0.smithi052.stdout:5/747: dread - d7/d51/d8b/fc4 zero size 2024-09-12T18:03:24.421 INFO:tasks.workunit.client.0.smithi052.stdout:4/931: dread d11/d17/d1b/d2a/f7d [0,4194304] 0 2024-09-12T18:03:24.421 INFO:tasks.workunit.client.0.smithi052.stdout:3/794: dwrite d0/d4/dbb/fda [0,4194304] 0 2024-09-12T18:03:24.421 INFO:tasks.workunit.client.0.smithi052.stdout:5/748: symlink d7/d1c/d1e/lee 0 2024-09-12T18:03:24.423 INFO:tasks.workunit.client.0.smithi052.stdout:3/795: creat d0/d4b/d4c/d10e/f116 x:0 0 0 2024-09-12T18:03:24.423 INFO:tasks.workunit.client.0.smithi052.stdout:5/749: unlink d7/d1f/d3a/d49/f87 0 2024-09-12T18:03:24.423 INFO:tasks.workunit.client.0.smithi052.stdout:4/932: symlink d11/d17/d1b/d2a/d82/d129/l146 0 2024-09-12T18:03:24.423 INFO:tasks.workunit.client.0.smithi052.stdout:4/933: stat d11/d65/dd1/fab 0 2024-09-12T18:03:24.424 INFO:tasks.workunit.client.0.smithi052.stdout:5/750: symlink d7/lef 0 2024-09-12T18:03:24.424 INFO:tasks.workunit.client.0.smithi052.stdout:5/751: creat d7/d59/d5c/ff0 x:0 0 0 2024-09-12T18:03:24.424 INFO:tasks.workunit.client.0.smithi052.stdout:4/934: write d11/d17/d1b/d2a/f7d [4154068,18911] 0 2024-09-12T18:03:24.425 INFO:tasks.workunit.client.0.smithi052.stdout:4/935: chown d11/d17/d1b/d2a/d82/c127 40 1 2024-09-12T18:03:24.425 INFO:tasks.workunit.client.0.smithi052.stdout:3/796: rename d0/d4/d25/d2a/d6/d7/de/da1/da4 to d0/d4b/d4c/d6b/d117 0 2024-09-12T18:03:24.428 INFO:tasks.workunit.client.0.smithi052.stdout:4/936: creat d11/d65/dc6/d95/dbf/d8e/dd4/f147 x:0 0 0 2024-09-12T18:03:24.429 INFO:tasks.workunit.client.0.smithi052.stdout:0/753: sync 2024-09-12T18:03:24.429 INFO:tasks.workunit.client.0.smithi052.stdout:7/749: sync 2024-09-12T18:03:24.429 INFO:tasks.workunit.client.0.smithi052.stdout:9/749: sync 2024-09-12T18:03:24.429 INFO:tasks.workunit.client.0.smithi052.stdout:5/752: truncate d7/d59/fa7 3098152 0 2024-09-12T18:03:24.429 INFO:tasks.workunit.client.0.smithi052.stdout:6/824: sync 2024-09-12T18:03:24.429 INFO:tasks.workunit.client.0.smithi052.stdout:8/848: sync 2024-09-12T18:03:24.429 INFO:tasks.workunit.client.0.smithi052.stdout:1/661: sync 2024-09-12T18:03:24.431 INFO:tasks.workunit.client.0.smithi052.stdout:0/754: mknod d2/d6/dd/d21/d26/d38/dd0/cf0 0 2024-09-12T18:03:24.431 INFO:tasks.workunit.client.0.smithi052.stdout:9/750: write d0/d18/d26/d4d/fb9 [577290,42779] 0 2024-09-12T18:03:24.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/662: creat d3/d1d/fe2 x:0 0 0 2024-09-12T18:03:24.432 INFO:tasks.workunit.client.0.smithi052.stdout:5/753: truncate d7/d1f/d45/f7a 1012698 0 2024-09-12T18:03:24.432 INFO:tasks.workunit.client.0.smithi052.stdout:6/825: rmdir d2/d21/d9f/dd7/de7/d58/d5d/d107/d112 39 2024-09-12T18:03:24.432 INFO:tasks.workunit.client.0.smithi052.stdout:7/750: write d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/fc6 [646446,9320] 0 2024-09-12T18:03:24.433 INFO:tasks.workunit.client.0.smithi052.stdout:6/826: mkdir d2/d15/d11f 0 2024-09-12T18:03:24.434 INFO:tasks.workunit.client.0.smithi052.stdout:5/754: creat d7/d1c/d1e/da5/ff1 x:0 0 0 2024-09-12T18:03:24.435 INFO:tasks.workunit.client.0.smithi052.stdout:3/797: dwrite d0/d4/d25/d2a/d6/d7/ff0 [0,4194304] 0 2024-09-12T18:03:24.437 INFO:tasks.workunit.client.0.smithi052.stdout:7/751: write d6/d12/d1e/d29/d5d/f28 [3845126,31896] 0 2024-09-12T18:03:24.440 INFO:tasks.workunit.client.0.smithi052.stdout:2/746: dread da/d1d/d7d/f91 [0,4194304] 0 2024-09-12T18:03:24.440 INFO:tasks.workunit.client.0.smithi052.stdout:5/755: rename d7/d1f/d3a to d7/d1f/d34/df2 0 2024-09-12T18:03:24.440 INFO:tasks.workunit.client.0.smithi052.stdout:4/937: dwrite d11/d70/dbd/f94 [0,4194304] 0 2024-09-12T18:03:24.442 INFO:tasks.workunit.client.0.smithi052.stdout:1/663: dwrite d3/d1d/d22/d3f/db0/fca [0,4194304] 0 2024-09-12T18:03:24.442 INFO:tasks.workunit.client.0.smithi052.stdout:5/756: chown d7/d1f/d34/l88 15 1 2024-09-12T18:03:24.442 INFO:tasks.workunit.client.0.smithi052.stdout:4/938: chown d11/d17/d1b/d2a 99518029 1 2024-09-12T18:03:24.442 INFO:tasks.workunit.client.0.smithi052.stdout:3/798: write d0/d4b/d4c/d6b/f8d [1036999,82852] 0 2024-09-12T18:03:24.443 INFO:tasks.workunit.client.0.smithi052.stdout:0/755: write d2/d6/f23 [1267175,75142] 0 2024-09-12T18:03:24.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/752: write d6/d12/d1e/d29/d5d/f65 [377368,41950] 0 2024-09-12T18:03:24.444 INFO:tasks.workunit.client.0.smithi052.stdout:8/849: dwrite d13/d3c/fee [0,4194304] 0 2024-09-12T18:03:24.444 INFO:tasks.workunit.client.0.smithi052.stdout:3/799: symlink d0/d4b/d4c/d6b/d48/l118 0 2024-09-12T18:03:24.444 INFO:tasks.workunit.client.0.smithi052.stdout:0/756: write d2/d6/dd/d21/f5f [617372,22699] 0 2024-09-12T18:03:24.445 INFO:tasks.workunit.client.0.smithi052.stdout:4/939: creat d11/d65/dc6/d95/f148 x:0 0 0 2024-09-12T18:03:24.445 INFO:tasks.workunit.client.0.smithi052.stdout:5/757: truncate d7/d1c/d1e/d98/fc8 563975 0 2024-09-12T18:03:24.447 INFO:tasks.workunit.client.0.smithi052.stdout:0/757: dread - d2/d8/dce/d48/fd9 zero size 2024-09-12T18:03:24.448 INFO:tasks.workunit.client.0.smithi052.stdout:8/850: truncate d13/d18/d38/f102 501858 0 2024-09-12T18:03:24.449 INFO:tasks.workunit.client.0.smithi052.stdout:7/753: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/ff7 x:0 0 0 2024-09-12T18:03:24.449 INFO:tasks.workunit.client.0.smithi052.stdout:4/940: link d11/d17/d1b/fcd d11/d65/dc6/d95/d12b/f149 0 2024-09-12T18:03:24.450 INFO:tasks.workunit.client.0.smithi052.stdout:8/851: chown d13/d35/d9c/l80 17846911 1 2024-09-12T18:03:24.450 INFO:tasks.workunit.client.0.smithi052.stdout:0/758: unlink d2/d6/dd/d21/d26/f2b 0 2024-09-12T18:03:24.451 INFO:tasks.workunit.client.0.smithi052.stdout:6/827: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f42 [0,4194304] 0 2024-09-12T18:03:24.451 INFO:tasks.workunit.client.0.smithi052.stdout:4/941: dread - d11/d17/d1b/d2a/d6a/d7f/d90/fe0 zero size 2024-09-12T18:03:24.452 INFO:tasks.workunit.client.0.smithi052.stdout:3/800: dread d0/d4b/d4c/d6b/fae [0,4194304] 0 2024-09-12T18:03:24.452 INFO:tasks.workunit.client.0.smithi052.stdout:0/759: read - d2/d1b/d72/d8d/fe3 zero size 2024-09-12T18:03:24.452 INFO:tasks.workunit.client.0.smithi052.stdout:8/852: write d13/d35/d9c/d103/f106 [192743,124067] 0 2024-09-12T18:03:24.452 INFO:tasks.workunit.client.0.smithi052.stdout:4/942: chown d11/d46/dd9/f132 509533 1 2024-09-12T18:03:24.453 INFO:tasks.workunit.client.0.smithi052.stdout:0/760: unlink d2/d6/dd/dad/ce6 0 2024-09-12T18:03:24.454 INFO:tasks.workunit.client.0.smithi052.stdout:8/853: link d13/d18/d5b/fb1 d13/d18/d5b/d70/f11b 0 2024-09-12T18:03:24.454 INFO:tasks.workunit.client.0.smithi052.stdout:0/761: truncate d2/d6/dd/d21/d26/d65/f7c 1030993 0 2024-09-12T18:03:24.455 INFO:tasks.workunit.client.0.smithi052.stdout:8/854: creat d13/d35/d9c/da3/f11c x:0 0 0 2024-09-12T18:03:24.456 INFO:tasks.workunit.client.0.smithi052.stdout:0/762: mknod d2/d57/cf1 0 2024-09-12T18:03:24.457 INFO:tasks.workunit.client.0.smithi052.stdout:0/763: stat d2/d8 0 2024-09-12T18:03:24.458 INFO:tasks.workunit.client.0.smithi052.stdout:8/855: rename d13/d35/c3a to d13/ddc/c11d 0 2024-09-12T18:03:24.459 INFO:tasks.workunit.client.0.smithi052.stdout:0/764: fdatasync d2/d6/dd/d21/d26/d38/d4a/fa5 0 2024-09-12T18:03:24.459 INFO:tasks.workunit.client.0.smithi052.stdout:4/943: dwrite d11/d65/dc6/f87 [0,4194304] 0 2024-09-12T18:03:24.460 INFO:tasks.workunit.client.0.smithi052.stdout:8/856: creat d13/d18/d38/dd3/dde/f11e x:0 0 0 2024-09-12T18:03:24.460 INFO:tasks.workunit.client.0.smithi052.stdout:3/801: dwrite d0/d4/d25/d2a/f32 [0,4194304] 0 2024-09-12T18:03:24.461 INFO:tasks.workunit.client.0.smithi052.stdout:4/944: fsync d11/d65/f71 0 2024-09-12T18:03:24.462 INFO:tasks.workunit.client.0.smithi052.stdout:0/765: mkdir d2/d6/dd/d21/d26/d38/dd0/df2 0 2024-09-12T18:03:24.462 INFO:tasks.workunit.client.0.smithi052.stdout:4/945: mkdir d11/d65/dc6/daf/d107/d14a 0 2024-09-12T18:03:24.463 INFO:tasks.workunit.client.0.smithi052.stdout:4/946: chown d11/d65/dc6/d95/f9e 701864 1 2024-09-12T18:03:24.463 INFO:tasks.workunit.client.0.smithi052.stdout:0/766: creat d2/d6/dd/d21/d41/ff3 x:0 0 0 2024-09-12T18:03:24.463 INFO:tasks.workunit.client.0.smithi052.stdout:4/947: fdatasync d11/d65/dd1/f39 0 2024-09-12T18:03:24.463 INFO:tasks.workunit.client.0.smithi052.stdout:0/767: chown d2/d1b/d72/cbc 7054 1 2024-09-12T18:03:24.465 INFO:tasks.workunit.client.0.smithi052.stdout:4/948: fsync d11/d65/dd1/d3b/d3f/f50 0 2024-09-12T18:03:24.465 INFO:tasks.workunit.client.0.smithi052.stdout:1/664: truncate d3/d10/d38/f4d 888400 0 2024-09-12T18:03:24.465 INFO:tasks.workunit.client.0.smithi052.stdout:0/768: creat d2/d8/dce/ff4 x:0 0 0 2024-09-12T18:03:24.465 INFO:tasks.workunit.client.0.smithi052.stdout:0/769: chown d2/d6/dd/d21/d47 250 1 2024-09-12T18:03:24.466 INFO:tasks.workunit.client.0.smithi052.stdout:8/857: read d13/d18/d21/f23 [3776848,4122] 0 2024-09-12T18:03:24.467 INFO:tasks.workunit.client.0.smithi052.stdout:0/770: symlink d2/d57/lf5 0 2024-09-12T18:03:24.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/858: write d13/d18/d38/dd3/dde/f115 [3806398,20229] 0 2024-09-12T18:03:24.469 INFO:tasks.workunit.client.0.smithi052.stdout:0/771: creat d2/d6/dd/d21/d26/ff6 x:0 0 0 2024-09-12T18:03:24.470 INFO:tasks.workunit.client.0.smithi052.stdout:2/747: dread da/d1d/d35/f83 [0,4194304] 0 2024-09-12T18:03:24.471 INFO:tasks.workunit.client.0.smithi052.stdout:5/758: dread d7/d1c/d1e/f44 [0,4194304] 0 2024-09-12T18:03:24.472 INFO:tasks.workunit.client.0.smithi052.stdout:5/759: readlink d7/lef 0 2024-09-12T18:03:24.472 INFO:tasks.workunit.client.0.smithi052.stdout:0/772: write d2/d6/dd/dad/fd2 [326549,119734] 0 2024-09-12T18:03:24.473 INFO:tasks.workunit.client.0.smithi052.stdout:2/748: chown da/dc/d15/da6/dbb/f7f 69 1 2024-09-12T18:03:24.473 INFO:tasks.workunit.client.0.smithi052.stdout:4/949: dwrite d11/d46/fb2 [4194304,4194304] 0 2024-09-12T18:03:24.474 INFO:tasks.workunit.client.0.smithi052.stdout:1/665: dwrite d3/d1d/fd1 [0,4194304] 0 2024-09-12T18:03:24.474 INFO:tasks.workunit.client.0.smithi052.stdout:6/828: truncate d2/d21/d9f/dd7/de7/fa9 1686398 0 2024-09-12T18:03:24.474 INFO:tasks.workunit.client.0.smithi052.stdout:1/666: chown d3/d1d/d22 61335 1 2024-09-12T18:03:24.475 INFO:tasks.workunit.client.0.smithi052.stdout:6/829: write d2/d49/f108 [1000521,92145] 0 2024-09-12T18:03:24.475 INFO:tasks.workunit.client.0.smithi052.stdout:1/667: chown d3/ld 30 1 2024-09-12T18:03:24.478 INFO:tasks.workunit.client.0.smithi052.stdout:2/749: rename da/d21/d6b/f8c to da/dc/d15/d22/d87/dc5/ffe 0 2024-09-12T18:03:24.479 INFO:tasks.workunit.client.0.smithi052.stdout:5/760: creat d7/d51/d8b/ff3 x:0 0 0 2024-09-12T18:03:24.480 INFO:tasks.workunit.client.0.smithi052.stdout:4/950: write d11/d65/dd1/d3b/d3f/f134 [1475918,9550] 0 2024-09-12T18:03:24.480 INFO:tasks.workunit.client.0.smithi052.stdout:2/750: sync 2024-09-12T18:03:24.480 INFO:tasks.workunit.client.0.smithi052.stdout:1/668: mkdir d3/d1d/d83/de3 0 2024-09-12T18:03:24.480 INFO:tasks.workunit.client.0.smithi052.stdout:5/761: creat d7/d51/ff4 x:0 0 0 2024-09-12T18:03:24.480 INFO:tasks.workunit.client.0.smithi052.stdout:4/951: mknod d11/d65/dd1/d3b/d6f/c14b 0 2024-09-12T18:03:24.480 INFO:tasks.workunit.client.0.smithi052.stdout:2/751: chown da/dc/d15/l99 88998 1 2024-09-12T18:03:24.481 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:24.475+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:24.482 INFO:tasks.workunit.client.0.smithi052.stdout:1/669: truncate d3/d10/f85 12353002 0 2024-09-12T18:03:24.482 INFO:tasks.workunit.client.0.smithi052.stdout:3/802: read d0/d4b/d4c/d6b/fbf [3249802,78682] 0 2024-09-12T18:03:24.482 INFO:tasks.workunit.client.0.smithi052.stdout:4/952: truncate d11/d65/dd1/d72/fd3 2458629 0 2024-09-12T18:03:24.483 INFO:tasks.workunit.client.0.smithi052.stdout:5/762: symlink d7/d1c/d6f/lf5 0 2024-09-12T18:03:24.483 INFO:tasks.workunit.client.0.smithi052.stdout:9/751: dread d0/d6/d3a/d43/f7a [0,4194304] 0 2024-09-12T18:03:24.483 INFO:tasks.workunit.client.0.smithi052.stdout:5/763: readlink d7/d59/d5c/d7c/ldc 0 2024-09-12T18:03:24.483 INFO:tasks.workunit.client.0.smithi052.stdout:4/953: fdatasync d11/d65/dc6/daf/d107/dc5/dc7/fd5 0 2024-09-12T18:03:24.484 INFO:tasks.workunit.client.0.smithi052.stdout:9/752: write d0/d58/f83 [1439275,2314] 0 2024-09-12T18:03:24.484 INFO:tasks.workunit.client.0.smithi052.stdout:4/954: rmdir d11/d17/d1b 39 2024-09-12T18:03:24.484 INFO:tasks.workunit.client.0.smithi052.stdout:5/764: creat d7/d59/d5c/d7c/ff6 x:0 0 0 2024-09-12T18:03:24.488 INFO:tasks.workunit.client.0.smithi052.stdout:4/955: rmdir d11/d65 39 2024-09-12T18:03:24.488 INFO:tasks.workunit.client.0.smithi052.stdout:8/859: dread d13/d35/de1/f96 [0,4194304] 0 2024-09-12T18:03:24.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/765: stat d7/d59/dbe/c6e 0 2024-09-12T18:03:24.490 INFO:tasks.workunit.client.0.smithi052.stdout:8/860: dread - d13/d18/fc7 zero size 2024-09-12T18:03:24.492 INFO:tasks.workunit.client.0.smithi052.stdout:1/670: dwrite d3/d1d/d22/d3f/f5f [0,4194304] 0 2024-09-12T18:03:24.493 INFO:tasks.workunit.client.0.smithi052.stdout:5/766: link d7/d59/d5c/f99 d7/d59/d5c/d7c/ff7 0 2024-09-12T18:03:24.494 INFO:tasks.workunit.client.0.smithi052.stdout:3/803: dwrite d0/d4/f19 [0,4194304] 0 2024-09-12T18:03:24.494 INFO:tasks.workunit.client.0.smithi052.stdout:8/861: chown d13/d18/d21/fb7 3117 1 2024-09-12T18:03:24.494 INFO:tasks.workunit.client.0.smithi052.stdout:2/752: truncate da/d1d/d35/f83 81205 0 2024-09-12T18:03:24.495 INFO:tasks.workunit.client.0.smithi052.stdout:4/956: creat d11/d17/d1b/d2a/d6a/d7f/d90/f14c x:0 0 0 2024-09-12T18:03:24.495 INFO:tasks.workunit.client.0.smithi052.stdout:9/753: dwrite d0/d6/d3a/d43/f4b [0,4194304] 0 2024-09-12T18:03:24.496 INFO:tasks.workunit.client.0.smithi052.stdout:1/671: write d3/d10/dc4/fd2 [208477,77801] 0 2024-09-12T18:03:24.498 INFO:tasks.workunit.client.0.smithi052.stdout:7/754: dread d6/d12/d1e/d29/d5d/f28 [0,4194304] 0 2024-09-12T18:03:24.498 INFO:tasks.workunit.client.0.smithi052.stdout:1/672: chown d3/d1d/d22/d3f/f45 160415175 1 2024-09-12T18:03:24.498 INFO:tasks.workunit.client.0.smithi052.stdout:1/673: sync 2024-09-12T18:03:24.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/754: rmdir d0/d6 39 2024-09-12T18:03:24.499 INFO:tasks.workunit.client.0.smithi052.stdout:4/957: write d11/d17/d1b/d2a/d6a/d7f/dd6/ff4 [316216,109928] 0 2024-09-12T18:03:24.499 INFO:tasks.workunit.client.0.smithi052.stdout:2/753: rename da/d1d/d7d/f91 to da/d1d/d35/d8e/fff 0 2024-09-12T18:03:24.500 INFO:tasks.workunit.client.0.smithi052.stdout:1/674: creat d3/d1d/d22/d27/d28/d88/fe4 x:0 0 0 2024-09-12T18:03:24.501 INFO:tasks.workunit.client.0.smithi052.stdout:4/958: mknod d11/d65/dd1/d72/c14d 0 2024-09-12T18:03:24.501 INFO:tasks.workunit.client.0.smithi052.stdout:1/675: chown d3/da2/dbe/fc9 44010343 1 2024-09-12T18:03:24.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/755: link d0/d6/d3a/d43/f4b d0/d18/ff9 0 2024-09-12T18:03:24.502 INFO:tasks.workunit.client.0.smithi052.stdout:1/676: mkdir d3/d1d/d22/d27/d28/de5 0 2024-09-12T18:03:24.504 INFO:tasks.workunit.client.0.smithi052.stdout:9/756: symlink d0/d18/d26/lfa 0 2024-09-12T18:03:24.505 INFO:tasks.workunit.client.0.smithi052.stdout:4/959: dread d11/d17/d1b/d2a/d6a/f73 [4194304,4194304] 0 2024-09-12T18:03:24.505 INFO:tasks.workunit.client.0.smithi052.stdout:6/830: dread d2/d21/d6a/f72 [0,4194304] 0 2024-09-12T18:03:24.506 INFO:tasks.workunit.client.0.smithi052.stdout:4/960: readlink d11/d65/dc6/daf/lc9 0 2024-09-12T18:03:24.507 INFO:tasks.workunit.client.0.smithi052.stdout:1/677: truncate d3/d10/f33 1580356 0 2024-09-12T18:03:24.507 INFO:tasks.workunit.client.0.smithi052.stdout:3/804: dwrite d0/d4b/d4c/f58 [0,4194304] 0 2024-09-12T18:03:24.507 INFO:tasks.workunit.client.0.smithi052.stdout:1/678: fdatasync d3/d10/f26 0 2024-09-12T18:03:24.507 INFO:tasks.workunit.client.0.smithi052.stdout:7/755: dwrite d6/f76 [0,4194304] 0 2024-09-12T18:03:24.508 INFO:tasks.workunit.client.0.smithi052.stdout:9/757: chown d0/d6/d3a/d42/d61/d6a/c6b 3411813 1 2024-09-12T18:03:24.509 INFO:tasks.workunit.client.0.smithi052.stdout:6/831: creat d2/d21/d9f/dd7/de7/d58/d5d/d9c/f120 x:0 0 0 2024-09-12T18:03:24.509 INFO:tasks.workunit.client.0.smithi052.stdout:1/679: symlink d3/da2/ddc/le6 0 2024-09-12T18:03:24.510 INFO:tasks.workunit.client.0.smithi052.stdout:5/767: dread d7/d1f/f76 [0,4194304] 0 2024-09-12T18:03:24.510 INFO:tasks.workunit.client.0.smithi052.stdout:2/754: dread da/dc/d15/f65 [0,4194304] 0 2024-09-12T18:03:24.511 INFO:tasks.workunit.client.0.smithi052.stdout:1/680: unlink d3/d10/l2d 0 2024-09-12T18:03:24.511 INFO:tasks.workunit.client.0.smithi052.stdout:6/832: symlink d2/d21/ded/df5/l121 0 2024-09-12T18:03:24.511 INFO:tasks.workunit.client.0.smithi052.stdout:3/805: write d0/d4/d25/d2a/d6/d7/de/f4f [1710401,116610] 0 2024-09-12T18:03:24.511 INFO:tasks.workunit.client.0.smithi052.stdout:2/755: stat da/f80 0 2024-09-12T18:03:24.515 INFO:tasks.workunit.client.0.smithi052.stdout:5/768: mknod d7/d51/dc6/cf8 0 2024-09-12T18:03:24.515 INFO:tasks.workunit.client.0.smithi052.stdout:2/756: mknod da/dc/d76/c100 0 2024-09-12T18:03:24.515 INFO:tasks.workunit.client.0.smithi052.stdout:4/961: dwrite d11/d65/dc6/d95/fde [0,4194304] 0 2024-09-12T18:03:24.515 INFO:tasks.workunit.client.0.smithi052.stdout:7/756: mknod d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/cf8 0 2024-09-12T18:03:24.515 INFO:tasks.workunit.client.0.smithi052.stdout:3/806: fsync d0/d4b/d57/d6d/f7b 0 2024-09-12T18:03:24.515 INFO:tasks.workunit.client.0.smithi052.stdout:1/681: mknod d3/da2/ce7 0 2024-09-12T18:03:24.517 INFO:tasks.workunit.client.0.smithi052.stdout:0/773: dread d2/d6/f4c [0,4194304] 0 2024-09-12T18:03:24.517 INFO:tasks.workunit.client.0.smithi052.stdout:9/758: dwrite d0/d6/d3a/d43/d74/fe9 [0,4194304] 0 2024-09-12T18:03:24.519 INFO:tasks.workunit.client.0.smithi052.stdout:7/757: creat d6/dc/d1a/ff9 x:0 0 0 2024-09-12T18:03:24.519 INFO:tasks.workunit.client.0.smithi052.stdout:8/862: truncate d13/d18/d5b/d70/f90 3319604 0 2024-09-12T18:03:24.520 INFO:tasks.workunit.client.0.smithi052.stdout:0/774: read - d2/d1b/d72/d8d/fe3 zero size 2024-09-12T18:03:24.520 INFO:tasks.workunit.client.0.smithi052.stdout:2/757: creat da/d1d/daa/f101 x:0 0 0 2024-09-12T18:03:24.521 INFO:tasks.workunit.client.0.smithi052.stdout:1/682: mknod d3/dcb/d74/dc8/ce8 0 2024-09-12T18:03:24.521 INFO:tasks.workunit.client.0.smithi052.stdout:5/769: creat d7/ff9 x:0 0 0 2024-09-12T18:03:24.522 INFO:tasks.workunit.client.0.smithi052.stdout:6/833: dwrite d2/d21/d9f/dd7/de7/fd3 [0,4194304] 0 2024-09-12T18:03:24.522 INFO:tasks.workunit.client.0.smithi052.stdout:7/758: creat d6/d12/d17/dac/ffa x:0 0 0 2024-09-12T18:03:24.522 INFO:tasks.workunit.client.0.smithi052.stdout:4/962: link d11/d65/dc6/d95/dbf/d8e/ffb d11/d65/dc6/daf/d102/f14e 0 2024-09-12T18:03:24.522 INFO:tasks.workunit.client.0.smithi052.stdout:9/759: creat d0/d18/d37/d87/d72/df6/ffb x:0 0 0 2024-09-12T18:03:24.522 INFO:tasks.workunit.client.0.smithi052.stdout:1/683: fsync d3/d10/dc4/fd2 0 2024-09-12T18:03:24.523 INFO:tasks.workunit.client.0.smithi052.stdout:1/684: sync 2024-09-12T18:03:24.523 INFO:tasks.workunit.client.0.smithi052.stdout:8/863: symlink d13/d18/d38/l11f 0 2024-09-12T18:03:24.523 INFO:tasks.workunit.client.0.smithi052.stdout:0/775: symlink d2/d1b/d72/d8d/lf7 0 2024-09-12T18:03:24.523 INFO:tasks.workunit.client.0.smithi052.stdout:3/807: link d0/d4/d25/d2a/d6/d41/ca7 d0/d4/d25/d2a/d6/d41/c119 0 2024-09-12T18:03:24.523 INFO:tasks.workunit.client.0.smithi052.stdout:2/758: creat da/dc/d15/d22/d87/dc5/f102 x:0 0 0 2024-09-12T18:03:24.524 INFO:tasks.workunit.client.0.smithi052.stdout:8/864: write d13/f67 [4884756,22533] 0 2024-09-12T18:03:24.524 INFO:tasks.workunit.client.0.smithi052.stdout:1/685: mkdir d3/da2/ddc/de9 0 2024-09-12T18:03:24.525 INFO:tasks.workunit.client.0.smithi052.stdout:4/963: rmdir d11/d65/dc6/daf/d107/d130 39 2024-09-12T18:03:24.525 INFO:tasks.workunit.client.0.smithi052.stdout:0/776: readlink d2/le4 0 2024-09-12T18:03:24.525 INFO:tasks.workunit.client.0.smithi052.stdout:7/759: mkdir d6/d12/d1e/d29/d5d/d71/d3a/dfb 0 2024-09-12T18:03:24.525 INFO:tasks.workunit.client.0.smithi052.stdout:3/808: mkdir d0/d4/d25/d2a/d11a 0 2024-09-12T18:03:24.525 INFO:tasks.workunit.client.0.smithi052.stdout:4/964: readlink d11/d17/d1b/d2a/lf3 0 2024-09-12T18:03:24.527 INFO:tasks.workunit.client.0.smithi052.stdout:1/686: truncate d3/d1d/d22/f30 4838514 0 2024-09-12T18:03:24.527 INFO:tasks.workunit.client.0.smithi052.stdout:0/777: creat d2/d6/dd/d21/ff8 x:0 0 0 2024-09-12T18:03:24.528 INFO:tasks.workunit.client.0.smithi052.stdout:1/687: chown d3/dcb 262901 1 2024-09-12T18:03:24.528 INFO:tasks.workunit.client.0.smithi052.stdout:3/809: chown d0/d4/d25/d2a/d6/d41/c119 196380039 1 2024-09-12T18:03:24.529 INFO:tasks.workunit.client.0.smithi052.stdout:8/865: getdents d13/d18/d5b/d70 0 2024-09-12T18:03:24.529 INFO:tasks.workunit.client.0.smithi052.stdout:1/688: chown d3/d1d/d22/d3f/d56/ldd 110665493 1 2024-09-12T18:03:24.530 INFO:tasks.workunit.client.0.smithi052.stdout:8/866: symlink d13/l120 0 2024-09-12T18:03:24.530 INFO:tasks.workunit.client.0.smithi052.stdout:7/760: read d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/fce [2386013,9146] 0 2024-09-12T18:03:24.530 INFO:tasks.workunit.client.0.smithi052.stdout:0/778: rename d2/d6/dd/d21/d26/d38/d4a/fc4 to d2/d8/dee/ff9 0 2024-09-12T18:03:24.531 INFO:tasks.workunit.client.0.smithi052.stdout:3/810: fsync d0/d4/d25/d2a/d6/d7/fd4 0 2024-09-12T18:03:24.531 INFO:tasks.workunit.client.0.smithi052.stdout:7/761: fdatasync d6/d12/fc5 0 2024-09-12T18:03:24.532 INFO:tasks.workunit.client.0.smithi052.stdout:8/867: rename d13/d35/de1 to d13/d35/de1/d121 22 2024-09-12T18:03:24.532 INFO:tasks.workunit.client.0.smithi052.stdout:6/834: dwrite d2/d15/dcc/fe6 [0,4194304] 0 2024-09-12T18:03:24.532 INFO:tasks.workunit.client.0.smithi052.stdout:2/759: dread da/d2c/f52 [0,4194304] 0 2024-09-12T18:03:24.533 INFO:tasks.workunit.client.0.smithi052.stdout:2/760: sync 2024-09-12T18:03:24.533 INFO:tasks.workunit.client.0.smithi052.stdout:7/762: dread - d6/d12/d1e/d29/da1/ff4 zero size 2024-09-12T18:03:24.533 INFO:tasks.workunit.client.0.smithi052.stdout:6/835: symlink d2/l122 0 2024-09-12T18:03:24.533 INFO:tasks.workunit.client.0.smithi052.stdout:8/868: truncate d13/fe3 858485 0 2024-09-12T18:03:24.533 INFO:tasks.workunit.client.0.smithi052.stdout:3/811: chown d0/d4/d25/d2a/fd2 4745196 1 2024-09-12T18:03:24.534 INFO:tasks.workunit.client.0.smithi052.stdout:0/779: rename d2/d6/dd/d21/d26/d65/fcf to d2/d6/dd/d21/d26/d38/d4a/d86/ffa 0 2024-09-12T18:03:24.535 INFO:tasks.workunit.client.0.smithi052.stdout:2/761: write da/f16 [4241612,42122] 0 2024-09-12T18:03:24.535 INFO:tasks.workunit.client.0.smithi052.stdout:7/763: mkdir d6/d12/d1e/dae/dfc 0 2024-09-12T18:03:24.536 INFO:tasks.workunit.client.0.smithi052.stdout:8/869: write d13/f9d [2049415,124842] 0 2024-09-12T18:03:24.536 INFO:tasks.workunit.client.0.smithi052.stdout:6/836: rmdir d2/d21/d9f/dd7/de7 39 2024-09-12T18:03:24.536 INFO:tasks.workunit.client.0.smithi052.stdout:4/965: dwrite d11/d17/d1b/d2a/d6a/d7f/f106 [0,4194304] 0 2024-09-12T18:03:24.537 INFO:tasks.workunit.client.0.smithi052.stdout:7/764: dread - d6/dc/d1a/ff2 zero size 2024-09-12T18:03:24.537 INFO:tasks.workunit.client.0.smithi052.stdout:2/762: truncate da/dc/f2e 2559820 0 2024-09-12T18:03:24.538 INFO:tasks.workunit.client.0.smithi052.stdout:3/812: read d0/d4b/fc2 [5112,103980] 0 2024-09-12T18:03:24.539 INFO:tasks.workunit.client.0.smithi052.stdout:1/689: dwrite d3/d1d/d72/fcd [0,4194304] 0 2024-09-12T18:03:24.539 INFO:tasks.workunit.client.0.smithi052.stdout:4/966: write d11/d17/d1b/d2a/d6a/d7f/d90/fa1 [98486,97975] 0 2024-09-12T18:03:24.539 INFO:tasks.workunit.client.0.smithi052.stdout:5/770: truncate d7/d1c/d1e/fd8 1386368 0 2024-09-12T18:03:24.540 INFO:tasks.workunit.client.0.smithi052.stdout:0/780: unlink d2/d6/dd/d21/d47/f67 0 2024-09-12T18:03:24.540 INFO:tasks.workunit.client.0.smithi052.stdout:8/870: creat d13/d18/d38/dbf/f122 x:0 0 0 2024-09-12T18:03:24.540 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:24.540 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:2357 3.8 e51/16 3:17051619:::200.0000000f:head v 51'399, mlcod=51'395)", 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.540230+0000", 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.00053941600000000003, 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00055749, 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540230+0000", 2024-09-12T18:03:24.541 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540230+0000", 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540231+0000", 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0299999999999999e-07 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.542 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540240+0000", 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2229999999999996e-06 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540248+0000", 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2349999999999999e-06 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540255+0000", 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1860000000000003e-06 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.543 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540301+0000", 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5714999999999999e-05 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540315+0000", 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4241e-05 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.544 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14248 4.b 4:d266d193:::10000003631.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.516941+0000", 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.023828887, 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.023896891999999999, 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14248 2024-09-12T18:03:24.545 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.516941+0000", 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.516941+0000", 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.546 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.516943+0000", 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1270000000000001e-06 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.523508+0000", 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065646089999999999 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.523526+0000", 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.853e-05 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.547 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.523534+0000", 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9640000000000003e-06 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.523659+0000", 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012494399999999999 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.548 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.523920+0000", 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026150099999999998 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.524139+0000", 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021874000000000001 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.533352+0000", 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092124259999999993 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.549 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14249 4.2f 4:f56767c3:::10000003855.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.523557+0000", 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.017212959999999999, 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017344431, 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:24.550 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14249 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.523557+0000", 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.523557+0000", 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.551 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.523558+0000", 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.387e-06 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531020+0000", 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0074622940000000004 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531040+0000", 2024-09-12T18:03:24.552 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9701999999999999e-05 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531050+0000", 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.696e-06 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531115+0000", 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5281000000000001e-05 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.553 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531302+0000", 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018731299999999999 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531454+0000", 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015197299999999999 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.536579+0000", 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051246920000000001 2024-09-12T18:03:24.554 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(client.4587.0:14250 4.3b e51/17 4:ddf09bcf:::1000000366c.00000000:head v 51'222, mlcod=51'220)", 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.531225+0000", 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0095449839999999994, 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0097306159999999992, 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.555 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531225+0000", 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531225+0000", 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.531225+0000", 2024-09-12T18:03:24.556 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4400000000000001e-07 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.536936+0000", 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0057107820000000002 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.536952+0000", 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5877999999999999e-05 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.557 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.536958+0000", 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6189999999999996e-06 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537044+0000", 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5877999999999993e-05 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537071+0000", 2024-09-12T18:03:24.558 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6633999999999999e-05 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_repop(mds.0.3:2356 3.8 e51/16 3:17051619:::200.0000000f:head v 51'398, mlcod=51'394)", 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.538361+0000", 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.0024086260000000001, 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002635905, 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.559 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.538361+0000", 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.538361+0000", 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.538362+0000", 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7599999999999997e-07 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.538385+0000", 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3975e-05 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.561 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.538397+0000", 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1593999999999999e-05 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.538405+0000", 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8040000000000002e-06 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.538641+0000", 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000236152 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.562 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.538654+0000", 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2826999999999999e-05 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.540961+0000", 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0023075259999999998 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-12T18:03:24.563 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 5 2024-09-12T18:03:24.564 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:24.567 INFO:tasks.workunit.client.0.smithi052.stdout:6/837: dread - d2/d21/d9f/dd7/de7/d58/d5d/d9c/fde zero size 2024-09-12T18:03:24.567 INFO:tasks.workunit.client.0.smithi052.stdout:2/763: creat da/d1d/d7d/f103 x:0 0 0 2024-09-12T18:03:24.567 INFO:tasks.workunit.client.0.smithi052.stdout:0/781: write d2/f4f [1739696,124951] 0 2024-09-12T18:03:24.567 INFO:tasks.workunit.client.0.smithi052.stdout:3/813: getdents d0/d16 0 2024-09-12T18:03:24.567 INFO:tasks.workunit.client.0.smithi052.stdout:2/764: fdatasync da/dc/f2b 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:5/771: truncate d7/d59/dbe/d6b/fa1 4420067 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:2/765: stat da/dc/d15/f69 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:6/838: symlink d2/d21/d9f/dd7/de7/d58/d5d/d107/d112/l123 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:4/967: creat d11/d65/dc6/d95/dbf/d8e/dd4/f14f x:0 0 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:5/772: chown d7/d1f/d45/f62 49295 1 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:2/766: truncate da/d1d/d35/d8e/fff 5001448 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:9/760: dwrite d0/d6/d3a/d42/f76 [0,4194304] 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:3/814: dread d0/d4b/d4c/f58 [0,4194304] 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:1/690: read d3/dcb/d74/f91 [1622411,60966] 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:9/761: creat d0/d1c/ffc x:0 0 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:1/691: write d3/d1d/d72/fce [395190,10285] 0 2024-09-12T18:03:24.568 INFO:tasks.workunit.client.0.smithi052.stdout:9/762: read - d0/d18/d37/fec zero size 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:0/782: dwrite d2/d57/d5b/f64 [4194304,4194304] 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:8/871: chown d13/d18/d5b/d70/f90 320743622 1 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:3/815: creat d0/d4/d25/d2a/d6/d7/d34/d72/d83/f11b x:0 0 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:2/767: dread da/f13 [0,4194304] 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:8/872: chown d13/d18/d5b/d70 910180 1 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:1/692: mknod d3/dcb/d74/cea 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:3/816: write d0/d4/d25/d2a/d2c/f67 [635587,43317] 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:9/763: creat d0/d18/d26/ffd x:0 0 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:0/783: fsync d2/d6/dd/d21/d41/fa6 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:6/839: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d9c/f31 [0,4194304] 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:4/968: dwrite d11/d17/d1b/d2a/d6a/d7f/f13c [0,4194304] 0 2024-09-12T18:03:24.569 INFO:tasks.workunit.client.0.smithi052.stdout:2/768: unlink da/dc/d15/d20/f14 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:1/693: mkdir d3/d1d/d22/deb 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:6/840: truncate d2/d49/f7a 362436 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:2/769: creat da/d2c/dbf/f104 x:0 0 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:4/969: rmdir d11/d17/d1b/d124 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:1/694: write d3/d10/dc4/fd2 [593555,5429] 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:3/817: getdents d0/d4/d25/d2a/d6/dd8 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:6/841: chown d2/d15/fe0 7591822 1 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:9/764: dread d0/d1c/f51 [0,4194304] 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:6/842: rename d2/d21/fec to d2/d15/dcc/f124 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:2/770: rename da/dc/d15/d20/d60/d6e to da/dc/d15/d20/d60/d6e/d105 22 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:1/695: getdents d3/d1d/d22/d66 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:2/771: fdatasync da/d1d/d7d/fc1 0 2024-09-12T18:03:24.570 INFO:tasks.workunit.client.0.smithi052.stdout:1/696: rmdir d3/d69/d89 39 2024-09-12T18:03:24.571 INFO:tasks.workunit.client.0.smithi052.stdout:9/765: read d0/d18/d26/d4d/fac [1422287,84416] 0 2024-09-12T18:03:24.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:24.573 INFO:tasks.workunit.client.0.smithi052.stdout:7/765: dread d6/d12/d1e/d29/d5d/f78 [0,4194304] 0 2024-09-12T18:03:24.573 INFO:tasks.workunit.client.0.smithi052.stdout:1/697: mknod d3/d10/d38/d8b/cec 0 2024-09-12T18:03:24.573 INFO:tasks.workunit.client.0.smithi052.stdout:6/843: rename d2/d21/d6a/fa7 to d2/d21/d9f/dd7/de7/d58/d5d/d87/f125 0 2024-09-12T18:03:24.573 INFO:tasks.workunit.client.0.smithi052.stdout:4/970: dread d11/d17/d1b/f5b [0,4194304] 0 2024-09-12T18:03:24.573 INFO:tasks.workunit.client.0.smithi052.stdout:4/971: mkdir d11/d17/d1b/d150 0 2024-09-12T18:03:24.573 INFO:tasks.workunit.client.0.smithi052.stdout:6/844: write d2/d21/d9f/dd7/de7/d58/d5d/d9c/f31 [1757527,49504] 0 2024-09-12T18:03:24.573 INFO:tasks.workunit.client.0.smithi052.stdout:4/972: mknod d11/d17/d1b/d2a/d6a/d7f/d90/c151 0 2024-09-12T18:03:24.577 INFO:tasks.workunit.client.0.smithi052.stdout:8/873: dread d13/f17 [0,4194304] 0 2024-09-12T18:03:24.579 INFO:tasks.workunit.client.0.smithi052.stdout:8/874: mkdir d13/d18/d5b/d70/d123 0 2024-09-12T18:03:24.579 INFO:tasks.workunit.client.0.smithi052.stdout:3/818: dwrite d0/d4/d25/fb5 [0,4194304] 0 2024-09-12T18:03:24.579 INFO:tasks.workunit.client.0.smithi052.stdout:8/875: readlink d13/d18/d38/l52 0 2024-09-12T18:03:24.580 INFO:tasks.workunit.client.0.smithi052.stdout:8/876: write d13/d18/d38/dbf/fcf [190380,41457] 0 2024-09-12T18:03:24.582 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:24.579+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:24.583 INFO:tasks.workunit.client.0.smithi052.stdout:7/766: truncate d6/d12/d1e/d29/d5d/d71/d3a/d83/f7c 651229 0 2024-09-12T18:03:24.584 INFO:tasks.workunit.client.0.smithi052.stdout:1/698: write d3/d10/d38/f4a [647831,108575] 0 2024-09-12T18:03:24.584 INFO:tasks.workunit.client.0.smithi052.stdout:8/877: link d13/d18/d21/dc1/f94 d13/d18/d38/dbf/dc5/f124 0 2024-09-12T18:03:24.585 INFO:tasks.workunit.client.0.smithi052.stdout:4/973: write d11/d65/dc6/d95/d12b/f149 [5043836,66213] 0 2024-09-12T18:03:24.585 INFO:tasks.workunit.client.0.smithi052.stdout:1/699: dread - d3/dcb/d74/d7d/f9d zero size 2024-09-12T18:03:24.585 INFO:tasks.workunit.client.0.smithi052.stdout:8/878: symlink d13/d35/de1/l125 0 2024-09-12T18:03:24.586 INFO:tasks.workunit.client.0.smithi052.stdout:7/767: unlink d6/d12/d1e/d29/d5d/d71/d9e/fdd 0 2024-09-12T18:03:24.586 INFO:tasks.workunit.client.0.smithi052.stdout:8/879: rmdir d13/d35/d9c/d9f 39 2024-09-12T18:03:24.587 INFO:tasks.workunit.client.0.smithi052.stdout:6/845: dread d2/d21/d6a/d97/fc0 [0,4194304] 0 2024-09-12T18:03:24.588 INFO:tasks.workunit.client.0.smithi052.stdout:8/880: link d13/d18/d38/f102 d13/d9b/f126 0 2024-09-12T18:03:24.588 INFO:tasks.workunit.client.0.smithi052.stdout:7/768: getdents d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3 0 2024-09-12T18:03:24.589 INFO:tasks.workunit.client.0.smithi052.stdout:6/846: write d2/d80/f48 [1878493,63087] 0 2024-09-12T18:03:24.589 INFO:tasks.workunit.client.0.smithi052.stdout:5/773: sync 2024-09-12T18:03:24.589 INFO:tasks.workunit.client.0.smithi052.stdout:8/881: write d13/d18/d38/dd3/fdf [3111320,63723] 0 2024-09-12T18:03:24.590 INFO:tasks.workunit.client.0.smithi052.stdout:9/766: dread d0/d6/fc5 [0,4194304] 0 2024-09-12T18:03:24.591 INFO:tasks.workunit.client.0.smithi052.stdout:5/774: creat d7/d1f/d45/ffa x:0 0 0 2024-09-12T18:03:24.593 INFO:tasks.workunit.client.0.smithi052.stdout:8/882: mkdir d13/d18/d21/d64/d127 0 2024-09-12T18:03:24.593 INFO:tasks.workunit.client.0.smithi052.stdout:6/847: read d2/d5e/f9d [3408772,86443] 0 2024-09-12T18:03:24.593 INFO:tasks.workunit.client.0.smithi052.stdout:5/775: dread - d7/d1c/d1e/da5/ff1 zero size 2024-09-12T18:03:24.593 INFO:tasks.workunit.client.0.smithi052.stdout:9/767: mknod d0/d6/d3a/d42/d61/d6a/cfe 0 2024-09-12T18:03:24.595 INFO:tasks.workunit.client.0.smithi052.stdout:0/784: dread d2/d8/f43 [0,4194304] 0 2024-09-12T18:03:24.595 INFO:tasks.workunit.client.0.smithi052.stdout:5/776: rename d7/d1f/d45/l81 to d7/d59/dbe/d6b/de7/lfb 0 2024-09-12T18:03:24.596 INFO:tasks.workunit.client.0.smithi052.stdout:9/768: rename d0/d1c/cdd to d0/d6/d3a/d43/dd5/cff 0 2024-09-12T18:03:24.597 INFO:tasks.workunit.client.0.smithi052.stdout:1/700: dwrite d3/d1d/d22/f57 [0,4194304] 0 2024-09-12T18:03:24.598 INFO:tasks.workunit.client.0.smithi052.stdout:7/769: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/fe3 [0,4194304] 0 2024-09-12T18:03:24.599 INFO:tasks.workunit.client.0.smithi052.stdout:5/777: creat d7/d59/dbe/ffc x:0 0 0 2024-09-12T18:03:24.600 INFO:tasks.workunit.client.0.smithi052.stdout:0/785: creat d2/d1b/d80/da3/ffb x:0 0 0 2024-09-12T18:03:24.600 INFO:tasks.workunit.client.0.smithi052.stdout:6/848: dwrite d2/d15/f113 [0,4194304] 0 2024-09-12T18:03:24.601 INFO:tasks.workunit.client.0.smithi052.stdout:5/778: chown d7/d59/dbe/c6e 59607694 1 2024-09-12T18:03:24.601 INFO:tasks.workunit.client.0.smithi052.stdout:0/786: truncate d2/d1b/f87 1707025 0 2024-09-12T18:03:24.601 INFO:tasks.workunit.client.0.smithi052.stdout:6/849: creat d2/d21/ded/f126 x:0 0 0 2024-09-12T18:03:24.603 INFO:tasks.workunit.client.0.smithi052.stdout:6/850: mknod d2/d21/d6a/d97/c127 0 2024-09-12T18:03:24.603 INFO:tasks.workunit.client.0.smithi052.stdout:0/787: truncate d2/d51/fe2 347868 0 2024-09-12T18:03:24.605 INFO:tasks.workunit.client.0.smithi052.stdout:6/851: mkdir d2/d21/d9f/dd7/d128 0 2024-09-12T18:03:24.605 INFO:tasks.workunit.client.0.smithi052.stdout:9/769: rename d0/d1c to d0/d18/d26/d100 0 2024-09-12T18:03:24.605 INFO:tasks.workunit.client.0.smithi052.stdout:5/779: write d7/d1f/f29 [1602087,96742] 0 2024-09-12T18:03:24.606 INFO:tasks.workunit.client.0.smithi052.stdout:3/819: dread d0/d4b/d4c/fd5 [0,4194304] 0 2024-09-12T18:03:24.606 INFO:tasks.workunit.client.0.smithi052.stdout:6/852: mkdir d2/d21/d76/d129 0 2024-09-12T18:03:24.607 INFO:tasks.workunit.client.0.smithi052.stdout:5/780: mkdir d7/d1c/d67/dfd 0 2024-09-12T18:03:24.607 INFO:tasks.workunit.client.0.smithi052.stdout:7/770: dwrite d6/d12/d1e/d29/d5d/f65 [0,4194304] 0 2024-09-12T18:03:24.613 INFO:tasks.workunit.client.0.smithi052.stdout:7/771: unlink d6/dc/fe 0 2024-09-12T18:03:24.613 INFO:tasks.workunit.client.0.smithi052.stdout:0/788: truncate d2/d6/dd/d21/d26/d38/d4a/fa5 159849 0 2024-09-12T18:03:24.613 INFO:tasks.workunit.client.0.smithi052.stdout:0/789: chown d2/d6/dd/d21/d26/d38/dd0/df2 304761 1 2024-09-12T18:03:24.614 INFO:tasks.workunit.client.0.smithi052.stdout:5/781: creat d7/d1f/ffe x:0 0 0 2024-09-12T18:03:24.614 INFO:tasks.workunit.client.0.smithi052.stdout:6/853: creat d2/d21/d9f/dd7/de7/d58/d5d/f12a x:0 0 0 2024-09-12T18:03:24.614 INFO:tasks.workunit.client.0.smithi052.stdout:0/790: symlink d2/d6/dd/d21/d26/lfc 0 2024-09-12T18:03:24.614 INFO:tasks.workunit.client.0.smithi052.stdout:9/770: dwrite d0/d18/d26/f46 [0,4194304] 0 2024-09-12T18:03:24.616 INFO:tasks.workunit.client.0.smithi052.stdout:6/854: truncate d2/d21/d9f/dd7/de7/d58/d5d/fb0 456425 0 2024-09-12T18:03:24.616 INFO:tasks.workunit.client.0.smithi052.stdout:9/771: creat d0/d6/de1/f101 x:0 0 0 2024-09-12T18:03:24.617 INFO:tasks.workunit.client.0.smithi052.stdout:7/772: dread d6/d12/d1e/d29/d5d/f78 [4194304,4194304] 0 2024-09-12T18:03:24.618 INFO:tasks.workunit.client.0.smithi052.stdout:9/772: mkdir d0/d6/d3a/d42/d61/d6a/d102 0 2024-09-12T18:03:24.619 INFO:tasks.workunit.client.0.smithi052.stdout:7/773: write d6/d12/d1e/d8e/fdc [283646,64582] 0 2024-09-12T18:03:24.619 INFO:tasks.workunit.client.0.smithi052.stdout:5/782: dwrite d7/d51/ff4 [0,4194304] 0 2024-09-12T18:03:24.620 INFO:tasks.workunit.client.0.smithi052.stdout:7/774: truncate d6/dc/fe8 4985929 0 2024-09-12T18:03:24.620 INFO:tasks.workunit.client.0.smithi052.stdout:5/783: mkdir d7/d1c/dff 0 2024-09-12T18:03:24.621 INFO:tasks.workunit.client.0.smithi052.stdout:5/784: mkdir d7/d59/dad/d100 0 2024-09-12T18:03:24.623 INFO:tasks.workunit.client.0.smithi052.stdout:6/855: getdents d2/d21/d9f/dd7 0 2024-09-12T18:03:24.624 INFO:tasks.workunit.client.0.smithi052.stdout:6/856: fdatasync d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/faf 0 2024-09-12T18:03:24.625 INFO:tasks.workunit.client.0.smithi052.stdout:6/857: symlink d2/dc6/l12b 0 2024-09-12T18:03:24.626 INFO:tasks.workunit.client.0.smithi052.stdout:7/775: dwrite d6/d12/d1e/d29/fd4 [0,4194304] 0 2024-09-12T18:03:24.627 INFO:tasks.workunit.client.0.smithi052.stdout:6/858: creat d2/d21/d9f/dd7/de7/d54/f12c x:0 0 0 2024-09-12T18:03:24.628 INFO:tasks.workunit.client.0.smithi052.stdout:6/859: unlink d2/d49/fc2 0 2024-09-12T18:03:24.628 INFO:tasks.workunit.client.0.smithi052.stdout:1/701: dread d3/dcb/d74/d7d/d84/f96 [0,4194304] 0 2024-09-12T18:03:24.630 INFO:tasks.workunit.client.0.smithi052.stdout:6/860: unlink d2/d21/d9f/dd7/de7/d58/d5d/d107/d112/le5 0 2024-09-12T18:03:24.631 INFO:tasks.workunit.client.0.smithi052.stdout:6/861: chown d2/d21/f98 6244269 1 2024-09-12T18:03:24.632 INFO:tasks.workunit.client.0.smithi052.stdout:9/773: dwrite d0/d18/d79/f2f [0,4194304] 0 2024-09-12T18:03:24.633 INFO:tasks.workunit.client.0.smithi052.stdout:9/774: fdatasync d0/d18/d26/d4d/fcb 0 2024-09-12T18:03:24.634 INFO:tasks.workunit.client.0.smithi052.stdout:1/702: dread d3/d1d/d22/d3f/db0/fca [0,4194304] 0 2024-09-12T18:03:24.634 INFO:tasks.workunit.client.0.smithi052.stdout:6/862: mknod d2/d21/d9f/dd7/de7/d54/dd5/c12d 0 2024-09-12T18:03:24.634 INFO:tasks.workunit.client.0.smithi052.stdout:0/791: dread d2/d6/dd/d21/d26/d2f/f5e [0,4194304] 0 2024-09-12T18:03:24.635 INFO:tasks.workunit.client.0.smithi052.stdout:1/703: creat d3/dcb/d74/fed x:0 0 0 2024-09-12T18:03:24.635 INFO:tasks.workunit.client.0.smithi052.stdout:0/792: stat d2/d6/dd/d21/d26/d38/d4a/d86/ffa 0 2024-09-12T18:03:24.635 INFO:tasks.workunit.client.0.smithi052.stdout:1/704: write d3/d1d/d22/d27/f62 [1660719,69371] 0 2024-09-12T18:03:24.636 INFO:tasks.workunit.client.0.smithi052.stdout:5/785: getdents d7/d59/dad 0 2024-09-12T18:03:24.636 INFO:tasks.workunit.client.0.smithi052.stdout:1/705: rmdir d3/d10/d38 39 2024-09-12T18:03:24.637 INFO:tasks.workunit.client.0.smithi052.stdout:5/786: read d7/ff [2165854,70480] 0 2024-09-12T18:03:24.638 INFO:tasks.workunit.client.0.smithi052.stdout:1/706: fsync d3/dcb/d74/d7d/d84/f96 0 2024-09-12T18:03:24.639 INFO:tasks.workunit.client.0.smithi052.stdout:0/793: truncate d2/d6/dd/d21/d26/d38/d4a/d86/fe1 306465 0 2024-09-12T18:03:24.639 INFO:tasks.workunit.client.0.smithi052.stdout:1/707: creat d3/d10/d38/d44/d49/fee x:0 0 0 2024-09-12T18:03:24.640 INFO:tasks.workunit.client.0.smithi052.stdout:9/775: dwrite d0/d6/d3a/d42/d93/fb0 [0,4194304] 0 2024-09-12T18:03:24.641 INFO:tasks.workunit.client.0.smithi052.stdout:1/708: unlink d3/d1d/c24 0 2024-09-12T18:03:24.641 INFO:tasks.workunit.client.0.smithi052.stdout:0/794: rename d2/d8/dce/d48/fe8 to d2/d6/dd/d21/d26/d65/de5/ffd 0 2024-09-12T18:03:24.642 INFO:tasks.workunit.client.0.smithi052.stdout:6/863: truncate d2/d21/f2a 2746468 0 2024-09-12T18:03:24.643 INFO:tasks.workunit.client.0.smithi052.stdout:3/820: dread d0/daf/fbe [0,4194304] 0 2024-09-12T18:03:24.645 INFO:tasks.workunit.client.0.smithi052.stdout:0/795: rename d2/d8/dce/d48/c5a to d2/d1b/d80/cfe 0 2024-09-12T18:03:24.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/776: link d6/dc/d1a/ff2 d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/ffd 0 2024-09-12T18:03:24.645 INFO:tasks.workunit.client.0.smithi052.stdout:0/796: readlink d2/l89 0 2024-09-12T18:03:24.645 INFO:tasks.workunit.client.0.smithi052.stdout:2/772: sync 2024-09-12T18:03:24.646 INFO:tasks.workunit.client.0.smithi052.stdout:7/777: write d6/f2d [7200266,117722] 0 2024-09-12T18:03:24.646 INFO:tasks.workunit.client.0.smithi052.stdout:5/787: dwrite d7/d1c/d6f/f89 [0,4194304] 0 2024-09-12T18:03:24.646 INFO:tasks.workunit.client.0.smithi052.stdout:3/821: rename d0/d16/d60/ddf/fad to d0/d4/f11c 0 2024-09-12T18:03:24.647 INFO:tasks.workunit.client.0.smithi052.stdout:7/778: chown d6/fd 51982999 1 2024-09-12T18:03:24.648 INFO:tasks.workunit.client.0.smithi052.stdout:9/776: write d0/d18/f40 [889558,120307] 0 2024-09-12T18:03:24.649 INFO:tasks.workunit.client.0.smithi052.stdout:5/788: mknod d7/d59/dad/c101 0 2024-09-12T18:03:24.649 INFO:tasks.workunit.client.0.smithi052.stdout:6/864: read d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f2d [1009840,70956] 0 2024-09-12T18:03:24.650 INFO:tasks.workunit.client.0.smithi052.stdout:3/822: mkdir d0/d4/d11d 0 2024-09-12T18:03:24.650 INFO:tasks.workunit.client.0.smithi052.stdout:2/773: rename da/d1d/d35/cb7 to da/dc/d76/c106 0 2024-09-12T18:03:24.650 INFO:tasks.workunit.client.0.smithi052.stdout:7/779: truncate d6/dc/d1a/d6a/f72 5079590 0 2024-09-12T18:03:24.651 INFO:tasks.workunit.client.0.smithi052.stdout:9/777: rmdir d0/d18/d26/de5 0 2024-09-12T18:03:24.651 INFO:tasks.workunit.client.0.smithi052.stdout:5/789: unlink d7/d1f/d34/df2/l42 0 2024-09-12T18:03:24.652 INFO:tasks.workunit.client.0.smithi052.stdout:7/780: dread - d6/d12/d1e/d8e/dcb/ff1 zero size 2024-09-12T18:03:24.652 INFO:tasks.workunit.client.0.smithi052.stdout:6/865: fsync d2/d15/f22 0 2024-09-12T18:03:24.652 INFO:tasks.workunit.client.0.smithi052.stdout:3/823: mkdir d0/d4/d25/d2a/d2c/dec/d11e 0 2024-09-12T18:03:24.652 INFO:tasks.workunit.client.0.smithi052.stdout:2/774: write da/d1d/d35/d8e/fff [2872423,72746] 0 2024-09-12T18:03:24.653 INFO:tasks.workunit.client.0.smithi052.stdout:9/778: dread - d0/d6/d3a/d42/da9/fe6 zero size 2024-09-12T18:03:24.653 INFO:tasks.workunit.client.0.smithi052.stdout:1/709: dwrite d3/d10/d38/f4d [0,4194304] 0 2024-09-12T18:03:24.653 INFO:tasks.workunit.client.0.smithi052.stdout:2/775: read - da/dc/d15/d20/ffc zero size 2024-09-12T18:03:24.654 INFO:tasks.workunit.client.0.smithi052.stdout:2/776: fdatasync da/dc/d15/d20/fe9 0 2024-09-12T18:03:24.654 INFO:tasks.workunit.client.0.smithi052.stdout:2/777: readlink da/d1d/lda 0 2024-09-12T18:03:24.655 INFO:tasks.workunit.client.0.smithi052.stdout:7/781: write d6/dc/d1a/d6a/f8b [1998170,109122] 0 2024-09-12T18:03:24.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/782: mknod d6/d12/d1e/d29/da1/cfe 0 2024-09-12T18:03:24.660 INFO:tasks.workunit.client.0.smithi052.stdout:1/710: getdents d3/d1d/d83/d8f 0 2024-09-12T18:03:24.661 INFO:tasks.workunit.client.0.smithi052.stdout:7/783: write d6/d12/d1e/d8e/f92 [839293,65927] 0 2024-09-12T18:03:24.663 INFO:tasks.workunit.client.0.smithi052.stdout:6/866: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/f68 [0,4194304] 0 2024-09-12T18:03:24.663 INFO:tasks.workunit.client.0.smithi052.stdout:4/974: sync 2024-09-12T18:03:24.663 INFO:tasks.workunit.client.0.smithi052.stdout:8/883: sync 2024-09-12T18:03:24.663 INFO:tasks.workunit.client.0.smithi052.stdout:0/797: dread d2/d6/dd/dad/fd2 [0,4194304] 0 2024-09-12T18:03:24.664 INFO:tasks.workunit.client.0.smithi052.stdout:5/790: dwrite d7/d59/d5c/d7c/f9b [0,4194304] 0 2024-09-12T18:03:24.664 INFO:tasks.workunit.client.0.smithi052.stdout:1/711: symlink d3/dcb/d74/d7d/d84/dbb/lef 0 2024-09-12T18:03:24.665 INFO:tasks.workunit.client.0.smithi052.stdout:7/784: mkdir d6/d12/d1e/d29/dff 0 2024-09-12T18:03:24.665 INFO:tasks.workunit.client.0.smithi052.stdout:8/884: truncate ff 8868704 0 2024-09-12T18:03:24.666 INFO:tasks.workunit.client.0.smithi052.stdout:2/778: dwrite da/dc/d15/d20/f95 [0,4194304] 0 2024-09-12T18:03:24.666 INFO:tasks.workunit.client.0.smithi052.stdout:9/779: dwrite d0/d18/d26/d33/f62 [0,4194304] 0 2024-09-12T18:03:24.667 INFO:tasks.workunit.client.0.smithi052.stdout:4/975: write d11/d65/dc6/d95/dbf/f27 [3051321,63587] 0 2024-09-12T18:03:24.668 INFO:tasks.workunit.client.0.smithi052.stdout:6/867: truncate d2/d21/d9f/dd7/de7/f104 396762 0 2024-09-12T18:03:24.668 INFO:tasks.workunit.client.0.smithi052.stdout:9/780: chown d0/d18/d26/d100/f99 3395347 1 2024-09-12T18:03:24.668 INFO:tasks.workunit.client.0.smithi052.stdout:2/779: write da/dc/d15/d22/f9d [610956,94393] 0 2024-09-12T18:03:24.669 INFO:tasks.workunit.client.0.smithi052.stdout:8/885: rmdir d13/d18/d38 39 2024-09-12T18:03:24.669 INFO:tasks.workunit.client.0.smithi052.stdout:0/798: creat d2/d6/dd/d21/d26/d2f/fff x:0 0 0 2024-09-12T18:03:24.670 INFO:tasks.workunit.client.0.smithi052.stdout:7/785: rmdir d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80 39 2024-09-12T18:03:24.670 INFO:tasks.workunit.client.0.smithi052.stdout:2/780: creat da/dc/d15/d22/d87/f107 x:0 0 0 2024-09-12T18:03:24.671 INFO:tasks.workunit.client.0.smithi052.stdout:8/886: write d13/d3c/fc3 [1197877,27403] 0 2024-09-12T18:03:24.671 INFO:tasks.workunit.client.0.smithi052.stdout:0/799: mknod d2/d6/dd/d21/d47/c100 0 2024-09-12T18:03:24.672 INFO:tasks.workunit.client.0.smithi052.stdout:2/781: mknod da/dc/d15/d22/d87/c108 0 2024-09-12T18:03:24.673 INFO:tasks.workunit.client.0.smithi052.stdout:6/868: getdents d2/d21/d9f/dd7/de7/d54 0 2024-09-12T18:03:24.674 INFO:tasks.workunit.client.0.smithi052.stdout:2/782: dread - da/dc/d15/f69 zero size 2024-09-12T18:03:24.674 INFO:tasks.workunit.client.0.smithi052.stdout:0/800: chown d2/d6/f4c 2 1 2024-09-12T18:03:24.675 INFO:tasks.workunit.client.0.smithi052.stdout:4/976: link d11/d65/dc6/daf/d107/dc5/dc7/cca d11/d65/d114/c152 0 2024-09-12T18:03:24.676 INFO:tasks.workunit.client.0.smithi052.stdout:0/801: rmdir d2/d1b 39 2024-09-12T18:03:24.677 INFO:tasks.workunit.client.0.smithi052.stdout:4/977: mkdir d11/d65/d6c/d153 0 2024-09-12T18:03:24.677 INFO:tasks.workunit.client.0.smithi052.stdout:2/783: mkdir da/dc/d15/d43/d109 0 2024-09-12T18:03:24.677 INFO:tasks.workunit.client.0.smithi052.stdout:9/781: dwrite d0/d6/d3a/f97 [0,4194304] 0 2024-09-12T18:03:24.678 INFO:tasks.workunit.client.0.smithi052.stdout:0/802: mknod d2/d6/dd/dd8/c101 0 2024-09-12T18:03:24.679 INFO:tasks.workunit.client.0.smithi052.stdout:4/978: truncate d11/f16 8528235 0 2024-09-12T18:03:24.680 INFO:tasks.workunit.client.0.smithi052.stdout:7/786: dwrite d6/dc/f30 [4194304,4194304] 0 2024-09-12T18:03:24.680 INFO:tasks.workunit.client.0.smithi052.stdout:9/782: dread - d0/d18/d26/d100/f8d zero size 2024-09-12T18:03:24.680 INFO:tasks.workunit.client.0.smithi052.stdout:8/887: dread d13/d18/d38/f91 [0,4194304] 0 2024-09-12T18:03:24.682 INFO:tasks.workunit.client.0.smithi052.stdout:4/979: chown d11/d17/d1b/d2a/d6a/d7f/la3 0 1 2024-09-12T18:03:24.682 INFO:tasks.workunit.client.0.smithi052.stdout:7/787: readlink d6/d12/d1e/d29/d5d/d71/l4a 0 2024-09-12T18:03:24.682 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:24.679+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:24.683 INFO:tasks.workunit.client.0.smithi052.stdout:6/869: dwrite d2/d15/dcc/f124 [0,4194304] 0 2024-09-12T18:03:24.683 INFO:tasks.workunit.client.0.smithi052.stdout:2/784: rename da/dc/d15/l8b to da/d2c/dbf/l10a 0 2024-09-12T18:03:24.683 INFO:tasks.workunit.client.0.smithi052.stdout:9/783: unlink d0/d18/d26/c8c 0 2024-09-12T18:03:24.684 INFO:tasks.workunit.client.0.smithi052.stdout:9/784: chown d0/d18/d26/d4d 3 1 2024-09-12T18:03:24.684 INFO:tasks.workunit.client.0.smithi052.stdout:8/888: creat d13/d18/d21/df6/f128 x:0 0 0 2024-09-12T18:03:24.685 INFO:tasks.workunit.client.0.smithi052.stdout:9/785: dread - d0/d18/d37/fec zero size 2024-09-12T18:03:24.685 INFO:tasks.workunit.client.0.smithi052.stdout:8/889: write d13/d35/d9c/da3/fd9 [139906,58630] 0 2024-09-12T18:03:24.686 INFO:tasks.workunit.client.0.smithi052.stdout:9/786: fdatasync d0/d6/d94/fc9 0 2024-09-12T18:03:24.688 INFO:tasks.workunit.client.0.smithi052.stdout:8/890: write d13/d18/d21/f41 [3333923,54505] 0 2024-09-12T18:03:24.690 INFO:tasks.workunit.client.0.smithi052.stdout:3/824: dread d0/d4/d25/f2e [0,4194304] 0 2024-09-12T18:03:24.691 INFO:tasks.workunit.client.0.smithi052.stdout:2/785: dread da/dc/d15/fc8 [0,4194304] 0 2024-09-12T18:03:24.691 INFO:tasks.workunit.client.0.smithi052.stdout:7/788: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/fd3 [0,4194304] 0 2024-09-12T18:03:24.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/980: dwrite d11/d65/dd1/d3b/f4e [4194304,4194304] 0 2024-09-12T18:03:24.693 INFO:tasks.workunit.client.0.smithi052.stdout:6/870: read d2/d21/d9f/dd7/de7/d58/d5d/f10f [32041,63082] 0 2024-09-12T18:03:24.693 INFO:tasks.workunit.client.0.smithi052.stdout:3/825: unlink d0/d4/f50 0 2024-09-12T18:03:24.693 INFO:tasks.workunit.client.0.smithi052.stdout:2/786: mknod da/d1d/d35/d8e/c10b 0 2024-09-12T18:03:24.695 INFO:tasks.workunit.client.0.smithi052.stdout:2/787: creat da/dc/d15/da6/dbb/f10c x:0 0 0 2024-09-12T18:03:24.696 INFO:tasks.workunit.client.0.smithi052.stdout:6/871: chown d2/d21/d9f/dd7/de7/c4f 57037 1 2024-09-12T18:03:24.696 INFO:tasks.workunit.client.0.smithi052.stdout:7/789: getdents d6/d12/d1e/dae 0 2024-09-12T18:03:24.696 INFO:tasks.workunit.client.0.smithi052.stdout:4/981: read d11/d17/d1b/d2a/d82/f4a [4620716,67137] 0 2024-09-12T18:03:24.698 INFO:tasks.workunit.client.0.smithi052.stdout:4/982: fdatasync d11/d65/dd1/d3b/d3f/f59 0 2024-09-12T18:03:24.698 INFO:tasks.workunit.client.0.smithi052.stdout:8/891: dwrite d13/f9e [0,4194304] 0 2024-09-12T18:03:24.700 INFO:tasks.workunit.client.0.smithi052.stdout:6/872: dread d2/d21/d9f/dd7/de7/d54/dd5/fda [0,4194304] 0 2024-09-12T18:03:24.700 INFO:tasks.workunit.client.0.smithi052.stdout:7/790: chown d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/c9f 147 1 2024-09-12T18:03:24.701 INFO:tasks.workunit.client.0.smithi052.stdout:4/983: chown d11/d17/d1b/c1c 935244710 1 2024-09-12T18:03:24.702 INFO:tasks.workunit.client.0.smithi052.stdout:9/787: truncate d0/d18/ff9 2115163 0 2024-09-12T18:03:24.703 INFO:tasks.workunit.client.0.smithi052.stdout:8/892: rename d13/d18/d21/d64 to d13/d18/d21/df6/d129 0 2024-09-12T18:03:24.703 INFO:tasks.workunit.client.0.smithi052.stdout:3/826: dwrite d0/d16/d60/fca [0,4194304] 0 2024-09-12T18:03:24.703 INFO:tasks.workunit.client.0.smithi052.stdout:9/788: stat d0/d18/f98 0 2024-09-12T18:03:24.704 INFO:tasks.workunit.client.0.smithi052.stdout:3/827: chown d0/d4/d33/cc4 2909 1 2024-09-12T18:03:24.704 INFO:tasks.workunit.client.0.smithi052.stdout:9/789: dread - d0/d18/d26/ffd zero size 2024-09-12T18:03:24.704 INFO:tasks.workunit.client.0.smithi052.stdout:6/873: mkdir d2/d21/d9f/dd7/de7/d58/d12e 0 2024-09-12T18:03:24.705 INFO:tasks.workunit.client.0.smithi052.stdout:2/788: dread da/dc/d15/f19 [0,4194304] 0 2024-09-12T18:03:24.705 INFO:tasks.workunit.client.0.smithi052.stdout:8/893: write d13/d18/d5b/d70/f114 [341730,61909] 0 2024-09-12T18:03:24.705 INFO:tasks.workunit.client.0.smithi052.stdout:7/791: unlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/lb5 0 2024-09-12T18:03:24.706 INFO:tasks.workunit.client.0.smithi052.stdout:9/790: chown d0/d18/d79/l9c 262701732 1 2024-09-12T18:03:24.706 INFO:tasks.workunit.client.0.smithi052.stdout:4/984: rename d11/d65/dc6/d95/dbf to d11/d17/d1b/d2a/d6a/d7f/ddb/d154 0 2024-09-12T18:03:24.707 INFO:tasks.workunit.client.0.smithi052.stdout:2/789: dread da/d2c/f52 [0,4194304] 0 2024-09-12T18:03:24.707 INFO:tasks.workunit.client.0.smithi052.stdout:7/792: truncate d6/d12/fc5 849959 0 2024-09-12T18:03:24.709 INFO:tasks.workunit.client.0.smithi052.stdout:3/828: symlink d0/d4/d25/d2a/d6/d7/d34/d72/d83/l11f 0 2024-09-12T18:03:24.709 INFO:tasks.workunit.client.0.smithi052.stdout:8/894: symlink d13/d18/d21/df6/d129/d127/l12a 0 2024-09-12T18:03:24.709 INFO:tasks.workunit.client.0.smithi052.stdout:7/793: creat d6/d12/d1e/d29/da1/f100 x:0 0 0 2024-09-12T18:03:24.709 INFO:tasks.workunit.client.0.smithi052.stdout:9/791: dread d0/d18/d37/d87/d72/fe7 [0,4194304] 0 2024-09-12T18:03:24.710 INFO:tasks.workunit.client.0.smithi052.stdout:3/829: chown d0/d4b/d4c/d6b/d48/f56 3962131 1 2024-09-12T18:03:24.710 INFO:tasks.workunit.client.0.smithi052.stdout:8/895: symlink d13/d18/d38/dfb/l12b 0 2024-09-12T18:03:24.711 INFO:tasks.workunit.client.0.smithi052.stdout:8/896: readlink d13/l120 0 2024-09-12T18:03:24.711 INFO:tasks.workunit.client.0.smithi052.stdout:1/712: sync 2024-09-12T18:03:24.711 INFO:tasks.workunit.client.0.smithi052.stdout:5/791: sync 2024-09-12T18:03:24.711 INFO:tasks.workunit.client.0.smithi052.stdout:9/792: unlink d0/d18/d37/d87/d72/le4 0 2024-09-12T18:03:24.711 INFO:tasks.workunit.client.0.smithi052.stdout:5/792: sync 2024-09-12T18:03:24.711 INFO:tasks.workunit.client.0.smithi052.stdout:7/794: rename d6/dc/f50 to d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/f101 0 2024-09-12T18:03:24.712 INFO:tasks.workunit.client.0.smithi052.stdout:3/830: fsync d0/d4/d25/d2a/d6/d7/d34/d71/fee 0 2024-09-12T18:03:24.712 INFO:tasks.workunit.client.0.smithi052.stdout:1/713: chown d3/d1d/d22/d27/d28/d88 7771115 1 2024-09-12T18:03:24.712 INFO:tasks.workunit.client.0.smithi052.stdout:8/897: rename d13/f9e to d13/d3c/f12c 0 2024-09-12T18:03:24.712 INFO:tasks.workunit.client.0.smithi052.stdout:5/793: creat d7/d1f/d34/f102 x:0 0 0 2024-09-12T18:03:24.712 INFO:tasks.workunit.client.0.smithi052.stdout:3/831: write d0/d4/d25/d2a/f32 [5738115,27371] 0 2024-09-12T18:03:24.713 INFO:tasks.workunit.client.0.smithi052.stdout:5/794: chown d7/d1f/d34/f102 263162951 1 2024-09-12T18:03:24.713 INFO:tasks.workunit.client.0.smithi052.stdout:8/898: creat d13/d35/d9c/d9f/f12d x:0 0 0 2024-09-12T18:03:24.713 INFO:tasks.workunit.client.0.smithi052.stdout:1/714: truncate d3/d1d/d22/d76/fb7 2796125 0 2024-09-12T18:03:24.714 INFO:tasks.workunit.client.0.smithi052.stdout:8/899: creat d13/d18/d38/f12e x:0 0 0 2024-09-12T18:03:24.715 INFO:tasks.workunit.client.0.smithi052.stdout:5/795: truncate d7/d59/dad/fdb 1033031 0 2024-09-12T18:03:24.715 INFO:tasks.workunit.client.0.smithi052.stdout:3/832: creat d0/d4b/d57/f120 x:0 0 0 2024-09-12T18:03:24.715 INFO:tasks.workunit.client.0.smithi052.stdout:1/715: mkdir d3/d1d/d22/d66/df0 0 2024-09-12T18:03:24.716 INFO:tasks.workunit.client.0.smithi052.stdout:1/716: write d3/d10/d38/f4d [5101336,7935] 0 2024-09-12T18:03:24.716 INFO:tasks.workunit.client.0.smithi052.stdout:1/717: sync 2024-09-12T18:03:24.717 INFO:tasks.workunit.client.0.smithi052.stdout:1/718: chown d3/dcb/f46 193 1 2024-09-12T18:03:24.718 INFO:tasks.workunit.client.0.smithi052.stdout:0/803: dread d2/d6/dd/d21/f32 [0,4194304] 0 2024-09-12T18:03:24.718 INFO:tasks.workunit.client.0.smithi052.stdout:1/719: chown d3/d1d/cb5 1 1 2024-09-12T18:03:24.720 INFO:tasks.workunit.client.0.smithi052.stdout:2/790: dread da/d1d/d7d/fc1 [0,4194304] 0 2024-09-12T18:03:24.722 INFO:tasks.workunit.client.0.smithi052.stdout:7/795: dwrite d6/d12/d1e/d8e/dcb/ff1 [0,4194304] 0 2024-09-12T18:03:24.722 INFO:tasks.workunit.client.0.smithi052.stdout:1/720: rename d3/dcb to d3/dcb/d74/d7f/df1 22 2024-09-12T18:03:24.723 INFO:tasks.workunit.client.0.smithi052.stdout:4/985: fdatasync d11/d65/dc6/d68/f85 0 2024-09-12T18:03:24.725 INFO:tasks.workunit.client.0.smithi052.stdout:2/791: creat da/dc/d15/da6/dbb/dd6/f10d x:0 0 0 2024-09-12T18:03:24.725 INFO:tasks.workunit.client.0.smithi052.stdout:5/796: dwrite d7/d1f/d45/fcd [0,4194304] 0 2024-09-12T18:03:24.726 INFO:tasks.workunit.client.0.smithi052.stdout:1/721: unlink d3/d10/d38/d44/d49/l70 0 2024-09-12T18:03:24.726 INFO:tasks.workunit.client.0.smithi052.stdout:3/833: dwrite d0/d4b/d4c/d6b/d117/dc7/de0/ff1 [0,4194304] 0 2024-09-12T18:03:24.728 INFO:tasks.workunit.client.0.smithi052.stdout:1/722: write d3/d1d/d83/d8f/fb4 [616068,102223] 0 2024-09-12T18:03:24.729 INFO:tasks.workunit.client.0.smithi052.stdout:1/723: write d3/f25 [599208,87344] 0 2024-09-12T18:03:24.729 INFO:tasks.workunit.client.0.smithi052.stdout:6/874: dread d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/f90 [0,4194304] 0 2024-09-12T18:03:24.730 INFO:tasks.workunit.client.0.smithi052.stdout:4/986: creat d11/d17/d1b/d2a/d6a/f155 x:0 0 0 2024-09-12T18:03:24.731 INFO:tasks.workunit.client.0.smithi052.stdout:2/792: mkdir da/d1d/d35/dd8/d10e 0 2024-09-12T18:03:24.731 INFO:tasks.workunit.client.0.smithi052.stdout:7/796: creat d6/d12/d1e/d29/d5d/f102 x:0 0 0 2024-09-12T18:03:24.731 INFO:tasks.workunit.client.0.smithi052.stdout:5/797: mknod d7/d59/dbe/d6b/c103 0 2024-09-12T18:03:24.731 INFO:tasks.workunit.client.0.smithi052.stdout:9/793: truncate d0/d18/d26/d100/f51 1514548 0 2024-09-12T18:03:24.731 INFO:tasks.workunit.client.0.smithi052.stdout:3/834: rename d0/d4b/d4c/d10e/f116 to d0/d4/d33/f121 0 2024-09-12T18:03:24.732 INFO:tasks.workunit.client.0.smithi052.stdout:7/797: rmdir d6/d12/d1e/d8e 39 2024-09-12T18:03:24.733 INFO:tasks.workunit.client.0.smithi052.stdout:9/794: mknod d0/d18/d79/c103 0 2024-09-12T18:03:24.734 INFO:tasks.workunit.client.0.smithi052.stdout:2/793: link da/f16 da/d71/f10f 0 2024-09-12T18:03:24.734 INFO:tasks.workunit.client.0.smithi052.stdout:3/835: symlink d0/d4/d25/d2a/d6/l122 0 2024-09-12T18:03:24.734 INFO:tasks.workunit.client.0.smithi052.stdout:9/795: creat d0/d6/d3a/d42/f104 x:0 0 0 2024-09-12T18:03:24.735 INFO:tasks.workunit.client.0.smithi052.stdout:2/794: fdatasync da/dc/d15/d22/d87/f107 0 2024-09-12T18:03:24.736 INFO:tasks.workunit.client.0.smithi052.stdout:7/798: chown d6/d12/d1e/d29/d5d/d71/d3a/cbe 21 1 2024-09-12T18:03:24.737 INFO:tasks.workunit.client.0.smithi052.stdout:9/796: write d0/d6/d3a/f97 [568914,18766] 0 2024-09-12T18:03:24.737 INFO:tasks.workunit.client.0.smithi052.stdout:3/836: mknod d0/d4/d25/d2a/d6/c123 0 2024-09-12T18:03:24.738 INFO:tasks.workunit.client.0.smithi052.stdout:2/795: creat da/dc/d15/da6/dbb/dd6/f110 x:0 0 0 2024-09-12T18:03:24.739 INFO:tasks.workunit.client.0.smithi052.stdout:4/987: dwrite d11/d65/dd1/d3b/f4e [4194304,4194304] 0 2024-09-12T18:03:24.739 INFO:tasks.workunit.client.0.smithi052.stdout:2/796: stat da/dc/d15/d22/l30 0 2024-09-12T18:03:24.739 INFO:tasks.workunit.client.0.smithi052.stdout:5/798: dwrite d7/d1c/d6f/f89 [0,4194304] 0 2024-09-12T18:03:24.740 INFO:tasks.workunit.client.0.smithi052.stdout:9/797: creat d0/d6/d94/f105 x:0 0 0 2024-09-12T18:03:24.740 INFO:tasks.workunit.client.0.smithi052.stdout:3/837: truncate d0/d4/d25/fa8 1094547 0 2024-09-12T18:03:24.740 INFO:tasks.workunit.client.0.smithi052.stdout:4/988: chown d11/d65/d114 420041755 1 2024-09-12T18:03:24.740 INFO:tasks.workunit.client.0.smithi052.stdout:7/799: dread d6/d12/fc5 [0,4194304] 0 2024-09-12T18:03:24.741 INFO:tasks.workunit.client.0.smithi052.stdout:5/799: readlink d7/d51/d8b/da3/le4 0 2024-09-12T18:03:24.741 INFO:tasks.workunit.client.0.smithi052.stdout:4/989: chown d11/d65/dd1/d72/c10c 4093270 1 2024-09-12T18:03:24.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/838: symlink d0/d4/d25/d2a/d6/d7/d34/d72/d83/de2/l124 0 2024-09-12T18:03:24.743 INFO:tasks.workunit.client.0.smithi052.stdout:4/990: mknod d11/d17/d1b/d2a/d6a/d7f/ddb/d154/d8e/c156 0 2024-09-12T18:03:24.743 INFO:tasks.workunit.client.0.smithi052.stdout:2/797: truncate da/dc/d15/f1f 3152999 0 2024-09-12T18:03:24.743 INFO:tasks.workunit.client.0.smithi052.stdout:9/798: fdatasync d0/d6/d3a/f97 0 2024-09-12T18:03:24.744 INFO:tasks.workunit.client.0.smithi052.stdout:2/798: write da/dc/d15/f1f [460156,14234] 0 2024-09-12T18:03:24.744 INFO:tasks.workunit.client.0.smithi052.stdout:3/839: write d0/d4/d25/d2a/d6/d7/fba [943745,87754] 0 2024-09-12T18:03:24.745 INFO:tasks.workunit.client.0.smithi052.stdout:0/804: dread d2/d6/f23 [0,4194304] 0 2024-09-12T18:03:24.746 INFO:tasks.workunit.client.0.smithi052.stdout:5/800: getdents d7/d1f 0 2024-09-12T18:03:24.746 INFO:tasks.workunit.client.0.smithi052.stdout:4/991: fdatasync d11/d17/d1b/fd8 0 2024-09-12T18:03:24.746 INFO:tasks.workunit.client.0.smithi052.stdout:5/801: sync 2024-09-12T18:03:24.746 INFO:tasks.workunit.client.0.smithi052.stdout:2/799: write da/dc/d15/d20/f4f [3154439,123161] 0 2024-09-12T18:03:24.747 INFO:tasks.workunit.client.0.smithi052.stdout:8/900: dread d13/d18/fd2 [0,4194304] 0 2024-09-12T18:03:24.747 INFO:tasks.workunit.client.0.smithi052.stdout:5/802: chown d7/d51/fb6 7 1 2024-09-12T18:03:24.748 INFO:tasks.workunit.client.0.smithi052.stdout:6/875: write d2/d21/d9f/dd7/de7/d58/d5d/f10d [729968,8520] 0 2024-09-12T18:03:24.748 INFO:tasks.workunit.client.0.smithi052.stdout:4/992: creat d11/d17/d1b/d2a/f157 x:0 0 0 2024-09-12T18:03:24.748 INFO:tasks.workunit.client.0.smithi052.stdout:2/800: chown da/d1d/d35/d7a/df4 71358308 1 2024-09-12T18:03:24.748 INFO:tasks.workunit.client.0.smithi052.stdout:6/876: sync 2024-09-12T18:03:24.749 INFO:tasks.workunit.client.0.smithi052.stdout:0/805: link d2/d6/dd/d21/ldc d2/d8/dee/l102 0 2024-09-12T18:03:24.750 INFO:tasks.workunit.client.0.smithi052.stdout:5/803: creat d7/d59/dbe/f104 x:0 0 0 2024-09-12T18:03:24.751 INFO:tasks.workunit.client.0.smithi052.stdout:8/901: read - d13/ddc/df3/f100 zero size 2024-09-12T18:03:24.751 INFO:tasks.workunit.client.0.smithi052.stdout:7/800: truncate d6/dc/fe8 4349687 0 2024-09-12T18:03:24.751 INFO:tasks.workunit.client.0.smithi052.stdout:0/806: fsync d2/d6/fb 0 2024-09-12T18:03:24.752 INFO:tasks.workunit.client.0.smithi052.stdout:1/724: dwrite d3/d1d/d22/f30 [0,4194304] 0 2024-09-12T18:03:24.752 INFO:tasks.workunit.client.0.smithi052.stdout:4/993: symlink d11/d17/d1b/d2a/d6a/l158 0 2024-09-12T18:03:24.752 INFO:tasks.workunit.client.0.smithi052.stdout:2/801: creat da/f111 x:0 0 0 2024-09-12T18:03:24.752 INFO:tasks.workunit.client.0.smithi052.stdout:7/801: fdatasync d6/f89 0 2024-09-12T18:03:24.753 INFO:tasks.workunit.client.0.smithi052.stdout:6/877: dread d2/d49/f7a [0,4194304] 0 2024-09-12T18:03:24.753 INFO:tasks.workunit.client.0.smithi052.stdout:5/804: write d7/d59/dad/fdb [1241427,76356] 0 2024-09-12T18:03:24.753 INFO:tasks.workunit.client.0.smithi052.stdout:7/802: chown d6/c8 0 1 2024-09-12T18:03:24.754 INFO:tasks.workunit.client.0.smithi052.stdout:8/902: creat d13/d18/d38/dbf/f12f x:0 0 0 2024-09-12T18:03:24.754 INFO:tasks.workunit.client.0.smithi052.stdout:1/725: mknod d3/d1d/d22/d3f/cf2 0 2024-09-12T18:03:24.754 INFO:tasks.workunit.client.0.smithi052.stdout:2/802: unlink da/d1d/d35/l56 0 2024-09-12T18:03:24.754 INFO:tasks.workunit.client.0.smithi052.stdout:2/803: sync 2024-09-12T18:03:24.755 INFO:tasks.workunit.client.0.smithi052.stdout:3/840: dwrite d0/d4b/d4c/ff9 [0,4194304] 0 2024-09-12T18:03:24.757 INFO:tasks.workunit.client.0.smithi052.stdout:8/903: rmdir d13/d3c 39 2024-09-12T18:03:24.757 INFO:tasks.workunit.client.0.smithi052.stdout:2/804: rename da/dc/d15/f39 to da/d71/f112 0 2024-09-12T18:03:24.758 INFO:tasks.workunit.client.0.smithi052.stdout:6/878: getdents d2/d21/ded 0 2024-09-12T18:03:24.758 INFO:tasks.workunit.client.0.smithi052.stdout:5/805: link d7/d1c/c74 d7/d51/dc6/c105 0 2024-09-12T18:03:24.758 INFO:tasks.workunit.client.0.smithi052.stdout:7/803: getdents d6/dc 0 2024-09-12T18:03:24.759 INFO:tasks.workunit.client.0.smithi052.stdout:3/841: mkdir d0/d4b/d4c/d6b/d125 0 2024-09-12T18:03:24.759 INFO:tasks.workunit.client.0.smithi052.stdout:8/904: unlink d13/d18/d21/f50 0 2024-09-12T18:03:24.760 INFO:tasks.workunit.client.0.smithi052.stdout:2/805: truncate da/d1d/f29 1444149 0 2024-09-12T18:03:24.760 INFO:tasks.workunit.client.0.smithi052.stdout:6/879: creat d2/d21/ded/f12f x:0 0 0 2024-09-12T18:03:24.761 INFO:tasks.workunit.client.0.smithi052.stdout:7/804: write d6/d12/fc5 [1647491,5570] 0 2024-09-12T18:03:24.761 INFO:tasks.workunit.client.0.smithi052.stdout:8/905: readlink d13/d35/d9c/lc6 0 2024-09-12T18:03:24.761 INFO:tasks.workunit.client.0.smithi052.stdout:3/842: rmdir d0/d4b/d4c/d6b/d117/df8 0 2024-09-12T18:03:24.762 INFO:tasks.workunit.client.0.smithi052.stdout:3/843: sync 2024-09-12T18:03:24.762 INFO:tasks.workunit.client.0.smithi052.stdout:5/806: dread d7/d1c/d1e/d98/fc8 [0,4194304] 0 2024-09-12T18:03:24.762 INFO:tasks.workunit.client.0.smithi052.stdout:4/994: dwrite d11/d17/d1b/d2a/d6a/da8/fcb [0,4194304] 0 2024-09-12T18:03:24.763 INFO:tasks.workunit.client.0.smithi052.stdout:5/807: unlink d7/f1a 0 2024-09-12T18:03:24.764 INFO:tasks.workunit.client.0.smithi052.stdout:2/806: write da/dc/d15/d43/f72 [3072860,65743] 0 2024-09-12T18:03:24.764 INFO:tasks.workunit.client.0.smithi052.stdout:1/726: dwrite d3/d1d/d22/d66/f97 [0,4194304] 0 2024-09-12T18:03:24.764 INFO:tasks.workunit.client.0.smithi052.stdout:6/880: getdents d2/d15/dcc 0 2024-09-12T18:03:24.765 INFO:tasks.workunit.client.0.smithi052.stdout:0/807: read d2/d6/dd/d21/f95 [3325848,83287] 0 2024-09-12T18:03:24.766 INFO:tasks.workunit.client.0.smithi052.stdout:4/995: write d11/d17/d1b/d2a/d33/f10b [571618,117570] 0 2024-09-12T18:03:24.766 INFO:tasks.workunit.client.0.smithi052.stdout:0/808: unlink d2/d6/lca 0 2024-09-12T18:03:24.767 INFO:tasks.workunit.client.0.smithi052.stdout:1/727: write d3/dcb/d74/d7d/d84/f96 [365108,50430] 0 2024-09-12T18:03:24.768 INFO:tasks.workunit.client.0.smithi052.stdout:4/996: chown d11/d17/d1b/d2a/d6a/d7f/dd6 6 1 2024-09-12T18:03:24.769 INFO:tasks.workunit.client.0.smithi052.stdout:5/808: creat d7/d59/dbe/d6b/f106 x:0 0 0 2024-09-12T18:03:24.769 INFO:tasks.workunit.client.0.smithi052.stdout:7/805: truncate d6/d12/d1e/d29/d5d/d71/d3a/d83/f7c 425290 0 2024-09-12T18:03:24.769 INFO:tasks.workunit.client.0.smithi052.stdout:5/809: readlink d7/d1c/d1e/l5e 0 2024-09-12T18:03:24.770 INFO:tasks.workunit.client.0.smithi052.stdout:0/809: write d2/d6/f23 [779124,129933] 0 2024-09-12T18:03:24.770 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:24.770 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:24.770 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:24.770 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:24.770 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:24.771 INFO:tasks.workunit.client.0.smithi052.stdout:0/810: creat d2/d6/dd/dd8/f103 x:0 0 0 2024-09-12T18:03:24.771 INFO:tasks.workunit.client.0.smithi052.stdout:4/997: chown d11/d17/d1b/d2a/d82/c11e 44958 1 2024-09-12T18:03:24.774 INFO:tasks.workunit.client.0.smithi052.stdout:1/728: link d3/d1d/d72/fce d3/d10/d38/d44/dac/ff3 0 2024-09-12T18:03:24.774 INFO:tasks.workunit.client.0.smithi052.stdout:5/810: mkdir d7/d59/dad/dce/d107 0 2024-09-12T18:03:24.775 INFO:tasks.workunit.client.0.smithi052.stdout:7/806: chown d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/ff7 427472 1 2024-09-12T18:03:24.776 INFO:tasks.workunit.client.0.smithi052.stdout:5/811: write d7/d1c/d1e/da5/ff1 [286716,68185] 0 2024-09-12T18:03:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:8/906: dwrite d13/d18/d21/df6/d129/f83 [0,4194304] 0 2024-09-12T18:03:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:7/807: mkdir d6/d12/d1e/d29/da1/d103 0 2024-09-12T18:03:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:4/998: write d11/d17/d1b/d2a/d6a/d7f/d90/fa1 [1566555,86066] 0 2024-09-12T18:03:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:0/811: dread - d2/d1b/d72/d8d/fe3 zero size 2024-09-12T18:03:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:1/729: truncate d3/dcb/d74/d7f/f94 4702557 0 2024-09-12T18:03:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:2/807: dread da/dc/d15/f1f [0,4194304] 0 2024-09-12T18:03:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:5/812: symlink d7/d1f/d34/df2/l108 0 2024-09-12T18:03:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:0/812: unlink d2/d1b/d72/d8d/l9f 0 2024-09-12T18:03:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:7/808: creat d6/d12/d1e/d29/d5d/d71/f104 x:0 0 0 2024-09-12T18:03:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:8/907: creat d13/d18/d21/f130 x:0 0 0 2024-09-12T18:03:24.783 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:24.779+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:0/813: write d2/d6/dd/d21/d26/d38/d4a/d86/fe1 [521105,9109] 0 2024-09-12T18:03:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:9/799: dread d0/d18/f9a [0,4194304] 0 2024-09-12T18:03:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:7/809: symlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/dee/l105 0 2024-09-12T18:03:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:5/813: read d7/d59/f97 [1314585,18431] 0 2024-09-12T18:03:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:8/908: link d13/f1f d13/d18/d38/dbf/dc5/f131 0 2024-09-12T18:03:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:2/808: dwrite da/dc/d15/d20/d60/d6e/fdb [0,4194304] 0 2024-09-12T18:03:24.789 INFO:tasks.workunit.client.0.smithi052.stdout:9/800: mkdir d0/d6/d3a/d42/da9/d106 0 2024-09-12T18:03:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:0/814: getdents d2/d6/dd/d21/d26/d65 0 2024-09-12T18:03:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:5/814: creat d7/d1c/d67/dfd/f109 x:0 0 0 2024-09-12T18:03:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:9/801: chown d0/f10 62762 1 2024-09-12T18:03:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:1/730: dwrite d3/dcb/d74/f91 [4194304,4194304] 0 2024-09-12T18:03:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:5/815: fdatasync d7/d1c/d1e/f36 0 2024-09-12T18:03:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:4/999: dwrite d11/d17/d1b/df9/dfd/ff5 [0,4194304] 0 2024-09-12T18:03:24.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:1/731: fsync d3/d1d/d22/d3f/d56/dd5/fe0 0 2024-09-12T18:03:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:5/816: creat d7/d51/d8b/da3/f10a x:0 0 0 2024-09-12T18:03:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:8/909: dread d13/d35/d9c/da3/fd9 [0,4194304] 0 2024-09-12T18:03:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:0/815: truncate d2/d1b/d72/d8d/fe3 570136 0 2024-09-12T18:03:24.796 INFO:tasks.workunit.client.0.smithi052.stdout:8/910: mkdir d13/d18/d38/dd3/dde/d132 0 2024-09-12T18:03:24.797 INFO:tasks.workunit.client.0.smithi052.stdout:1/732: mknod d3/d1d/d22/d76/cf4 0 2024-09-12T18:03:24.797 INFO:tasks.workunit.client.0.smithi052.stdout:0/816: chown d2/d8/dee/l102 23538 1 2024-09-12T18:03:24.798 INFO:tasks.workunit.client.0.smithi052.stdout:8/911: creat d13/d9b/dff/f133 x:0 0 0 2024-09-12T18:03:24.799 INFO:tasks.workunit.client.0.smithi052.stdout:3/844: dread d0/d4b/d57/f7d [0,4194304] 0 2024-09-12T18:03:24.800 INFO:tasks.workunit.client.0.smithi052.stdout:0/817: chown d2/d6/dd/d21/d26/d38/f49 9 1 2024-09-12T18:03:24.800 INFO:tasks.workunit.client.0.smithi052.stdout:9/802: dwrite d0/d18/d37/f4c [4194304,4194304] 0 2024-09-12T18:03:24.800 INFO:tasks.workunit.client.0.smithi052.stdout:1/733: mknod d3/d1d/d22/d3f/d56/dd5/cf5 0 2024-09-12T18:03:24.802 INFO:tasks.workunit.client.0.smithi052.stdout:9/803: stat d0/d18/ff9 0 2024-09-12T18:03:24.802 INFO:tasks.workunit.client.0.smithi052.stdout:8/912: dread d13/d18/d5b/d70/f114 [0,4194304] 0 2024-09-12T18:03:24.803 INFO:tasks.workunit.client.0.smithi052.stdout:0/818: rename d2/d6/dd/d21/d41/f75 to d2/d57/d5b/db9/f104 0 2024-09-12T18:03:24.803 INFO:tasks.workunit.client.0.smithi052.stdout:9/804: write d0/d18/d37/f47 [209920,63297] 0 2024-09-12T18:03:24.804 INFO:tasks.workunit.client.0.smithi052.stdout:7/810: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/ffd [0,4194304] 0 2024-09-12T18:03:24.804 INFO:tasks.workunit.client.0.smithi052.stdout:8/913: chown d13/f9d 0 1 2024-09-12T18:03:24.805 INFO:tasks.workunit.client.0.smithi052.stdout:9/805: write d0/d18/d26/d100/f22 [1360091,80078] 0 2024-09-12T18:03:24.805 INFO:tasks.workunit.client.0.smithi052.stdout:8/914: stat d13/d35/c5c 0 2024-09-12T18:03:24.805 INFO:tasks.workunit.client.0.smithi052.stdout:0/819: symlink d2/d6/dd/d21/d47/l105 0 2024-09-12T18:03:24.807 INFO:tasks.workunit.client.0.smithi052.stdout:0/820: unlink d2/d8/dee/ff9 0 2024-09-12T18:03:24.808 INFO:tasks.workunit.client.0.smithi052.stdout:8/915: dread d13/d18/d5b/d70/f11b [0,4194304] 0 2024-09-12T18:03:24.808 INFO:tasks.workunit.client.0.smithi052.stdout:0/821: chown d2/ca2 1582193 1 2024-09-12T18:03:24.809 INFO:tasks.workunit.client.0.smithi052.stdout:8/916: write d13/d3c/f72 [702223,113557] 0 2024-09-12T18:03:24.809 INFO:tasks.workunit.client.0.smithi052.stdout:6/881: dread d2/f51 [4194304,4194304] 0 2024-09-12T18:03:24.810 INFO:tasks.workunit.client.0.smithi052.stdout:8/917: rmdir d13/d35/d9c/d103 39 2024-09-12T18:03:24.812 INFO:tasks.workunit.client.0.smithi052.stdout:6/882: rename d2/d21/d9f/dd7/de7/d58/cc1 to d2/dc6/c130 0 2024-09-12T18:03:24.812 INFO:tasks.workunit.client.0.smithi052.stdout:6/883: readlink d2/d49/l118 0 2024-09-12T18:03:24.817 INFO:tasks.workunit.client.0.smithi052.stdout:6/884: mkdir d2/d21/ded/df5/d131 0 2024-09-12T18:03:24.817 INFO:tasks.workunit.client.0.smithi052.stdout:9/806: truncate d0/d58/d7f/ff0 2756560 0 2024-09-12T18:03:24.817 INFO:tasks.workunit.client.0.smithi052.stdout:7/811: truncate d6/d12/d1e/d29/d5d/d71/d9e/fc9 325859 0 2024-09-12T18:03:24.817 INFO:tasks.workunit.client.0.smithi052.stdout:9/807: fsync d0/d6/d3a/f5d 0 2024-09-12T18:03:24.817 INFO:tasks.workunit.client.0.smithi052.stdout:8/918: dwrite d13/d18/d21/df6/d129/f8c [0,4194304] 0 2024-09-12T18:03:24.818 INFO:tasks.workunit.client.0.smithi052.stdout:6/885: read d2/d15/f2c [7993949,13582] 0 2024-09-12T18:03:24.819 INFO:tasks.workunit.client.0.smithi052.stdout:8/919: mknod d13/ddc/c134 0 2024-09-12T18:03:24.819 INFO:tasks.workunit.client.0.smithi052.stdout:9/808: rename d0/d6/d3a/d43/d74/l89 to d0/l107 0 2024-09-12T18:03:24.819 INFO:tasks.workunit.client.0.smithi052.stdout:6/886: sync 2024-09-12T18:03:24.821 INFO:tasks.workunit.client.0.smithi052.stdout:6/887: truncate d2/f11d 51269 0 2024-09-12T18:03:24.821 INFO:tasks.workunit.client.0.smithi052.stdout:8/920: chown d13/d18/d5b/d70/fb0 1484573 1 2024-09-12T18:03:24.821 INFO:tasks.workunit.client.0.smithi052.stdout:9/809: unlink d0/d18/d37/d87/d72/le8 0 2024-09-12T18:03:24.822 INFO:tasks.workunit.client.0.smithi052.stdout:1/734: dread d3/d10/f26 [0,4194304] 0 2024-09-12T18:03:24.823 INFO:tasks.workunit.client.0.smithi052.stdout:8/921: dread - d13/d18/d21/df6/f101 zero size 2024-09-12T18:03:24.823 INFO:tasks.workunit.client.0.smithi052.stdout:9/810: mkdir d0/d6/d3a/d42/d61/d108 0 2024-09-12T18:03:24.824 INFO:tasks.workunit.client.0.smithi052.stdout:7/812: dwrite d6/dc/d1a/ff2 [4194304,4194304] 0 2024-09-12T18:03:24.824 INFO:tasks.workunit.client.0.smithi052.stdout:6/888: mknod d2/d21/d9f/dd7/de7/d58/d5d/c132 0 2024-09-12T18:03:24.824 INFO:tasks.workunit.client.0.smithi052.stdout:1/735: link d3/lb d3/d1d/d72/lf6 0 2024-09-12T18:03:24.825 INFO:tasks.workunit.client.0.smithi052.stdout:8/922: write d13/d18/fd2 [2309223,21062] 0 2024-09-12T18:03:24.826 INFO:tasks.workunit.client.0.smithi052.stdout:6/889: link d2/d21/d76/f7f d2/f133 0 2024-09-12T18:03:24.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/813: dread - d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb6 zero size 2024-09-12T18:03:24.826 INFO:tasks.workunit.client.0.smithi052.stdout:1/736: creat d3/d1d/d22/d3f/ff7 x:0 0 0 2024-09-12T18:03:24.827 INFO:tasks.workunit.client.0.smithi052.stdout:7/814: creat d6/d12/d1e/dae/db3/f106 x:0 0 0 2024-09-12T18:03:24.828 INFO:tasks.workunit.client.0.smithi052.stdout:1/737: mkdir d3/d1d/d22/d66/df8 0 2024-09-12T18:03:24.829 INFO:tasks.workunit.client.0.smithi052.stdout:5/817: dread d7/d1c/d67/fa8 [0,4194304] 0 2024-09-12T18:03:24.829 INFO:tasks.workunit.client.0.smithi052.stdout:9/811: dread d0/d18/f9a [0,4194304] 0 2024-09-12T18:03:24.830 INFO:tasks.workunit.client.0.smithi052.stdout:5/818: chown f4 1043322 1 2024-09-12T18:03:24.831 INFO:tasks.workunit.client.0.smithi052.stdout:7/815: symlink d6/dc/d1a/d6a/l107 0 2024-09-12T18:03:24.831 INFO:tasks.workunit.client.0.smithi052.stdout:6/890: rename d2/d21/d9f/dd7/de7/d54/dd5/c10a to d2/d21/d9f/dd7/de7/d58/c134 0 2024-09-12T18:03:24.831 INFO:tasks.workunit.client.0.smithi052.stdout:6/891: unlink d2/f70 0 2024-09-12T18:03:24.833 INFO:tasks.workunit.client.0.smithi052.stdout:2/809: dread da/dc/d15/d22/d87/fc6 [0,4194304] 0 2024-09-12T18:03:24.833 INFO:tasks.workunit.client.0.smithi052.stdout:5/819: truncate d7/d1c/d67/dfd/f109 594416 0 2024-09-12T18:03:24.833 INFO:tasks.workunit.client.0.smithi052.stdout:9/812: rename d0/d18/d26/d4d/d54/fd4 to d0/d6/d94/f109 0 2024-09-12T18:03:24.833 INFO:tasks.workunit.client.0.smithi052.stdout:7/816: mkdir d6/d12/d1e/d29/d5d/d71/de1/d108 0 2024-09-12T18:03:24.834 INFO:tasks.workunit.client.0.smithi052.stdout:6/892: link d2/d21/lca d2/d21/ded/df5/l135 0 2024-09-12T18:03:24.834 INFO:tasks.workunit.client.0.smithi052.stdout:9/813: read - d0/d18/d26/d100/ffc zero size 2024-09-12T18:03:24.836 INFO:tasks.workunit.client.0.smithi052.stdout:5/820: creat d7/d59/dad/d100/f10b x:0 0 0 2024-09-12T18:03:24.836 INFO:tasks.workunit.client.0.smithi052.stdout:2/810: mkdir da/d21/dbe/d113 0 2024-09-12T18:03:24.836 INFO:tasks.workunit.client.0.smithi052.stdout:5/821: fdatasync d7/d1c/f95 0 2024-09-12T18:03:24.837 INFO:tasks.workunit.client.0.smithi052.stdout:1/738: dwrite d3/d1d/d22/d3f/ff7 [0,4194304] 0 2024-09-12T18:03:24.838 INFO:tasks.workunit.client.0.smithi052.stdout:5/822: write d7/d1f/d34/df2/fbb [3415909,124263] 0 2024-09-12T18:03:24.839 INFO:tasks.workunit.client.0.smithi052.stdout:2/811: readlink da/dc/d15/d43/l53 0 2024-09-12T18:03:24.839 INFO:tasks.workunit.client.0.smithi052.stdout:2/812: fdatasync da/d71/fc7 0 2024-09-12T18:03:24.840 INFO:tasks.workunit.client.0.smithi052.stdout:2/813: dread - da/d21/ff0 zero size 2024-09-12T18:03:24.840 INFO:tasks.workunit.client.0.smithi052.stdout:2/814: readlink da/d1d/l5d 0 2024-09-12T18:03:24.843 INFO:tasks.workunit.client.0.smithi052.stdout:2/815: creat da/dc/d15/da6/df1/f114 x:0 0 0 2024-09-12T18:03:24.844 INFO:tasks.workunit.client.0.smithi052.stdout:9/814: dwrite d0/d18/d26/dd2/fde [0,4194304] 0 2024-09-12T18:03:24.845 INFO:tasks.workunit.client.0.smithi052.stdout:6/893: truncate d2/d21/d6a/f96 2608442 0 2024-09-12T18:03:24.845 INFO:tasks.workunit.client.0.smithi052.stdout:1/739: write d3/da2/dbe/fc9 [3685534,115825] 0 2024-09-12T18:03:24.846 INFO:tasks.workunit.client.0.smithi052.stdout:3/845: dread d0/d4/d25/d2a/d6/d7/f2b [0,4194304] 0 2024-09-12T18:03:24.846 INFO:tasks.workunit.client.0.smithi052.stdout:9/815: symlink d0/d18/d26/d100/l10a 0 2024-09-12T18:03:24.847 INFO:tasks.workunit.client.0.smithi052.stdout:8/923: dread d13/d18/d38/dbf/fe0 [0,4194304] 0 2024-09-12T18:03:24.847 INFO:tasks.workunit.client.0.smithi052.stdout:2/816: link da/d2c/dbf/ff9 da/dc/d15/d22/d87/f115 0 2024-09-12T18:03:24.848 INFO:tasks.workunit.client.0.smithi052.stdout:1/740: mknod d3/d1d/d22/d66/cf9 0 2024-09-12T18:03:24.848 INFO:tasks.workunit.client.0.smithi052.stdout:5/823: dwrite d7/d59/f97 [0,4194304] 0 2024-09-12T18:03:24.850 INFO:tasks.workunit.client.0.smithi052.stdout:2/817: write da/dc/d15/da6/dbb/dd6/f110 [265582,18737] 0 2024-09-12T18:03:24.850 INFO:tasks.workunit.client.0.smithi052.stdout:1/741: creat d3/d1d/ffa x:0 0 0 2024-09-12T18:03:24.850 INFO:tasks.workunit.client.0.smithi052.stdout:5/824: read d7/d59/dbe/d6b/fa1 [3886777,15258] 0 2024-09-12T18:03:24.851 INFO:tasks.workunit.client.0.smithi052.stdout:8/924: link d13/d18/d5b/cb3 d13/d18/d38/dd3/dde/c135 0 2024-09-12T18:03:24.852 INFO:tasks.workunit.client.0.smithi052.stdout:8/925: dread - d13/d18/d5b/d70/f109 zero size 2024-09-12T18:03:24.852 INFO:tasks.workunit.client.0.smithi052.stdout:6/894: truncate d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/fd4 296303 0 2024-09-12T18:03:24.852 INFO:tasks.workunit.client.0.smithi052.stdout:1/742: fsync d3/d1d/d22/d3f/f5f 0 2024-09-12T18:03:24.852 INFO:tasks.workunit.client.0.smithi052.stdout:3/846: write d0/d4b/d4c/d6b/d48/f51 [1055216,100912] 0 2024-09-12T18:03:24.853 INFO:tasks.workunit.client.0.smithi052.stdout:5/825: rename d7/d59/dbe/c80 to d7/d51/dc6/c10c 0 2024-09-12T18:03:24.853 INFO:tasks.workunit.client.0.smithi052.stdout:3/847: sync 2024-09-12T18:03:24.853 INFO:tasks.workunit.client.0.smithi052.stdout:6/895: stat d2/d5e/ce1 0 2024-09-12T18:03:24.854 INFO:tasks.workunit.client.0.smithi052.stdout:8/926: fdatasync d13/d18/d21/dc1/f94 0 2024-09-12T18:03:24.854 INFO:tasks.workunit.client.0.smithi052.stdout:2/818: getdents da/dc/d15/d22/d87 0 2024-09-12T18:03:24.857 INFO:tasks.workunit.client.0.smithi052.stdout:5/826: write d7/d1f/d34/df2/d49/f5a [2224345,6203] 0 2024-09-12T18:03:24.857 INFO:tasks.workunit.client.0.smithi052.stdout:0/822: dread d2/f29 [0,4194304] 0 2024-09-12T18:03:24.857 INFO:tasks.workunit.client.0.smithi052.stdout:9/816: dwrite d0/d6/d3a/d42/da9/fe6 [0,4194304] 0 2024-09-12T18:03:24.858 INFO:tasks.workunit.client.0.smithi052.stdout:3/848: rename d0/d4b/d57/d6d/lb7 to d0/d4/d25/d2a/d6/dd8/l126 0 2024-09-12T18:03:24.859 INFO:tasks.workunit.client.0.smithi052.stdout:2/819: dread da/dc/d15/f65 [0,4194304] 0 2024-09-12T18:03:24.859 INFO:tasks.workunit.client.0.smithi052.stdout:7/817: dread d6/d12/fbc [0,4194304] 0 2024-09-12T18:03:24.859 INFO:tasks.workunit.client.0.smithi052.stdout:5/827: chown d7/d1c/d6f/lf5 14312 1 2024-09-12T18:03:24.860 INFO:tasks.workunit.client.0.smithi052.stdout:6/896: dread d2/d21/d9f/dd7/de7/d58/d5d/fb0 [0,4194304] 0 2024-09-12T18:03:24.860 INFO:tasks.workunit.client.0.smithi052.stdout:3/849: chown d0/d4/d25/d2a/d2c/dec 248434195 1 2024-09-12T18:03:24.861 INFO:tasks.workunit.client.0.smithi052.stdout:5/828: read - d7/d59/dbe/d6b/f106 zero size 2024-09-12T18:03:24.861 INFO:tasks.workunit.client.0.smithi052.stdout:7/818: mknod d6/d12/d1e/d29/c109 0 2024-09-12T18:03:24.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/820: rename da/dc/d15/d20/fc0 to da/dc/d15/d22/f116 0 2024-09-12T18:03:24.862 INFO:tasks.workunit.client.0.smithi052.stdout:5/829: unlink d7/c11 0 2024-09-12T18:03:24.863 INFO:tasks.workunit.client.0.smithi052.stdout:9/817: dread d0/d6/d3a/d43/d74/f77 [0,4194304] 0 2024-09-12T18:03:24.864 INFO:tasks.workunit.client.0.smithi052.stdout:5/830: symlink d7/d1f/d34/l10d 0 2024-09-12T18:03:24.864 INFO:tasks.workunit.client.0.smithi052.stdout:2/821: creat da/d21/dbe/f117 x:0 0 0 2024-09-12T18:03:24.864 INFO:tasks.workunit.client.0.smithi052.stdout:8/927: dwrite d13/f67 [4194304,4194304] 0 2024-09-12T18:03:24.864 INFO:tasks.workunit.client.0.smithi052.stdout:3/850: link d0/d4/f19 d0/d4/d25/d2a/d6/d7/d34/d72/d83/f127 0 2024-09-12T18:03:24.864 INFO:tasks.workunit.client.0.smithi052.stdout:9/818: readlink d0/l64 0 2024-09-12T18:03:24.865 INFO:tasks.workunit.client.0.smithi052.stdout:8/928: stat d13/l120 0 2024-09-12T18:03:24.865 INFO:tasks.workunit.client.0.smithi052.stdout:8/929: readlink d13/d18/d5b/d70/l98 0 2024-09-12T18:03:24.866 INFO:tasks.workunit.client.0.smithi052.stdout:7/819: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/f10a x:0 0 0 2024-09-12T18:03:24.866 INFO:tasks.workunit.client.0.smithi052.stdout:3/851: unlink d0/d16/d7c/c86 0 2024-09-12T18:03:24.867 INFO:tasks.workunit.client.0.smithi052.stdout:2/822: mknod da/dc/d15/c118 0 2024-09-12T18:03:24.868 INFO:tasks.workunit.client.0.smithi052.stdout:3/852: truncate d0/d4b/d4c/f58 4465457 0 2024-09-12T18:03:24.869 INFO:tasks.workunit.client.0.smithi052.stdout:2/823: link da/d71/cd7 da/dc/d15/d20/d60/c119 0 2024-09-12T18:03:24.869 INFO:tasks.workunit.client.0.smithi052.stdout:3/853: symlink d0/d4b/d4c/d6b/d117/dc7/de0/l128 0 2024-09-12T18:03:24.870 INFO:tasks.workunit.client.0.smithi052.stdout:3/854: rmdir d0/d4/d25/d2a/d2c/dec 39 2024-09-12T18:03:24.871 INFO:tasks.workunit.client.0.smithi052.stdout:2/824: rename da/dc/d15/d20/la9 to da/dc/d15/d22/d87/dc3/l11a 0 2024-09-12T18:03:24.872 INFO:tasks.workunit.client.0.smithi052.stdout:2/825: write da/d71/f94 [315643,2742] 0 2024-09-12T18:03:24.872 INFO:tasks.workunit.client.0.smithi052.stdout:3/855: mknod d0/d4/d25/d2a/c129 0 2024-09-12T18:03:24.873 INFO:tasks.workunit.client.0.smithi052.stdout:2/826: chown da/dc/d15/d20/d60/d6e 416166 1 2024-09-12T18:03:24.873 INFO:tasks.workunit.client.0.smithi052.stdout:3/856: stat d0/d4b/d57/d6d/c78 0 2024-09-12T18:03:24.874 INFO:tasks.workunit.client.0.smithi052.stdout:2/827: write da/dc/d15/d22/f9d [1247043,56310] 0 2024-09-12T18:03:24.874 INFO:tasks.workunit.client.0.smithi052.stdout:3/857: write d0/d4/d25/d2a/d6/d7/d34/f5b [1244962,19397] 0 2024-09-12T18:03:24.879 INFO:tasks.workunit.client.0.smithi052.stdout:1/743: truncate d3/d10/d38/d44/d49/f8e 128661 0 2024-09-12T18:03:24.879 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:03:24.881 INFO:tasks.workunit.client.0.smithi052.stdout:1/744: mknod d3/d1d/d22/d66/df8/cfb 0 2024-09-12T18:03:24.883 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:24.879+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:24.886 INFO:tasks.workunit.client.0.smithi052.stdout:5/831: write d7/f3c [3010867,4560] 0 2024-09-12T18:03:24.886 INFO:tasks.workunit.client.0.smithi052.stdout:3/858: rename d0/d4/d25/f81 to d0/d4/d25/d2a/d2c/dec/d11e/f12a 0 2024-09-12T18:03:24.886 INFO:tasks.workunit.client.0.smithi052.stdout:2/828: dwrite da/dc/d15/d22/f8d [0,4194304] 0 2024-09-12T18:03:24.886 INFO:tasks.workunit.client.0.smithi052.stdout:1/745: write d3/d10/d38/d44/d49/fb9 [1024901,62047] 0 2024-09-12T18:03:24.887 INFO:tasks.workunit.client.0.smithi052.stdout:5/832: chown d7/d59/dbe/ffc 3392955 1 2024-09-12T18:03:24.887 INFO:tasks.workunit.client.0.smithi052.stdout:0/823: dread d2/d8/f1c [0,4194304] 0 2024-09-12T18:03:24.887 INFO:tasks.workunit.client.0.smithi052.stdout:9/819: dread d0/d18/d26/d4d/f8a [0,4194304] 0 2024-09-12T18:03:24.888 INFO:tasks.workunit.client.0.smithi052.stdout:1/746: mknod d3/d1d/d22/d27/d28/cfc 0 2024-09-12T18:03:24.890 INFO:tasks.workunit.client.0.smithi052.stdout:8/930: dwrite d13/d18/d5b/d70/f11b [0,4194304] 0 2024-09-12T18:03:24.890 INFO:tasks.workunit.client.0.smithi052.stdout:2/829: write da/dc/d15/d20/d60/d6e/dab/fe5 [941493,131067] 0 2024-09-12T18:03:24.892 INFO:tasks.workunit.client.0.smithi052.stdout:1/747: read d3/d1d/d22/d3f/f5f [1938139,13548] 0 2024-09-12T18:03:24.892 INFO:tasks.workunit.client.0.smithi052.stdout:5/833: getdents d7/d1c/d1e/da5/de6 0 2024-09-12T18:03:24.893 INFO:tasks.workunit.client.0.smithi052.stdout:9/820: creat d0/d6/f10b x:0 0 0 2024-09-12T18:03:24.893 INFO:tasks.workunit.client.0.smithi052.stdout:1/748: creat d3/d1d/d22/d66/ffd x:0 0 0 2024-09-12T18:03:24.894 INFO:tasks.workunit.client.0.smithi052.stdout:8/931: write d13/d35/f85 [2785420,25625] 0 2024-09-12T18:03:24.894 INFO:tasks.workunit.client.0.smithi052.stdout:9/821: stat d0/d18/fc3 0 2024-09-12T18:03:24.895 INFO:tasks.workunit.client.0.smithi052.stdout:1/749: chown d3/dcb/d74/c9a 5099801 1 2024-09-12T18:03:24.895 INFO:tasks.workunit.client.0.smithi052.stdout:7/820: dread d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/f101 [0,4194304] 0 2024-09-12T18:03:24.895 INFO:tasks.workunit.client.0.smithi052.stdout:3/859: dwrite d0/d4b/d4c/f46 [0,4194304] 0 2024-09-12T18:03:24.896 INFO:tasks.workunit.client.0.smithi052.stdout:1/750: chown d3/dcb/d74/d7d 10864588 1 2024-09-12T18:03:24.896 INFO:tasks.workunit.client.0.smithi052.stdout:9/822: creat d0/d18/d79/da6/f10c x:0 0 0 2024-09-12T18:03:24.897 INFO:tasks.workunit.client.0.smithi052.stdout:0/824: dread d2/d6/dd/d21/f32 [0,4194304] 0 2024-09-12T18:03:24.897 INFO:tasks.workunit.client.0.smithi052.stdout:9/823: read - d0/d18/d26/d100/f8d zero size 2024-09-12T18:03:24.898 INFO:tasks.workunit.client.0.smithi052.stdout:3/860: write d0/d4b/d4c/d6b/d48/fb9 [4308498,110384] 0 2024-09-12T18:03:24.899 INFO:tasks.workunit.client.0.smithi052.stdout:0/825: symlink d2/d1b/d80/da3/l106 0 2024-09-12T18:03:24.901 INFO:tasks.workunit.client.0.smithi052.stdout:0/826: rename d2/d1b/d80/da3/fb8 to d2/d6/dd/f107 0 2024-09-12T18:03:24.902 INFO:tasks.workunit.client.0.smithi052.stdout:6/897: dread d2/f3a [0,4194304] 0 2024-09-12T18:03:24.902 INFO:tasks.workunit.client.0.smithi052.stdout:1/751: dwrite d3/d10/f26 [0,4194304] 0 2024-09-12T18:03:24.903 INFO:tasks.workunit.client.0.smithi052.stdout:0/827: write d2/d6/dd/d21/d41/d59/fc6 [283386,45005] 0 2024-09-12T18:03:24.903 INFO:tasks.workunit.client.0.smithi052.stdout:3/861: read d0/d4/d33/fcf [46988,84083] 0 2024-09-12T18:03:24.905 INFO:tasks.workunit.client.0.smithi052.stdout:5/834: truncate d7/f8 1476168 0 2024-09-12T18:03:24.905 INFO:tasks.workunit.client.0.smithi052.stdout:9/824: fsync d0/d6/d3a/d42/d61/f82 0 2024-09-12T18:03:24.906 INFO:tasks.workunit.client.0.smithi052.stdout:6/898: mknod d2/d15/dcc/c136 0 2024-09-12T18:03:24.906 INFO:tasks.workunit.client.0.smithi052.stdout:1/752: unlink d3/d1d/d22/d66/ffd 0 2024-09-12T18:03:24.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:03:24.908 INFO:tasks.workunit.client.0.smithi052.stdout:5/835: symlink d7/d1f/l10e 0 2024-09-12T18:03:24.908 INFO:tasks.workunit.client.0.smithi052.stdout:1/753: write d3/f8 [3231616,10184] 0 2024-09-12T18:03:24.908 INFO:tasks.workunit.client.0.smithi052.stdout:6/899: truncate d2/d5e/fb9 1580181 0 2024-09-12T18:03:24.908 INFO:tasks.workunit.client.0.smithi052.stdout:9/825: write d0/d6/d3a/d42/da9/fc8 [3794021,33656] 0 2024-09-12T18:03:24.909 INFO:tasks.workunit.client.0.smithi052.stdout:5/836: mknod d7/d1c/dff/c10f 0 2024-09-12T18:03:24.911 INFO:tasks.workunit.client.0.smithi052.stdout:1/754: chown d3/d1d/d22/d3f/d56/dd5/fe0 0 1 2024-09-12T18:03:24.911 INFO:tasks.workunit.client.0.smithi052.stdout:9/826: creat d0/d18/d26/d33/f10d x:0 0 0 2024-09-12T18:03:24.911 INFO:tasks.workunit.client.0.smithi052.stdout:6/900: mkdir d2/d21/d9f/dd7/de7/d54/dd5/d137 0 2024-09-12T18:03:24.912 INFO:tasks.workunit.client.0.smithi052.stdout:0/828: dwrite d2/d51/fc5 [0,4194304] 0 2024-09-12T18:03:24.912 INFO:tasks.workunit.client.0.smithi052.stdout:1/755: chown d3/d10/d38/d44/c63 2093716 1 2024-09-12T18:03:24.914 INFO:tasks.workunit.client.0.smithi052.stdout:1/756: unlink d3/d1d/d72/lf6 0 2024-09-12T18:03:24.914 INFO:tasks.workunit.client.0.smithi052.stdout:0/829: link d2/d57/lf5 d2/d57/d5b/d7a/l108 0 2024-09-12T18:03:24.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:03:24.917 INFO:tasks.workunit.client.0.smithi052.stdout:0/830: truncate d2/d8/f1c 201597 0 2024-09-12T18:03:24.918 INFO:tasks.workunit.client.0.smithi052.stdout:3/862: dwrite d0/d4/dbb/fc5 [0,4194304] 0 2024-09-12T18:03:24.918 INFO:tasks.workunit.client.0.smithi052.stdout:0/831: stat d2/d57/d5b/d7a/fcc 0 2024-09-12T18:03:24.920 INFO:tasks.workunit.client.0.smithi052.stdout:1/757: truncate d3/f25 299548 0 2024-09-12T18:03:24.921 INFO:tasks.workunit.client.0.smithi052.stdout:0/832: creat d2/d1b/d72/f109 x:0 0 0 2024-09-12T18:03:24.922 INFO:tasks.workunit.client.0.smithi052.stdout:9/827: dwrite d0/fb5 [0,4194304] 0 2024-09-12T18:03:24.923 INFO:tasks.workunit.client.0.smithi052.stdout:1/758: write d3/f8 [327953,64113] 0 2024-09-12T18:03:24.924 INFO:tasks.workunit.client.0.smithi052.stdout:9/828: unlink d0/d6/d3a/fd9 0 2024-09-12T18:03:24.925 INFO:tasks.workunit.client.0.smithi052.stdout:1/759: stat d3/d1d/d22/d3f/d56/ldd 0 2024-09-12T18:03:24.926 INFO:tasks.workunit.client.0.smithi052.stdout:9/829: creat d0/d18/d37/d9e/f10e x:0 0 0 2024-09-12T18:03:24.927 INFO:tasks.workunit.client.0.smithi052.stdout:7/821: dread d6/d12/d1e/d29/d5d/f28 [0,4194304] 0 2024-09-12T18:03:24.927 INFO:tasks.workunit.client.0.smithi052.stdout:1/760: rename d3/d10/d38/cc2 to d3/d69/d89/cfe 0 2024-09-12T18:03:24.928 INFO:tasks.workunit.client.0.smithi052.stdout:9/830: symlink d0/d6/d3a/d43/l10f 0 2024-09-12T18:03:24.929 INFO:tasks.workunit.client.0.smithi052.stdout:1/761: mkdir d3/d1d/d22/d76/dff 0 2024-09-12T18:03:24.929 INFO:tasks.workunit.client.0.smithi052.stdout:7/822: readlink d6/d12/d1e/d29/l5f 0 2024-09-12T18:03:24.929 INFO:tasks.workunit.client.0.smithi052.stdout:8/932: dread d13/d18/f19 [0,4194304] 0 2024-09-12T18:03:24.930 INFO:tasks.workunit.client.0.smithi052.stdout:1/762: rmdir d3/d1d 39 2024-09-12T18:03:24.930 INFO:tasks.workunit.client.0.smithi052.stdout:9/831: unlink d0/d18/d26/dd2/le2 0 2024-09-12T18:03:24.931 INFO:tasks.workunit.client.0.smithi052.stdout:7/823: mkdir d6/d12/d1e/d29/d5d/d71/d9e/d10b 0 2024-09-12T18:03:24.931 INFO:tasks.workunit.client.0.smithi052.stdout:9/832: fdatasync d0/fb 0 2024-09-12T18:03:24.932 INFO:tasks.workunit.client.0.smithi052.stdout:0/833: dwrite d2/d6/dd/d21/d26/d2f/fa1 [0,4194304] 0 2024-09-12T18:03:24.932 INFO:tasks.workunit.client.0.smithi052.stdout:3/863: dread d0/d4/d25/d2a/f55 [0,4194304] 0 2024-09-12T18:03:24.932 INFO:tasks.workunit.client.0.smithi052.stdout:0/834: readlink d2/d1b/d80/lb4 0 2024-09-12T18:03:24.934 INFO:tasks.workunit.client.0.smithi052.stdout:0/835: write d2/d6/dd/d21/d26/d2f/fff [518180,21438] 0 2024-09-12T18:03:24.935 INFO:tasks.workunit.client.0.smithi052.stdout:7/824: symlink d6/d12/d1e/de7/l10c 0 2024-09-12T18:03:24.935 INFO:tasks.workunit.client.0.smithi052.stdout:1/763: link d3/d10/f85 d3/d1d/d22/d66/df0/f100 0 2024-09-12T18:03:24.937 INFO:tasks.workunit.client.0.smithi052.stdout:2/830: dread da/dc/d15/d20/fe [0,4194304] 0 2024-09-12T18:03:24.937 INFO:tasks.workunit.client.0.smithi052.stdout:1/764: mkdir d3/d1d/d72/d101 0 2024-09-12T18:03:24.937 INFO:tasks.workunit.client.0.smithi052.stdout:9/833: getdents d0/d18/d26/d33 0 2024-09-12T18:03:24.939 INFO:tasks.workunit.client.0.smithi052.stdout:3/864: write d0/d4b/d57/f7d [4915440,48039] 0 2024-09-12T18:03:24.939 INFO:tasks.workunit.client.0.smithi052.stdout:2/831: mknod da/dc/d15/da6/df1/c11b 0 2024-09-12T18:03:24.941 INFO:tasks.workunit.client.0.smithi052.stdout:2/832: rename da/dc/d15/d22/d87/fa0 to da/dc/d15/d20/d60/f11c 0 2024-09-12T18:03:24.943 INFO:tasks.workunit.client.0.smithi052.stdout:9/834: dread d0/d18/d26/d33/f52 [0,4194304] 0 2024-09-12T18:03:24.944 INFO:tasks.workunit.client.0.smithi052.stdout:9/835: mknod d0/d18/d37/d87/d72/df6/c110 0 2024-09-12T18:03:24.946 INFO:tasks.workunit.client.0.smithi052.stdout:1/765: write d3/d1d/d72/fce [370423,112412] 0 2024-09-12T18:03:24.946 INFO:tasks.workunit.client.0.smithi052.stdout:9/836: rename d0/da3/db8/f69 to d0/d6/d3a/d43/dd5/f111 0 2024-09-12T18:03:24.948 INFO:tasks.workunit.client.0.smithi052.stdout:9/837: creat d0/d6/d3a/d42/d61/d108/f112 x:0 0 0 2024-09-12T18:03:24.949 INFO:tasks.workunit.client.0.smithi052.stdout:9/838: mkdir d0/d6/d3a/d42/d113 0 2024-09-12T18:03:24.949 INFO:tasks.workunit.client.0.smithi052.stdout:0/836: truncate d2/d6/dd/d21/d26/d2f/fa1 2870606 0 2024-09-12T18:03:24.950 INFO:tasks.workunit.client.0.smithi052.stdout:0/837: mknod d2/d6/dd/d21/d26/d2f/de9/c10a 0 2024-09-12T18:03:24.951 INFO:tasks.workunit.client.0.smithi052.stdout:0/838: mkdir d2/d6/d10b 0 2024-09-12T18:03:24.951 INFO:tasks.workunit.client.0.smithi052.stdout:0/839: readlink d2/d8/dee/l102 0 2024-09-12T18:03:24.952 INFO:tasks.workunit.client.0.smithi052.stdout:1/766: write d3/dcb/d74/d7d/d84/fa1 [385603,46732] 0 2024-09-12T18:03:24.954 INFO:tasks.workunit.client.0.smithi052.stdout:3/865: dwrite d0/d16/d60/f65 [0,4194304] 0 2024-09-12T18:03:24.955 INFO:tasks.workunit.client.0.smithi052.stdout:1/767: chown d3/d1d/d22/d66/df0/f100 15 1 2024-09-12T18:03:24.957 INFO:tasks.workunit.client.0.smithi052.stdout:0/840: rename d2/d1b/d80/cfe to d2/d57/c10c 0 2024-09-12T18:03:24.957 INFO:tasks.workunit.client.0.smithi052.stdout:7/825: dread d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/fd3 [0,4194304] 0 2024-09-12T18:03:24.957 INFO:tasks.workunit.client.0.smithi052.stdout:3/866: write d0/d4b/d4c/d6b/d48/ffa [15837,107172] 0 2024-09-12T18:03:24.957 INFO:tasks.workunit.client.0.smithi052.stdout:9/839: dwrite d0/d58/d7f/ff0 [0,4194304] 0 2024-09-12T18:03:24.958 INFO:tasks.workunit.client.0.smithi052.stdout:1/768: mkdir d3/dcb/d74/d7d/d102 0 2024-09-12T18:03:24.960 INFO:tasks.workunit.client.0.smithi052.stdout:7/826: write d6/dc/d1a/ff2 [3400936,87216] 0 2024-09-12T18:03:24.961 INFO:tasks.workunit.client.0.smithi052.stdout:1/769: truncate d3/d1d/d72/fce 915069 0 2024-09-12T18:03:24.961 INFO:tasks.workunit.client.0.smithi052.stdout:9/840: truncate d0/d6/d3a/d42/d61/fab 553503 0 2024-09-12T18:03:24.961 INFO:tasks.workunit.client.0.smithi052.stdout:0/841: creat d2/d6/dd/f10d x:0 0 0 2024-09-12T18:03:24.962 INFO:tasks.workunit.client.0.smithi052.stdout:9/841: creat d0/d6/d3a/d42/d93/f114 x:0 0 0 2024-09-12T18:03:24.963 INFO:tasks.workunit.client.0.smithi052.stdout:0/842: write d2/d6/dd/dd8/f103 [127583,92309] 0 2024-09-12T18:03:24.963 INFO:tasks.workunit.client.0.smithi052.stdout:9/842: creat d0/f115 x:0 0 0 2024-09-12T18:03:24.964 INFO:tasks.workunit.client.0.smithi052.stdout:1/770: truncate d3/d1d/d22/d3f/d56/f79 271778 0 2024-09-12T18:03:24.964 INFO:tasks.workunit.client.0.smithi052.stdout:0/843: write d2/d6/dd/d21/d41/ff3 [738404,120062] 0 2024-09-12T18:03:24.965 INFO:tasks.workunit.client.0.smithi052.stdout:9/843: write d0/d18/d37/fec [560176,10351] 0 2024-09-12T18:03:24.965 INFO:tasks.workunit.client.0.smithi052.stdout:1/771: chown d3/dcb/d74/d7d/f9d 1517640 1 2024-09-12T18:03:24.966 INFO:tasks.workunit.client.0.smithi052.stdout:1/772: stat d3/d69/fd7 0 2024-09-12T18:03:24.967 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.299882899, 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:24.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.29984915, 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:24.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:24.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.299807780999998, 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:24.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:24.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:24.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.984 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 2053189~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.273152855999999, 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037455038000000003, 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692432+0000", 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9999999999999997e-07 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692453+0000", 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0412e-05 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692463+0000", 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0577000000000001e-05 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692471+0000", 2024-09-12T18:03:24.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4100000000000002e-06 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718677+0000", 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.026206521 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.718798+0000", 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120538 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.719143+0000", 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000345235 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.721718+0000", 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025749420000000002 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729675+0000", 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079570179999999997 2024-09-12T18:03:24.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729785+0000", 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000109874 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729887+0000", 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000101811 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 2055638~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.273101833999998, 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.03758189, 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692483+0000", 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692484+0000", 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5300000000000002e-07 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692495+0000", 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.132e-05 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692504+0000", 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4790000000000002e-06 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.692511+0000", 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9770000000000003e-06 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720074+0000", 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.027562749000000001 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720202+0000", 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012780100000000001 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.720397+0000", 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019465199999999999 2024-09-12T18:03:24.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.723964+0000", 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035674280000000001 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.729966+0000", 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0060025219999999997 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730010+0000", 2024-09-12T18:03:24.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3387999999999999e-05 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.730064+0000", 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4620999999999998e-05 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:24.996 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.267736168999999, 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:24.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:24.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:25.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.267668875999998, 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:25.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.267635053999999, 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:25.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:25.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.013 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.267587084999999, 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:25.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:25.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.267545889000001, 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:25.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:25.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:25.028 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.26411482, 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:25.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:25.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.263923465000001, 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:25.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:25.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 2532501~3109 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2983000929999999, 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038228275999999999, 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:25.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667287+0000", 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667297+0000", 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0837e-05 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667318+0000", 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0132e-05 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667333+0000", 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5464e-05 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682093+0000", 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014760517000000001 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682239+0000", 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145704 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682429+0000", 2024-09-12T18:03:25.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189419 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687963+0000", 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055348469999999999 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705429+0000", 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017465897000000001 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705472+0000", 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705513+0000", 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0395000000000002e-05 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 2535610~33089 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:25.045 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2981966180000004, 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038208328999999999, 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667389+0000", 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667437+0000", 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8296e-05 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667461+0000", 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3315999999999998e-05 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667475+0000", 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4806e-05 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683310+0000", 2024-09-12T18:03:25.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015835025999999999 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683414+0000", 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103782 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683558+0000", 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144222 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687979+0000", 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044206499999999999 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705541+0000", 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017561879999999998 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705573+0000", 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1513000000000001e-05 2024-09-12T18:03:25.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705596+0000", 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3598e-05 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:393 3.2 3:4272d415:::200.0000000b:head [write 2568699~16268 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2980773330000002, 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038174923999999999, 2024-09-12T18:03:25.051 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:25.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667508+0000", 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.26e-06 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667540+0000", 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1544999999999997e-05 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667560+0000", 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.965e-05 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667581+0000", 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1073e-05 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684213+0000", 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016632040000000001 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684298+0000", 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700999999999998e-05 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684441+0000", 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142325 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.688223+0000", 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037828240000000002 2024-09-12T18:03:25.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705621+0000", 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017397394 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705661+0000", 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9725000000000003e-05 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705682+0000", 2024-09-12T18:03:25.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1387e-05 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:394 3.2 3:4272d415:::200.0000000b:head [write 2584967~9560 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2974996379999997, 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037725440999999998, 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.057 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668087+0000", 2024-09-12T18:03:25.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4269999999999998e-06 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668114+0000", 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6475999999999999e-05 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668140+0000", 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5896000000000001e-05 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668159+0000", 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8936999999999998e-05 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686422+0000", 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018263577999999999 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686807+0000", 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000385263 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687150+0000", 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034306300000000001 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.689567+0000", 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002416961 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705716+0000", 2024-09-12T18:03:25.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016148172999999998 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705773+0000", 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7275999999999998e-05 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705810+0000", 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7391000000000002e-05 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10722 4.12 4:4a23efdb:::100000030fe.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.2928149759999998, 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039390537000000003, 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10722 2024-09-12T18:03:25.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672772+0000", 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2400000000000002e-06 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680073+0000", 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073009110000000002 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680106+0000", 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3812000000000001e-05 2024-09-12T18:03:25.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680121+0000", 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.486e-05 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690602+0000", 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010480952999999999 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690789+0000", 2024-09-12T18:03:25.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018728399999999999 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690975+0000", 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000185613 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.706973+0000", 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015997546000000001 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712089+0000", 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051161699999999997 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712130+0000", 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1069000000000003e-05 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712160+0000", 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0079000000000001e-05 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.068 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10804 4.b 4:d006e46e:::10000003140.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.973319139, 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044910052999999998, 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.069 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10804 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:25.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992268+0000", 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7870000000000002e-06 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012102+0000", 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019833542999999999 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012139+0000", 2024-09-12T18:03:25.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012163+0000", 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3998999999999998e-05 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012267+0000", 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010427100000000001 2024-09-12T18:03:25.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012333+0000", 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5907000000000004e-05 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012775+0000", 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000442058 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.021332+0000", 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008556882 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037041+0000", 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015709548 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037115+0000", 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3645000000000004e-05 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037175+0000", 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0183000000000003e-05 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11578 4.2d 4:b54e928a:::10000003360.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.797080641, 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041673711000000002, 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.075 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11578 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168505+0000", 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5899999999999995e-07 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182775+0000", 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014270628 2024-09-12T18:03:25.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182793+0000", 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8156e-05 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182813+0000", 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9602e-05 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182897+0000", 2024-09-12T18:03:25.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3688000000000002e-05 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182995+0000", 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7826999999999997e-05 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.183185+0000", 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019040999999999999 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.193832+0000", 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010646901 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210041+0000", 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016209214 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210116+0000", 2024-09-12T18:03:25.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4482999999999998e-05 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210177+0000", 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1943e-05 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14233 4.10 4:0a00b3f9:::100000032b1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:25.081 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.467679595, 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039262674999999997, 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14233 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:25.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497907+0000", 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8020000000000001e-06 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509871+0000", 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011964415000000001 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509889+0000", 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7779999999999999e-05 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509900+0000", 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.164e-05 2024-09-12T18:03:25.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509977+0000", 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6831999999999999e-05 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510106+0000", 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012833000000000001 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510271+0000", 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000165052 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.519886+0000", 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096156620000000005 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537057+0000", 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017170843000000002 2024-09-12T18:03:25.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537114+0000", 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.694e-05 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537167+0000", 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3378999999999998e-05 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:25.087 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:25.088 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:25.088 INFO:tasks.workunit.client.0.smithi052.stdout:9/844: chown d0/d18/d26/d4d/f8a 15245451 1 2024-09-12T18:03:25.088 INFO:tasks.workunit.client.0.smithi052.stdout:3/867: dwrite d0/d4/dbb/fda [0,4194304] 0 2024-09-12T18:03:25.088 INFO:tasks.workunit.client.0.smithi052.stdout:9/845: write d0/f10 [3493485,8961] 0 2024-09-12T18:03:25.088 INFO:tasks.workunit.client.0.smithi052.stdout:1/773: write d3/d1d/d22/d3f/f5f [2589760,102902] 0 2024-09-12T18:03:25.090 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:25.096 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:25.085+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:25.100 INFO:tasks.workunit.client.0.smithi052.stdout:9/846: chown d0/d6/d3a/d43/cce 97 1 2024-09-12T18:03:25.100 INFO:tasks.workunit.client.0.smithi052.stdout:7/827: read d6/d12/d1e/d29/d5d/d71/d3a/d83/f7a [510262,106607] 0 2024-09-12T18:03:25.100 INFO:tasks.workunit.client.0.smithi052.stdout:0/844: rename d2/d6/dd/d21/d41 to d2/d6/dd/d21/d47/d10e 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:1/774: symlink d3/da2/ddc/de9/l103 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:3/868: dwrite d0/d4/d25/d2a/d6/d7/fd4 [0,4194304] 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:7/828: dread d6/dc/f8c [0,4194304] 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:0/845: dwrite d2/d6/dd/dd8/f103 [0,4194304] 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:9/847: dread d0/d6/fc5 [0,4194304] 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:9/848: rmdir d0/d18/d26/d4d/d54 39 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:9/849: rmdir d0/d6/d3a/d43/d74 39 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:0/846: write d2/d1b/fdb [1085743,45515] 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:0/847: rename d2/d1b/d72/f109 to d2/d6/dd/d21/f10f 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:0/848: chown d2/d6/dd/d21/d47/d10e/fc7 2078314 1 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:3/869: dread d0/d4b/d57/d6d/f7b [0,4194304] 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:9/850: dread d0/d18/d37/f47 [0,4194304] 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:3/870: creat d0/d4b/d4c/d6b/d117/f12b x:0 0 0 2024-09-12T18:03:25.101 INFO:tasks.workunit.client.0.smithi052.stdout:0/849: dwrite d2/f31 [0,4194304] 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:9/851: creat d0/d6/d3a/f116 x:0 0 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:0/850: chown d2/d1b 180 1 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:9/852: fdatasync d0/d18/d26/d4d/fc2 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:9/853: dread d0/d6/d3a/d43/d74/f77 [0,4194304] 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:3/871: truncate d0/d4b/d4c/d6b/fbf 2765775 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:0/851: dread d2/d6/dd/d21/f32 [0,4194304] 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:3/872: chown d0/d4/d25/d2a/d6/d41/c119 1515 1 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/775: dread d3/f8 [0,4194304] 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/776: symlink d3/d1d/d22/d3f/d56/l104 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:3/873: rename d0/d4/d25/d2a/d6/d7/fba to d0/d4/d25/d2a/d6/d7/d34/d72/d83/de2/f12c 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:9/854: dwrite d0/d18/d26/d33/f62 [0,4194304] 0 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/777: rmdir d3 39 2024-09-12T18:03:25.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/778: write d3/d1d/d22/d27/f90 [1540264,8130] 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:1/779: write d3/d1d/d22/d3f/d56/dd5/fe0 [689305,118732] 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:1/780: truncate d3/d10/d38/d44/fcf 158276 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:3/874: dwrite d0/d4/d25/d2a/d6/d7/f74 [0,4194304] 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/829: dread d6/f89 [0,4194304] 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:3/875: chown d0/d4/d25/d2a/d2c/dec/d11e 2085439 1 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/830: stat d6/d12/d1e/d29/d5d/d71/d9e/l7e 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:9/855: write d0/d6/fc5 [3302825,55388] 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:3/876: rename d0/d16/d60/l98 to d0/d4/d25/d2a/d6/d7/l12d 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/831: truncate d6/d12/d1e/d29/d5d/d71/f104 236171 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:3/877: write d0/d4b/fc2 [90265,123392] 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:7/832: dread d6/d12/d1e/f2c [0,4194304] 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:3/878: fdatasync d0/d4/d25/d2a/d6/d7/d34/d71/fee 0 2024-09-12T18:03:25.103 INFO:tasks.workunit.client.0.smithi052.stdout:9/856: dread d0/d18/d26/d4d/d54/f5b [0,4194304] 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:9/857: fdatasync d0/d18/d37/d87/d72/df6/ffb 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/833: dread d6/dc/d1a/d6a/f72 [0,4194304] 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:9/858: creat d0/d6/d3a/d42/d61/d6a/f117 x:0 0 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/834: readlink d6/d12/d1e/d29/d5d/d71/d9e/ld2 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:9/859: dread - d0/d6/de1/f101 zero size 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/835: creat d6/f10d x:0 0 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:9/860: fsync d0/d18/d26/d4d/fac 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/836: unlink d6/d12/d1e/f2c 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:9/861: symlink d0/d18/d37/d87/d72/df6/l118 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/837: chown d6/f76 427 1 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/838: creat d6/d12/d1e/de7/f10e x:0 0 0 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi052.stdout:9/862: rename d0/da3/db8/l60 to d0/d6/d3a/d43/l119 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/837: sync 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/901: sync 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/838: mkdir d7/d59/dad/dce/d110 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/902: write d2/d21/d9f/fb5 [1970145,39369] 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/839: read d7/d1c/f6c [4103673,77542] 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/903: symlink d2/d21/d9f/dd7/de7/d58/d5d/l138 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:7/839: dwrite d6/d12/d1e/d29/da1/fb2 [4194304,4194304] 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/840: rmdir d7/d1f/d34 39 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/904: write d2/f51 [856021,57546] 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:9/863: dwrite d0/d18/d37/f47 [0,4194304] 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:9/864: creat d0/d18/d37/f11a x:0 0 0 2024-09-12T18:03:25.105 INFO:tasks.workunit.client.0.smithi052.stdout:6/905: stat d2/d21/d9f/dd7/de7/d58/d5d/f10f 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:5/841: unlink d7/d1f/f4b 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/865: mknod d0/d6/d3a/d43/c11b 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:5/842: write d7/d59/d5c/ff0 [220135,107029] 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:6/906: write d2/d21/d9f/dd7/de7/d58/d5d/f12a [449206,84278] 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/866: creat d0/d18/d37/d9e/f11c x:0 0 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:5/843: write d7/f19 [1359464,17902] 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:5/844: readlink d7/d51/d8d/la6 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/867: symlink d0/d6/d3a/d42/d61/d108/l11d 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:6/907: write d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/faf [659276,53469] 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:7/840: dwrite d6/dc/d1a/d6a/f8a [0,4194304] 0 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/868: rmdir d0/d18/d79 39 2024-09-12T18:03:25.106 INFO:tasks.workunit.client.0.smithi052.stdout:6/908: write d2/d21/ded/df5/f116 [640346,1994] 0 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:5/845: rename d7/ff to d7/d59/dad/dce/d110/f111 0 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:7/841: dread - d6/d12/d1e/d29/daf/ff5 zero size 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:9/869: write d0/d18/d37/d9e/f10e [625185,30782] 0 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:5/846: stat d7/d1f/c22 0 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:7/842: dread - d6/f10d zero size 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:9/870: stat d0/d18/d37/d87/c75 0 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:7/843: chown d6/d12 3082855 1 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:5/847: chown d7/d59/c6d 938 1 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:6/909: dread d2/d21/d9f/dd7/de7/f104 [0,4194304] 0 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:5/848: mknod d7/d1f/d45/c112 0 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:7/844: readlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/leb 0 2024-09-12T18:03:25.107 INFO:tasks.workunit.client.0.smithi052.stdout:6/910: symlink d2/d15/l139 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:5/849: write d7/d59/dad/fdb [1881842,102804] 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:5/850: rename d7/d59/dad/d100/f10b to d7/d51/d8d/f113 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:6/911: rename d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f46 to d2/d21/d9f/dd7/de7/d54/dfe/f13a 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:6/912: unlink d2/dc6/l12b 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:6/913: chown d2/d21/l38 12 1 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:7/845: dread d6/dc/d1a/ff2 [4194304,4194304] 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:9/871: dwrite d0/d6/d3a/d42/f76 [0,4194304] 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:5/851: dwrite f4 [4194304,4194304] 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:9/872: mkdir d0/d18/d37/d87/d72/df6/d11e 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:5/852: write d7/d51/d8b/fe0 [871742,57721] 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:5/853: fdatasync d7/d59/d5c/fbf 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:9/873: write d0/d6/d3a/d43/d74/f77 [151506,103936] 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:7/846: link d6/dc/c66 d6/d12/d1e/d29/da1/d103/c10f 0 2024-09-12T18:03:25.108 INFO:tasks.workunit.client.0.smithi052.stdout:5/854: creat d7/d1c/d6f/f114 x:0 0 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/874: stat d0/d6/d3a/d42/d61/f82 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/847: write d6/d9b/fa7 [5173740,9380] 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:5/855: mkdir d7/d51/d8d/d115 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:5/856: dread - d7/d1f/d45/ffa zero size 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/848: write d6/f76 [366799,23936] 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/875: link d0/d6/d3a/d43/fcd d0/d18/d26/dd2/f11f 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/849: write d6/f5a [5214752,93063] 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/850: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d110 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/876: mknod d0/d18/d26/d100/dbc/c120 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/877: dread d0/d6/d3a/d42/da9/fe6 [0,4194304] 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/878: fdatasync d0/d6/d94/f109 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:9/879: truncate d0/d6/d3a/d42/da9/fe6 4187730 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/851: dwrite d6/dc/d1a/d6a/f72 [0,4194304] 0 2024-09-12T18:03:25.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/852: chown d6/d12/d1e/d29/da1 55548 1 2024-09-12T18:03:25.110 INFO:tasks.workunit.client.0.smithi052.stdout:6/914: dread d2/d5e/fc3 [0,4194304] 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/915: fdatasync d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f61 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/916: symlink d2/d21/d9f/dd7/de7/d54/dd5/l13b 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/917: unlink d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea/leb 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/918: chown d2/d80/f8c 2631 1 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:9/880: truncate d0/d6/d3a/d42/f76 287813 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:9/881: read - d0/d6/d3a/d42/d93/f114 zero size 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:9/882: readlink d0/l64 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:9/883: symlink d0/d18/d26/d100/l121 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/919: mkdir d2/d21/d9f/dd7/de7/d54/dd5/df3/d13c 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:9/884: mknod d0/d18/d79/da6/c122 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/920: fsync d2/fbc 0 2024-09-12T18:03:25.112 INFO:tasks.workunit.client.0.smithi052.stdout:6/921: rename d2/d21/d9f/dd7/de7/f92 to d2/d15/dcc/f13d 0 2024-09-12T18:03:25.113 INFO:tasks.workunit.client.0.smithi052.stdout:6/922: creat d2/d21/d9f/dd7/de7/d54/dd5/df3/f13e x:0 0 0 2024-09-12T18:03:25.113 INFO:tasks.workunit.client.0.smithi052.stdout:6/923: dread d2/f3a [0,4194304] 0 2024-09-12T18:03:25.113 INFO:tasks.workunit.client.0.smithi052.stdout:6/924: write d2/f43 [3750103,127678] 0 2024-09-12T18:03:25.116 INFO:tasks.workunit.client.0.smithi052.stdout:6/925: dread d2/d5e/f93 [0,4194304] 0 2024-09-12T18:03:25.116 INFO:tasks.workunit.client.0.smithi052.stdout:6/926: mknod d2/d15/c13f 0 2024-09-12T18:03:25.123 INFO:tasks.workunit.client.0.smithi052.stdout:6/927: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/f68 [0,4194304] 0 2024-09-12T18:03:25.130 INFO:tasks.workunit.client.0.smithi052.stdout:6/928: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/f90 [0,4194304] 0 2024-09-12T18:03:25.131 INFO:tasks.workunit.client.0.smithi052.stdout:6/929: mknod d2/d5e/d115/c140 0 2024-09-12T18:03:25.133 INFO:tasks.workunit.client.0.smithi052.stdout:9/885: dread d0/d6/d3a/f5d [0,4194304] 0 2024-09-12T18:03:25.134 INFO:tasks.workunit.client.0.smithi052.stdout:9/886: fdatasync d0/d18/d37/d87/d72/fe7 0 2024-09-12T18:03:25.135 INFO:tasks.workunit.client.0.smithi052.stdout:9/887: chown d0/d6/d3a/f97 957 1 2024-09-12T18:03:25.137 INFO:tasks.workunit.client.0.smithi052.stdout:9/888: creat d0/d18/d37/d87/d72/f123 x:0 0 0 2024-09-12T18:03:25.138 INFO:tasks.workunit.client.0.smithi052.stdout:9/889: symlink d0/d6/l124 0 2024-09-12T18:03:25.138 INFO:tasks.workunit.client.0.smithi052.stdout:6/930: dwrite d2/d21/d9f/dd7/de7/d54/f12c [0,4194304] 0 2024-09-12T18:03:25.139 INFO:tasks.workunit.client.0.smithi052.stdout:9/890: creat d0/d18/d26/d4d/f125 x:0 0 0 2024-09-12T18:03:25.139 INFO:tasks.workunit.client.0.smithi052.stdout:6/931: mknod d2/d21/d9f/dd7/de7/c141 0 2024-09-12T18:03:25.139 INFO:tasks.workunit.client.0.smithi052.stdout:6/932: chown d2/c6c 16613060 1 2024-09-12T18:03:25.140 INFO:tasks.workunit.client.0.smithi052.stdout:9/891: unlink d0/d6/l24 0 2024-09-12T18:03:25.141 INFO:tasks.workunit.client.0.smithi052.stdout:1/781: sync 2024-09-12T18:03:25.141 INFO:tasks.workunit.client.0.smithi052.stdout:0/852: sync 2024-09-12T18:03:25.141 INFO:tasks.workunit.client.0.smithi052.stdout:3/879: sync 2024-09-12T18:03:25.141 INFO:tasks.workunit.client.0.smithi052.stdout:2/833: sync 2024-09-12T18:03:25.141 INFO:tasks.workunit.client.0.smithi052.stdout:8/933: sync 2024-09-12T18:03:25.142 INFO:tasks.workunit.client.0.smithi052.stdout:1/782: chown d3/c15 15427 1 2024-09-12T18:03:25.142 INFO:tasks.workunit.client.0.smithi052.stdout:8/934: mknod d13/d18/d38/dd3/c136 0 2024-09-12T18:03:25.143 INFO:tasks.workunit.client.0.smithi052.stdout:2/834: write da/dc/d15/fc8 [660499,120264] 0 2024-09-12T18:03:25.143 INFO:tasks.workunit.client.0.smithi052.stdout:1/783: truncate d3/fb3 2478699 0 2024-09-12T18:03:25.144 INFO:tasks.workunit.client.0.smithi052.stdout:8/935: mkdir d13/d18/d21/df6/d137 0 2024-09-12T18:03:25.144 INFO:tasks.workunit.client.0.smithi052.stdout:8/936: fsync d13/ff5 0 2024-09-12T18:03:25.145 INFO:tasks.workunit.client.0.smithi052.stdout:8/937: fdatasync d13/d3c/f3d 0 2024-09-12T18:03:25.145 INFO:tasks.workunit.client.0.smithi052.stdout:8/938: fdatasync d13/d18/d21/df6/f101 0 2024-09-12T18:03:25.145 INFO:tasks.workunit.client.0.smithi052.stdout:9/892: dread d0/d18/d26/d4d/f8a [0,4194304] 0 2024-09-12T18:03:25.147 INFO:tasks.workunit.client.0.smithi052.stdout:9/893: creat d0/d18/d37/d87/f126 x:0 0 0 2024-09-12T18:03:25.147 INFO:tasks.workunit.client.0.smithi052.stdout:8/939: mknod d13/d18/d5b/d70/d123/c138 0 2024-09-12T18:03:25.147 INFO:tasks.workunit.client.0.smithi052.stdout:9/894: mkdir d0/d6/d3a/d42/d93/d127 0 2024-09-12T18:03:25.149 INFO:tasks.workunit.client.0.smithi052.stdout:9/895: creat d0/d18/d37/d87/d72/df6/d11e/f128 x:0 0 0 2024-09-12T18:03:25.150 INFO:tasks.workunit.client.0.smithi052.stdout:9/896: symlink d0/d6/d3a/d43/d74/l129 0 2024-09-12T18:03:25.150 INFO:tasks.workunit.client.0.smithi052.stdout:2/835: truncate f8 3638175 0 2024-09-12T18:03:25.151 INFO:tasks.workunit.client.0.smithi052.stdout:9/897: write d0/d18/d26/d4d/f125 [285092,42960] 0 2024-09-12T18:03:25.152 INFO:tasks.workunit.client.0.smithi052.stdout:2/836: rmdir da/d1d/d35/dd8/d10e 0 2024-09-12T18:03:25.154 INFO:tasks.workunit.client.0.smithi052.stdout:9/898: truncate d0/d18/d37/d87/d72/df6/d11e/f128 418623 0 2024-09-12T18:03:25.155 INFO:tasks.workunit.client.0.smithi052.stdout:9/899: unlink d0/d18/d79/da6/ldb 0 2024-09-12T18:03:25.156 INFO:tasks.workunit.client.0.smithi052.stdout:9/900: link d0/da3/db8/f5f d0/d6/de1/f12a 0 2024-09-12T18:03:25.157 INFO:tasks.workunit.client.0.smithi052.stdout:2/837: dread da/d1d/d35/f33 [0,4194304] 0 2024-09-12T18:03:25.158 INFO:tasks.workunit.client.0.smithi052.stdout:9/901: mkdir d0/d18/d37/d87/d72/df6/d11e/d12b 0 2024-09-12T18:03:25.159 INFO:tasks.workunit.client.0.smithi052.stdout:9/902: write d0/d18/d26/d4d/f125 [655926,45683] 0 2024-09-12T18:03:25.159 INFO:tasks.workunit.client.0.smithi052.stdout:2/838: chown da/dc/d15/d20/d60/d6e/dab/fe5 12497385 1 2024-09-12T18:03:25.160 INFO:tasks.workunit.client.0.smithi052.stdout:9/903: truncate d0/d6/de1/f101 664221 0 2024-09-12T18:03:25.161 INFO:tasks.workunit.client.0.smithi052.stdout:9/904: link d0/d6/de1/f101 d0/f12c 0 2024-09-12T18:03:25.165 INFO:tasks.workunit.client.0.smithi052.stdout:2/839: write da/d2c/dbf/ff9 [986072,96960] 0 2024-09-12T18:03:25.166 INFO:tasks.workunit.client.0.smithi052.stdout:3/880: dread d0/fef [0,4194304] 0 2024-09-12T18:03:25.166 INFO:tasks.workunit.client.0.smithi052.stdout:6/933: dread d2/d21/f98 [0,4194304] 0 2024-09-12T18:03:25.167 INFO:tasks.workunit.client.0.smithi052.stdout:2/840: symlink da/d1d/dd9/l11d 0 2024-09-12T18:03:25.168 INFO:tasks.workunit.client.0.smithi052.stdout:6/934: truncate d2/d49/f108 2073920 0 2024-09-12T18:03:25.168 INFO:tasks.workunit.client.0.smithi052.stdout:2/841: symlink da/dc/d15/da6/df1/l11e 0 2024-09-12T18:03:25.169 INFO:tasks.workunit.client.0.smithi052.stdout:6/935: mknod d2/d21/d76/c142 0 2024-09-12T18:03:25.169 INFO:tasks.workunit.client.0.smithi052.stdout:2/842: stat da/d71/cd7 0 2024-09-12T18:03:25.170 INFO:tasks.workunit.client.0.smithi052.stdout:2/843: readlink da/d21/d6b/l9f 0 2024-09-12T18:03:25.171 INFO:tasks.workunit.client.0.smithi052.stdout:2/844: stat da/d71/f10f 0 2024-09-12T18:03:25.171 INFO:tasks.workunit.client.0.smithi052.stdout:6/936: truncate d2/d15/dcc/f124 4753527 0 2024-09-12T18:03:25.171 INFO:tasks.workunit.client.0.smithi052.stdout:6/937: chown d2/d21 544 1 2024-09-12T18:03:25.172 INFO:tasks.workunit.client.0.smithi052.stdout:1/784: dread d3/d10/d38/f4d [0,4194304] 0 2024-09-12T18:03:25.172 INFO:tasks.workunit.client.0.smithi052.stdout:2/845: creat da/d1d/d7d/db3/f11f x:0 0 0 2024-09-12T18:03:25.173 INFO:tasks.workunit.client.0.smithi052.stdout:3/881: dwrite d0/d4/dbb/ff3 [0,4194304] 0 2024-09-12T18:03:25.174 INFO:tasks.workunit.client.0.smithi052.stdout:1/785: link d3/d69/l6a d3/l105 0 2024-09-12T18:03:25.174 INFO:tasks.workunit.client.0.smithi052.stdout:6/938: creat d2/d21/d9f/dd7/de7/d58/d5d/d87/f143 x:0 0 0 2024-09-12T18:03:25.175 INFO:tasks.workunit.client.0.smithi052.stdout:3/882: link d0/fcb d0/d4b/d4c/f12e 0 2024-09-12T18:03:25.175 INFO:tasks.workunit.client.0.smithi052.stdout:3/883: write d0/d16/f1e [4256090,73653] 0 2024-09-12T18:03:25.176 INFO:tasks.workunit.client.0.smithi052.stdout:6/939: creat d2/d21/d9f/dd7/de7/d54/f144 x:0 0 0 2024-09-12T18:03:25.176 INFO:tasks.workunit.client.0.smithi052.stdout:1/786: link d3/d1d/d22/d3f/cf2 d3/da2/dbe/c106 0 2024-09-12T18:03:25.177 INFO:tasks.workunit.client.0.smithi052.stdout:1/787: chown d3/d10/d38/d44 3 1 2024-09-12T18:03:25.178 INFO:tasks.workunit.client.0.smithi052.stdout:6/940: mknod d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea/c145 0 2024-09-12T18:03:25.178 INFO:tasks.workunit.client.0.smithi052.stdout:1/788: rename d3/dcb/c31 to d3/da2/ddc/de9/c107 0 2024-09-12T18:03:25.179 INFO:tasks.workunit.client.0.smithi052.stdout:6/941: creat d2/d21/d76/f146 x:0 0 0 2024-09-12T18:03:25.179 INFO:tasks.workunit.client.0.smithi052.stdout:1/789: creat d3/d10/d38/d44/f108 x:0 0 0 2024-09-12T18:03:25.180 INFO:tasks.workunit.client.0.smithi052.stdout:6/942: write d2/d21/d6a/fee [670700,79055] 0 2024-09-12T18:03:25.180 INFO:tasks.workunit.client.0.smithi052.stdout:1/790: mkdir d3/d1d/d83/d109 0 2024-09-12T18:03:25.180 INFO:tasks.workunit.client.0.smithi052.stdout:6/943: stat d2/d21/d9f/dd7/de7/c141 0 2024-09-12T18:03:25.181 INFO:tasks.workunit.client.0.smithi052.stdout:1/791: rmdir d3/d10/d38/d8b 39 2024-09-12T18:03:25.182 INFO:tasks.workunit.client.0.smithi052.stdout:6/944: readlink d2/d21/d9f/dd7/de7/d58/d5d/l100 0 2024-09-12T18:03:25.182 INFO:tasks.workunit.client.0.smithi052.stdout:1/792: unlink d3/d1d/d22/l6c 0 2024-09-12T18:03:25.183 INFO:tasks.workunit.client.0.smithi052.stdout:3/884: dwrite d0/d4/d25/d2a/d6/d7/ff0 [0,4194304] 0 2024-09-12T18:03:25.183 INFO:tasks.workunit.client.0.smithi052.stdout:1/793: symlink d3/d1d/d22/d66/df0/l10a 0 2024-09-12T18:03:25.185 INFO:tasks.workunit.client.0.smithi052.stdout:3/885: creat d0/d4/d25/f12f x:0 0 0 2024-09-12T18:03:25.185 INFO:tasks.workunit.client.0.smithi052.stdout:1/794: rename d3/d10/d38/d44/dac/fcc to d3/dcb/d74/f10b 0 2024-09-12T18:03:25.186 INFO:tasks.workunit.client.0.smithi052.stdout:3/886: fsync d0/d4/d25/d2a/d2c/f63 0 2024-09-12T18:03:25.187 INFO:tasks.workunit.client.0.smithi052.stdout:3/887: creat d0/d16/d7c/f130 x:0 0 0 2024-09-12T18:03:25.188 INFO:tasks.workunit.client.0.smithi052.stdout:3/888: chown d0/d4b/d4c/d6b/d117/dc7/fce 54 1 2024-09-12T18:03:25.188 INFO:tasks.workunit.client.0.smithi052.stdout:9/905: dread d0/d58/f83 [0,4194304] 0 2024-09-12T18:03:25.189 INFO:tasks.workunit.client.0.smithi052.stdout:3/889: mknod d0/d4/d11d/c131 0 2024-09-12T18:03:25.190 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:25.185+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:25.193 INFO:tasks.workunit.client.0.smithi052.stdout:1/795: dwrite d3/d69/f7e [4194304,4194304] 0 2024-09-12T18:03:25.195 INFO:tasks.workunit.client.0.smithi052.stdout:9/906: dwrite d0/f115 [0,4194304] 0 2024-09-12T18:03:25.196 INFO:tasks.workunit.client.0.smithi052.stdout:1/796: truncate d3/dcb/f80 1756544 0 2024-09-12T18:03:25.197 INFO:tasks.workunit.client.0.smithi052.stdout:0/853: sync 2024-09-12T18:03:25.198 INFO:tasks.workunit.client.0.smithi052.stdout:5/857: sync 2024-09-12T18:03:25.198 INFO:tasks.workunit.client.0.smithi052.stdout:7/853: sync 2024-09-12T18:03:25.198 INFO:tasks.workunit.client.0.smithi052.stdout:8/940: sync 2024-09-12T18:03:25.198 INFO:tasks.workunit.client.0.smithi052.stdout:3/890: dwrite d0/d4/d25/d2a/d6/d7/fd4 [0,4194304] 0 2024-09-12T18:03:25.199 INFO:tasks.workunit.client.0.smithi052.stdout:0/854: symlink d2/d1b/l110 0 2024-09-12T18:03:25.200 INFO:tasks.workunit.client.0.smithi052.stdout:9/907: link d0/d18/d37/fec d0/d6/d3a/d42/d61/d6a/f12d 0 2024-09-12T18:03:25.200 INFO:tasks.workunit.client.0.smithi052.stdout:1/797: link d3/d1d/d22/d3f/cd6 d3/c10c 0 2024-09-12T18:03:25.202 INFO:tasks.workunit.client.0.smithi052.stdout:7/854: rename d6/l19 to d6/d12/d1e/dae/l111 0 2024-09-12T18:03:25.202 INFO:tasks.workunit.client.0.smithi052.stdout:1/798: dread - d3/dcb/d74/d7d/f9d zero size 2024-09-12T18:03:25.202 INFO:tasks.workunit.client.0.smithi052.stdout:5/858: creat d7/d59/dad/dce/d107/f116 x:0 0 0 2024-09-12T18:03:25.202 INFO:tasks.workunit.client.0.smithi052.stdout:8/941: mkdir d13/d18/d21/d139 0 2024-09-12T18:03:25.203 INFO:tasks.workunit.client.0.smithi052.stdout:9/908: truncate d0/d6/d3a/d42/f76 680326 0 2024-09-12T18:03:25.203 INFO:tasks.workunit.client.0.smithi052.stdout:7/855: rename d6/d12/d1e/d29/daf to d6/dc/d112 0 2024-09-12T18:03:25.203 INFO:tasks.workunit.client.0.smithi052.stdout:8/942: creat d13/d18/d38/dbf/f13a x:0 0 0 2024-09-12T18:03:25.203 INFO:tasks.workunit.client.0.smithi052.stdout:1/799: creat d3/dcb/d74/d7d/d84/f10d x:0 0 0 2024-09-12T18:03:25.203 INFO:tasks.workunit.client.0.smithi052.stdout:8/943: chown d13/d18/d38/dbf/fe0 3039 1 2024-09-12T18:03:25.204 INFO:tasks.workunit.client.0.smithi052.stdout:5/859: write d7/d1c/f3f [9467021,77656] 0 2024-09-12T18:03:25.204 INFO:tasks.workunit.client.0.smithi052.stdout:1/800: mkdir d3/dcb/d74/d7d/d84/d10e 0 2024-09-12T18:03:25.205 INFO:tasks.workunit.client.0.smithi052.stdout:8/944: creat d13/d18/f13b x:0 0 0 2024-09-12T18:03:25.205 INFO:tasks.workunit.client.0.smithi052.stdout:5/860: symlink d7/d59/dad/dce/d107/l117 0 2024-09-12T18:03:25.206 INFO:tasks.workunit.client.0.smithi052.stdout:1/801: getdents d3/d69 0 2024-09-12T18:03:25.206 INFO:tasks.workunit.client.0.smithi052.stdout:8/945: symlink d13/d35/d9c/l13c 0 2024-09-12T18:03:25.207 INFO:tasks.workunit.client.0.smithi052.stdout:1/802: fdatasync d3/d1d/d22/fbf 0 2024-09-12T18:03:25.207 INFO:tasks.workunit.client.0.smithi052.stdout:6/945: dread d2/d15/f23 [0,4194304] 0 2024-09-12T18:03:25.207 INFO:tasks.workunit.client.0.smithi052.stdout:9/909: read d0/f10 [3894675,97553] 0 2024-09-12T18:03:25.208 INFO:tasks.workunit.client.0.smithi052.stdout:8/946: write d13/d18/d21/df6/d129/f83 [3467045,79016] 0 2024-09-12T18:03:25.208 INFO:tasks.workunit.client.0.smithi052.stdout:6/946: chown d2/d21/l29 51142117 1 2024-09-12T18:03:25.209 INFO:tasks.workunit.client.0.smithi052.stdout:9/910: symlink d0/d18/d37/l12e 0 2024-09-12T18:03:25.209 INFO:tasks.workunit.client.0.smithi052.stdout:8/947: fdatasync d13/d18/d38/dbf/f12f 0 2024-09-12T18:03:25.209 INFO:tasks.workunit.client.0.smithi052.stdout:8/948: readlink d13/d35/l77 0 2024-09-12T18:03:25.210 INFO:tasks.workunit.client.0.smithi052.stdout:9/911: rmdir d0/d18/d26/d100/dbc 39 2024-09-12T18:03:25.211 INFO:tasks.workunit.client.0.smithi052.stdout:9/912: creat d0/d18/d26/d33/f12f x:0 0 0 2024-09-12T18:03:25.212 INFO:tasks.workunit.client.0.smithi052.stdout:5/861: truncate d7/d1f/d45/f62 254287 0 2024-09-12T18:03:25.212 INFO:tasks.workunit.client.0.smithi052.stdout:0/855: dread d2/d6/dd/d21/d26/d38/f49 [0,4194304] 0 2024-09-12T18:03:25.213 INFO:tasks.workunit.client.0.smithi052.stdout:8/949: link d13/d18/d38/dbf/f122 d13/d35/d9c/da3/f13d 0 2024-09-12T18:03:25.217 INFO:tasks.workunit.client.0.smithi052.stdout:1/803: dread d3/d10/f33 [0,4194304] 0 2024-09-12T18:03:25.217 INFO:tasks.workunit.client.0.smithi052.stdout:0/856: creat d2/d1b/f111 x:0 0 0 2024-09-12T18:03:25.217 INFO:tasks.workunit.client.0.smithi052.stdout:0/857: fdatasync d2/d57/f82 0 2024-09-12T18:03:25.217 INFO:tasks.workunit.client.0.smithi052.stdout:5/862: truncate d7/d59/d5c/d7c/ff6 877911 0 2024-09-12T18:03:25.218 INFO:tasks.workunit.client.0.smithi052.stdout:7/856: dwrite d6/d12/d1e/d29/d5d/d71/f42 [4194304,4194304] 0 2024-09-12T18:03:25.218 INFO:tasks.workunit.client.0.smithi052.stdout:8/950: read d13/f1f [1574863,94502] 0 2024-09-12T18:03:25.218 INFO:tasks.workunit.client.0.smithi052.stdout:1/804: creat d3/dcb/d74/d7d/d102/f10f x:0 0 0 2024-09-12T18:03:25.219 INFO:tasks.workunit.client.0.smithi052.stdout:7/857: symlink d6/d12/d1e/dae/db3/l113 0 2024-09-12T18:03:25.220 INFO:tasks.workunit.client.0.smithi052.stdout:1/805: creat d3/d1d/d83/ddf/f110 x:0 0 0 2024-09-12T18:03:25.220 INFO:tasks.workunit.client.0.smithi052.stdout:6/947: dwrite d2/f10 [4194304,4194304] 0 2024-09-12T18:03:25.222 INFO:tasks.workunit.client.0.smithi052.stdout:1/806: fdatasync d3/d1d/d22/d3f/f5f 0 2024-09-12T18:03:25.222 INFO:tasks.workunit.client.0.smithi052.stdout:8/951: link d13/d3c/c6f d13/d18/d21/df6/d137/c13e 0 2024-09-12T18:03:25.222 INFO:tasks.workunit.client.0.smithi052.stdout:6/948: chown d2/d21/f98 14376 1 2024-09-12T18:03:25.222 INFO:tasks.workunit.client.0.smithi052.stdout:9/913: dwrite d0/d6/d3a/d42/d61/d108/f112 [0,4194304] 0 2024-09-12T18:03:25.222 INFO:tasks.workunit.client.0.smithi052.stdout:5/863: link d7/d59/d5c/d7c/f9b d7/d1f/d34/df2/d49/f118 0 2024-09-12T18:03:25.224 INFO:tasks.workunit.client.0.smithi052.stdout:0/858: creat d2/d57/f112 x:0 0 0 2024-09-12T18:03:25.225 INFO:tasks.workunit.client.0.smithi052.stdout:1/807: symlink d3/da2/l111 0 2024-09-12T18:03:25.225 INFO:tasks.workunit.client.0.smithi052.stdout:6/949: chown d2/d15/dcc/f124 6098754 1 2024-09-12T18:03:25.225 INFO:tasks.workunit.client.0.smithi052.stdout:9/914: chown d0/d18/d79/da6/f10c 2223040 1 2024-09-12T18:03:25.229 INFO:tasks.workunit.client.0.smithi052.stdout:9/915: write d0/d6/d3a/f116 [393168,31757] 0 2024-09-12T18:03:25.230 INFO:tasks.workunit.client.0.smithi052.stdout:5/864: read d7/d59/d5c/d7c/f9b [1442947,12181] 0 2024-09-12T18:03:25.231 INFO:tasks.workunit.client.0.smithi052.stdout:7/858: dwrite d6/d12/d17/dac/fd9 [0,4194304] 0 2024-09-12T18:03:25.232 INFO:tasks.workunit.client.0.smithi052.stdout:9/916: dread - d0/d18/d37/f11a zero size 2024-09-12T18:03:25.232 INFO:tasks.workunit.client.0.smithi052.stdout:8/952: dwrite d13/d3c/f62 [0,4194304] 0 2024-09-12T18:03:25.233 INFO:tasks.workunit.client.0.smithi052.stdout:6/950: link d2/d21/d9f/dd7/de7/f10b d2/d21/d9f/dd7/de7/d58/d5d/f147 0 2024-09-12T18:03:25.233 INFO:tasks.workunit.client.0.smithi052.stdout:0/859: getdents d2/d6/dd/d21/d26/d2f/de9 0 2024-09-12T18:03:25.233 INFO:tasks.workunit.client.0.smithi052.stdout:5/865: fsync d7/d51/d8d/f113 0 2024-09-12T18:03:25.234 INFO:tasks.workunit.client.0.smithi052.stdout:0/860: write d2/d51/fe2 [17653,99163] 0 2024-09-12T18:03:25.235 INFO:tasks.workunit.client.0.smithi052.stdout:9/917: write d0/d18/d26/d4d/fb9 [1298045,68601] 0 2024-09-12T18:03:25.235 INFO:tasks.workunit.client.0.smithi052.stdout:6/951: write d2/d21/d9f/dd7/de7/d58/f66 [1654994,80059] 0 2024-09-12T18:03:25.236 INFO:tasks.workunit.client.0.smithi052.stdout:5/866: creat d7/d1f/d34/df2/d49/f119 x:0 0 0 2024-09-12T18:03:25.237 INFO:tasks.workunit.client.0.smithi052.stdout:1/808: dwrite d3/d1d/d22/d3f/db0/fca [0,4194304] 0 2024-09-12T18:03:25.237 INFO:tasks.workunit.client.0.smithi052.stdout:9/918: readlink d0/d18/d37/d9e/leb 0 2024-09-12T18:03:25.237 INFO:tasks.workunit.client.0.smithi052.stdout:6/952: chown d2/d15/f2c 48283026 1 2024-09-12T18:03:25.238 INFO:tasks.workunit.client.0.smithi052.stdout:5/867: stat d7/d51/fb6 0 2024-09-12T18:03:25.239 INFO:tasks.workunit.client.0.smithi052.stdout:2/846: sync 2024-09-12T18:03:25.240 INFO:tasks.workunit.client.0.smithi052.stdout:3/891: sync 2024-09-12T18:03:25.240 INFO:tasks.workunit.client.0.smithi052.stdout:7/859: sync 2024-09-12T18:03:25.241 INFO:tasks.workunit.client.0.smithi052.stdout:7/860: stat d6/dc/f30 0 2024-09-12T18:03:25.242 INFO:tasks.workunit.client.0.smithi052.stdout:8/953: dwrite d13/f17 [0,4194304] 0 2024-09-12T18:03:25.242 INFO:tasks.workunit.client.0.smithi052.stdout:1/809: symlink d3/d1d/d22/d3f/db0/l112 0 2024-09-12T18:03:25.243 INFO:tasks.workunit.client.0.smithi052.stdout:9/919: chown d0/d18/d37/d87/d72/c81 0 1 2024-09-12T18:03:25.244 INFO:tasks.workunit.client.0.smithi052.stdout:9/920: sync 2024-09-12T18:03:25.244 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14830 4.18 4:18db98d4:::10000003975.00000000:head [write 393168~31757 in=31757b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231827+0000", 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.011172823, 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011222172000000001, 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.245 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14830 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231827+0000", 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231827+0000", 2024-09-12T18:03:25.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231829+0000", 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.051e-06 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231848+0000", 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9528999999999999e-05 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231861+0000", 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2843999999999999e-05 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231867+0000", 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3149999999999997e-06 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231927+0000", 2024-09-12T18:03:25.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9729999999999999e-05 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.232090+0000", 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016337599999999999 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.232221+0000", 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013104800000000001 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233383+0000", 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011615950000000001 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14827 4.8 e52/17 4:1171651b:::100000030fc.00000001:head v 52'208, mlcod=52'206)", 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.011017839, 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011244560000000001, 2024-09-12T18:03:25.250 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231983+0000", 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.16e-07 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239015+0000", 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070313540000000001 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239054+0000", 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9675000000000002e-05 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239070+0000", 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239237+0000", 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016739399999999999 2024-09-12T18:03:25.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239285+0000", 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7500999999999998e-05 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14834 4.8 e52/17)", 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.239669+0000", 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0033313219999999998, 2024-09-12T18:03:25.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036658010000000002, 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "queued for pg", 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239669+0000", 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239669+0000", 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239670+0000", 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0100000000000003e-07 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239915+0000", 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00024478 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.256 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239926+0000", 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1731e-05 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239934+0000", 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2919999999999998e-06 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2593 3.d 3:b02ffd62:::200.00000010:head [write 1568195~14920 [fadvise_dontneed] in=14920b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T18:03:25.257 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.241182+0000", 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.00181839, 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002249713, 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241182+0000", 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241182+0000", 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241183+0000", 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4309999999999999e-06 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241243+0000", 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9718e-05 2024-09-12T18:03:25.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241256+0000", 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2979000000000001e-05 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241278+0000", 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1724000000000001e-05 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241353+0000", 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5382000000000004e-05 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241484+0000", 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013123400000000001 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241651+0000", 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016697000000000001 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.261 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:2594 3.d 3:b02ffd62:::200.00000010:head [write 1583115~2452 [fadvise_dontneed] in=2452b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.241688+0000", 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0013121459999999999, 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001867905, 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241688+0000", 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241688+0000", 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241698+0000", 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7119999999999995e-06 2024-09-12T18:03:25.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241703+0000", 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1959999999999999e-06 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241717+0000", 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4397e-05 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.241722+0000", 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6e-06 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242759+0000", 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00103736 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243360+0000", 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00060075000000000005 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.265 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14831 4.18 4.448d6f98 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0090375609999999995, 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0096945720000000003, 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "queued for pg", 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.266 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14831 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233964+0000", 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8700000000000004e-07 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242877+0000", 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089131509999999994 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242914+0000", 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7376999999999998e-05 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242929+0000", 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4728e-05 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.269 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14828 4.29 e52/17 4:97d37d51:::1000000396b.00000000:head v 52'194, mlcod=51'192)", 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.234606+0000", 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.0083947440000000009, 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091502389999999992, 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.234606+0000", 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.234606+0000", 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.234607+0000", 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.085e-06 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243503+0000", 2024-09-12T18:03:25.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088964679999999994 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243513+0000", 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0339e-05 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243519+0000", 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4700000000000001e-06 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243573+0000", 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3922999999999999e-05 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243590+0000", 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6994999999999999e-05 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.273 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop_reply(client.4587.0:14830 4.18 e52/17)", 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.243538+0000", 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4294967295.9994621, 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000325342, 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "queued for pg", 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243538+0000", 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243538+0000", 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243539+0000", 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5300000000000004e-07 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243542+0000", 2024-09-12T18:03:25.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3749999999999999e-06 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243549+0000", 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6800000000000004e-06 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243553+0000", 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5680000000000001e-06 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.276 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14835 4.17 e52/17 4:e8e24d6c:::100000032c0.00000000:head v 52'200, mlcod=51'198)", 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.243562+0000", 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4294967295.9994378, 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00039639800000000001, 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243562+0000", 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243562+0000", 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243563+0000", 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3999999999999997e-07 2024-09-12T18:03:25.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243616+0000", 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3578000000000001e-05 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243624+0000", 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.622e-06 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243629+0000", 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5169999999999999e-06 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243698+0000", 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8515000000000004e-05 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243727+0000", 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8586999999999999e-05 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.280 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop_reply(mds.0.3:2593 3.d e52/16)", 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.243737+0000", 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4294967295.9992633, 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000319282, 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "queued for pg", 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243737+0000", 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243737+0000", 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243737+0000", 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243742+0000", 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5299999999999998e-06 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243752+0000", 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0173999999999999e-05 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.243758+0000", 2024-09-12T18:03:25.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4539999999999998e-06 2024-09-12T18:03:25.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.284 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.284 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.284 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:03:25.284 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 10 2024-09-12T18:03:25.284 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:25.288 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:25.291 INFO:tasks.workunit.client.0.smithi052.stdout:3/892: creat d0/d4b/d4c/d6b/f132 x:0 0 0 2024-09-12T18:03:25.291 INFO:tasks.workunit.client.0.smithi052.stdout:2/847: truncate da/dc/d15/d20/d60/d6e/fdb 4812074 0 2024-09-12T18:03:25.291 INFO:tasks.workunit.client.0.smithi052.stdout:5/868: dwrite f4 [4194304,4194304] 0 2024-09-12T18:03:25.291 INFO:tasks.workunit.client.0.smithi052.stdout:5/869: stat d7/d59/fb2 0 2024-09-12T18:03:25.291 INFO:tasks.workunit.client.0.smithi052.stdout:9/921: truncate d0/d18/d26/d100/ffc 651701 0 2024-09-12T18:03:25.291 INFO:tasks.workunit.client.0.smithi052.stdout:9/922: sync 2024-09-12T18:03:25.291 INFO:tasks.workunit.client.0.smithi052.stdout:2/848: unlink da/dc/d15/d22/d87/dc5/f102 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:8/954: truncate fb 310106 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:1/810: dwrite d3/dcb/d74/d7d/d84/f10d [0,4194304] 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:3/893: symlink d0/d4/d25/d2a/d6/d7/d34/d72/d83/l133 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:6/953: dwrite d2/d21/d9f/dd7/de7/f104 [0,4194304] 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:0/861: dread d2/d6/dd/f39 [0,4194304] 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:7/861: link d6/dc/c51 d6/d12/d1e/d29/d5d/d71/de1/c114 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:9/923: link d0/d18/d37/d87/d72/df6/ffb d0/d58/d7f/f130 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:9/924: sync 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:1/811: stat d3/d1d/d22/d66/df0/f100 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:5/870: write d7/d1f/d45/f7a [1170564,55046] 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:9/925: stat d0/f1d 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:0/862: write d2/d57/d5b/d7a/fd6 [769616,78090] 0 2024-09-12T18:03:25.292 INFO:tasks.workunit.client.0.smithi052.stdout:0/863: chown d2/d6/l28 88756 1 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:1/812: creat d3/d1d/d22/d66/df8/f113 x:0 0 0 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:5/871: mkdir d7/d1c/d67/dfd/d11a 0 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:6/954: unlink d2/d21/d9f/dd7/de7/d54/f6f 0 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:7/862: creat d6/d12/d1e/d29/da1/ddf/f115 x:0 0 0 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:0/864: truncate d2/d57/d5b/fda 4839096 0 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:3/894: dread d0/d16/d60/f65 [0,4194304] 0 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:3/895: sync 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:7/863: write d6/d12/d1e/d8e/fa9 [2306324,14103] 0 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:1/813: getdents d3/d1d/d22 0 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:3/896: dread - d0/d4/d25/d2a/d6/d7/dab/fd1 zero size 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:7/864: rename d6/d12/d1e/dae to d6/d12/d1e/dae/db3/def/d116 22 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:7/865: rmdir d6/d9b 39 2024-09-12T18:03:25.293 INFO:tasks.workunit.client.0.smithi052.stdout:0/865: rmdir d2/d6/dd/d21/d26/d38/d4a 39 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:0/866: write d2/d6/dd/d21/f10f [904774,122507] 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:8/955: dread d13/f117 [0,4194304] 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:9/926: dread d0/d18/d37/d87/d72/df6/d11e/f128 [0,4194304] 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:2/849: read da/d2c/f2d [1429762,12499] 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:8/956: creat d13/ddc/f13f x:0 0 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:3/897: dwrite d0/d4b/d57/d6d/f7b [0,4194304] 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:8/957: write d13/d18/d5b/ff4 [503063,90016] 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:9/927: truncate d0/d18/d26/d4d/d54/f5b 5116282 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:3/898: readlink d0/d4/d25/d2a/d6/d7/d34/d72/d83/l11f 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:9/928: creat d0/d6/f131 x:0 0 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:8/958: link d13/d18/d38/dbf/fc4 d13/d18/d38/dd3/dde/f140 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:3/899: mknod d0/d4b/d4c/d6b/d117/dc7/c134 0 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:9/929: chown d0/d18/d79/da6/lc7 1444517 1 2024-09-12T18:03:25.294 INFO:tasks.workunit.client.0.smithi052.stdout:8/959: mkdir d13/d18/d141 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:9/930: readlink d0/d58/d7f/lb6 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:8/960: creat d13/d18/d38/f142 x:0 0 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:3/900: getdents d0/d4/d25/d2a/d6/d7/d79/de1/d105 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:3/901: mknod d0/d4b/d57/d6d/de8/c135 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:8/961: getdents d13/d18/d38/dd3 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:9/931: creat d0/d6/d3a/d42/d61/d6a/d102/f132 x:0 0 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:8/962: unlink d13/d18/d38/dd3/lfd 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:9/932: fdatasync d0/d6/d94/fc9 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:3/902: write d0/d4b/d4c/d6b/d117/dc7/de0/ff1 [3881836,92584] 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:2/850: dread da/d2c/dbf/ff9 [0,4194304] 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:6/955: dwrite d2/d21/d6a/f96 [0,4194304] 0 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:3/903: chown d0/d4b/d57 0 1 2024-09-12T18:03:25.295 INFO:tasks.workunit.client.0.smithi052.stdout:8/963: write d13/d18/d21/f110 [402923,125654] 0 2024-09-12T18:03:25.296 INFO:tasks.workunit.client.0.smithi052.stdout:1/814: dwrite d3/d10/d38/d44/d49/f8e [0,4194304] 0 2024-09-12T18:03:25.296 INFO:tasks.workunit.client.0.smithi052.stdout:9/933: rmdir d0/d18/d26 39 2024-09-12T18:03:25.296 INFO:tasks.workunit.client.0.smithi052.stdout:0/867: write d2/d6/dd/d21/f35 [4846372,60925] 0 2024-09-12T18:03:25.296 INFO:tasks.workunit.client.0.smithi052.stdout:5/872: dread d7/d51/ff4 [0,4194304] 0 2024-09-12T18:03:25.296 INFO:tasks.workunit.client.0.smithi052.stdout:2/851: symlink da/dc/d15/da6/df1/l120 0 2024-09-12T18:03:25.296 INFO:tasks.workunit.client.0.smithi052.stdout:1/815: fsync d3/d69/fd7 0 2024-09-12T18:03:25.296 INFO:tasks.workunit.client.0.smithi052.stdout:1/816: fsync d3/d10/d38/f4d 0 2024-09-12T18:03:25.296 INFO:tasks.workunit.client.0.smithi052.stdout:1/817: unlink d3/dcb/d74/fed 0 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:3/904: read d0/d16/d60/fca [2767635,41764] 0 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/818: chown d3/dcb/d74/d7f/dd8 568 1 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:6/956: truncate d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f7c 696285 0 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:7/866: dread d6/d9b/fa7 [0,4194304] 0 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/819: rmdir d3/da2/dbe 39 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:3/905: stat d0/d4b/d4c/d6b/d117/dc7/ff7 0 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:5/873: dwrite d7/d1c/d1e/f44 [0,4194304] 0 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:6/957: chown d2/d21/d9f/fb5 1048 1 2024-09-12T18:03:25.298 INFO:tasks.workunit.client.0.smithi052.stdout:9/934: dwrite d0/f1d [0,4194304] 0 2024-09-12T18:03:25.299 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:25.293+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:25.300 INFO:tasks.workunit.client.0.smithi052.stdout:5/874: unlink d7/d1c/f3f 0 2024-09-12T18:03:25.300 INFO:tasks.workunit.client.0.smithi052.stdout:9/935: readlink d0/l64 0 2024-09-12T18:03:25.301 INFO:tasks.workunit.client.0.smithi052.stdout:1/820: rename d3/d1d/d22/d27/cc1 to d3/dcb/d74/d7d/d84/dbb/c114 0 2024-09-12T18:03:25.301 INFO:tasks.workunit.client.0.smithi052.stdout:6/958: write d2/d5e/f93 [397472,117447] 0 2024-09-12T18:03:25.301 INFO:tasks.workunit.client.0.smithi052.stdout:5/875: unlink d7/d1c/f33 0 2024-09-12T18:03:25.302 INFO:tasks.workunit.client.0.smithi052.stdout:3/906: symlink d0/d4/d25/d2a/d6/d7/de/l136 0 2024-09-12T18:03:25.302 INFO:tasks.workunit.client.0.smithi052.stdout:8/964: dread d13/d35/de1/f96 [0,4194304] 0 2024-09-12T18:03:25.302 INFO:tasks.workunit.client.0.smithi052.stdout:9/936: fsync d0/da3/db8/f5f 0 2024-09-12T18:03:25.303 INFO:tasks.workunit.client.0.smithi052.stdout:1/821: rename d3/d1d/d22/d27/d28 to d3/d10/dc4/d115 0 2024-09-12T18:03:25.305 INFO:tasks.workunit.client.0.smithi052.stdout:3/907: dread - d0/d4/d25/d2a/d6/f108 zero size 2024-09-12T18:03:25.306 INFO:tasks.workunit.client.0.smithi052.stdout:7/867: dwrite d6/d12/d1e/d8e/fa9 [0,4194304] 0 2024-09-12T18:03:25.307 INFO:tasks.workunit.client.0.smithi052.stdout:1/822: creat d3/d1d/d22/d3f/db0/f116 x:0 0 0 2024-09-12T18:03:25.309 INFO:tasks.workunit.client.0.smithi052.stdout:1/823: creat d3/dcb/d74/dc8/f117 x:0 0 0 2024-09-12T18:03:25.309 INFO:tasks.workunit.client.0.smithi052.stdout:7/868: rename d6/d12/d1e/d29/d5d/d71/f104 to d6/d12/d1e/dae/f117 0 2024-09-12T18:03:25.310 INFO:tasks.workunit.client.0.smithi052.stdout:9/937: getdents d0/d18/d26/d100/dbc 0 2024-09-12T18:03:25.310 INFO:tasks.workunit.client.0.smithi052.stdout:5/876: dwrite d7/d51/d8d/fdd [0,4194304] 0 2024-09-12T18:03:25.311 INFO:tasks.workunit.client.0.smithi052.stdout:5/877: stat d7/d1c/d1e/da5 0 2024-09-12T18:03:25.312 INFO:tasks.workunit.client.0.smithi052.stdout:0/868: dread d2/f29 [0,4194304] 0 2024-09-12T18:03:25.312 INFO:tasks.workunit.client.0.smithi052.stdout:5/878: write d7/d1c/d1e/da5/fd6 [616866,36274] 0 2024-09-12T18:03:25.313 INFO:tasks.workunit.client.0.smithi052.stdout:6/959: link d2/d21/d9f/dd7/de7/d58/d5d/d87/cf2 d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/dea/c148 0 2024-09-12T18:03:25.313 INFO:tasks.workunit.client.0.smithi052.stdout:0/869: chown d2/d6/dd/d21/d26/d38/l46 43940 1 2024-09-12T18:03:25.314 INFO:tasks.workunit.client.0.smithi052.stdout:6/960: stat d2/d21/d9f/dd7/de7/d58/d5d/d9c/f31 0 2024-09-12T18:03:25.316 INFO:tasks.workunit.client.0.smithi052.stdout:1/824: rmdir d3/d10/dc4/d115 39 2024-09-12T18:03:25.316 INFO:tasks.workunit.client.0.smithi052.stdout:8/965: write d13/d18/d38/dbf/dc5/f131 [485916,76925] 0 2024-09-12T18:03:25.317 INFO:tasks.workunit.client.0.smithi052.stdout:2/852: dread da/dc/d15/fc8 [0,4194304] 0 2024-09-12T18:03:25.318 INFO:tasks.workunit.client.0.smithi052.stdout:1/825: mkdir d3/d1d/d22/d66/df0/d118 0 2024-09-12T18:03:25.319 INFO:tasks.workunit.client.0.smithi052.stdout:8/966: write d13/d18/d21/df6/f101 [1014188,79114] 0 2024-09-12T18:03:25.319 INFO:tasks.workunit.client.0.smithi052.stdout:1/826: chown d3/d1d/d22/d66 2 1 2024-09-12T18:03:25.321 INFO:tasks.workunit.client.0.smithi052.stdout:2/853: link da/d1d/d35/dd8/cea da/d1d/d35/d7a/c121 0 2024-09-12T18:03:25.321 INFO:tasks.workunit.client.0.smithi052.stdout:6/961: dwrite d2/d15/fe0 [0,4194304] 0 2024-09-12T18:03:25.321 INFO:tasks.workunit.client.0.smithi052.stdout:1/827: fsync d3/dcb/d74/f10b 0 2024-09-12T18:03:25.325 INFO:tasks.workunit.client.0.smithi052.stdout:8/967: getdents d13/d18/d38/dd3/dde 0 2024-09-12T18:03:25.326 INFO:tasks.workunit.client.0.smithi052.stdout:1/828: creat d3/d1d/d22/d66/df8/f119 x:0 0 0 2024-09-12T18:03:25.326 INFO:tasks.workunit.client.0.smithi052.stdout:6/962: write d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/f94 [1213734,103420] 0 2024-09-12T18:03:25.327 INFO:tasks.workunit.client.0.smithi052.stdout:8/968: readlink d13/d18/d38/dfb/l12b 0 2024-09-12T18:03:25.327 INFO:tasks.workunit.client.0.smithi052.stdout:1/829: symlink d3/d1d/d22/d3f/db0/l11a 0 2024-09-12T18:03:25.328 INFO:tasks.workunit.client.0.smithi052.stdout:6/963: mkdir d2/d80/d149 0 2024-09-12T18:03:25.329 INFO:tasks.workunit.client.0.smithi052.stdout:1/830: mkdir d3/d69/d89/d11b 0 2024-09-12T18:03:25.329 INFO:tasks.workunit.client.0.smithi052.stdout:8/969: read d13/d18/d5b/f76 [3679079,94948] 0 2024-09-12T18:03:25.330 INFO:tasks.workunit.client.0.smithi052.stdout:6/964: symlink d2/d21/d6a/d97/l14a 0 2024-09-12T18:03:25.330 INFO:tasks.workunit.client.0.smithi052.stdout:2/854: dwrite da/dc/d15/d43/f72 [4194304,4194304] 0 2024-09-12T18:03:25.331 INFO:tasks.workunit.client.0.smithi052.stdout:1/831: rename d3/d1d/d22/d27/f50 to d3/d69/d89/d11b/f11c 0 2024-09-12T18:03:25.331 INFO:tasks.workunit.client.0.smithi052.stdout:8/970: creat d13/d35/d9c/d9f/f143 x:0 0 0 2024-09-12T18:03:25.331 INFO:tasks.workunit.client.0.smithi052.stdout:6/965: readlink d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/l6b 0 2024-09-12T18:03:25.332 INFO:tasks.workunit.client.0.smithi052.stdout:2/855: write da/dc/f2e [1344955,42821] 0 2024-09-12T18:03:25.332 INFO:tasks.workunit.client.0.smithi052.stdout:1/832: dread - d3/d1d/d22/fbf zero size 2024-09-12T18:03:25.332 INFO:tasks.workunit.client.0.smithi052.stdout:8/971: read - d13/d18/d38/dbf/dc5/f11a zero size 2024-09-12T18:03:25.333 INFO:tasks.workunit.client.0.smithi052.stdout:9/938: write d0/d6/d3a/d43/f4b [2554641,32249] 0 2024-09-12T18:03:25.334 INFO:tasks.workunit.client.0.smithi052.stdout:1/833: write d3/d1d/d22/d3f/f45 [3382624,73118] 0 2024-09-12T18:03:25.334 INFO:tasks.workunit.client.0.smithi052.stdout:2/856: creat da/d21/da2/dc9/f122 x:0 0 0 2024-09-12T18:03:25.335 INFO:tasks.workunit.client.0.smithi052.stdout:9/939: rename d0/d6/f131 to d0/d58/d7f/f133 0 2024-09-12T18:03:25.337 INFO:tasks.workunit.client.0.smithi052.stdout:1/834: mknod d3/d10/dc4/c11d 0 2024-09-12T18:03:25.338 INFO:tasks.workunit.client.0.smithi052.stdout:9/940: getdents d0/d18/d26/d100/dbc 0 2024-09-12T18:03:25.339 INFO:tasks.workunit.client.0.smithi052.stdout:2/857: rename da/d71/ld1 to da/d71/l123 0 2024-09-12T18:03:25.340 INFO:tasks.workunit.client.0.smithi052.stdout:9/941: write d0/d6/d3a/d43/d74/f77 [1392454,118485] 0 2024-09-12T18:03:25.340 INFO:tasks.workunit.client.0.smithi052.stdout:5/879: dread d7/d1c/d1e/f36 [0,4194304] 0 2024-09-12T18:03:25.341 INFO:tasks.workunit.client.0.smithi052.stdout:8/972: write d13/d18/d21/fac [103283,39994] 0 2024-09-12T18:03:25.342 INFO:tasks.workunit.client.0.smithi052.stdout:2/858: read - da/d1d/d35/d7a/fe1 zero size 2024-09-12T18:03:25.342 INFO:tasks.workunit.client.0.smithi052.stdout:1/835: getdents d3/d1d/d22/d3f/d56/dd5 0 2024-09-12T18:03:25.343 INFO:tasks.workunit.client.0.smithi052.stdout:8/973: chown d13/d18/d5b/lbc 122262764 1 2024-09-12T18:03:25.343 INFO:tasks.workunit.client.0.smithi052.stdout:0/870: dread d2/d8/f43 [0,4194304] 0 2024-09-12T18:03:25.344 INFO:tasks.workunit.client.0.smithi052.stdout:5/880: write d7/d1c/d1e/d98/fa2 [1332900,35544] 0 2024-09-12T18:03:25.344 INFO:tasks.workunit.client.0.smithi052.stdout:2/859: fdatasync da/d2c/f52 0 2024-09-12T18:03:25.344 INFO:tasks.workunit.client.0.smithi052.stdout:9/942: truncate d0/d18/d26/d4d/d54/f5b 5503988 0 2024-09-12T18:03:25.345 INFO:tasks.workunit.client.0.smithi052.stdout:1/836: write d3/d10/d38/d44/d49/fb9 [672956,59333] 0 2024-09-12T18:03:25.346 INFO:tasks.workunit.client.0.smithi052.stdout:8/974: unlink d13/d35/de1/f104 0 2024-09-12T18:03:25.346 INFO:tasks.workunit.client.0.smithi052.stdout:6/966: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d9c/d26/f28 [0,4194304] 0 2024-09-12T18:03:25.347 INFO:tasks.workunit.client.0.smithi052.stdout:5/881: mknod d7/d51/d8b/c11b 0 2024-09-12T18:03:25.348 INFO:tasks.workunit.client.0.smithi052.stdout:0/871: fsync d2/d6/dd/d21/d26/d38/d4a/fae 0 2024-09-12T18:03:25.348 INFO:tasks.workunit.client.0.smithi052.stdout:7/869: dread d6/d12/f47 [0,4194304] 0 2024-09-12T18:03:25.349 INFO:tasks.workunit.client.0.smithi052.stdout:8/975: rmdir d13/ddc 39 2024-09-12T18:03:25.349 INFO:tasks.workunit.client.0.smithi052.stdout:2/860: write da/dc/d15/da6/dbb/dd6/f110 [1089321,126495] 0 2024-09-12T18:03:25.349 INFO:tasks.workunit.client.0.smithi052.stdout:3/908: dread d0/d16/d7c/fa6 [0,4194304] 0 2024-09-12T18:03:25.350 INFO:tasks.workunit.client.0.smithi052.stdout:1/837: mkdir d3/d1d/d11e 0 2024-09-12T18:03:25.350 INFO:tasks.workunit.client.0.smithi052.stdout:5/882: chown d7/d1c/d1e/lee 1839722 1 2024-09-12T18:03:25.350 INFO:tasks.workunit.client.0.smithi052.stdout:1/838: sync 2024-09-12T18:03:25.351 INFO:tasks.workunit.client.0.smithi052.stdout:9/943: creat d0/d18/d26/d4d/f134 x:0 0 0 2024-09-12T18:03:25.354 INFO:tasks.workunit.client.0.smithi052.stdout:2/861: rename da/d21/d6b to da/d21/d124 0 2024-09-12T18:03:25.354 INFO:tasks.workunit.client.0.smithi052.stdout:5/883: mknod d7/d1c/d67/c11c 0 2024-09-12T18:03:25.354 INFO:tasks.workunit.client.0.smithi052.stdout:3/909: symlink d0/d4/d25/d2a/d6/dcc/l137 0 2024-09-12T18:03:25.354 INFO:tasks.workunit.client.0.smithi052.stdout:8/976: readlink d13/d18/d38/l69 0 2024-09-12T18:03:25.354 INFO:tasks.workunit.client.0.smithi052.stdout:7/870: chown d6/d12/d1e/d29/d5d/d71/de1/c114 1997600 1 2024-09-12T18:03:25.354 INFO:tasks.workunit.client.0.smithi052.stdout:6/967: creat d2/d21/d9f/dd7/de7/d58/d5d/d107/d112/f14b x:0 0 0 2024-09-12T18:03:25.355 INFO:tasks.workunit.client.0.smithi052.stdout:9/944: unlink d0/d6/c19 0 2024-09-12T18:03:25.356 INFO:tasks.workunit.client.0.smithi052.stdout:8/977: stat d13/d35/d9c/l13c 0 2024-09-12T18:03:25.357 INFO:tasks.workunit.client.0.smithi052.stdout:3/910: chown d0/d4b/d57/d6d/f77 11064 1 2024-09-12T18:03:25.358 INFO:tasks.workunit.client.0.smithi052.stdout:8/978: mkdir d13/d144 0 2024-09-12T18:03:25.358 INFO:tasks.workunit.client.0.smithi052.stdout:9/945: readlink d0/d18/d26/d4d/d54/l71 0 2024-09-12T18:03:25.360 INFO:tasks.workunit.client.0.smithi052.stdout:6/968: chown d2/d21/d9f/dd7/de7/d54/dd5/df3/d13c 243 1 2024-09-12T18:03:25.361 INFO:tasks.workunit.client.0.smithi052.stdout:3/911: write d0/d4b/d4c/f46 [1468929,30819] 0 2024-09-12T18:03:25.362 INFO:tasks.workunit.client.0.smithi052.stdout:8/979: dread - d13/d18/d38/dbf/f13a zero size 2024-09-12T18:03:25.362 INFO:tasks.workunit.client.0.smithi052.stdout:0/872: dwrite d2/d6/dd/d21/d26/d38/d4a/d86/fe1 [0,4194304] 0 2024-09-12T18:03:25.362 INFO:tasks.workunit.client.0.smithi052.stdout:1/839: dwrite d3/d10/d38/f4d [4194304,4194304] 0 2024-09-12T18:03:25.362 INFO:tasks.workunit.client.0.smithi052.stdout:5/884: dwrite d7/d59/f65 [0,4194304] 0 2024-09-12T18:03:25.365 INFO:tasks.workunit.client.0.smithi052.stdout:6/969: readlink d2/d21/d9f/dd7/de7/d58/d5d/d107/d112/l123 0 2024-09-12T18:03:25.365 INFO:tasks.workunit.client.0.smithi052.stdout:1/840: creat d3/d69/d89/d11b/f11f x:0 0 0 2024-09-12T18:03:25.365 INFO:tasks.workunit.client.0.smithi052.stdout:5/885: mknod d7/d1f/d34/c11d 0 2024-09-12T18:03:25.366 INFO:tasks.workunit.client.0.smithi052.stdout:3/912: fsync d0/d4/f11c 0 2024-09-12T18:03:25.366 INFO:tasks.workunit.client.0.smithi052.stdout:0/873: mkdir d2/d6/dd/d21/d26/d38/dd0/df2/d113 0 2024-09-12T18:03:25.366 INFO:tasks.workunit.client.0.smithi052.stdout:1/841: write d3/d1d/ffa [326577,46138] 0 2024-09-12T18:03:25.367 INFO:tasks.workunit.client.0.smithi052.stdout:5/886: unlink d7/d1c/d1e/l92 0 2024-09-12T18:03:25.367 INFO:tasks.workunit.client.0.smithi052.stdout:1/842: symlink d3/da2/dbe/l120 0 2024-09-12T18:03:25.370 INFO:tasks.workunit.client.0.smithi052.stdout:1/843: unlink d3/d10/l4e 0 2024-09-12T18:03:25.370 INFO:tasks.workunit.client.0.smithi052.stdout:3/913: truncate d0/d4/d25/d2a/d6/d7/d34/fb1 1002460 0 2024-09-12T18:03:25.371 INFO:tasks.workunit.client.0.smithi052.stdout:3/914: write d0/d4b/fc2 [431962,79813] 0 2024-09-12T18:03:25.372 INFO:tasks.workunit.client.0.smithi052.stdout:2/862: dread da/d71/fb0 [0,4194304] 0 2024-09-12T18:03:25.375 INFO:tasks.workunit.client.0.smithi052.stdout:3/915: link d0/d4b/d4c/f97 d0/d4/d25/d2a/d6/d7/d79/de1/f138 0 2024-09-12T18:03:25.375 INFO:tasks.workunit.client.0.smithi052.stdout:2/863: rename da/dc/d15/fc8 to da/dc/d15/d20/d60/d6e/dab/f125 0 2024-09-12T18:03:25.376 INFO:tasks.workunit.client.0.smithi052.stdout:1/844: dread d3/d1d/ffa [0,4194304] 0 2024-09-12T18:03:25.376 INFO:tasks.workunit.client.0.smithi052.stdout:8/980: truncate d13/d18/d21/f41 156017 0 2024-09-12T18:03:25.376 INFO:tasks.workunit.client.0.smithi052.stdout:9/946: dwrite d0/d6/d3a/d43/dd5/f111 [0,4194304] 0 2024-09-12T18:03:25.376 INFO:tasks.workunit.client.0.smithi052.stdout:3/916: rmdir d0/d4/d11d 39 2024-09-12T18:03:25.377 INFO:tasks.workunit.client.0.smithi052.stdout:7/871: dread d6/dc/f2f [0,4194304] 0 2024-09-12T18:03:25.377 INFO:tasks.workunit.client.0.smithi052.stdout:5/887: dwrite d7/d59/fb2 [0,4194304] 0 2024-09-12T18:03:25.378 INFO:tasks.workunit.client.0.smithi052.stdout:9/947: stat d0/l1 0 2024-09-12T18:03:25.378 INFO:tasks.workunit.client.0.smithi052.stdout:7/872: write d6/dc/d1a/ff9 [264842,30526] 0 2024-09-12T18:03:25.379 INFO:tasks.workunit.client.0.smithi052.stdout:3/917: chown d0/d4b/d4c/d6b/d117/dc7/lc8 0 1 2024-09-12T18:03:25.379 INFO:tasks.workunit.client.0.smithi052.stdout:8/981: mkdir d13/d18/d38/d145 0 2024-09-12T18:03:25.379 INFO:tasks.workunit.client.0.smithi052.stdout:9/948: chown d0/fb 218 1 2024-09-12T18:03:25.380 INFO:tasks.workunit.client.0.smithi052.stdout:1/845: truncate d3/d1d/d22/d3f/d56/dd5/fe0 899285 0 2024-09-12T18:03:25.380 INFO:tasks.workunit.client.0.smithi052.stdout:5/888: symlink d7/d51/d8d/d115/l11e 0 2024-09-12T18:03:25.381 INFO:tasks.workunit.client.0.smithi052.stdout:9/949: write d0/d18/d37/d87/d72/f123 [118704,56904] 0 2024-09-12T18:03:25.383 INFO:tasks.workunit.client.0.smithi052.stdout:8/982: chown d13/c32 1 1 2024-09-12T18:03:25.383 INFO:tasks.workunit.client.0.smithi052.stdout:3/918: creat d0/d4/dbb/f139 x:0 0 0 2024-09-12T18:03:25.386 INFO:tasks.workunit.client.0.smithi052.stdout:1/846: symlink d3/d10/d38/d44/d49/l121 0 2024-09-12T18:03:25.386 INFO:tasks.workunit.client.0.smithi052.stdout:5/889: rename d7/d1f/d34/df2/d49/fcc to d7/d51/f11f 0 2024-09-12T18:03:25.388 INFO:tasks.workunit.client.0.smithi052.stdout:6/970: sync 2024-09-12T18:03:25.388 INFO:tasks.workunit.client.0.smithi052.stdout:5/890: unlink d7/d59/d5c/fbf 0 2024-09-12T18:03:25.389 INFO:tasks.workunit.client.0.smithi052.stdout:8/983: symlink d13/d18/d38/dbf/dc5/l146 0 2024-09-12T18:03:25.390 INFO:tasks.workunit.client.0.smithi052.stdout:7/873: dwrite d6/dc/d1a/ff2 [4194304,4194304] 0 2024-09-12T18:03:25.390 INFO:tasks.workunit.client.0.smithi052.stdout:5/891: readlink d7/d1f/d34/l88 0 2024-09-12T18:03:25.392 INFO:tasks.workunit.client.0.smithi052.stdout:2/864: dwrite da/dc/d15/d22/d87/fc6 [0,4194304] 0 2024-09-12T18:03:25.393 INFO:tasks.workunit.client.0.smithi052.stdout:3/919: mknod d0/d16/d60/ddf/c13a 0 2024-09-12T18:03:25.395 INFO:tasks.workunit.client.0.smithi052.stdout:2/865: creat da/dc/d15/d20/f126 x:0 0 0 2024-09-12T18:03:25.395 INFO:tasks.workunit.client.0.smithi052.stdout:9/950: dwrite d0/d18/d26/ffd [0,4194304] 0 2024-09-12T18:03:25.396 INFO:tasks.workunit.client.0.smithi052.stdout:8/984: rename f7 to d13/d18/d21/df6/d129/d127/f147 0 2024-09-12T18:03:25.398 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:25.395+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:25.400 INFO:tasks.workunit.client.0.smithi052.stdout:8/985: symlink d13/d3c/l148 0 2024-09-12T18:03:25.403 INFO:tasks.workunit.client.0.smithi052.stdout:0/874: dread d2/d6/f23 [0,4194304] 0 2024-09-12T18:03:25.404 INFO:tasks.workunit.client.0.smithi052.stdout:1/847: dwrite d3/dcb/d74/d7f/f94 [0,4194304] 0 2024-09-12T18:03:25.405 INFO:tasks.workunit.client.0.smithi052.stdout:5/892: dwrite d7/d1f/d34/fca [0,4194304] 0 2024-09-12T18:03:25.405 INFO:tasks.workunit.client.0.smithi052.stdout:9/951: write d0/d6/d3a/d42/d93/f114 [791849,102353] 0 2024-09-12T18:03:25.407 INFO:tasks.workunit.client.0.smithi052.stdout:0/875: mknod d2/d8/c114 0 2024-09-12T18:03:25.409 INFO:tasks.workunit.client.0.smithi052.stdout:5/893: creat d7/d51/dc6/f120 x:0 0 0 2024-09-12T18:03:25.409 INFO:tasks.workunit.client.0.smithi052.stdout:9/952: symlink d0/d6/d3a/d42/d61/d6a/l135 0 2024-09-12T18:03:25.411 INFO:tasks.workunit.client.0.smithi052.stdout:6/971: dwrite d2/d21/d9f/dd7/de7/d58/d5d/f7d [4194304,4194304] 0 2024-09-12T18:03:25.412 INFO:tasks.workunit.client.0.smithi052.stdout:2/866: dwrite da/dc/d15/d20/f95 [0,4194304] 0 2024-09-12T18:03:25.414 INFO:tasks.workunit.client.0.smithi052.stdout:3/920: dwrite d0/d4/d25/d2a/d6/d7/d34/d71/fee [0,4194304] 0 2024-09-12T18:03:25.414 INFO:tasks.workunit.client.0.smithi052.stdout:2/867: fsync da/d1d/d7d/db3/f11f 0 2024-09-12T18:03:25.416 INFO:tasks.workunit.client.0.smithi052.stdout:0/876: rename d2/d1b/fdb to d2/d6/dd/d21/d26/d65/f115 0 2024-09-12T18:03:25.418 INFO:tasks.workunit.client.0.smithi052.stdout:8/986: dwrite d13/d18/d5b/fb1 [0,4194304] 0 2024-09-12T18:03:25.419 INFO:tasks.workunit.client.0.smithi052.stdout:1/848: dwrite d3/d1d/fd1 [0,4194304] 0 2024-09-12T18:03:25.420 INFO:tasks.workunit.client.0.smithi052.stdout:2/868: read - da/d1d/d7d/fe7 zero size 2024-09-12T18:03:25.420 INFO:tasks.workunit.client.0.smithi052.stdout:9/953: creat d0/d6/d3a/d42/d61/d6a/f136 x:0 0 0 2024-09-12T18:03:25.421 INFO:tasks.workunit.client.0.smithi052.stdout:1/849: dread - d3/dcb/d74/d7d/f9d zero size 2024-09-12T18:03:25.422 INFO:tasks.workunit.client.0.smithi052.stdout:3/921: mknod d0/d4b/d4c/d6b/d117/dc7/de0/c13b 0 2024-09-12T18:03:25.422 INFO:tasks.workunit.client.0.smithi052.stdout:0/877: write d2/d6/dd/f9d [3702278,23735] 0 2024-09-12T18:03:25.423 INFO:tasks.workunit.client.0.smithi052.stdout:2/869: creat da/dc/d76/f127 x:0 0 0 2024-09-12T18:03:25.424 INFO:tasks.workunit.client.0.smithi052.stdout:7/874: write d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/f101 [390850,81112] 0 2024-09-12T18:03:25.424 INFO:tasks.workunit.client.0.smithi052.stdout:5/894: dwrite d7/d1c/f6c [0,4194304] 0 2024-09-12T18:03:25.424 INFO:tasks.workunit.client.0.smithi052.stdout:3/922: fsync d0/d4/dbb/f139 0 2024-09-12T18:03:25.424 INFO:tasks.workunit.client.0.smithi052.stdout:1/850: fsync d3/d1d/d22/d27/f81 0 2024-09-12T18:03:25.425 INFO:tasks.workunit.client.0.smithi052.stdout:2/870: write da/d2c/f2d [2484218,125071] 0 2024-09-12T18:03:25.428 INFO:tasks.workunit.client.0.smithi052.stdout:0/878: chown d2/d6/dd/d21/d47/f58 16 1 2024-09-12T18:03:25.428 INFO:tasks.workunit.client.0.smithi052.stdout:9/954: creat d0/d18/d26/d4d/d54/f137 x:0 0 0 2024-09-12T18:03:25.429 INFO:tasks.workunit.client.0.smithi052.stdout:3/923: write d0/d4/d25/d2a/d2c/da9/fcd [4448677,76005] 0 2024-09-12T18:03:25.429 INFO:tasks.workunit.client.0.smithi052.stdout:2/871: write da/d2c/f52 [713063,3459] 0 2024-09-12T18:03:25.430 INFO:tasks.workunit.client.0.smithi052.stdout:1/851: unlink d3/d10/fa0 0 2024-09-12T18:03:25.430 INFO:tasks.workunit.client.0.smithi052.stdout:0/879: fdatasync d2/d6/dd/d21/d26/d38/d4a/fae 0 2024-09-12T18:03:25.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/955: mkdir d0/d18/d37/d87/d72/df6/d11e/d12b/d138 0 2024-09-12T18:03:25.430 INFO:tasks.workunit.client.0.smithi052.stdout:5/895: link d7/d1c/d1e/da5/lb0 d7/d1f/d34/df2/l121 0 2024-09-12T18:03:25.430 INFO:tasks.workunit.client.0.smithi052.stdout:5/896: stat d7/d59/dbe/d6b 0 2024-09-12T18:03:25.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/956: rmdir d0/d6/d3a/d43 39 2024-09-12T18:03:25.431 INFO:tasks.workunit.client.0.smithi052.stdout:5/897: creat d7/d1c/dff/f122 x:0 0 0 2024-09-12T18:03:25.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/852: mknod d3/dcb/d74/d7d/d102/c122 0 2024-09-12T18:03:25.431 INFO:tasks.workunit.client.0.smithi052.stdout:0/880: link d2/d57/d5b/d7a/ccd d2/d1b/d80/c116 0 2024-09-12T18:03:25.431 INFO:tasks.workunit.client.0.smithi052.stdout:5/898: rename d7 to d7/d1c/d123 22 2024-09-12T18:03:25.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/853: chown d3/d1d/d22/d3f/ca8 0 1 2024-09-12T18:03:25.432 INFO:tasks.workunit.client.0.smithi052.stdout:9/957: rename d0/d6/d3a/d43/f4b to d0/d6/d3a/d43/d74/f139 0 2024-09-12T18:03:25.433 INFO:tasks.workunit.client.0.smithi052.stdout:5/899: rename d7/d59/dbe/c6e to d7/d1c/d67/dfd/c124 0 2024-09-12T18:03:25.433 INFO:tasks.workunit.client.0.smithi052.stdout:1/854: creat d3/d10/d38/d44/f123 x:0 0 0 2024-09-12T18:03:25.434 INFO:tasks.workunit.client.0.smithi052.stdout:6/972: dread d2/d21/d9f/dd7/de7/fa9 [0,4194304] 0 2024-09-12T18:03:25.434 INFO:tasks.workunit.client.0.smithi052.stdout:5/900: readlink d7/d51/d8b/da3/lae 0 2024-09-12T18:03:25.436 INFO:tasks.workunit.client.0.smithi052.stdout:9/958: truncate d0/d18/d26/d4d/fac 1332133 0 2024-09-12T18:03:25.436 INFO:tasks.workunit.client.0.smithi052.stdout:1/855: symlink d3/dcb/d74/d7d/d102/l124 0 2024-09-12T18:03:25.437 INFO:tasks.workunit.client.0.smithi052.stdout:2/872: dwrite da/dc/d15/da6/dbb/f7f [0,4194304] 0 2024-09-12T18:03:25.437 INFO:tasks.workunit.client.0.smithi052.stdout:9/959: creat d0/d18/d37/d87/d72/df6/d11e/f13a x:0 0 0 2024-09-12T18:03:25.438 INFO:tasks.workunit.client.0.smithi052.stdout:9/960: unlink d0/d6/d3a/d43/dd5/f111 0 2024-09-12T18:03:25.438 INFO:tasks.workunit.client.0.smithi052.stdout:3/924: dread d0/d4/d33/fcf [0,4194304] 0 2024-09-12T18:03:25.439 INFO:tasks.workunit.client.0.smithi052.stdout:7/875: truncate d6/d12/d17/f52 3182127 0 2024-09-12T18:03:25.440 INFO:tasks.workunit.client.0.smithi052.stdout:2/873: truncate da/dc/d15/fdd 1066058 0 2024-09-12T18:03:25.441 INFO:tasks.workunit.client.0.smithi052.stdout:9/961: getdents d0/d58/d7f 0 2024-09-12T18:03:25.442 INFO:tasks.workunit.client.0.smithi052.stdout:2/874: symlink da/d1d/l128 0 2024-09-12T18:03:25.442 INFO:tasks.workunit.client.0.smithi052.stdout:7/876: rename d6/d12/c23 to d6/d12/d17/c118 0 2024-09-12T18:03:25.442 INFO:tasks.workunit.client.0.smithi052.stdout:3/925: rename d0/d4/d25/d2a/d2c/f63 to d0/d4/d25/d2a/d2c/f13c 0 2024-09-12T18:03:25.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/962: mknod d0/d18/d37/d87/d72/df6/d11e/c13b 0 2024-09-12T18:03:25.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/877: fdatasync d6/f10d 0 2024-09-12T18:03:25.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/901: write d7/d59/dbe/f5b [284698,39622] 0 2024-09-12T18:03:25.444 INFO:tasks.workunit.client.0.smithi052.stdout:6/973: dwrite d2/d21/d9f/dd7/de7/d58/d5d/d87/dd1/f85 [0,4194304] 0 2024-09-12T18:03:25.444 INFO:tasks.workunit.client.0.smithi052.stdout:2/875: symlink da/d1d/d35/d7a/df4/l129 0 2024-09-12T18:03:25.445 INFO:tasks.workunit.client.0.smithi052.stdout:6/974: mknod d2/d21/ded/df5/c14c 0 2024-09-12T18:03:25.445 INFO:tasks.workunit.client.0.smithi052.stdout:2/876: write da/dc/d15/f69 [591983,114179] 0 2024-09-12T18:03:25.446 INFO:tasks.workunit.client.0.smithi052.stdout:2/877: creat da/d1d/daa/f12a x:0 0 0 2024-09-12T18:03:25.446 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:25.446 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:25.446 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:25.447 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:25.447 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:25.450 INFO:tasks.workunit.client.0.smithi052.stdout:9/963: dwrite d0/d18/d37/d9e/f11c [0,4194304] 0 2024-09-12T18:03:25.450 INFO:tasks.workunit.client.0.smithi052.stdout:5/902: dwrite d7/d1f/d34/df2/f85 [4194304,4194304] 0 2024-09-12T18:03:25.451 INFO:tasks.workunit.client.0.smithi052.stdout:3/926: dread d0/d4/d25/d2a/d2c/f13c [0,4194304] 0 2024-09-12T18:03:25.451 INFO:tasks.workunit.client.0.smithi052.stdout:7/878: mknod d6/d12/c119 0 2024-09-12T18:03:25.451 INFO:tasks.workunit.client.0.smithi052.stdout:9/964: mknod d0/d58/c13c 0 2024-09-12T18:03:25.452 INFO:tasks.workunit.client.0.smithi052.stdout:3/927: creat d0/d16/d7c/d85/d111/f13d x:0 0 0 2024-09-12T18:03:25.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/879: chown d6/d12/d1e/d29/da1/ff4 1252744012 1 2024-09-12T18:03:25.454 INFO:tasks.workunit.client.0.smithi052.stdout:2/878: truncate da/dc/f82 5921897 0 2024-09-12T18:03:25.454 INFO:tasks.workunit.client.0.smithi052.stdout:7/880: unlink d6/dc/d1a/d6a/f8a 0 2024-09-12T18:03:25.456 INFO:tasks.workunit.client.0.smithi052.stdout:7/881: chown d6/dc/d1a/c82 6991459 1 2024-09-12T18:03:25.457 INFO:tasks.workunit.client.0.smithi052.stdout:2/879: rename da/dc/d15/d43/f5c to da/d21/d124/f12b 0 2024-09-12T18:03:25.458 INFO:tasks.workunit.client.0.smithi052.stdout:8/987: dread d13/d18/d21/f27 [0,4194304] 0 2024-09-12T18:03:25.458 INFO:tasks.workunit.client.0.smithi052.stdout:6/975: dwrite d2/fbc [0,4194304] 0 2024-09-12T18:03:25.459 INFO:tasks.workunit.client.0.smithi052.stdout:2/880: write da/dc/f5e [4276562,83627] 0 2024-09-12T18:03:25.460 INFO:tasks.workunit.client.0.smithi052.stdout:7/882: creat d6/d12/d17/dac/f11a x:0 0 0 2024-09-12T18:03:25.460 INFO:tasks.workunit.client.0.smithi052.stdout:8/988: mkdir d13/d18/d141/d149 0 2024-09-12T18:03:25.460 INFO:tasks.workunit.client.0.smithi052.stdout:7/883: fdatasync d6/f10d 0 2024-09-12T18:03:25.460 INFO:tasks.workunit.client.0.smithi052.stdout:8/989: stat d13/d3c/f95 0 2024-09-12T18:03:25.460 INFO:tasks.workunit.client.0.smithi052.stdout:9/965: dwrite d0/d18/f98 [0,4194304] 0 2024-09-12T18:03:25.460 INFO:tasks.workunit.client.0.smithi052.stdout:6/976: dread - d2/d21/d9f/dd7/de7/d58/d5d/d9c/fde zero size 2024-09-12T18:03:25.461 INFO:tasks.workunit.client.0.smithi052.stdout:8/990: mknod d13/d35/d9c/da3/c14a 0 2024-09-12T18:03:25.461 INFO:tasks.workunit.client.0.smithi052.stdout:6/977: rmdir d2/d21/ded/df5 39 2024-09-12T18:03:25.461 INFO:tasks.workunit.client.0.smithi052.stdout:5/903: truncate d7/d59/fb2 163247 0 2024-09-12T18:03:25.462 INFO:tasks.workunit.client.0.smithi052.stdout:7/884: creat d6/d12/d1e/d29/d5d/d71/d3a/d83/f11b x:0 0 0 2024-09-12T18:03:25.463 INFO:tasks.workunit.client.0.smithi052.stdout:5/904: dread - d7/d1f/d34/df2/f4f zero size 2024-09-12T18:03:25.463 INFO:tasks.workunit.client.0.smithi052.stdout:0/881: sync 2024-09-12T18:03:25.463 INFO:tasks.workunit.client.0.smithi052.stdout:1/856: sync 2024-09-12T18:03:25.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/978: write d2/d21/d9f/dd7/de7/d58/d5d/f10d [1727846,78769] 0 2024-09-12T18:03:25.465 INFO:tasks.workunit.client.0.smithi052.stdout:5/905: write d7/d1f/f76 [150084,50009] 0 2024-09-12T18:03:25.465 INFO:tasks.workunit.client.0.smithi052.stdout:3/928: truncate d0/d4/d25/d2a/d6/d7/d34/f5b 2904400 0 2024-09-12T18:03:25.467 INFO:tasks.workunit.client.0.smithi052.stdout:7/885: link d6/d12/d1e/d29/d5d/d71/c75 d6/d12/d1e/c11c 0 2024-09-12T18:03:25.467 INFO:tasks.workunit.client.0.smithi052.stdout:5/906: chown d7/d59/dbe/d6b/l7b 2 1 2024-09-12T18:03:25.468 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:25.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/979: getdents d2/d15/dcc 0 2024-09-12T18:03:25.469 INFO:tasks.workunit.client.0.smithi052.stdout:8/991: dread d13/d18/d5b/d70/f11b [0,4194304] 0 2024-09-12T18:03:25.469 INFO:tasks.workunit.client.0.smithi052.stdout:5/907: write d7/d1f/d45/f50 [2879314,93607] 0 2024-09-12T18:03:25.469 INFO:tasks.workunit.client.0.smithi052.stdout:3/929: write d0/d4/d25/d2a/d6/d7/dab/fbc [948145,79253] 0 2024-09-12T18:03:25.470 INFO:tasks.workunit.client.0.smithi052.stdout:9/966: dwrite d0/d18/d37/f4c [8388608,4194304] 0 2024-09-12T18:03:25.470 INFO:tasks.workunit.client.0.smithi052.stdout:6/980: write d2/d21/d9f/fb5 [3260176,62570] 0 2024-09-12T18:03:25.471 INFO:tasks.workunit.client.0.smithi052.stdout:5/908: stat d7/d1f/d34/f48 0 2024-09-12T18:03:25.471 INFO:tasks.workunit.client.0.smithi052.stdout:7/886: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/dee/d11d 0 2024-09-12T18:03:25.471 INFO:tasks.workunit.client.0.smithi052.stdout:8/992: chown d13/d18/d21/l31 1214540536 1 2024-09-12T18:03:25.471 INFO:tasks.workunit.client.0.smithi052.stdout:6/981: write d2/f10 [7017401,42589] 0 2024-09-12T18:03:25.472 INFO:tasks.workunit.client.0.smithi052.stdout:5/909: mknod d7/d59/d84/c125 0 2024-09-12T18:03:25.472 INFO:tasks.workunit.client.0.smithi052.stdout:3/930: chown d0/d4/d25/d2a/d6/d7/l12d 58 1 2024-09-12T18:03:25.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/967: mknod d0/d6/d3a/d43/dd5/c13d 0 2024-09-12T18:03:25.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/993: symlink d13/d144/l14b 0 2024-09-12T18:03:25.472 INFO:tasks.workunit.client.0.smithi052.stdout:3/931: readlink d0/d4b/ld6 0 2024-09-12T18:03:25.473 INFO:tasks.workunit.client.0.smithi052.stdout:7/887: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/d11e 0 2024-09-12T18:03:25.473 INFO:tasks.workunit.client.0.smithi052.stdout:5/910: write d7/d1c/d6f/fc3 [17697,86112] 0 2024-09-12T18:03:25.473 INFO:tasks.workunit.client.0.smithi052.stdout:9/968: creat d0/d6/d3a/d43/dd7/f13e x:0 0 0 2024-09-12T18:03:25.474 INFO:tasks.workunit.client.0.smithi052.stdout:3/932: mknod d0/d4/d25/d2a/d6/d7/d79/c13e 0 2024-09-12T18:03:25.474 INFO:tasks.workunit.client.0.smithi052.stdout:5/911: mknod d7/d59/dad/dce/d110/c126 0 2024-09-12T18:03:25.474 INFO:tasks.workunit.client.0.smithi052.stdout:9/969: rmdir d0/d18/d26/d33 39 2024-09-12T18:03:25.475 INFO:tasks.workunit.client.0.smithi052.stdout:3/933: dread - d0/d4/d25/d2a/fe6 zero size 2024-09-12T18:03:25.475 INFO:tasks.workunit.client.0.smithi052.stdout:5/912: chown d7/d1f/f76 4559 1 2024-09-12T18:03:25.475 INFO:tasks.workunit.client.0.smithi052.stdout:3/934: fsync d0/d4/d25/f12f 0 2024-09-12T18:03:25.475 INFO:tasks.workunit.client.0.smithi052.stdout:9/970: creat d0/d18/d37/d87/f13f x:0 0 0 2024-09-12T18:03:25.476 INFO:tasks.workunit.client.0.smithi052.stdout:3/935: write d0/d16/f1e [4455968,92593] 0 2024-09-12T18:03:25.476 INFO:tasks.workunit.client.0.smithi052.stdout:5/913: creat d7/d59/d5c/d7c/f127 x:0 0 0 2024-09-12T18:03:25.476 INFO:tasks.workunit.client.0.smithi052.stdout:9/971: write d0/d6/d3a/d42/d61/fab [1527826,55024] 0 2024-09-12T18:03:25.477 INFO:tasks.workunit.client.0.smithi052.stdout:1/857: write d3/d10/f33 [573592,54117] 0 2024-09-12T18:03:25.478 INFO:tasks.workunit.client.0.smithi052.stdout:1/858: write d3/d10/d38/f9c [5646070,1465] 0 2024-09-12T18:03:25.479 INFO:tasks.workunit.client.0.smithi052.stdout:1/859: stat d3/d1d/d83/d8f/c93 0 2024-09-12T18:03:25.479 INFO:tasks.workunit.client.0.smithi052.stdout:9/972: dread d0/d18/d37/d87/d72/f123 [0,4194304] 0 2024-09-12T18:03:25.481 INFO:tasks.workunit.client.0.smithi052.stdout:9/973: mknod d0/c140 0 2024-09-12T18:03:25.483 INFO:tasks.workunit.client.0.smithi052.stdout:9/974: chown d0/d6/d3a/d43/d74/cc1 121971 1 2024-09-12T18:03:25.484 INFO:tasks.workunit.client.0.smithi052.stdout:3/936: dwrite d0/d4b/d57/f120 [0,4194304] 0 2024-09-12T18:03:25.484 INFO:tasks.workunit.client.0.smithi052.stdout:8/994: dread d13/d18/d21/f59 [0,4194304] 0 2024-09-12T18:03:25.485 INFO:tasks.workunit.client.0.smithi052.stdout:0/882: dread d2/d6/dd/d21/d26/d2f/f96 [0,4194304] 0 2024-09-12T18:03:25.485 INFO:tasks.workunit.client.0.smithi052.stdout:3/937: fdatasync d0/d4/d25/d2a/d2c/f13c 0 2024-09-12T18:03:25.485 INFO:tasks.workunit.client.0.smithi052.stdout:0/883: readlink d2/d1b/d80/da3/l106 0 2024-09-12T18:03:25.486 INFO:tasks.workunit.client.0.smithi052.stdout:8/995: truncate d13/ddc/df3/f100 940618 0 2024-09-12T18:03:25.486 INFO:tasks.workunit.client.0.smithi052.stdout:5/914: dread d7/d1c/d1e/d98/fa2 [0,4194304] 0 2024-09-12T18:03:25.486 INFO:tasks.workunit.client.0.smithi052.stdout:3/938: symlink d0/l13f 0 2024-09-12T18:03:25.486 INFO:tasks.workunit.client.0.smithi052.stdout:8/996: dread - d13/ff5 zero size 2024-09-12T18:03:25.487 INFO:tasks.workunit.client.0.smithi052.stdout:0/884: stat d2/d6/dd/d21/d26/d65/f7c 0 2024-09-12T18:03:25.487 INFO:tasks.workunit.client.0.smithi052.stdout:5/915: chown d7/d51/dc6/c10c 22195 1 2024-09-12T18:03:25.488 INFO:tasks.workunit.client.0.smithi052.stdout:8/997: creat d13/d35/f14c x:0 0 0 2024-09-12T18:03:25.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/916: mknod d7/d1c/d1e/c128 0 2024-09-12T18:03:25.490 INFO:tasks.workunit.client.0.smithi052.stdout:5/917: chown d7/d51/d8d/d115 282361 1 2024-09-12T18:03:25.490 INFO:tasks.workunit.client.0.smithi052.stdout:2/881: sync 2024-09-12T18:03:25.490 INFO:tasks.workunit.client.0.smithi052.stdout:1/860: sync 2024-09-12T18:03:25.490 INFO:tasks.workunit.client.0.smithi052.stdout:1/861: sync 2024-09-12T18:03:25.490 INFO:tasks.workunit.client.0.smithi052.stdout:6/982: dread d2/ff [0,4194304] 0 2024-09-12T18:03:25.491 INFO:tasks.workunit.client.0.smithi052.stdout:5/918: creat d7/d1c/d1e/da5/f129 x:0 0 0 2024-09-12T18:03:25.491 INFO:tasks.workunit.client.0.smithi052.stdout:7/888: sync 2024-09-12T18:03:25.491 INFO:tasks.workunit.client.0.smithi052.stdout:6/983: stat d2/d80/f48 0 2024-09-12T18:03:25.491 INFO:tasks.workunit.client.0.smithi052.stdout:1/862: rmdir d3/d1d/d83/ddf 39 2024-09-12T18:03:25.491 INFO:tasks.workunit.client.0.smithi052.stdout:2/882: write da/dc/d15/f19 [1817338,115888] 0 2024-09-12T18:03:25.492 INFO:tasks.workunit.client.0.smithi052.stdout:9/975: sync 2024-09-12T18:03:25.492 INFO:tasks.workunit.client.0.smithi052.stdout:7/889: fdatasync d6/dc/d112/ff5 0 2024-09-12T18:03:25.493 INFO:tasks.workunit.client.0.smithi052.stdout:2/883: readlink da/dc/d15/d22/l4c 0 2024-09-12T18:03:25.494 INFO:tasks.workunit.client.0.smithi052.stdout:9/976: chown d0/d6/d3a/d42/d61/d6a/c6b 427816677 1 2024-09-12T18:03:25.494 INFO:tasks.workunit.client.0.smithi052.stdout:1/863: chown d3/d10/d38/d8b/cc5 2040460 1 2024-09-12T18:03:25.494 INFO:tasks.workunit.client.0.smithi052.stdout:7/890: dread - d6/d12/d1e/dae/db3/f106 zero size 2024-09-12T18:03:25.494 INFO:tasks.workunit.client.0.smithi052.stdout:5/919: rename d7/f30 to d7/d59/dad/dce/f12a 0 2024-09-12T18:03:25.495 INFO:tasks.workunit.client.0.smithi052.stdout:2/884: unlink da/dc/fcc 0 2024-09-12T18:03:25.496 INFO:tasks.workunit.client.0.smithi052.stdout:1/864: creat d3/da2/ddc/f125 x:0 0 0 2024-09-12T18:03:25.496 INFO:tasks.workunit.client.0.smithi052.stdout:7/891: unlink d6/d12/d1e/l2a 0 2024-09-12T18:03:25.496 INFO:tasks.workunit.client.0.smithi052.stdout:0/885: dwrite d2/d1b/d80/da3/fdf [0,4194304] 0 2024-09-12T18:03:25.497 INFO:tasks.workunit.client.0.smithi052.stdout:9/977: creat d0/d18/d37/d87/d72/df6/f141 x:0 0 0 2024-09-12T18:03:25.497 INFO:tasks.workunit.client.0.smithi052.stdout:5/920: unlink d7/f19 0 2024-09-12T18:03:25.497 INFO:tasks.workunit.client.0.smithi052.stdout:8/998: dwrite d13/d35/d9c/d9f/fcb [0,4194304] 0 2024-09-12T18:03:25.497 INFO:tasks.workunit.client.0.smithi052.stdout:2/885: write da/d2c/dbf/ddf/ff8 [51250,41201] 0 2024-09-12T18:03:25.499 INFO:tasks.workunit.client.0.smithi052.stdout:0/886: write d2/d8/dce/d48/f4d [1142087,2776] 0 2024-09-12T18:03:25.499 INFO:tasks.workunit.client.0.smithi052.stdout:0/887: sync 2024-09-12T18:03:25.499 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:25.495+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:25.500 INFO:tasks.workunit.client.0.smithi052.stdout:2/886: write da/dc/d15/d20/f95 [714319,24593] 0 2024-09-12T18:03:25.500 INFO:tasks.workunit.client.0.smithi052.stdout:8/999: fdatasync d13/d18/d21/f23 0 2024-09-12T18:03:25.500 INFO:tasks.workunit.client.0.smithi052.stdout:6/984: write d2/fb [435204,67208] 0 2024-09-12T18:03:25.501 INFO:tasks.workunit.client.0.smithi052.stdout:2/887: stat da/d1d/d35/fa8 0 2024-09-12T18:03:25.501 INFO:tasks.workunit.client.0.smithi052.stdout:5/921: rmdir d7/d1c 39 2024-09-12T18:03:25.501 INFO:tasks.workunit.client.0.smithi052.stdout:9/978: mkdir d0/d18/d37/d142 0 2024-09-12T18:03:25.501 INFO:tasks.workunit.client.0.smithi052.stdout:0/888: stat d2/d6/dd/d21/d26/f40 0 2024-09-12T18:03:25.501 INFO:tasks.workunit.client.0.smithi052.stdout:6/985: mkdir d2/d15/dcc/d14d 0 2024-09-12T18:03:25.503 INFO:tasks.workunit.client.0.smithi052.stdout:5/922: getdents d7/d51/dc6 0 2024-09-12T18:03:25.503 INFO:tasks.workunit.client.0.smithi052.stdout:0/889: rmdir d2/d6/dd/d21/d26/d38/d4a/d86 39 2024-09-12T18:03:25.503 INFO:tasks.workunit.client.0.smithi052.stdout:0/890: sync 2024-09-12T18:03:25.504 INFO:tasks.workunit.client.0.smithi052.stdout:9/979: rename d0/d18/f9a to d0/d18/d26/d33/f143 0 2024-09-12T18:03:25.505 INFO:tasks.workunit.client.0.smithi052.stdout:6/986: creat d2/d21/d9f/dd7/de7/d54/dd5/f14e x:0 0 0 2024-09-12T18:03:25.505 INFO:tasks.workunit.client.0.smithi052.stdout:5/923: creat d7/d59/dad/dce/d110/f12b x:0 0 0 2024-09-12T18:03:25.506 INFO:tasks.workunit.client.0.smithi052.stdout:9/980: symlink d0/d6/de1/l144 0 2024-09-12T18:03:25.506 INFO:tasks.workunit.client.0.smithi052.stdout:6/987: stat d2/d21/d6a/d97 0 2024-09-12T18:03:25.506 INFO:tasks.workunit.client.0.smithi052.stdout:7/892: dwrite d6/dc/fba [0,4194304] 0 2024-09-12T18:03:25.506 INFO:tasks.workunit.client.0.smithi052.stdout:1/865: dwrite d3/d1d/d22/f57 [0,4194304] 0 2024-09-12T18:03:25.507 INFO:tasks.workunit.client.0.smithi052.stdout:9/981: chown d0/d6/d3a/d43/dd7 194622328 1 2024-09-12T18:03:25.508 INFO:tasks.workunit.client.0.smithi052.stdout:1/866: chown d3/dcb/d74/d7d/d84/d10e 1104 1 2024-09-12T18:03:25.508 INFO:tasks.workunit.client.0.smithi052.stdout:3/939: dread d0/d4/d25/d2a/d6/d41/f59 [0,4194304] 0 2024-09-12T18:03:25.509 INFO:tasks.workunit.client.0.smithi052.stdout:1/867: creat d3/d69/d89/f126 x:0 0 0 2024-09-12T18:03:25.510 INFO:tasks.workunit.client.0.smithi052.stdout:9/982: getdents d0/d18/d26/d4d 0 2024-09-12T18:03:25.511 INFO:tasks.workunit.client.0.smithi052.stdout:5/924: rename d7/d1f/d34/df2/la0 to d7/d1c/d67/l12c 0 2024-09-12T18:03:25.511 INFO:tasks.workunit.client.0.smithi052.stdout:3/940: truncate d0/d4b/d57/d6d/f77 447072 0 2024-09-12T18:03:25.512 INFO:tasks.workunit.client.0.smithi052.stdout:9/983: mkdir d0/d18/d37/d145 0 2024-09-12T18:03:25.512 INFO:tasks.workunit.client.0.smithi052.stdout:7/893: rename d6/d12/c119 to d6/d12/d1e/de7/c11f 0 2024-09-12T18:03:25.513 INFO:tasks.workunit.client.0.smithi052.stdout:1/868: symlink d3/d1d/d22/d66/df8/l127 0 2024-09-12T18:03:25.514 INFO:tasks.workunit.client.0.smithi052.stdout:9/984: readlink d0/d6/d3a/d43/laa 0 2024-09-12T18:03:25.514 INFO:tasks.workunit.client.0.smithi052.stdout:7/894: chown d6/d12/d1e/d8e/fa9 39066611 1 2024-09-12T18:03:25.514 INFO:tasks.workunit.client.0.smithi052.stdout:0/891: dwrite d2/d6/dd/dd8/f103 [0,4194304] 0 2024-09-12T18:03:25.515 INFO:tasks.workunit.client.0.smithi052.stdout:6/988: dwrite d2/d21/d6a/fee [0,4194304] 0 2024-09-12T18:03:25.518 INFO:tasks.workunit.client.0.smithi052.stdout:3/941: creat d0/d4/d25/d2a/d6/d7/f140 x:0 0 0 2024-09-12T18:03:25.518 INFO:tasks.workunit.client.0.smithi052.stdout:5/925: truncate d7/f8 2494527 0 2024-09-12T18:03:25.518 INFO:tasks.workunit.client.0.smithi052.stdout:9/985: rmdir d0/d6/d3a/d42/d61/d6a/d102 39 2024-09-12T18:03:25.518 INFO:tasks.workunit.client.0.smithi052.stdout:0/892: dread d2/f29 [0,4194304] 0 2024-09-12T18:03:25.519 INFO:tasks.workunit.client.0.smithi052.stdout:6/989: creat d2/d21/d9f/f14f x:0 0 0 2024-09-12T18:03:25.519 INFO:tasks.workunit.client.0.smithi052.stdout:7/895: symlink d6/d12/l120 0 2024-09-12T18:03:25.519 INFO:tasks.workunit.client.0.smithi052.stdout:9/986: fdatasync d0/d18/f9f 0 2024-09-12T18:03:25.519 INFO:tasks.workunit.client.0.smithi052.stdout:5/926: write d7/d1f/d45/ffa [135018,18214] 0 2024-09-12T18:03:25.520 INFO:tasks.workunit.client.0.smithi052.stdout:3/942: symlink d0/d4b/l141 0 2024-09-12T18:03:25.520 INFO:tasks.workunit.client.0.smithi052.stdout:0/893: mkdir d2/d6/dd/d21/d26/d2f/de9/d117 0 2024-09-12T18:03:25.520 INFO:tasks.workunit.client.0.smithi052.stdout:9/987: chown d0/d6/d3a/d42/da9/d106 213 1 2024-09-12T18:03:25.520 INFO:tasks.workunit.client.0.smithi052.stdout:6/990: mknod d2/d21/d9f/dd7/de7/d58/d5d/d107/c150 0 2024-09-12T18:03:25.521 INFO:tasks.workunit.client.0.smithi052.stdout:7/896: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/f121 x:0 0 0 2024-09-12T18:03:25.521 INFO:tasks.workunit.client.0.smithi052.stdout:3/943: unlink d0/d4/d25/fa8 0 2024-09-12T18:03:25.521 INFO:tasks.workunit.client.0.smithi052.stdout:0/894: mkdir d2/d1b/d80/d118 0 2024-09-12T18:03:25.521 INFO:tasks.workunit.client.0.smithi052.stdout:3/944: fsync d0/d4b/d4c/fd5 0 2024-09-12T18:03:25.522 INFO:tasks.workunit.client.0.smithi052.stdout:6/991: mkdir d2/d21/ded/df5/d131/d151 0 2024-09-12T18:03:25.522 INFO:tasks.workunit.client.0.smithi052.stdout:7/897: creat d6/d12/d1e/d29/d5d/d71/d9e/d10b/f122 x:0 0 0 2024-09-12T18:03:25.523 INFO:tasks.workunit.client.0.smithi052.stdout:0/895: write d2/d1b/d80/da3/fdf [4018643,46720] 0 2024-09-12T18:03:25.524 INFO:tasks.workunit.client.0.smithi052.stdout:7/898: creat d6/d12/d1e/d29/d5d/d71/d9e/f123 x:0 0 0 2024-09-12T18:03:25.525 INFO:tasks.workunit.client.0.smithi052.stdout:6/992: getdents d2/d21/ded/df5/d131/d151 0 2024-09-12T18:03:25.526 INFO:tasks.workunit.client.0.smithi052.stdout:5/927: dwrite d7/d1f/d45/fcd [0,4194304] 0 2024-09-12T18:03:25.527 INFO:tasks.workunit.client.0.smithi052.stdout:6/993: truncate d2/d80/fa4 4360472 0 2024-09-12T18:03:25.527 INFO:tasks.workunit.client.0.smithi052.stdout:3/945: link d0/d4/d33/f121 d0/d4/d25/d2a/d6/d7/de/da1/f142 0 2024-09-12T18:03:25.528 INFO:tasks.workunit.client.0.smithi052.stdout:9/988: dwrite d0/d6/d3a/f116 [0,4194304] 0 2024-09-12T18:03:25.529 INFO:tasks.workunit.client.0.smithi052.stdout:1/869: truncate d3/d1d/d22/f57 1694911 0 2024-09-12T18:03:25.530 INFO:tasks.workunit.client.0.smithi052.stdout:6/994: symlink d2/d80/d149/l152 0 2024-09-12T18:03:25.530 INFO:tasks.workunit.client.0.smithi052.stdout:1/870: readlink d3/da2/ddc/de9/l103 0 2024-09-12T18:03:25.530 INFO:tasks.workunit.client.0.smithi052.stdout:1/871: sync 2024-09-12T18:03:25.531 INFO:tasks.workunit.client.0.smithi052.stdout:3/946: mkdir d0/d4/d25/d2a/d2c/d143 0 2024-09-12T18:03:25.531 INFO:tasks.workunit.client.0.smithi052.stdout:7/899: getdents d6/d12 0 2024-09-12T18:03:25.531 INFO:tasks.workunit.client.0.smithi052.stdout:9/989: write d0/d18/d79/da6/f10c [759995,53718] 0 2024-09-12T18:03:25.532 INFO:tasks.workunit.client.0.smithi052.stdout:7/900: symlink d6/dc/d112/l124 0 2024-09-12T18:03:25.533 INFO:tasks.workunit.client.0.smithi052.stdout:6/995: fsync d2/d21/d9f/dd7/de7/d58/d5d/d87/f125 0 2024-09-12T18:03:25.533 INFO:tasks.workunit.client.0.smithi052.stdout:3/947: fdatasync d0/d4/d25/d2a/d6/d7/f140 0 2024-09-12T18:03:25.533 INFO:tasks.workunit.client.0.smithi052.stdout:1/872: mknod d3/d69/d89/dc0/c128 0 2024-09-12T18:03:25.533 INFO:tasks.workunit.client.0.smithi052.stdout:0/896: dwrite d2/d6/dd/d21/d26/d2f/f5e [0,4194304] 0 2024-09-12T18:03:25.534 INFO:tasks.workunit.client.0.smithi052.stdout:9/990: creat d0/d6/d3a/d42/f146 x:0 0 0 2024-09-12T18:03:25.534 INFO:tasks.workunit.client.0.smithi052.stdout:9/991: sync 2024-09-12T18:03:25.534 INFO:tasks.workunit.client.0.smithi052.stdout:7/901: chown d6/d12/d1e/d29/d5d 57423123 1 2024-09-12T18:03:25.535 INFO:tasks.workunit.client.0.smithi052.stdout:1/873: stat d3/d10/d38/d44 0 2024-09-12T18:03:25.535 INFO:tasks.workunit.client.0.smithi052.stdout:7/902: read - d6/d12/d1e/d29/da1/ddf/f115 zero size 2024-09-12T18:03:25.535 INFO:tasks.workunit.client.0.smithi052.stdout:6/996: mkdir d2/d21/d153 0 2024-09-12T18:03:25.536 INFO:tasks.workunit.client.0.smithi052.stdout:9/992: mkdir d0/d18/d37/d87/d147 0 2024-09-12T18:03:25.536 INFO:tasks.workunit.client.0.smithi052.stdout:7/903: write d6/dc/d112/fea [73250,90773] 0 2024-09-12T18:03:25.537 INFO:tasks.workunit.client.0.smithi052.stdout:0/897: creat d2/d6/dd/d21/d26/d65/f119 x:0 0 0 2024-09-12T18:03:25.537 INFO:tasks.workunit.client.0.smithi052.stdout:2/888: dread da/dc/f2b [0,4194304] 0 2024-09-12T18:03:25.538 INFO:tasks.workunit.client.0.smithi052.stdout:6/997: rename d2/d5e/f9d to d2/d80/f154 0 2024-09-12T18:03:25.538 INFO:tasks.workunit.client.0.smithi052.stdout:1/874: fdatasync d3/d10/dc4/d115/f32 0 2024-09-12T18:03:25.538 INFO:tasks.workunit.client.0.smithi052.stdout:3/948: link d0/d4b/d57/d6d/c78 d0/d4/d25/d2a/d6/d7/d34/c144 0 2024-09-12T18:03:25.538 INFO:tasks.workunit.client.0.smithi052.stdout:9/993: rmdir d0/d6/d3a/d42/d61 39 2024-09-12T18:03:25.539 INFO:tasks.workunit.client.0.smithi052.stdout:7/904: truncate d6/d12/d1e/d29/d5d/d71/ff0 443846 0 2024-09-12T18:03:25.539 INFO:tasks.workunit.client.0.smithi052.stdout:2/889: unlink da/d21/c6d 0 2024-09-12T18:03:25.539 INFO:tasks.workunit.client.0.smithi052.stdout:9/994: rmdir d0/d6 39 2024-09-12T18:03:25.539 INFO:tasks.workunit.client.0.smithi052.stdout:0/898: symlink d2/d6/dd/d21/d26/d38/dd0/df2/d113/l11a 0 2024-09-12T18:03:25.540 INFO:tasks.workunit.client.0.smithi052.stdout:6/998: mkdir d2/d21/ded/df5/d131/d151/d155 0 2024-09-12T18:03:25.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/875: truncate d3/d10/d38/d44/fcf 729556 0 2024-09-12T18:03:25.540 INFO:tasks.workunit.client.0.smithi052.stdout:3/949: write d0/d4/d25/d2a/d6/d7/de/f9b [294135,77041] 0 2024-09-12T18:03:25.540 INFO:tasks.workunit.client.0.smithi052.stdout:2/890: fsync da/dc/d15/da6/df1/f114 0 2024-09-12T18:03:25.541 INFO:tasks.workunit.client.0.smithi052.stdout:1/876: write d3/d1d/d22/d27/f81 [2784021,62404] 0 2024-09-12T18:03:25.541 INFO:tasks.workunit.client.0.smithi052.stdout:9/995: creat d0/d6/d3a/d42/d113/f148 x:0 0 0 2024-09-12T18:03:25.541 INFO:tasks.workunit.client.0.smithi052.stdout:7/905: mknod d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/c125 0 2024-09-12T18:03:25.542 INFO:tasks.workunit.client.0.smithi052.stdout:3/950: symlink d0/d4/d11d/l145 0 2024-09-12T18:03:25.543 INFO:tasks.workunit.client.0.smithi052.stdout:7/906: rename d6/d12/d1e/de7/f10e to d6/d12/d17/f126 0 2024-09-12T18:03:25.543 INFO:tasks.workunit.client.0.smithi052.stdout:9/996: getdents d0/d18/d26/d4d/d54 0 2024-09-12T18:03:25.543 INFO:tasks.workunit.client.0.smithi052.stdout:7/907: symlink d6/d9b/l127 0 2024-09-12T18:03:25.544 INFO:tasks.workunit.client.0.smithi052.stdout:9/997: fsync d0/da3/db8/f5f 0 2024-09-12T18:03:25.545 INFO:tasks.workunit.client.0.smithi052.stdout:7/908: stat d6/d12/d1e/d29/d5d/f102 0 2024-09-12T18:03:25.548 INFO:tasks.workunit.client.0.smithi052.stdout:9/998: creat d0/d18/d37/d87/d147/f149 x:0 0 0 2024-09-12T18:03:25.548 INFO:tasks.workunit.client.0.smithi052.stdout:6/999: dwrite d2/d21/f4c [4194304,4194304] 0 2024-09-12T18:03:25.550 INFO:tasks.workunit.client.0.smithi052.stdout:5/928: fsync d7/d1f/d45/fcd 0 2024-09-12T18:03:25.550 INFO:tasks.workunit.client.0.smithi052.stdout:2/891: dwrite da/dc/d15/d22/d87/dc5/ffe [0,4194304] 0 2024-09-12T18:03:25.550 INFO:tasks.workunit.client.0.smithi052.stdout:7/909: mkdir d6/d12/d1e/d29/d5d/d71/d3a/d83/d128 0 2024-09-12T18:03:25.551 INFO:tasks.workunit.client.0.smithi052.stdout:3/951: dwrite d0/d4b/d4c/fd5 [4194304,4194304] 0 2024-09-12T18:03:25.554 INFO:tasks.workunit.client.0.smithi052.stdout:2/892: creat da/dc/d15/d43/d109/f12c x:0 0 0 2024-09-12T18:03:25.554 INFO:tasks.workunit.client.0.smithi052.stdout:9/999: getdents d0/d18/d37/d87/d72/df6/d11e/d12b 0 2024-09-12T18:03:25.554 INFO:tasks.workunit.client.0.smithi052.stdout:7/910: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/f129 x:0 0 0 2024-09-12T18:03:25.555 INFO:tasks.workunit.client.0.smithi052.stdout:2/893: write da/d1d/d35/f3f [4548820,107030] 0 2024-09-12T18:03:25.555 INFO:tasks.workunit.client.0.smithi052.stdout:7/911: write d6/f3c [3142367,114854] 0 2024-09-12T18:03:25.557 INFO:tasks.workunit.client.0.smithi052.stdout:0/899: dwrite d2/d8/f1c [0,4194304] 0 2024-09-12T18:03:25.557 INFO:tasks.workunit.client.0.smithi052.stdout:7/912: rename d6/dc/f34 to d6/dc/d112/f12a 0 2024-09-12T18:03:25.558 INFO:tasks.workunit.client.0.smithi052.stdout:0/900: rename d2/c5 to d2/d6/dd/d21/c11b 0 2024-09-12T18:03:25.558 INFO:tasks.workunit.client.0.smithi052.stdout:7/913: mknod d6/d12/d1e/d29/da1/d103/c12b 0 2024-09-12T18:03:25.558 INFO:tasks.workunit.client.0.smithi052.stdout:0/901: write d2/d6/f94 [1978859,44701] 0 2024-09-12T18:03:25.565 INFO:tasks.workunit.client.0.smithi052.stdout:0/902: dwrite d2/d6/dd/d21/d26/d65/f7d [0,4194304] 0 2024-09-12T18:03:25.567 INFO:tasks.workunit.client.0.smithi052.stdout:0/903: creat d2/d57/f11c x:0 0 0 2024-09-12T18:03:25.568 INFO:tasks.workunit.client.0.smithi052.stdout:5/929: dwrite d7/d59/fb2 [0,4194304] 0 2024-09-12T18:03:25.568 INFO:tasks.workunit.client.0.smithi052.stdout:0/904: mkdir d2/d6/d11d 0 2024-09-12T18:03:25.569 INFO:tasks.workunit.client.0.smithi052.stdout:0/905: creat d2/d1b/d72/d69/f11e x:0 0 0 2024-09-12T18:03:25.576 INFO:tasks.workunit.client.0.smithi052.stdout:2/894: dread da/dc/d15/d22/f9d [0,4194304] 0 2024-09-12T18:03:25.579 INFO:tasks.workunit.client.0.smithi052.stdout:0/906: dread d2/d6/dd/d21/d47/f58 [0,4194304] 0 2024-09-12T18:03:25.582 INFO:tasks.workunit.client.0.smithi052.stdout:0/907: rename d2/d1b/d72/d69/faf to d2/d1b/d80/d118/f11f 0 2024-09-12T18:03:25.583 INFO:tasks.workunit.client.0.smithi052.stdout:2/895: dwrite da/dc/d15/d20/d60/f70 [0,4194304] 0 2024-09-12T18:03:25.583 INFO:tasks.workunit.client.0.smithi052.stdout:0/908: fdatasync d2/d6/dd/d21/d26/d2f/f96 0 2024-09-12T18:03:25.584 INFO:tasks.workunit.client.0.smithi052.stdout:0/909: rmdir d2/d1b 39 2024-09-12T18:03:25.584 INFO:tasks.workunit.client.0.smithi052.stdout:2/896: symlink da/dc/d15/d20/l12d 0 2024-09-12T18:03:25.585 INFO:tasks.workunit.client.0.smithi052.stdout:2/897: fdatasync da/d1d/daa/f12a 0 2024-09-12T18:03:25.586 INFO:tasks.workunit.client.0.smithi052.stdout:0/910: creat d2/d8/dee/f120 x:0 0 0 2024-09-12T18:03:25.586 INFO:tasks.workunit.client.0.smithi052.stdout:2/898: mkdir da/dc/d15/d12e 0 2024-09-12T18:03:25.586 INFO:tasks.workunit.client.0.smithi052.stdout:1/877: dread d3/dcb/d74/f91 [4194304,4194304] 0 2024-09-12T18:03:25.587 INFO:tasks.workunit.client.0.smithi052.stdout:2/899: write da/d1d/d35/f31 [3457561,87577] 0 2024-09-12T18:03:25.588 INFO:tasks.workunit.client.0.smithi052.stdout:3/952: dread d0/d4b/d4c/d6b/d117/dc7/de0/fe3 [0,4194304] 0 2024-09-12T18:03:25.588 INFO:tasks.workunit.client.0.smithi052.stdout:1/878: mknod d3/dcb/d74/d7d/d84/d10e/c129 0 2024-09-12T18:03:25.590 INFO:tasks.workunit.client.0.smithi052.stdout:7/914: dread d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/fce [0,4194304] 0 2024-09-12T18:03:25.590 INFO:tasks.workunit.client.0.smithi052.stdout:3/953: write d0/d4b/d4c/d6b/d117/dc7/ff7 [981795,9843] 0 2024-09-12T18:03:25.591 INFO:tasks.workunit.client.0.smithi052.stdout:1/879: link d3/d1d/d72/f9e d3/d10/f12a 0 2024-09-12T18:03:25.591 INFO:tasks.workunit.client.0.smithi052.stdout:7/915: chown d6/d12/d1e/c11c 29894300 1 2024-09-12T18:03:25.592 INFO:tasks.workunit.client.0.smithi052.stdout:3/954: symlink d0/d4/d25/l146 0 2024-09-12T18:03:25.593 INFO:tasks.workunit.client.0.smithi052.stdout:0/911: dwrite d2/d8/fa8 [0,4194304] 0 2024-09-12T18:03:25.593 INFO:tasks.workunit.client.0.smithi052.stdout:3/955: unlink d0/d4/f11c 0 2024-09-12T18:03:25.593 INFO:tasks.workunit.client.0.smithi052.stdout:1/880: chown d3/d1d/d22/d3f/c48 1052185383 1 2024-09-12T18:03:25.593 INFO:tasks.workunit.client.0.smithi052.stdout:7/916: fdatasync d6/d12/d1e/d29/f67 0 2024-09-12T18:03:25.593 INFO:tasks.workunit.client.0.smithi052.stdout:2/900: dread da/d1d/d35/f31 [0,4194304] 0 2024-09-12T18:03:25.594 INFO:tasks.workunit.client.0.smithi052.stdout:3/956: write d0/d16/f1e [4884231,122867] 0 2024-09-12T18:03:25.594 INFO:tasks.workunit.client.0.smithi052.stdout:1/881: write d3/d1d/d22/d76/fb7 [2747274,62119] 0 2024-09-12T18:03:25.595 INFO:tasks.workunit.client.0.smithi052.stdout:0/912: rename d2/d1b/d80/da3/ffb to d2/d1b/d72/d8d/f121 0 2024-09-12T18:03:25.595 INFO:tasks.workunit.client.0.smithi052.stdout:1/882: write d3/d1d/d22/d76/fb7 [3043637,58713] 0 2024-09-12T18:03:25.596 INFO:tasks.workunit.client.0.smithi052.stdout:7/917: read d6/d12/d1e/d29/d5d/d71/d9e/fc9 [152324,3058] 0 2024-09-12T18:03:25.598 INFO:tasks.workunit.client.0.smithi052.stdout:1/883: creat d3/d1d/d22/d3f/db0/f12b x:0 0 0 2024-09-12T18:03:25.599 INFO:tasks.workunit.client.0.smithi052.stdout:0/913: mknod d2/d6/dd/d21/d26/d38/d4a/d86/c122 0 2024-09-12T18:03:25.599 INFO:tasks.workunit.client.0.smithi052.stdout:7/918: fsync d6/d12/d1e/d29/d5d/d71/d3a/d8f/da8/fb4 0 2024-09-12T18:03:25.600 INFO:tasks.workunit.client.0.smithi052.stdout:1/884: creat d3/d1d/d83/de3/f12c x:0 0 0 2024-09-12T18:03:25.600 INFO:tasks.workunit.client.0.smithi052.stdout:0/914: write d2/d1b/d80/da3/fdf [2416230,123438] 0 2024-09-12T18:03:25.600 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:25.595+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:25.601 INFO:tasks.workunit.client.0.smithi052.stdout:1/885: getdents d3/d1d/d11e 0 2024-09-12T18:03:25.602 INFO:tasks.workunit.client.0.smithi052.stdout:3/957: dwrite d0/d4/f28 [0,4194304] 0 2024-09-12T18:03:25.605 INFO:tasks.workunit.client.0.smithi052.stdout:7/919: dread d6/d12/d1e/d8e/f92 [0,4194304] 0 2024-09-12T18:03:25.605 INFO:tasks.workunit.client.0.smithi052.stdout:3/958: getdents d0/d4/d25/d2a/d6/d7/d79/de1 0 2024-09-12T18:03:25.605 INFO:tasks.workunit.client.0.smithi052.stdout:5/930: sync 2024-09-12T18:03:25.606 INFO:tasks.workunit.client.0.smithi052.stdout:7/920: chown d6/c37 2140 1 2024-09-12T18:03:25.606 INFO:tasks.workunit.client.0.smithi052.stdout:5/931: creat d7/d59/dbe/f12d x:0 0 0 2024-09-12T18:03:25.606 INFO:tasks.workunit.client.0.smithi052.stdout:3/959: mknod d0/d4/d25/d2a/d2c/dec/d11e/c147 0 2024-09-12T18:03:25.607 INFO:tasks.workunit.client.0.smithi052.stdout:7/921: write d6/d9b/fcd [518087,128201] 0 2024-09-12T18:03:25.608 INFO:tasks.workunit.client.0.smithi052.stdout:7/922: readlink d6/d12/l69 0 2024-09-12T18:03:25.608 INFO:tasks.workunit.client.0.smithi052.stdout:1/886: dwrite d3/d10/f26 [0,4194304] 0 2024-09-12T18:03:25.608 INFO:tasks.workunit.client.0.smithi052.stdout:3/960: fdatasync d0/d16/d7c/d85/d111/f13d 0 2024-09-12T18:03:25.611 INFO:tasks.workunit.client.0.smithi052.stdout:7/923: fsync d6/d12/d1e/d29/d5d/f28 0 2024-09-12T18:03:25.611 INFO:tasks.workunit.client.0.smithi052.stdout:3/961: rename d0/d4/d25/d2a/f32 to d0/d16/d7c/d85/d111/f148 0 2024-09-12T18:03:25.613 INFO:tasks.workunit.client.0.smithi052.stdout:7/924: chown d6/d12/d1e/d29/d5d/d71/f42 1069 1 2024-09-12T18:03:25.613 INFO:tasks.workunit.client.0.smithi052.stdout:5/932: dwrite d7/d1c/dff/f122 [0,4194304] 0 2024-09-12T18:03:25.614 INFO:tasks.workunit.client.0.smithi052.stdout:1/887: dwrite d3/d10/f33 [0,4194304] 0 2024-09-12T18:03:25.614 INFO:tasks.workunit.client.0.smithi052.stdout:7/925: mkdir d6/d12/d1e/d29/d5d/d71/d12c 0 2024-09-12T18:03:25.615 INFO:tasks.workunit.client.0.smithi052.stdout:1/888: chown d3/d1d/d22/d3f/l58 19185 1 2024-09-12T18:03:25.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/901: dread da/dc/d15/f3c [0,4194304] 0 2024-09-12T18:03:25.620 INFO:tasks.workunit.client.0.smithi052.stdout:2/902: creat da/d21/f12f x:0 0 0 2024-09-12T18:03:25.620 INFO:tasks.workunit.client.0.smithi052.stdout:7/926: dwrite d6/dc/f30 [4194304,4194304] 0 2024-09-12T18:03:25.622 INFO:tasks.workunit.client.0.smithi052.stdout:2/903: mkdir da/d1d/d35/d130 0 2024-09-12T18:03:25.623 INFO:tasks.workunit.client.0.smithi052.stdout:7/927: mkdir d6/d12/d1e/d29/d5d/d71/d9e/d12d 0 2024-09-12T18:03:25.623 INFO:tasks.workunit.client.0.smithi052.stdout:0/915: dread d2/d57/d5b/db9/f104 [0,4194304] 0 2024-09-12T18:03:25.624 INFO:tasks.workunit.client.0.smithi052.stdout:7/928: stat d6/d12/d1e/d29/da1/ddf 0 2024-09-12T18:03:25.624 INFO:tasks.workunit.client.0.smithi052.stdout:2/904: rmdir da/dc/d15/d20/da5 39 2024-09-12T18:03:25.624 INFO:tasks.workunit.client.0.smithi052.stdout:0/916: readlink d2/d1b/d80/da3/l106 0 2024-09-12T18:03:25.625 INFO:tasks.workunit.client.0.smithi052.stdout:2/905: rmdir da/dc/d15/d43/d109 39 2024-09-12T18:03:25.625 INFO:tasks.workunit.client.0.smithi052.stdout:7/929: mkdir d6/d12/d1e/d29/da1/ddf/d12e 0 2024-09-12T18:03:25.625 INFO:tasks.workunit.client.0.smithi052.stdout:0/917: creat d2/d1b/d80/da3/f123 x:0 0 0 2024-09-12T18:03:25.626 INFO:tasks.workunit.client.0.smithi052.stdout:7/930: chown d6/d12/d1e/d29/d5d/f78 30540972 1 2024-09-12T18:03:25.626 INFO:tasks.workunit.client.0.smithi052.stdout:2/906: getdents da/dc/d15 0 2024-09-12T18:03:25.626 INFO:tasks.workunit.client.0.smithi052.stdout:3/962: dwrite d0/d4/d33/f121 [0,4194304] 0 2024-09-12T18:03:25.632 INFO:tasks.workunit.client.0.smithi052.stdout:2/907: dread da/dc/d15/d20/d60/f70 [0,4194304] 0 2024-09-12T18:03:25.634 INFO:tasks.workunit.client.0.smithi052.stdout:2/908: dread da/dc/f2b [0,4194304] 0 2024-09-12T18:03:25.636 INFO:tasks.workunit.client.0.smithi052.stdout:7/931: write d6/d12/d1e/d29/d5d/d71/d9e/fc9 [1202535,78697] 0 2024-09-12T18:03:25.637 INFO:tasks.workunit.client.0.smithi052.stdout:7/932: readlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/leb 0 2024-09-12T18:03:25.638 INFO:tasks.workunit.client.0.smithi052.stdout:7/933: mknod d6/d12/d1e/d29/d5d/d71/d3a/dfb/c12f 0 2024-09-12T18:03:25.639 INFO:tasks.workunit.client.0.smithi052.stdout:7/934: write d6/d12/d1e/d29/fa6 [4099270,1397] 0 2024-09-12T18:03:25.640 INFO:tasks.workunit.client.0.smithi052.stdout:7/935: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/f130 x:0 0 0 2024-09-12T18:03:25.646 INFO:tasks.workunit.client.0.smithi052.stdout:7/936: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/f129 [0,4194304] 0 2024-09-12T18:03:25.647 INFO:tasks.workunit.client.0.smithi052.stdout:7/937: write d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/fda [820324,30949] 0 2024-09-12T18:03:25.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/963: dread d0/d4/d25/d2a/d6/d7/f74 [0,4194304] 0 2024-09-12T18:03:25.649 INFO:tasks.workunit.client.0.smithi052.stdout:7/938: creat d6/d12/d1e/dae/f131 x:0 0 0 2024-09-12T18:03:25.650 INFO:tasks.workunit.client.0.smithi052.stdout:7/939: fdatasync d6/d12/d1e/d8e/dcb/fe2 0 2024-09-12T18:03:25.650 INFO:tasks.workunit.client.0.smithi052.stdout:7/940: rename d6/dc/d1a/ff2 to d6/d12/f132 0 2024-09-12T18:03:25.651 INFO:tasks.workunit.client.0.smithi052.stdout:7/941: fdatasync d6/d9b/fa7 0 2024-09-12T18:03:25.656 INFO:tasks.workunit.client.0.smithi052.stdout:3/964: write d0/d4b/d4c/d6b/fbf [1410210,65855] 0 2024-09-12T18:03:25.657 INFO:tasks.workunit.client.0.smithi052.stdout:7/942: readlink d6/d12/d1e/d29/d5d/d71/l3e 0 2024-09-12T18:03:25.658 INFO:tasks.workunit.client.0.smithi052.stdout:3/965: rename d0/d4b/d4c/d6b/d48/l5e to d0/d4/d25/d2a/d6/d7/dab/l149 0 2024-09-12T18:03:25.658 INFO:tasks.workunit.client.0.smithi052.stdout:3/966: creat d0/d4/d25/d2a/d2c/da9/db8/f14a x:0 0 0 2024-09-12T18:03:25.659 INFO:tasks.workunit.client.0.smithi052.stdout:3/967: symlink d0/d16/l14b 0 2024-09-12T18:03:25.660 INFO:tasks.workunit.client.0.smithi052.stdout:3/968: write d0/d4/d25/d2a/f55 [488585,90497] 0 2024-09-12T18:03:25.661 INFO:tasks.workunit.client.0.smithi052.stdout:7/943: dread d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/fc6 [0,4194304] 0 2024-09-12T18:03:25.662 INFO:tasks.workunit.client.0.smithi052.stdout:7/944: creat d6/d12/d1e/d29/f133 x:0 0 0 2024-09-12T18:03:25.663 INFO:tasks.workunit.client.0.smithi052.stdout:7/945: mkdir d6/dc/d1a/d6a/d134 0 2024-09-12T18:03:25.663 INFO:tasks.workunit.client.0.smithi052.stdout:7/946: fsync d6/d12/d1e/d29/d5d/f102 0 2024-09-12T18:03:25.664 INFO:tasks.workunit.client.0.smithi052.stdout:1/889: sync 2024-09-12T18:03:25.664 INFO:tasks.workunit.client.0.smithi052.stdout:5/933: sync 2024-09-12T18:03:25.664 INFO:tasks.workunit.client.0.smithi052.stdout:0/918: sync 2024-09-12T18:03:25.664 INFO:tasks.workunit.client.0.smithi052.stdout:2/909: sync 2024-09-12T18:03:25.665 INFO:tasks.workunit.client.0.smithi052.stdout:5/934: mkdir d7/d59/dad/d100/d12e 0 2024-09-12T18:03:25.665 INFO:tasks.workunit.client.0.smithi052.stdout:3/969: dread d0/d4/d25/d2a/d6/d7/d34/d72/d83/de2/f12c [0,4194304] 0 2024-09-12T18:03:25.666 INFO:tasks.workunit.client.0.smithi052.stdout:2/910: write da/dc/d15/d20/d60/f70 [1518480,8596] 0 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.6102602170000004, 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:25.667 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:25.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:25.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:25.674 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10795 4.22 4:4414d34e:::1000000315b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7122426329999998, 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03153454, 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.675 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10795 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952771+0000", 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9290000000000001e-06 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960575+0000", 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078039479999999998 2024-09-12T18:03:25.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960595+0000", 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9644e-05 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960609+0000", 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4246999999999999e-05 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960772+0000", 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016263000000000001 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960936+0000", 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016446899999999999 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.961298+0000", 2024-09-12T18:03:25.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036151899999999998 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.981362+0000", 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020064015000000001 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984110+0000", 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00274852 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984227+0000", 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116267 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984304+0000", 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7352000000000001e-05 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11134 4.30 4:0ea0a8b4:::10000003186.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.1546415760000004, 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037582955000000001, 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11134 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.682 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000001e-07 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518086+0000", 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077143059999999998 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518103+0000", 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7441000000000001e-05 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518116+0000", 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2573e-05 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518192+0000", 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-12T18:03:25.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518319+0000", 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012724599999999999 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518439+0000", 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119436 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.527060+0000", 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086211320000000001 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547881+0000", 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02082063 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547921+0000", 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0411999999999999e-05 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547954+0000", 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2583000000000003e-05 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11524 4.1a 4:5913b086:::1000000336d.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.106207+0000", 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.5588052860000001, 2024-09-12T18:03:25.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030262587000000001, 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11524 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.106207+0000", 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.106207+0000", 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.106210+0000", 2024-09-12T18:03:25.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9069999999999999e-06 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.116601+0000", 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010391068999999999 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.116616+0000", 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.526e-05 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.116626+0000", 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0319000000000001e-05 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.116727+0000", 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010092199999999999 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.116980+0000", 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025215699999999998 2024-09-12T18:03:25.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.117263+0000", 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028353100000000001 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.125200+0000", 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079369460000000003 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.136349+0000", 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0111489 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.136421+0000", 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2074000000000001e-05 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.136469+0000", 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8501999999999997e-05 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.694 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11577 4.35 4:acdeb9c5:::1000000332a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4993609509999999, 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032699999, 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11577 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165652+0000", 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0920000000000001e-06 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175860+0000", 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010207233 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175874+0000", 2024-09-12T18:03:25.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4229999999999999e-05 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175882+0000", 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7330000000000003e-06 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175941+0000", 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8996000000000002e-05 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176090+0000", 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014994800000000001 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176209+0000", 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118825 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.184925+0000", 2024-09-12T18:03:25.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008715558 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198295+0000", 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013369804000000001 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198327+0000", 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1942e-05 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198351+0000", 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14036 4.31 4:8eca8ddf:::100000031b8.00000000:head [write 0~4194304 [4@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.4005106899999999, 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034286130999999997, 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.701 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14036 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264505+0000", 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0570000000000001e-06 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273393+0000", 2024-09-12T18:03:25.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088884240000000007 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273426+0000", 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3256999999999997e-05 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273441+0000", 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4445e-05 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273550+0000", 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010887099999999999 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273689+0000", 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139178 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273844+0000", 2024-09-12T18:03:25.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155291 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.282512+0000", 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086676940000000001 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298736+0000", 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016224160000000001 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298766+0000", 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9961e-05 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298788+0000", 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1793e-05 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14099 4.18 4:18c6d816:::10000003304.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:25.707 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.3221499729999999, 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031590162999999997, 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14099 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342865+0000", 2024-09-12T18:03:25.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.74e-06 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350699+0000", 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078345069999999992 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350738+0000", 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.837e-05 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350757+0000", 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9519000000000001e-05 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350912+0000", 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015452099999999999 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351291+0000", 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037953800000000001 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351691+0000", 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000399379 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.362505+0000", 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010814503 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374285+0000", 2024-09-12T18:03:25.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011780135000000001 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374369+0000", 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3429000000000004e-05 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374452+0000", 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3522000000000004e-05 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.713 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14111 4.a 4:530380b1:::10000003584.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.301390729, 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032405549999999998, 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.714 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14111 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363624+0000", 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3329999999999999e-06 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369957+0000", 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063336720000000003 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369986+0000", 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8269e-05 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370001+0000", 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-05 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370257+0000", 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025585799999999998 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370536+0000", 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027879400000000001 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370979+0000", 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044307100000000001 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.380399+0000", 2024-09-12T18:03:25.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094193109999999997 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395936+0000", 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01553759 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395987+0000", 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1249999999999999e-05 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.396027+0000", 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9651999999999999e-05 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14165 4.32 4:4ea4de87:::100000037a0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.2266495019999999, 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030909196, 2024-09-12T18:03:25.720 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14165 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438365+0000", 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0540000000000002e-06 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446256+0000", 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078916520000000007 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446295+0000", 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000003e-05 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446311+0000", 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6696000000000001e-05 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446418+0000", 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010707199999999999 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446610+0000", 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019208499999999999 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446827+0000", 2024-09-12T18:03:25.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216939 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.452206+0000", 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053787210000000004 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469114+0000", 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016907493999999999 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469196+0000", 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2237999999999994e-05 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469272+0000", 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6114999999999999e-05 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14176 4.5 4:a36cb72d:::10000003716.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:25.726 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.2183861060000001, 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.040437328000000002, 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14176 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446629+0000", 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.429e-06 2024-09-12T18:03:25.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460229+0000", 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013600736 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460276+0000", 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6721999999999998e-05 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460297+0000", 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1308999999999999e-05 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460554+0000", 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025637199999999999 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460983+0000", 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042940099999999999 2024-09-12T18:03:25.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.461353+0000", 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036966199999999999 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.484975+0000", 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023622647 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486801+0000", 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00182548 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486933+0000", 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013208800000000001 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.487063+0000", 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013048199999999999 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.732 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14374 4.38 4:1dead311:::10000003395.00000000:head [write 0~4194304 [2@357324]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.99500584199999997, 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039429224999999998, 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.733 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14374 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670009+0000", 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.497e-06 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682349+0000", 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012339785000000001 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682387+0000", 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8633000000000001e-05 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682404+0000", 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7005999999999999e-05 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682514+0000", 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010951900000000001 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682649+0000", 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013563799999999999 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682836+0000", 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186424 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.701541+0000", 2024-09-12T18:03:25.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018705016000000001 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709313+0000", 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077725889999999999 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709392+0000", 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8860000000000001e-05 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709436+0000", 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14734 4.32 4:4f3042f2:::1000000322e.00000000:head [write 0~4194304 [3@261943]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.60359224099999997, 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033021488000000002, 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.739 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14734 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061421+0000", 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069604+0000", 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081825100000000005 2024-09-12T18:03:25.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069626+0000", 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2849000000000001e-05 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069645+0000", 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8926000000000001e-05 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069736+0000", 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0107999999999999e-05 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069861+0000", 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125704 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.070200+0000", 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000338308 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.080698+0000", 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010498182 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094351+0000", 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013653168 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094404+0000", 2024-09-12T18:03:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3424999999999998e-05 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094441+0000", 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7131000000000001e-05 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14827 4.8 e52/17 4:1171651b:::100000030fc.00000001:head v 52'208, mlcod=52'206)", 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:25.745 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.43302975199999999, 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032040617, 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231983+0000", 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.16e-07 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239015+0000", 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070313540000000001 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239054+0000", 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9675000000000002e-05 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239070+0000", 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239237+0000", 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016739399999999999 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239285+0000", 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7500999999999998e-05 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.263984+0000", 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024699115000000001 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264023+0000", 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9431999999999998e-05 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14831 4.18 4:19f6b122:::1000000364a.00000000:head [write 0~4194304 [2@3284618]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.43104947399999999, 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03242449, 2024-09-12T18:03:25.750 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14831 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233964+0000", 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8700000000000004e-07 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242877+0000", 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089131509999999994 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242914+0000", 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7376999999999998e-05 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242929+0000", 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4728e-05 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252348+0000", 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094188910000000004 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252475+0000", 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126735 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252712+0000", 2024-09-12T18:03:25.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000237075 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264747+0000", 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012034977000000001 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266308+0000", 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015612130000000001 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266348+0000", 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0278999999999998e-05 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266387+0000", 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9076999999999999e-05 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14964 4.22 4:442ef67f:::10000003341.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.28527636000000001, 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030833801000000001, 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14964 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.757 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379737+0000", 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386729+0000", 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069922450000000002 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386748+0000", 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:25.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386759+0000", 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1522000000000001e-05 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386849+0000", 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0255999999999998e-05 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386982+0000", 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013296400000000001 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.387166+0000", 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018323100000000001 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.395195+0000", 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080296380000000004 2024-09-12T18:03:25.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410331+0000", 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01513607 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410451+0000", 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119546 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410570+0000", 2024-09-12T18:03:25.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118687 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14971 4.e 4:73867252:::1000000382a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.27234561299999999, 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031669396000000002, 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.763 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14971 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392668+0000", 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.629e-06 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399618+0000", 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069498049999999999 2024-09-12T18:03:25.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399636+0000", 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8045000000000001e-05 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399647+0000", 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0482000000000001e-05 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399738+0000", 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1737999999999995e-05 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399886+0000", 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014755700000000001 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.400110+0000", 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224565 2024-09-12T18:03:25.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408175+0000", 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080649520000000002 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424146+0000", 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015970997000000001 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424205+0000", 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8638999999999999e-05 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424336+0000", 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130987 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14973 4.13 4:c81d059c:::100000038e4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.769 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.26533820600000002, 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032659724000000001, 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14973 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399676+0000", 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:25.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404945+0000", 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052687569999999998 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404964+0000", 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404979+0000", 2024-09-12T18:03:25.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5290000000000001e-05 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405106+0000", 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127126 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405251+0000", 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014441200000000001 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405392+0000", 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014160600000000001 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.414573+0000", 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091801000000000001 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432244+0000", 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017671630000000001 2024-09-12T18:03:25.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432295+0000", 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0729000000000002e-05 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432334+0000", 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8773999999999998e-05 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14978 4.22 4:4562f5e1:::10000003754.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.25633678999999998, 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.049933508000000001, 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.776 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14978 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408677+0000", 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3489999999999999e-06 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416648+0000", 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079712930000000008 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416680+0000", 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2005999999999998e-05 2024-09-12T18:03:25.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416698+0000", 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416815+0000", 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011641099999999999 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417000+0000", 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018498000000000001 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417272+0000", 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027257699999999998 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.429341+0000", 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012068314 2024-09-12T18:03:25.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458491+0000", 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029150250999999999 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458553+0000", 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2539999999999994e-05 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458609+0000", 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5461999999999999e-05 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14990 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.23853252599999999, 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032296710999999999, 2024-09-12T18:03:25.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14990 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426481+0000", 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.433997+0000", 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075159520000000002 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434013+0000", 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5702e-05 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434021+0000", 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434090+0000", 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9029000000000006e-05 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434202+0000", 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011158999999999999 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434358+0000", 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001562 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.442632+0000", 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082736500000000004 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458688+0000", 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016056844000000001 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458737+0000", 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8204999999999997e-05 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458776+0000", 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9789000000000001e-05 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.788 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15095 4.e 4:7041e79b:::10000003456.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.109121328, 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032716585999999999, 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:25.789 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15095 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:25.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555892+0000", 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564584+0000", 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086921359999999996 2024-09-12T18:03:25.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564596+0000", 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1704e-05 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564602+0000", 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1079999999999998e-06 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:25.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564695+0000", 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3370999999999998e-05 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564964+0000", 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026938500000000002 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.565178+0000", 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021372200000000001 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.571064+0000", 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058862769999999997 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588548+0000", 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017483561000000002 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:25.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588582+0000", 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4436e-05 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588607+0000", 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5006000000000001e-05 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:25.795 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:25.797 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:25.793+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:25.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:25.816 INFO:tasks.workunit.client.0.smithi052.stdout:3/970: truncate d0/d4/d25/d2a/d6/d7/f2b 5103325 0 2024-09-12T18:03:25.816 INFO:tasks.workunit.client.0.smithi052.stdout:0/919: getdents d2/d8 0 2024-09-12T18:03:25.816 INFO:tasks.workunit.client.0.smithi052.stdout:3/971: chown d0/d4/d25/d2a/d6/dcc/cea 5920119 1 2024-09-12T18:03:25.816 INFO:tasks.workunit.client.0.smithi052.stdout:1/890: dwrite d3/dcb/f80 [0,4194304] 0 2024-09-12T18:03:25.816 INFO:tasks.workunit.client.0.smithi052.stdout:1/891: getdents d3/d1d/d83/d8f 0 2024-09-12T18:03:25.816 INFO:tasks.workunit.client.0.smithi052.stdout:1/892: symlink d3/d1d/d83/de3/l12d 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/893: chown d3/dcb/d74/d7d/d102/l124 32921 1 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/894: rmdir d3 39 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/895: read d3/fb3 [2315231,123587] 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/896: write d3/d1d/d22/d27/f5c [3992646,66928] 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/897: write d3/dcb/d74/d7d/d84/f96 [4002771,13914] 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/898: truncate d3/dcb/d74/f10b 1275994 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:7/947: dread d6/d12/d17/dac/fd9 [0,4194304] 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:7/948: read d6/dc/fba [3180483,119273] 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:7/949: write d6/d9b/fcd [1359781,77085] 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:2/911: dread da/d71/fb0 [0,4194304] 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:1/899: read d3/da2/dbe/fc9 [1332065,123888] 0 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi052.stdout:2/912: mkdir da/d1d/daa/d131 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/900: write d3/d1d/d22/f30 [5565774,31546] 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/913: unlink da/d2c/f3b 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/901: rmdir d3/dcb/d74/d7d/d84/d10e 39 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/902: read - d3/d10/d38/d44/f123 zero size 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/914: unlink da/dc/d15/da6/df1/c11b 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/903: stat d3/d1d/d22/d66/cf9 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/915: rmdir da/dc/d15/d20/d60/ded 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/904: creat d3/d10/d38/d8b/f12e x:0 0 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/916: link da/dc/d76/fb5 da/d1d/d35/d7a/f132 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/905: getdents d3/d10/d38/d44/d49 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/917: symlink da/d2c/l133 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:7/950: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/ffd [4194304,4194304] 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/906: write d3/dcb/d74/d7d/d102/f10f [971031,70151] 0 2024-09-12T18:03:25.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/918: write da/dc/d15/d22/d87/fc6 [5164429,116600] 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/919: read - da/dc/d15/d22/f116 zero size 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:7/951: mkdir d6/d12/d1e/d29/d5d/d71/d9e/d135 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/920: creat da/d1d/daa/d131/f134 x:0 0 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/921: creat da/dc/d15/d22/d87/dc3/f135 x:0 0 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:7/952: read d6/dc/d1a/d6a/f8b [88042,114751] 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/922: creat da/dc/d15/d20/d60/d6e/f136 x:0 0 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:7/953: mkdir d6/d12/d1e/d29/d5d/d71/d9e/d135/d136 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/923: stat da/dc/d15/da6/dbb/f7f 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/924: mkdir da/d1d/daa/d131/d137 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/925: mkdir da/dc/d15/da6/d138 0 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:2/926: chown da/d2c/dbf/l10a 9338799 1 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi052.stdout:5/935: sync 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:0/920: sync 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:3/972: sync 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:2/927: creat da/dc/d76/dc4/f139 x:0 0 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:5/936: fsync d7/d1c/d67/fa8 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:0/921: write d2/f4f [2465727,24399] 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:3/973: fsync d0/d4b/d57/f7d 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:2/928: mkdir da/d1d/dd9/d13a 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:0/922: fsync d2/d51/fc5 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:2/929: mknod da/d1d/dd9/c13b 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:5/937: creat d7/d1c/d67/dfd/f12f x:0 0 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:3/974: symlink d0/d4/d25/l14c 0 2024-09-12T18:03:25.820 INFO:tasks.workunit.client.0.smithi052.stdout:7/954: dwrite d6/d12/d1e/d29/d5d/d71/d3a/d8f/f10a [0,4194304] 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/923: dread - d2/d6/dd/d21/d47/d10e/fc3 zero size 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:3/975: link d0/d16/l5f d0/d4/d11d/l14d 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/924: rename d2/d6/dd/d21/d26/d2f/f50 to d2/d6/dd/d21/d26/d38/dd0/df2/d113/f124 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/925: chown d2/f31 44319289 1 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:2/930: getdents da/dc/d15/d22/d87/dc3 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:5/938: write d7/d59/dbe/d6b/fa1 [71214,108630] 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/926: fdatasync d2/d1b/d80/d118/f11f 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:2/931: rename da/dc/d15 to da/d1d/d35/d13c 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/927: write d2/d6/dd/d21/d26/d38/f49 [1866681,39191] 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:5/939: read d7/d59/f97 [484249,80872] 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/928: rmdir d2/d6/dd/d21/d26/d38 39 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/929: truncate d2/d6/dd/d21/d26/d2f/f5e 2900587 0 2024-09-12T18:03:25.821 INFO:tasks.workunit.client.0.smithi052.stdout:2/932: dwrite da/d2c/f9a [0,4194304] 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:0/930: stat d2/d6/dd/f39 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:5/940: dwrite d7/d1f/d34/df2/d49/fea [0,4194304] 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:0/931: write d2/d6/dd/f60 [2252178,60692] 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:1/907: dread d3/d1d/f2c [0,4194304] 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:0/932: creat d2/d6/dd/d21/d26/d38/d4a/f125 x:0 0 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:1/908: chown d3/d1d/d22/d3f/db0/l112 1 1 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:0/933: write d2/d6/dd/d21/d26/d65/f115 [2352667,63414] 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:1/909: getdents d3/d1d/d22/d66 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:5/941: dwrite d7/d1f/d45/ffa [0,4194304] 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:1/910: link d3/d10/d38/d44/f123 d3/d1d/d22/f12f 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:3/976: dread d0/d4/d25/d2a/d2c/f67 [0,4194304] 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:3/977: mknod d0/d4/d25/d2a/d6/d7/d34/d71/c14e 0 2024-09-12T18:03:25.822 INFO:tasks.workunit.client.0.smithi052.stdout:1/911: dwrite d3/d1d/d22/f12f [0,4194304] 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/942: read d7/f16 [2621391,64705] 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:1/912: creat d3/d1d/d22/d27/f130 x:0 0 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/943: symlink d7/d1c/d67/dfd/l130 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/944: fdatasync d7/d1c/d6f/f89 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:1/913: write d3/dcb/d74/d7d/d84/f10d [3329140,23821] 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:7/955: dread d6/dc/f30 [0,4194304] 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:1/914: readlink d3/d10/d38/d8b/l98 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/945: unlink d7/d1c/d1e/da5/ff1 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:3/978: dwrite d0/d16/d60/fca [4194304,4194304] 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/946: write d7/d1f/f76 [1458207,13874] 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:3/979: symlink d0/d4b/d4c/d6b/l14f 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:1/915: creat d3/dcb/d74/d7d/d84/d10e/f131 x:0 0 0 2024-09-12T18:03:25.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/947: unlink d7/d51/d8b/daf/ce2 0 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:7/956: link d6/d12/d1e/d29/d5d/d71/d3a/d83/f7a d6/d9b/f137 0 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:5/948: chown d7/d1c/d67/dfd 1 1 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:7/957: stat d6/d12/d1e/dae/db3/f106 0 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:3/980: mknod d0/d16/d60/ddf/c150 0 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:7/958: rmdir d6/d12/d17/dac 39 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:5/949: creat d7/d51/d8b/f131 x:0 0 0 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:3/981: chown d0/d4/d25/d2a/l8f 10304 1 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:7/959: mknod d6/d12/d1e/de7/c138 0 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:5/950: write d7/d59/d5c/ff0 [1245016,107198] 0 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:3/982: readlink d0/d4b/d4c/d6b/d48/l99 0 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:7/960: chown d6/d12/d1e/d29/d5d/d71/d3a/l44 48 1 2024-09-12T18:03:25.824 INFO:tasks.workunit.client.0.smithi052.stdout:5/951: mknod d7/d1c/d1e/da5/de6/c132 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:5/952: symlink d7/d51/d8b/daf/l133 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:3/983: fsync d0/d4/d25/d2a/d6/d7/d34/d72/d83/de2/f12c 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:5/953: write d7/d1f/d34/df2/f4f [213297,128966] 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:1/916: dwrite d3/d10/d38/d44/d49/fee [0,4194304] 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:1/917: sync 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:3/984: rename d0/d16/d60/ddf/c8c to d0/d4/d25/d2a/d6/c151 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:3/985: creat d0/d4/d25/d2a/d2c/dec/f152 x:0 0 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:3/986: sync 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:3/987: write d0/d4/d25/d2a/d6/d7/f2b [4453560,119367] 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:7/961: dwrite d6/d12/d1e/d8e/f92 [0,4194304] 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:1/918: dwrite d3/d10/dc4/d115/f29 [0,4194304] 0 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:1/919: dread - d3/d1d/d22/fbf zero size 2024-09-12T18:03:25.825 INFO:tasks.workunit.client.0.smithi052.stdout:5/954: dwrite d7/d59/f65 [0,4194304] 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/962: symlink d6/d12/d1e/d29/d5d/d71/d9e/d12d/l139 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/963: symlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/l13a 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/964: read - d6/f10d zero size 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/965: write d6/d12/f47 [2260265,88681] 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/966: truncate d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/dca/ff7 194598 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:5/955: dwrite d7/d59/dbe/ffc [0,4194304] 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/967: creat d6/dc/d1a/d6a/f13b x:0 0 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:5/956: dwrite d7/d59/dad/dce/f12a [8388608,4194304] 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:5/957: chown d7/d1c/dff/c10f 401 1 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/968: dwrite d6/d12/d17/f74 [0,4194304] 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:7/969: mknod d6/d9b/c13c 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:1/920: read d3/d1d/d72/fce [634962,56769] 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:1/921: fsync d3/d1d/d22/d3f/d56/dd5/fe0 0 2024-09-12T18:03:25.826 INFO:tasks.workunit.client.0.smithi052.stdout:1/922: rmdir d3/dcb/d74/d7d 39 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:7/970: dread d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/fce [0,4194304] 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:1/923: mkdir d3/d1d/d22/d132 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:5/958: dwrite d7/d1c/d6f/fdf [0,4194304] 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:5/959: chown d7/d1c/d6f/l93 15214379 1 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:1/924: creat d3/d1d/f133 x:0 0 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:5/960: creat d7/d59/dbe/d6b/f134 x:0 0 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:1/925: mkdir d3/dcb/d74/d7d/d84/dbb/d134 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:1/926: chown d3/d1d/d72/fcd 219 1 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:1/927: symlink d3/d1d/d22/d76/dff/l135 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:7/971: dwrite d6/d12/d1e/f6d [4194304,4194304] 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:1/928: mknod d3/dcb/d74/da3/c136 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:7/972: fdatasync d6/d12/d1e/d29/fa6 0 2024-09-12T18:03:25.827 INFO:tasks.workunit.client.0.smithi052.stdout:1/929: chown d3/dcb/d74/da3/c136 0 1 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:1/930: creat d3/d10/d38/d44/d49/f137 x:0 0 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:7/973: write d6/d12/d1e/d29/d5d/d71/d3a/d8f/f10a [4229524,128974] 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:0/934: dread d2/d6/dd/d21/d26/f40 [0,4194304] 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:1/931: mkdir d3/da2/ddc/de9/d138 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:0/935: creat d2/d6/dd/d21/d47/f126 x:0 0 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:7/974: creat d6/d12/d1e/d29/d5d/d71/d3a/dfb/f13d x:0 0 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:5/961: dread d7/d1c/d1e/da5/fd6 [0,4194304] 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:7/975: readlink d6/d12/d1e/la4 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:1/932: creat d3/d1d/d83/f139 x:0 0 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:3/988: dread d0/d4b/f64 [0,4194304] 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:5/962: stat d7/l75 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:0/936: mkdir d2/d6/dd/d21/d47/d127 0 2024-09-12T18:03:25.828 INFO:tasks.workunit.client.0.smithi052.stdout:1/933: chown d3/l54 842979263 1 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:3/989: chown d0/d4b/d4c/d6b/l14f 0 1 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:7/976: creat d6/d12/d1e/d8e/dcb/f13e x:0 0 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:7/977: fsync d6/ff 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:0/937: mkdir d2/d57/d5b/d7a/d128 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:5/963: getdents d7/d1c/d6f 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:7/978: creat d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/dee/d11d/f13f x:0 0 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:0/938: getdents d2/d6/dd/d21/d26/d38/dd0/df2/d113 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:2/933: dread da/d21/f26 [0,4194304] 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:3/990: read d0/d4b/d4c/d6b/d48/fb9 [1405518,43379] 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:0/939: fdatasync d2/d8/dce/d48/f6a 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:7/979: link d6/dc/c66 d6/d9b/c140 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:2/934: rename da/d1d/d35/d13c/d12e to da/d2c/dbf/ddf/d13d 0 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:2/935: sync 2024-09-12T18:03:25.829 INFO:tasks.workunit.client.0.smithi052.stdout:3/991: rmdir d0/d4b/d107 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/940: rename d2/d8/fa8 to d2/d6/dd/d21/d26/d2f/de9/f129 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/980: symlink d6/d12/d17/l141 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:3/992: mkdir d0/d4/d25/d2a/d6/d7/d34/d71/dde/d153 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/941: creat d2/d57/f12a x:0 0 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/981: readlink d6/d12/d1e/d29/d5d/d71/d3a/d8f/d80/lb8 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/942: chown d2/d51/fc5 1857 1 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/982: write d6/d12/d1e/d29/da1/ff4 [259975,49405] 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/943: rename d2/ca2 to d2/d1b/d80/c12b 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/983: rmdir d6/dc/d1a/d6a 39 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/944: creat d2/d6/dd/d21/d26/d38/dd0/f12c x:0 0 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/984: dread - d6/d12/f99 zero size 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/945: unlink d2/le4 0 2024-09-12T18:03:25.830 INFO:tasks.workunit.client.0.smithi052.stdout:7/985: symlink d6/d12/l142 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/993: truncate d0/d4b/d57/d6d/f7b 3164504 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/994: chown d0/d4/d25/d2a/d6/d41/f45 8 1 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:7/986: mknod d6/d12/d1e/d29/c143 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/995: dread - d0/d4/d25/d2a/fe6 zero size 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:5/964: dwrite d7/d1f/d45/ffa [4194304,4194304] 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:0/946: dwrite d2/d6/dd/d21/d26/d2f/fff [0,4194304] 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/996: truncate d0/d4b/f64 3493438 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:2/936: dwrite da/d1d/d35/d13c/f3c [0,4194304] 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:0/947: write d2/d57/f82 [1065802,95097] 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:7/987: link d6/d12/d17/c3b d6/d12/d1e/dae/dfc/c144 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/997: fdatasync d0/d4b/d4c/d6b/d117/dc7/de0/fe3 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:0/948: creat d2/d1b/d80/da3/f12d x:0 0 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:7/988: mknod d6/dc/d1a/d6a/c145 0 2024-09-12T18:03:25.831 INFO:tasks.workunit.client.0.smithi052.stdout:2/937: write da/d1d/d35/d13c/d20/d60/f7c [638522,77476] 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:2/938: mkdir da/d1d/d13e 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:5/965: dwrite d7/d1c/d1e/f44 [0,4194304] 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:2/939: mkdir da/d1d/d35/d7a/d13f 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:5/966: creat d7/d1f/d34/f135 x:0 0 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:7/989: getdents d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/da3/dee/d11d 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:5/967: chown d7/d59/d5c/d7c/ceb 1241801 1 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:7/990: symlink d6/d12/d1e/d8e/dcb/l146 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:2/940: rename da/d1d/d35/d13c/d20/l12d to da/d1d/d35/d13c/d20/l140 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:7/991: unlink d6/d12/d1e/c11c 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:0/949: dwrite d2/d1b/d72/d69/f7b [0,4194304] 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:0/950: fsync d2/d6/f94 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:2/941: rename da/d1d/d35/d13c/d20/f64 to da/d1d/f141 0 2024-09-12T18:03:25.832 INFO:tasks.workunit.client.0.smithi052.stdout:0/951: mknod d2/d6/dd/d21/d26/d65/c12e 0 2024-09-12T18:03:25.839 INFO:tasks.workunit.client.0.smithi052.stdout:2/942: symlink da/d1d/d35/d13c/d20/d60/d6e/l142 0 2024-09-12T18:03:25.839 INFO:tasks.workunit.client.0.smithi052.stdout:1/934: dread d3/d10/d38/f9c [0,4194304] 0 2024-09-12T18:03:25.839 INFO:tasks.workunit.client.0.smithi052.stdout:5/968: dwrite d7/d1c/d67/dfd/f109 [0,4194304] 0 2024-09-12T18:03:25.839 INFO:tasks.workunit.client.0.smithi052.stdout:2/943: fdatasync da/d1d/d35/d13c/d20/d60/fe4 0 2024-09-12T18:03:25.839 INFO:tasks.workunit.client.0.smithi052.stdout:1/935: readlink d3/d1d/d22/d76/dff/l135 0 2024-09-12T18:03:25.839 INFO:tasks.workunit.client.0.smithi052.stdout:7/992: dwrite d6/d12/d1e/d8e/fa9 [0,4194304] 0 2024-09-12T18:03:25.839 INFO:tasks.workunit.client.0.smithi052.stdout:1/936: write d3/dcb/d74/d7d/d102/f10f [317093,3905] 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:5/969: creat d7/d59/dad/d100/d12e/f136 x:0 0 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:7/993: stat d6/dc/d1a/d6a/c145 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:5/970: mknod d7/d59/dad/d100/c137 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:7/994: dread - d6/d12/d1e/d29/d5d/d71/d3a/dfb/f13d zero size 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:0/952: dwrite d2/d1b/d72/d8d/f121 [0,4194304] 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:5/971: write d7/d1f/d34/df2/d49/f5a [643141,129053] 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:1/937: rename d3/dcb/d74/d7d/d84/dbb/ldb to d3/dcb/d74/d7d/d84/d10e/l13a 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:0/953: chown d2/d6/dd/d21/f5f 176 1 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:7/995: creat d6/d12/d1e/d29/da1/ddf/f147 x:0 0 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:1/938: dread - d3/d1d/d83/ddf/f110 zero size 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:7/996: unlink d6/d12/d1e/d29/d5d/d71/c98 0 2024-09-12T18:03:25.840 INFO:tasks.workunit.client.0.smithi052.stdout:0/954: getdents d2/d6/dd/d21/d26/d38/dd0/df2 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:1/939: mknod d3/dcb/d74/d7d/d84/c13b 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:7/997: dread d6/d12/d1e/d29/d5d/d71/d3a/d8f/d85/fc6 [0,4194304] 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:0/955: creat d2/f12f x:0 0 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:1/940: write d3/d10/dc4/d115/f29 [707970,17667] 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:7/998: write d6/d12/d1e/d29/d5d/f78 [4356646,30959] 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:1/941: mkdir d3/d10/d13c 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:7/999: rename d6/c55 to d6/dc/d112/c148 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:1/942: symlink d3/d1d/d22/l13d 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:0/956: link d2/d1b/d72/d69/db6/lc8 d2/d6/dd/d21/d26/d38/dd0/df2/l130 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:1/943: rmdir d3/dcb 39 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:5/972: dwrite d7/d59/d5c/d7c/fb4 [0,4194304] 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:3/998: read d0/d4b/d4c/d6b/f8d [824396,121162] 0 2024-09-12T18:03:25.841 INFO:tasks.workunit.client.0.smithi052.stdout:0/957: truncate d2/d57/f12a 662734 0 2024-09-12T18:03:25.842 INFO:tasks.workunit.client.0.smithi052.stdout:5/973: symlink d7/d1c/d1e/l138 0 2024-09-12T18:03:25.843 INFO:tasks.workunit.client.0.smithi052.stdout:1/944: write d3/d10/f53 [834399,60961] 0 2024-09-12T18:03:25.843 INFO:tasks.workunit.client.0.smithi052.stdout:0/958: dread d2/d6/dd/d21/d26/d2f/de9/f129 [0,4194304] 0 2024-09-12T18:03:25.843 INFO:tasks.workunit.client.0.smithi052.stdout:5/974: stat d7/d51/d8b/daf/fba 0 2024-09-12T18:03:25.843 INFO:tasks.workunit.client.0.smithi052.stdout:1/945: creat d3/d10/dc4/f13e x:0 0 0 2024-09-12T18:03:25.843 INFO:tasks.workunit.client.0.smithi052.stdout:0/959: mknod d2/d6/dd/dad/c131 0 2024-09-12T18:03:25.843 INFO:tasks.workunit.client.0.smithi052.stdout:5/975: rename d7/d1f/d34/f48 to d7/d1c/d1e/da5/de6/f139 0 2024-09-12T18:03:25.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/999: dwrite d0/d4/f28 [4194304,4194304] 0 2024-09-12T18:03:25.844 INFO:tasks.workunit.client.0.smithi052.stdout:0/960: unlink d2/d57/led 0 2024-09-12T18:03:25.844 INFO:tasks.workunit.client.0.smithi052.stdout:1/946: creat d3/d69/d89/d11b/f13f x:0 0 0 2024-09-12T18:03:25.844 INFO:tasks.workunit.client.0.smithi052.stdout:5/976: rename d7/d59/dbe/f104 to d7/f13a 0 2024-09-12T18:03:25.845 INFO:tasks.workunit.client.0.smithi052.stdout:0/961: rename d2/d6/dd/d21/d26/d65/l9b to d2/d6/dd/l132 0 2024-09-12T18:03:25.848 INFO:tasks.workunit.client.0.smithi052.stdout:0/962: dread d2/d6/dd/d21/d26/d2f/f96 [0,4194304] 0 2024-09-12T18:03:25.850 INFO:tasks.workunit.client.0.smithi052.stdout:1/947: dwrite d3/d69/d89/d11b/f13f [0,4194304] 0 2024-09-12T18:03:25.850 INFO:tasks.workunit.client.0.smithi052.stdout:0/963: fdatasync d2/d6/dd/d21/d26/d2f/fff 0 2024-09-12T18:03:25.850 INFO:tasks.workunit.client.0.smithi052.stdout:5/977: dwrite d7/d1c/d1e/d98/fa2 [0,4194304] 0 2024-09-12T18:03:25.851 INFO:tasks.workunit.client.0.smithi052.stdout:1/948: dread - d3/d1d/d22/d66/df8/f113 zero size 2024-09-12T18:03:25.851 INFO:tasks.workunit.client.0.smithi052.stdout:1/949: sync 2024-09-12T18:03:25.852 INFO:tasks.workunit.client.0.smithi052.stdout:1/950: stat d3/le 0 2024-09-12T18:03:25.852 INFO:tasks.workunit.client.0.smithi052.stdout:0/964: rmdir d2/d6/dd/d21/d26/d38/d4a/d86 39 2024-09-12T18:03:25.852 INFO:tasks.workunit.client.0.smithi052.stdout:5/978: mkdir d7/d1c/d67/dfd/d13b 0 2024-09-12T18:03:25.852 INFO:tasks.workunit.client.0.smithi052.stdout:0/965: mknod d2/d1b/d72/d69/db6/c133 0 2024-09-12T18:03:25.854 INFO:tasks.workunit.client.0.smithi052.stdout:5/979: truncate d7/d59/d5c/d7c/ff7 958540 0 2024-09-12T18:03:25.855 INFO:tasks.workunit.client.0.smithi052.stdout:0/966: symlink d2/d6/dd/dd8/l134 0 2024-09-12T18:03:25.856 INFO:tasks.workunit.client.0.smithi052.stdout:5/980: creat d7/d51/d8d/d115/f13c x:0 0 0 2024-09-12T18:03:25.856 INFO:tasks.workunit.client.0.smithi052.stdout:5/981: mknod d7/d1c/d67/c13d 0 2024-09-12T18:03:25.857 INFO:tasks.workunit.client.0.smithi052.stdout:5/982: read - d7/d1f/d45/f94 zero size 2024-09-12T18:03:25.858 INFO:tasks.workunit.client.0.smithi052.stdout:0/967: rename d2/d1b to d2/d1b/d80/d118/d135 22 2024-09-12T18:03:25.858 INFO:tasks.workunit.client.0.smithi052.stdout:1/951: dwrite d3/d10/d38/d44/d49/f137 [0,4194304] 0 2024-09-12T18:03:25.858 INFO:tasks.workunit.client.0.smithi052.stdout:0/968: write d2/d1b/f87 [773033,48304] 0 2024-09-12T18:03:25.858 INFO:tasks.workunit.client.0.smithi052.stdout:5/983: creat d7/d51/d8b/f13e x:0 0 0 2024-09-12T18:03:25.859 INFO:tasks.workunit.client.0.smithi052.stdout:5/984: sync 2024-09-12T18:03:25.859 INFO:tasks.workunit.client.0.smithi052.stdout:1/952: mkdir d3/d1d/d83/d140 0 2024-09-12T18:03:25.860 INFO:tasks.workunit.client.0.smithi052.stdout:0/969: stat d2/d6/dd/d21/d26/d38/dd0/df2/l130 0 2024-09-12T18:03:25.860 INFO:tasks.workunit.client.0.smithi052.stdout:1/953: write d3/d10/f85 [10706248,79028] 0 2024-09-12T18:03:25.860 INFO:tasks.workunit.client.0.smithi052.stdout:0/970: dread - d2/d6/dd/d21/ff8 zero size 2024-09-12T18:03:25.861 INFO:tasks.workunit.client.0.smithi052.stdout:1/954: write d3/d1d/d22/fbf [253874,38869] 0 2024-09-12T18:03:25.866 INFO:tasks.workunit.client.0.smithi052.stdout:2/944: dread f8 [0,4194304] 0 2024-09-12T18:03:25.866 INFO:tasks.workunit.client.0.smithi052.stdout:5/985: dwrite d7/d51/d8b/ff3 [0,4194304] 0 2024-09-12T18:03:25.867 INFO:tasks.workunit.client.0.smithi052.stdout:0/971: dwrite d2/d6/dd/d21/d26/d2f/de9/f129 [0,4194304] 0 2024-09-12T18:03:25.868 INFO:tasks.workunit.client.0.smithi052.stdout:0/972: fdatasync d2/d6/dd/d21/d26/d38/d4a/f125 0 2024-09-12T18:03:25.868 INFO:tasks.workunit.client.0.smithi052.stdout:5/986: write d7/f13a [690500,121478] 0 2024-09-12T18:03:25.869 INFO:tasks.workunit.client.0.smithi052.stdout:2/945: write da/d1d/d35/d13c/d43/fca [960518,59261] 0 2024-09-12T18:03:25.869 INFO:tasks.workunit.client.0.smithi052.stdout:1/955: dread d3/d1d/ffa [0,4194304] 0 2024-09-12T18:03:25.870 INFO:tasks.workunit.client.0.smithi052.stdout:2/946: creat da/d1d/d35/f143 x:0 0 0 2024-09-12T18:03:25.870 INFO:tasks.workunit.client.0.smithi052.stdout:5/987: write d7/d1f/d45/f7a [311075,28255] 0 2024-09-12T18:03:25.871 INFO:tasks.workunit.client.0.smithi052.stdout:1/956: creat d3/da2/dbe/f141 x:0 0 0 2024-09-12T18:03:25.871 INFO:tasks.workunit.client.0.smithi052.stdout:2/947: chown da/d1d/lda 0 1 2024-09-12T18:03:25.872 INFO:tasks.workunit.client.0.smithi052.stdout:5/988: chown d7/d1f/d34/l10d 109422528 1 2024-09-12T18:03:25.874 INFO:tasks.workunit.client.0.smithi052.stdout:2/948: write da/d1d/d35/d13c/d43/f4e [3886417,3872] 0 2024-09-12T18:03:25.875 INFO:tasks.workunit.client.0.smithi052.stdout:2/949: creat da/d21/da2/f144 x:0 0 0 2024-09-12T18:03:25.875 INFO:tasks.workunit.client.0.smithi052.stdout:5/989: link d7/d1f/d45/f62 d7/d1c/d67/dfd/d13b/f13f 0 2024-09-12T18:03:25.876 INFO:tasks.workunit.client.0.smithi052.stdout:2/950: write da/d1d/d35/f3f [3154102,89449] 0 2024-09-12T18:03:25.876 INFO:tasks.workunit.client.0.smithi052.stdout:0/973: dwrite d2/d6/fb [0,4194304] 0 2024-09-12T18:03:25.877 INFO:tasks.workunit.client.0.smithi052.stdout:5/990: fsync d7/d1f/d45/f7a 0 2024-09-12T18:03:25.878 INFO:tasks.workunit.client.0.smithi052.stdout:1/957: dwrite d3/d10/d38/d44/f123 [0,4194304] 0 2024-09-12T18:03:25.879 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:03:25.881 INFO:tasks.workunit.client.0.smithi052.stdout:5/991: write d7/d1c/d1e/f64 [468663,34862] 0 2024-09-12T18:03:25.883 INFO:tasks.workunit.client.0.smithi052.stdout:2/951: truncate da/d1d/d35/d13c/d22/f116 38572 0 2024-09-12T18:03:25.883 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:03:25.884 INFO:tasks.workunit.client.0.smithi052.stdout:5/992: getdents d7/d59/dad 0 2024-09-12T18:03:25.884 INFO:tasks.workunit.client.0.smithi052.stdout:1/958: symlink d3/dcb/d74/d7d/d84/dbb/l142 0 2024-09-12T18:03:25.887 INFO:tasks.workunit.client.0.smithi052.stdout:0/974: dwrite d2/d51/fc5 [0,4194304] 0 2024-09-12T18:03:25.889 INFO:tasks.workunit.client.0.smithi052.stdout:5/993: rename d7/d51/d8d/fdd to d7/d1c/d1e/f140 0 2024-09-12T18:03:25.891 INFO:tasks.workunit.client.0.smithi052.stdout:5/994: symlink d7/d1c/d67/dfd/d11a/l141 0 2024-09-12T18:03:25.892 INFO:tasks.workunit.client.0.smithi052.stdout:0/975: symlink d2/d6/dd/d21/d47/d10e/d59/l136 0 2024-09-12T18:03:25.892 INFO:tasks.workunit.client.0.smithi052.stdout:1/959: dwrite d3/d1d/d22/d3f/d56/dd5/fe0 [0,4194304] 0 2024-09-12T18:03:25.892 INFO:tasks.workunit.client.0.smithi052.stdout:5/995: symlink d7/d1f/l142 0 2024-09-12T18:03:25.893 INFO:tasks.workunit.client.0.smithi052.stdout:0/976: chown d2/d1b/d72/d8d/lf7 8093857 1 2024-09-12T18:03:25.894 INFO:tasks.workunit.client.0.smithi052.stdout:0/977: creat d2/d1b/d80/d118/f137 x:0 0 0 2024-09-12T18:03:25.896 INFO:tasks.workunit.client.0.smithi052.stdout:0/978: rmdir d2/d6/d11d 0 2024-09-12T18:03:25.897 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:25.895+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:25.898 INFO:tasks.workunit.client.0.smithi052.stdout:5/996: write d7/d59/d5c/d7c/fb5 [6816490,111111] 0 2024-09-12T18:03:25.898 INFO:tasks.workunit.client.0.smithi052.stdout:1/960: dread d3/dcb/d74/d7d/d102/f10f [0,4194304] 0 2024-09-12T18:03:25.900 INFO:tasks.workunit.client.0.smithi052.stdout:2/952: dread da/d1d/d35/d13c/d20/d60/f7c [0,4194304] 0 2024-09-12T18:03:25.902 INFO:tasks.workunit.client.0.smithi052.stdout:2/953: stat da/d1d/d35/d13c/l99 0 2024-09-12T18:03:25.903 INFO:tasks.workunit.client.0.smithi052.stdout:2/954: write da/f17 [3627692,30571] 0 2024-09-12T18:03:25.903 INFO:tasks.workunit.client.0.smithi052.stdout:5/997: dread d7/d59/d5c/d7c/fb4 [0,4194304] 0 2024-09-12T18:03:25.904 INFO:tasks.workunit.client.0.smithi052.stdout:0/979: dwrite d2/d8/dce/d48/fd9 [0,4194304] 0 2024-09-12T18:03:25.905 INFO:tasks.workunit.client.0.smithi052.stdout:5/998: symlink d7/d51/d8d/l143 0 2024-09-12T18:03:25.906 INFO:tasks.workunit.client.0.smithi052.stdout:5/999: write d7/d1f/f8c [522400,74673] 0 2024-09-12T18:03:25.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/955: dwrite da/d1d/d35/d13c/d22/d87/fc6 [0,4194304] 0 2024-09-12T18:03:25.911 INFO:tasks.workunit.client.0.smithi052.stdout:0/980: dwrite d2/d6/dd/dad/fb3 [0,4194304] 0 2024-09-12T18:03:25.913 INFO:tasks.workunit.client.0.smithi052.stdout:0/981: mknod d2/d8/dce/c138 0 2024-09-12T18:03:25.913 INFO:tasks.workunit.client.0.smithi052.stdout:2/956: link da/d1d/d35/d13c/d43/ccf da/d1d/c145 0 2024-09-12T18:03:25.914 INFO:tasks.workunit.client.0.smithi052.stdout:0/982: mknod d2/d1b/c139 0 2024-09-12T18:03:25.919 INFO:tasks.workunit.client.0.smithi052.stdout:1/961: dread d3/d10/d38/f40 [0,4194304] 0 2024-09-12T18:03:25.920 INFO:tasks.workunit.client.0.smithi052.stdout:0/983: dread d2/d6/dd/d21/d26/d2f/de9/f129 [0,4194304] 0 2024-09-12T18:03:25.920 INFO:tasks.workunit.client.0.smithi052.stdout:2/957: dwrite da/d1d/d35/d13c/da6/ff3 [0,4194304] 0 2024-09-12T18:03:25.922 INFO:tasks.workunit.client.0.smithi052.stdout:2/958: rename da/f80 to da/d21/da2/dc9/f146 0 2024-09-12T18:03:25.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:03:25.924 INFO:tasks.workunit.client.0.smithi052.stdout:0/984: getdents d2/d6/dd/d21/d47/d10e 0 2024-09-12T18:03:25.924 INFO:tasks.workunit.client.0.smithi052.stdout:0/985: chown d2/f4f 786702 1 2024-09-12T18:03:25.924 INFO:tasks.workunit.client.0.smithi052.stdout:2/959: truncate da/d1d/d35/d7a/df4/ffb 401945 0 2024-09-12T18:03:25.925 INFO:tasks.workunit.client.0.smithi052.stdout:0/986: chown d2/d8/dee/l102 6402237 1 2024-09-12T18:03:25.925 INFO:tasks.workunit.client.0.smithi052.stdout:2/960: symlink da/d1d/d35/d13c/l147 0 2024-09-12T18:03:25.926 INFO:tasks.workunit.client.0.smithi052.stdout:0/987: creat d2/d6/dd/d21/d26/d65/f13a x:0 0 0 2024-09-12T18:03:25.926 INFO:tasks.workunit.client.0.smithi052.stdout:0/988: mkdir d2/d1b/d80/d13b 0 2024-09-12T18:03:25.926 INFO:tasks.workunit.client.0.smithi052.stdout:2/961: symlink da/d1d/d35/d13c/da6/dbb/dd6/l148 0 2024-09-12T18:03:25.927 INFO:tasks.workunit.client.0.smithi052.stdout:2/962: rename da/d1d/d35/f6f to da/d1d/d7d/db3/f149 0 2024-09-12T18:03:25.927 INFO:tasks.workunit.client.0.smithi052.stdout:0/989: rename d2/d6/dd/d21/c11b to d2/d6/dd/d21/d26/d2f/de9/d117/c13c 0 2024-09-12T18:03:25.927 INFO:tasks.workunit.client.0.smithi052.stdout:2/963: creat da/d2c/dbf/ddf/d13d/f14a x:0 0 0 2024-09-12T18:03:25.928 INFO:tasks.workunit.client.0.smithi052.stdout:0/990: write d2/d57/d5b/f64 [1056018,41896] 0 2024-09-12T18:03:25.929 INFO:tasks.workunit.client.0.smithi052.stdout:0/991: mknod d2/d6/dd/dd8/c13d 0 2024-09-12T18:03:25.930 INFO:tasks.workunit.client.0.smithi052.stdout:0/992: write d2/d57/d5b/d7a/fd6 [489104,126701] 0 2024-09-12T18:03:25.934 INFO:tasks.workunit.client.0.smithi052.stdout:2/964: dwrite da/d1d/d35/d13c/f92 [0,4194304] 0 2024-09-12T18:03:25.937 INFO:tasks.workunit.client.0.smithi052.stdout:2/965: write da/d1d/d35/d7a/f132 [563391,77199] 0 2024-09-12T18:03:25.938 INFO:tasks.workunit.client.0.smithi052.stdout:2/966: write da/d1d/d35/d13c/d20/fe9 [289516,122400] 0 2024-09-12T18:03:25.939 INFO:tasks.workunit.client.0.smithi052.stdout:2/967: dread - da/d21/ff0 zero size 2024-09-12T18:03:25.939 INFO:tasks.workunit.client.0.smithi052.stdout:2/968: dread - da/d21/ff0 zero size 2024-09-12T18:03:25.940 INFO:tasks.workunit.client.0.smithi052.stdout:2/969: creat da/d1d/d35/d7a/d13f/f14b x:0 0 0 2024-09-12T18:03:25.941 INFO:tasks.workunit.client.0.smithi052.stdout:2/970: mkdir da/d1d/d35/d14c 0 2024-09-12T18:03:25.942 INFO:tasks.workunit.client.0.smithi052.stdout:2/971: stat da/d1d/d35/d13c/d43/fca 0 2024-09-12T18:03:25.942 INFO:tasks.workunit.client.0.smithi052.stdout:2/972: stat da/d1d/d35/d13c/da6/d138 0 2024-09-12T18:03:25.942 INFO:tasks.workunit.client.0.smithi052.stdout:2/973: write da/dc/f2e [2566862,35205] 0 2024-09-12T18:03:25.944 INFO:tasks.workunit.client.0.smithi052.stdout:2/974: getdents da/d1d/d35/d13c/d22 0 2024-09-12T18:03:25.945 INFO:tasks.workunit.client.0.smithi052.stdout:2/975: read da/d1d/d35/d13c/f69 [113401,75731] 0 2024-09-12T18:03:25.947 INFO:tasks.workunit.client.0.smithi052.stdout:2/976: link da/dc/f82 da/d1d/d35/f14d 0 2024-09-12T18:03:25.947 INFO:tasks.workunit.client.0.smithi052.stdout:2/977: fdatasync da/d1d/f29 0 2024-09-12T18:03:25.948 INFO:tasks.workunit.client.0.smithi052.stdout:2/978: unlink da/dc/c27 0 2024-09-12T18:03:25.949 INFO:tasks.workunit.client.0.smithi052.stdout:2/979: write da/d1d/d35/d13c/d22/f8d [4692385,64958] 0 2024-09-12T18:03:25.949 INFO:tasks.workunit.client.0.smithi052.stdout:0/993: dread d2/d6/dd/d21/d26/fd7 [0,4194304] 0 2024-09-12T18:03:25.950 INFO:tasks.workunit.client.0.smithi052.stdout:2/980: truncate da/d2c/dbf/ddf/ff8 565386 0 2024-09-12T18:03:25.950 INFO:tasks.workunit.client.0.smithi052.stdout:0/994: write d2/d6/dd/d21/d26/d65/f7d [2118624,28227] 0 2024-09-12T18:03:25.951 INFO:tasks.workunit.client.0.smithi052.stdout:0/995: dread - d2/d1b/d72/d69/f11e zero size 2024-09-12T18:03:25.951 INFO:tasks.workunit.client.0.smithi052.stdout:2/981: write da/d1d/d35/d13c/d22/d87/f107 [637759,83018] 0 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:15366 4.34 4:2de623c9:::1000000352d.00000001:head [write 498081~64958 in=64958b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:25.950058+0000", 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.002076474, 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020959889999999999, 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:25.952 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 15366 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950058+0000", 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:25.953 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950058+0000", 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950059+0000", 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.15e-06 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950096+0000", 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7116999999999997e-05 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950112+0000", 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5648e-05 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950119+0000", 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0910000000000004e-06 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950184+0000", 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5192999999999997e-05 2024-09-12T18:03:25.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950294+0000", 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109647 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.950458+0000", 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00016428800000000001 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951508+0000", 2024-09-12T18:03:25.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001050243 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:15367 4.2e 4:77f85201:::1000000355c.00000000:head [write 2118624~28227 in=28227b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:25.951332+0000", 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00080205200000000004, 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00087354900000000005, 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:25.957 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 15367 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951332+0000", 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:25.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951332+0000", 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951334+0000", 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3200000000000001e-06 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951387+0000", 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3711999999999997e-05 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951404+0000", 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6568000000000001e-05 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951416+0000", 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.242e-05 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951471+0000", 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5183999999999999e-05 2024-09-12T18:03:25.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951524+0000", 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2182000000000003e-05 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.951615+0000", 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1336999999999996e-05 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:25.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop_reply(client.4587.0:15366 4.34 e53/17)", 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:25.952193+0000", 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 4294967295.9999409, 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6759000000000003e-05, 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "queued for pg", 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.952193+0000", 2024-09-12T18:03:25.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.952193+0000", 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.952194+0000", 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0979999999999999e-06 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.952199+0000", 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.437e-06 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.952212+0000", 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3366999999999999e-05 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:25.952222+0000", 2024-09-12T18:03:25.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5710000000000004e-06 2024-09-12T18:03:25.965 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:25.965 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:25.965 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:25.965 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:25.965 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-12T18:03:25.965 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 3 2024-09-12T18:03:25.965 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:25.966 INFO:tasks.workunit.client.0.smithi052.stdout:2/982: mknod da/d1d/d7d/c14e 0 2024-09-12T18:03:25.966 INFO:tasks.workunit.client.0.smithi052.stdout:2/983: dwrite da/d1d/d35/d13c/d20/d60/d6e/dab/f125 [0,4194304] 0 2024-09-12T18:03:25.966 INFO:tasks.workunit.client.0.smithi052.stdout:2/984: write da/d21/da2/dc9/f146 [1313080,108209] 0 2024-09-12T18:03:25.966 INFO:tasks.workunit.client.0.smithi052.stdout:2/985: read - da/d1d/d35/d13c/d20/d60/d6e/f136 zero size 2024-09-12T18:03:25.966 INFO:tasks.workunit.client.0.smithi052.stdout:2/986: dread - da/d1d/d35/d13c/da6/dbb/f10c zero size 2024-09-12T18:03:25.966 INFO:tasks.workunit.client.0.smithi052.stdout:2/987: dread da/f16 [4194304,4194304] 0 2024-09-12T18:03:25.967 INFO:tasks.workunit.client.0.smithi052.stdout:2/988: readlink da/d1d/d35/d13c/d20/d60/d6e/dab/lbd 0 2024-09-12T18:03:25.967 INFO:tasks.workunit.client.0.smithi052.stdout:2/989: dread da/d2c/f51 [0,4194304] 0 2024-09-12T18:03:25.968 INFO:tasks.workunit.client.0.smithi052.stdout:0/996: dread d2/d8/dce/d48/f9a [0,4194304] 0 2024-09-12T18:03:25.968 INFO:tasks.workunit.client.0.smithi052.stdout:2/990: rename da/d2c/dbf/ddf/d13d/f14a to da/dc/d76/dc4/f14f 0 2024-09-12T18:03:25.968 INFO:tasks.workunit.client.0.smithi052.stdout:0/997: write d2/d6/dd/f10d [99771,111426] 0 2024-09-12T18:03:25.969 INFO:tasks.workunit.client.0.smithi052.stdout:2/991: write da/d1d/d35/d13c/d20/fb2 [1433289,6286] 0 2024-09-12T18:03:25.970 INFO:tasks.workunit.client.0.smithi052.stdout:2/992: chown da/d21 130721922 1 2024-09-12T18:03:25.970 INFO:tasks.workunit.client.0.smithi052.stdout:0/998: mkdir d2/d1b/d72/d69/d13e 0 2024-09-12T18:03:25.970 INFO:tasks.workunit.client.0.smithi052.stdout:2/993: dread - da/d1d/d7d/fe7 zero size 2024-09-12T18:03:25.970 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:25.971 INFO:tasks.workunit.client.0.smithi052.stdout:0/999: creat d2/d57/d5b/d7a/f13f x:0 0 0 2024-09-12T18:03:25.972 INFO:tasks.workunit.client.0.smithi052.stdout:2/994: dread da/d1d/f29 [0,4194304] 0 2024-09-12T18:03:25.974 INFO:tasks.workunit.client.0.smithi052.stdout:2/995: read da/d1d/d35/d13c/d20/d60/d6e/fce [152256,102048] 0 2024-09-12T18:03:25.974 INFO:tasks.workunit.client.0.smithi052.stdout:2/996: dread - da/d2c/dbf/f104 zero size 2024-09-12T18:03:25.975 INFO:tasks.workunit.client.0.smithi052.stdout:2/997: stat da/dc/d76/dc4/f139 0 2024-09-12T18:03:25.975 INFO:tasks.workunit.client.0.smithi052.stdout:2/998: chown da/d1d/d35/d13c/d43 431086 1 2024-09-12T18:03:25.976 INFO:tasks.workunit.client.0.smithi052.stdout:2/999: fdatasync da/d1d/f141 0 2024-09-12T18:03:26.015 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:26.013+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:26.056 INFO:tasks.workunit.client.0.smithi052.stdout:1/962: sync 2024-09-12T18:03:26.056 INFO:tasks.workunit.client.0.smithi052.stdout:1/963: truncate d3/d10/d38/d8b/f12e 562175 0 2024-09-12T18:03:26.057 INFO:tasks.workunit.client.0.smithi052.stdout:1/964: unlink d3/d1d/d83/de3/l12d 0 2024-09-12T18:03:26.058 INFO:tasks.workunit.client.0.smithi052.stdout:1/965: creat d3/d1d/d11e/f143 x:0 0 0 2024-09-12T18:03:26.059 INFO:tasks.workunit.client.0.smithi052.stdout:1/966: getdents d3/d1d/d72/d101 0 2024-09-12T18:03:26.059 INFO:tasks.workunit.client.0.smithi052.stdout:1/967: creat d3/d10/d38/d44/d49/f144 x:0 0 0 2024-09-12T18:03:26.060 INFO:tasks.workunit.client.0.smithi052.stdout:1/968: dread - d3/d1d/f133 zero size 2024-09-12T18:03:26.085 INFO:tasks.workunit.client.0.smithi052.stdout:1/969: dread d3/f35 [0,4194304] 0 2024-09-12T18:03:26.086 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:26.086 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:26.086 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:26.086 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:26.086 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:26.099 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:26.097+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:26.101 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:26.199 INFO:tasks.workunit.client.0.smithi052.stdout:1/970: sync 2024-09-12T18:03:26.199 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:26.199+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:26.200 INFO:tasks.workunit.client.0.smithi052.stdout:1/971: dread - d3/dcb/d74/d7d/d84/d10e/f131 zero size 2024-09-12T18:03:26.201 INFO:tasks.workunit.client.0.smithi052.stdout:1/972: getdents d3/d69/d89 0 2024-09-12T18:03:26.202 INFO:tasks.workunit.client.0.smithi052.stdout:1/973: write d3/d10/f85 [2575140,46251] 0 2024-09-12T18:03:26.204 INFO:tasks.workunit.client.0.smithi052.stdout:1/974: write d3/d1d/d83/de3/f12c [726369,6795] 0 2024-09-12T18:03:26.205 INFO:tasks.workunit.client.0.smithi052.stdout:1/975: creat d3/d69/f145 x:0 0 0 2024-09-12T18:03:26.206 INFO:tasks.workunit.client.0.smithi052.stdout:1/976: creat d3/dcb/d74/d7d/d102/f146 x:0 0 0 2024-09-12T18:03:26.207 INFO:tasks.workunit.client.0.smithi052.stdout:1/977: chown d3/da2 7993186 1 2024-09-12T18:03:26.209 INFO:tasks.workunit.client.0.smithi052.stdout:1/978: rename d3/dcb/d74/da3/c136 to d3/dcb/d74/da3/c147 0 2024-09-12T18:03:26.210 INFO:tasks.workunit.client.0.smithi052.stdout:1/979: fsync d3/dcb/d74/d7f/f94 0 2024-09-12T18:03:26.211 INFO:tasks.workunit.client.0.smithi052.stdout:1/980: dread - d3/dcb/d74/d7f/fc3 zero size 2024-09-12T18:03:26.213 INFO:tasks.workunit.client.0.smithi052.stdout:1/981: truncate d3/d10/d38/d44/fcf 874861 0 2024-09-12T18:03:26.214 INFO:tasks.workunit.client.0.smithi052.stdout:1/982: write d3/dcb/d74/d7d/d84/f96 [512226,68996] 0 2024-09-12T18:03:26.216 INFO:tasks.workunit.client.0.smithi052.stdout:1/983: creat d3/dcb/d74/d7f/f148 x:0 0 0 2024-09-12T18:03:26.216 INFO:tasks.workunit.client.0.smithi052.stdout:1/984: dread - d3/d1d/f133 zero size 2024-09-12T18:03:26.217 INFO:tasks.workunit.client.0.smithi052.stdout:1/985: readlink d3/ld 0 2024-09-12T18:03:26.219 INFO:tasks.workunit.client.0.smithi052.stdout:1/986: getdents d3/d1d/d22/d66/df0 0 2024-09-12T18:03:26.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:26.262 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:26.262 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:26.262 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:26.262 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.592239371, 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:26.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.265 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:26.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:26.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.592202365, 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.269 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.270 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:26.271 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:26.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.273 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.274 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.592159023000001, 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.275 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.276 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.277 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.278 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:26.279 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.592121374, 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.281 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:26.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.284 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:26.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.592081665, 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.287 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:26.289 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.290 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:26.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.292 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.592043868999999, 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:26.293 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.294 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:26.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.296 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.297 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.298 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591983877000001, 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.299 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.300 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:26.301 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.302 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:26.303 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:26.304 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591888793000001, 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.305 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.306 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.307 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:26.308 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.309 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:26.310 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591822465, 2024-09-12T18:03:26.311 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:26.312 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.313 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:26.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.315 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.316 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591765585999999, 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:26.317 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.318 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.319 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:26.320 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.321 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:26.322 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.323 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591709581, 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.324 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:26.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.326 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:26.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.329 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591644399, 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.330 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.333 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591603617000001, 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.336 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:26.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.340 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591567960999999, 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:26.347 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591521919, 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.348 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:26.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.353 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591483743, 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.354 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.355 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:26.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:26.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.591437287, 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.360 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:26.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:26.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.365 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.550813241, 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.366 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:26.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:26.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.371 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.550797537999999, 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.372 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.373 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.374 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:26.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.376 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 13.543067216000001, 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:26.378 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.379 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:26.380 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.381 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:26.382 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.383 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:26.384 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:26.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:26.387 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:26.381+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:26.388 INFO:tasks.workunit.client.0.smithi052.stdout:1/987: sync 2024-09-12T18:03:26.388 INFO:tasks.workunit.client.0.smithi052.stdout:1/988: write d3/dcb/d74/dc8/f117 [421768,112903] 0 2024-09-12T18:03:26.388 INFO:tasks.workunit.client.0.smithi052.stdout:1/989: rmdir d3/dcb/d74/d7d 39 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/990: truncate d3/dcb/d74/f91 6732977 0 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/991: truncate d3/d1d/d22/d3f/db0/f116 183144 0 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/992: creat d3/d1d/d22/d3f/f149 x:0 0 0 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/993: write d3/d1d/d22/d76/fb7 [3845957,110709] 0 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/994: chown d3/da2/ddc/de9/c107 2052 1 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/995: creat d3/dcb/d74/d7d/d84/d10e/f14a x:0 0 0 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/996: link d3/dcb/d74/d7d/d84/dbb/l142 d3/d1d/d22/d66/df0/l14b 0 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/997: fdatasync d3/dcb/f46 0 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/998: dread d3/d1d/d22/fbf [0,4194304] 0 2024-09-12T18:03:26.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/999: dwrite d3/dcb/d74/d7f/fc3 [0,4194304] 0 2024-09-12T18:03:26.390 INFO:tasks.workunit.client.0.smithi052.stderr:+ rm -rf -- ./tmp.rHXaLPNaoG 2024-09-12T18:03:26.390 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:26.390 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:26.390 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:26.391 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:26.411 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:26.412 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:26.487 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:26.483+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:26.520 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:26.520 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:26.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:26.588 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:26.585+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:26.662 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:26.663 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:26.677 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:26.722 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:26.719+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:26.790 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:26.785+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:26.803 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:26.804 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:26.819 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:26.891 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:26.887+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:26.896 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:03:26.914 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:03:26.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:26.952 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:26.952 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:26.966 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:26.992 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:26.989+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:27.093 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:27.087+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:27.131 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:27.131 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:27.145 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:27.194 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:27.189+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:27.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:27.254 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-12T18:03:26.891623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1300621994,"num_objects":11093,"num_object_clones":0,"num_object_copies":22186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11093,"num_whiteouts":0,"num_read":1047,"num_read_kb":459801,"num_write":13416,"num_write_kb":2147612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13379,"ondisk_log_size":13379,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":418292,"kb_used_data":296932,"kb_used_omap":4,"kb_used_meta":121275,"kb_avail":282697228,"statfs":{"total":289910292480,"available":289481961472,"internally_reserved":0,"allocated":304058368,"data_stored":2109195194,"data_compressed":124240652,"data_compressed_allocated":161579008,"data_compressed_original":2020603550,"omap_allocated":4785,"internal_metadata":124185935},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1154067450,"num_objects":409,"num_object_clones":0,"num_object_copies":818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":409,"num_whiteouts":0,"num_read":940,"num_read_kb":454981,"num_write":2288,"num_write_kb":1979475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.311597"},"pg_stats":[{"pgid":"4.3f","version":"50'196","reported_seq":277,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.433633+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:22.433633+0000","last_peered":"2024-09-12T18:03:22.433633+0000","last_clean":"2024-09-12T18:03:22.433633+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:22.433633+0000","last_undegraded":"2024-09-12T18:03:22.433633+0000","last_fullsized":"2024-09-12T18:03:22.433633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34560028,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":7,"num_read_kb":4224,"num_write":196,"num_write_kb":50844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"50'224","reported_seq":342,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.552251+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:03:22.552251+0000","last_peered":"2024-09-12T18:03:22.552251+0000","last_clean":"2024-09-12T18:03:22.552251+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:03:22.552251+0000","last_undegraded":"2024-09-12T18:03:22.552251+0000","last_fullsized":"2024-09-12T18:03:22.552251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26733597,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":44,"num_read_kb":19191,"num_write":224,"num_write_kb":83645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"50'159","reported_seq":234,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.225178+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:21.225178+0000","last_peered":"2024-09-12T18:03:21.225178+0000","last_clean":"2024-09-12T18:03:21.225178+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:21.225178+0000","last_undegraded":"2024-09-12T18:03:21.225178+0000","last_fullsized":"2024-09-12T18:03:21.225178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4962741,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":4968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"50'163","reported_seq":239,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.288316+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:22.288316+0000","last_peered":"2024-09-12T18:03:22.288316+0000","last_clean":"2024-09-12T18:03:22.288316+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:22.288316+0000","last_undegraded":"2024-09-12T18:03:22.288316+0000","last_fullsized":"2024-09-12T18:03:22.288316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13769332,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":1,"num_read_kb":208,"num_write":161,"num_write_kb":13479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"50'210","reported_seq":305,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.637752+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:22.637752+0000","last_peered":"2024-09-12T18:03:22.637752+0000","last_clean":"2024-09-12T18:03:22.637752+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:22.637752+0000","last_undegraded":"2024-09-12T18:03:22.637752+0000","last_fullsized":"2024-09-12T18:03:22.637752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27745386,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":21,"num_read_kb":12741,"num_write":210,"num_write_kb":59365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"50'166","reported_seq":240,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.327439+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:22.327439+0000","last_peered":"2024-09-12T18:03:22.327439+0000","last_clean":"2024-09-12T18:03:22.327439+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:22.327439+0000","last_undegraded":"2024-09-12T18:03:22.327439+0000","last_fullsized":"2024-09-12T18:03:22.327439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21578896,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":21719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"50'198","reported_seq":281,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.566937+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:22.566937+0000","last_peered":"2024-09-12T18:03:22.566937+0000","last_clean":"2024-09-12T18:03:22.566937+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:22.566937+0000","last_undegraded":"2024-09-12T18:03:22.566937+0000","last_fullsized":"2024-09-12T18:03:22.566937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28036621,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":8,"num_read_kb":4236,"num_write":198,"num_write_kb":38799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"50'181","reported_seq":295,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.476435+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:03:22.476435+0000","last_peered":"2024-09-12T18:03:22.476435+0000","last_clean":"2024-09-12T18:03:22.476435+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:03:22.476435+0000","last_undegraded":"2024-09-12T18:03:22.476435+0000","last_fullsized":"2024-09-12T18:03:22.476435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22584973,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":39,"num_read_kb":21518,"num_write":180,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"50'178","reported_seq":256,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.752261+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:21.752261+0000","last_peered":"2024-09-12T18:03:21.752261+0000","last_clean":"2024-09-12T18:03:21.752261+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:21.752261+0000","last_undegraded":"2024-09-12T18:03:21.752261+0000","last_fullsized":"2024-09-12T18:03:21.752261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9500005,"num_objects":174,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":174,"num_whiteouts":0,"num_read":4,"num_read_kb":839,"num_write":178,"num_write_kb":17663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"50'184","reported_seq":285,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.209388+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:03:22.209388+0000","last_peered":"2024-09-12T18:03:22.209388+0000","last_clean":"2024-09-12T18:03:22.209388+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:03:22.209388+0000","last_undegraded":"2024-09-12T18:03:22.209388+0000","last_fullsized":"2024-09-12T18:03:22.209388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32934421,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":27,"num_read_kb":10529,"num_write":184,"num_write_kb":46585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"50'174","reported_seq":273,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.372910+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:22.372910+0000","last_peered":"2024-09-12T18:03:22.372910+0000","last_clean":"2024-09-12T18:03:22.372910+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:22.372910+0000","last_undegraded":"2024-09-12T18:03:22.372910+0000","last_fullsized":"2024-09-12T18:03:22.372910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6023352,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":24,"num_read_kb":8883,"num_write":174,"num_write_kb":21808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"50'166","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.601395+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:22.601395+0000","last_peered":"2024-09-12T18:03:22.601395+0000","last_clean":"2024-09-12T18:03:22.601395+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:22.601395+0000","last_undegraded":"2024-09-12T18:03:22.601395+0000","last_fullsized":"2024-09-12T18:03:22.601395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16623791,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":10,"num_read_kb":5299,"num_write":166,"num_write_kb":25683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"50'161","reported_seq":235,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.697272+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:19.697272+0000","last_peered":"2024-09-12T18:03:19.697272+0000","last_clean":"2024-09-12T18:03:19.697272+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:19.697272+0000","last_undegraded":"2024-09-12T18:03:19.697272+0000","last_fullsized":"2024-09-12T18:03:19.697272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4791593,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"50'191","reported_seq":286,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.589431+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:22.589431+0000","last_peered":"2024-09-12T18:03:22.589431+0000","last_clean":"2024-09-12T18:03:22.589431+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:22.589431+0000","last_undegraded":"2024-09-12T18:03:22.589431+0000","last_fullsized":"2024-09-12T18:03:22.589431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15183931,"num_objects":175,"num_object_clones":0,"num_object_copies":350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":0,"num_read":20,"num_read_kb":5193,"num_write":190,"num_write_kb":34645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"50'192","reported_seq":290,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.512973+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:22.512973+0000","last_peered":"2024-09-12T18:03:22.512973+0000","last_clean":"2024-09-12T18:03:22.512973+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:22.512973+0000","last_undegraded":"2024-09-12T18:03:22.512973+0000","last_fullsized":"2024-09-12T18:03:22.512973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43439738,"num_objects":173,"num_object_clones":0,"num_object_copies":346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":173,"num_whiteouts":0,"num_read":17,"num_read_kb":8782,"num_write":192,"num_write_kb":79411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"50'217","reported_seq":315,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.304750+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:22.304750+0000","last_peered":"2024-09-12T18:03:22.304750+0000","last_clean":"2024-09-12T18:03:22.304750+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:22.304750+0000","last_undegraded":"2024-09-12T18:03:22.304750+0000","last_fullsized":"2024-09-12T18:03:22.304750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31146291,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":23,"num_read_kb":15455,"num_write":215,"num_write_kb":55383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"50'190","reported_seq":282,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.421999+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:22.421999+0000","last_peered":"2024-09-12T18:03:22.421999+0000","last_clean":"2024-09-12T18:03:22.421999+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:22.421999+0000","last_undegraded":"2024-09-12T18:03:22.421999+0000","last_fullsized":"2024-09-12T18:03:22.421999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16639147,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":18,"num_read_kb":10022,"num_write":190,"num_write_kb":30342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"50'183","reported_seq":259,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.361953+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:03:22.361953+0000","last_peered":"2024-09-12T18:03:22.361953+0000","last_clean":"2024-09-12T18:03:22.361953+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:03:22.361953+0000","last_undegraded":"2024-09-12T18:03:22.361953+0000","last_fullsized":"2024-09-12T18:03:22.361953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28374384,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":2,"num_read_kb":135,"num_write":182,"num_write_kb":46152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"50'208","reported_seq":306,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.552497+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:03:22.552497+0000","last_peered":"2024-09-12T18:03:22.552497+0000","last_clean":"2024-09-12T18:03:22.552497+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:03:22.552497+0000","last_undegraded":"2024-09-12T18:03:22.552497+0000","last_fullsized":"2024-09-12T18:03:22.552497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23594205,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":24,"num_read_kb":17125,"num_write":208,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"50'189","reported_seq":265,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.260115+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:22.260115+0000","last_peered":"2024-09-12T18:03:22.260115+0000","last_clean":"2024-09-12T18:03:22.260115+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:22.260115+0000","last_undegraded":"2024-09-12T18:03:22.260115+0000","last_fullsized":"2024-09-12T18:03:22.260115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6070333,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":1,"num_read_kb":100,"num_write":189,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"50'171","reported_seq":252,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.550473+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:03:22.550473+0000","last_peered":"2024-09-12T18:03:22.550473+0000","last_clean":"2024-09-12T18:03:22.550473+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:03:22.550473+0000","last_undegraded":"2024-09-12T18:03:22.550473+0000","last_fullsized":"2024-09-12T18:03:22.550473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221602,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":6,"num_read_kb":1371,"num_write":183,"num_write_kb":17533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"50'201","reported_seq":292,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.655459+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:22.655459+0000","last_peered":"2024-09-12T18:03:22.655459+0000","last_clean":"2024-09-12T18:03:22.655459+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:22.655459+0000","last_undegraded":"2024-09-12T18:03:22.655459+0000","last_fullsized":"2024-09-12T18:03:22.655459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14101425,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":17,"num_read_kb":3382,"num_write":200,"num_write_kb":34393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"50'178","reported_seq":264,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.310425+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:03:22.310425+0000","last_peered":"2024-09-12T18:03:22.310425+0000","last_clean":"2024-09-12T18:03:22.310425+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:03:22.310425+0000","last_undegraded":"2024-09-12T18:03:22.310425+0000","last_fullsized":"2024-09-12T18:03:22.310425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17962291,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":178,"num_write_kb":38251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"50'217","reported_seq":311,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.562220+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:03:22.562220+0000","last_peered":"2024-09-12T18:03:22.562220+0000","last_clean":"2024-09-12T18:03:22.562220+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:03:22.562220+0000","last_undegraded":"2024-09-12T18:03:22.562220+0000","last_fullsized":"2024-09-12T18:03:22.562220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29311840,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":20,"num_read_kb":7675,"num_write":217,"num_write_kb":59638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"50'184","reported_seq":266,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.160059+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:22.160059+0000","last_peered":"2024-09-12T18:03:22.160059+0000","last_clean":"2024-09-12T18:03:22.160059+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:22.160059+0000","last_undegraded":"2024-09-12T18:03:22.160059+0000","last_fullsized":"2024-09-12T18:03:22.160059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":752503,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":182,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"50'211","reported_seq":307,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.592025+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:22.592025+0000","last_peered":"2024-09-12T18:03:22.592025+0000","last_clean":"2024-09-12T18:03:22.592025+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:22.592025+0000","last_undegraded":"2024-09-12T18:03:22.592025+0000","last_fullsized":"2024-09-12T18:03:22.592025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24537103,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":22,"num_read_kb":6182,"num_write":209,"num_write_kb":46989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"50'181","reported_seq":265,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.638048+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:22.638048+0000","last_peered":"2024-09-12T18:03:22.638048+0000","last_clean":"2024-09-12T18:03:22.638048+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:22.638048+0000","last_undegraded":"2024-09-12T18:03:22.638048+0000","last_fullsized":"2024-09-12T18:03:22.638048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25151997,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":9,"num_read_kb":8328,"num_write":181,"num_write_kb":34456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"50'184","reported_seq":281,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.559294+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:22.559294+0000","last_peered":"2024-09-12T18:03:22.559294+0000","last_clean":"2024-09-12T18:03:22.559294+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:22.559294+0000","last_undegraded":"2024-09-12T18:03:22.559294+0000","last_fullsized":"2024-09-12T18:03:22.559294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28407055,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":23,"num_read_kb":13269,"num_write":182,"num_write_kb":30154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"50'190","reported_seq":274,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.360402+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:03:22.360402+0000","last_peered":"2024-09-12T18:03:22.360402+0000","last_clean":"2024-09-12T18:03:22.360402+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:03:22.360402+0000","last_undegraded":"2024-09-12T18:03:22.360402+0000","last_fullsized":"2024-09-12T18:03:22.360402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30641521,"num_objects":167,"num_object_clones":0,"num_object_copies":334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":0,"num_read":10,"num_read_kb":1411,"num_write":190,"num_write_kb":50841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"50'210","reported_seq":274,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.189700+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:22.189700+0000","last_peered":"2024-09-12T18:03:22.189700+0000","last_clean":"2024-09-12T18:03:22.189700+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:22.189700+0000","last_undegraded":"2024-09-12T18:03:22.189700+0000","last_fullsized":"2024-09-12T18:03:22.189700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21732444,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":26,"num_read_kb":14101,"num_write":209,"num_write_kb":38237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"50'203","reported_seq":298,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.511475+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:03:22.511475+0000","last_peered":"2024-09-12T18:03:22.511475+0000","last_clean":"2024-09-12T18:03:22.511475+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:03:22.511475+0000","last_undegraded":"2024-09-12T18:03:22.511475+0000","last_fullsized":"2024-09-12T18:03:22.511475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20172290,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":21,"num_read_kb":10488,"num_write":203,"num_write_kb":42726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"50'188","reported_seq":277,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.567916+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:22.567916+0000","last_peered":"2024-09-12T18:03:22.567916+0000","last_clean":"2024-09-12T18:03:22.567916+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:22.567916+0000","last_undegraded":"2024-09-12T18:03:22.567916+0000","last_fullsized":"2024-09-12T18:03:22.567916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15396585,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":14,"num_read_kb":8387,"num_write":188,"num_write_kb":14940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"50'178","reported_seq":281,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.601178+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:22.601178+0000","last_peered":"2024-09-12T18:03:22.601178+0000","last_clean":"2024-09-12T18:03:22.601178+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:22.601178+0000","last_undegraded":"2024-09-12T18:03:22.601178+0000","last_fullsized":"2024-09-12T18:03:22.601178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37489084,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":29,"num_read_kb":13718,"num_write":177,"num_write_kb":42512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"50'379","reported_seq":456,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.061613+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:22.061613+0000","last_peered":"2024-09-12T18:03:22.061613+0000","last_clean":"2024-09-12T18:03:22.061613+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:22.061613+0000","last_undegraded":"2024-09-12T18:03:22.061613+0000","last_fullsized":"2024-09-12T18:03:22.061613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"50'170","reported_seq":263,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.016558+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:22.016558+0000","last_peered":"2024-09-12T18:03:22.016558+0000","last_clean":"2024-09-12T18:03:22.016558+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:22.016558+0000","last_undegraded":"2024-09-12T18:03:22.016558+0000","last_fullsized":"2024-09-12T18:03:22.016558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9867130,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":19,"num_read_kb":8834,"num_write":169,"num_write_kb":9106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.688380+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:19.688380+0000","last_peered":"2024-09-12T18:03:19.688380+0000","last_clean":"2024-09-12T18:03:19.688380+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:19.688380+0000","last_undegraded":"2024-09-12T18:03:19.688380+0000","last_fullsized":"2024-09-12T18:03:19.688380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"50'183","reported_seq":260,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.189314+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:21.189314+0000","last_peered":"2024-09-12T18:03:21.189314+0000","last_clean":"2024-09-12T18:03:21.189314+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:21.189314+0000","last_undegraded":"2024-09-12T18:03:21.189314+0000","last_fullsized":"2024-09-12T18:03:21.189314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9191417,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":3,"num_read_kb":475,"num_write":183,"num_write_kb":13455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.697134+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:19.697134+0000","last_peered":"2024-09-12T18:03:19.697134+0000","last_clean":"2024-09-12T18:03:19.697134+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:19.697134+0000","last_undegraded":"2024-09-12T18:03:19.697134+0000","last_fullsized":"2024-09-12T18:03:19.697134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"50'175","reported_seq":263,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.455465+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:22.455465+0000","last_peered":"2024-09-12T18:03:22.455465+0000","last_clean":"2024-09-12T18:03:22.455465+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:22.455465+0000","last_undegraded":"2024-09-12T18:03:22.455465+0000","last_fullsized":"2024-09-12T18:03:22.455465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382471,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":14,"num_read_kb":8308,"num_write":174,"num_write_kb":18054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":85,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682381+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:19.682381+0000","last_peered":"2024-09-12T18:03:19.682381+0000","last_clean":"2024-09-12T18:03:19.682381+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:19.682381+0000","last_undegraded":"2024-09-12T18:03:19.682381+0000","last_fullsized":"2024-09-12T18:03:19.682381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685603+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:19.685603+0000","last_peered":"2024-09-12T18:03:19.685603+0000","last_clean":"2024-09-12T18:03:19.685603+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:19.685603+0000","last_undegraded":"2024-09-12T18:03:19.685603+0000","last_fullsized":"2024-09-12T18:03:19.685603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"50'185","reported_seq":265,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.369487+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:22.369487+0000","last_peered":"2024-09-12T18:03:22.369487+0000","last_clean":"2024-09-12T18:03:22.369487+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:22.369487+0000","last_undegraded":"2024-09-12T18:03:22.369487+0000","last_fullsized":"2024-09-12T18:03:22.369487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4922695,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":6,"num_read_kb":1156,"num_write":184,"num_write_kb":21443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.702423+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:19.702423+0000","last_peered":"2024-09-12T18:03:19.702423+0000","last_clean":"2024-09-12T18:03:19.702423+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:19.702423+0000","last_undegraded":"2024-09-12T18:03:19.702423+0000","last_fullsized":"2024-09-12T18:03:19.702423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'210","reported_seq":297,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.514785+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:03:22.514785+0000","last_peered":"2024-09-12T18:03:22.514785+0000","last_clean":"2024-09-12T18:03:22.514785+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:03:22.514785+0000","last_undegraded":"2024-09-12T18:03:22.514785+0000","last_fullsized":"2024-09-12T18:03:22.514785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18828476,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":13,"num_read_kb":6070,"num_write":210,"num_write_kb":34870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"50'3","reported_seq":80,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684603+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:19.684603+0000","last_peered":"2024-09-12T18:03:19.684603+0000","last_clean":"2024-09-12T18:03:19.684603+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:19.684603+0000","last_undegraded":"2024-09-12T18:03:19.684603+0000","last_fullsized":"2024-09-12T18:03:19.684603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'190","reported_seq":282,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.426006+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:22.426006+0000","last_peered":"2024-09-12T18:03:22.426006+0000","last_clean":"2024-09-12T18:03:22.426006+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:22.426006+0000","last_undegraded":"2024-09-12T18:03:22.426006+0000","last_fullsized":"2024-09-12T18:03:22.426006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18547308,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":17,"num_read_kb":9090,"num_write":189,"num_write_kb":26103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685291+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:19.685291+0000","last_peered":"2024-09-12T18:03:19.685291+0000","last_clean":"2024-09-12T18:03:19.685291+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:19.685291+0000","last_undegraded":"2024-09-12T18:03:19.685291+0000","last_fullsized":"2024-09-12T18:03:19.685291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"50'196","reported_seq":295,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.270762+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:03:22.270762+0000","last_peered":"2024-09-12T18:03:22.270762+0000","last_clean":"2024-09-12T18:03:22.270762+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:03:22.270762+0000","last_undegraded":"2024-09-12T18:03:22.270762+0000","last_fullsized":"2024-09-12T18:03:22.270762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13106092,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":25,"num_read_kb":13268,"num_write":196,"num_write_kb":34177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'5","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685585+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:03:19.685585+0000","last_peered":"2024-09-12T18:03:19.685585+0000","last_clean":"2024-09-12T18:03:19.685585+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:03:19.685585+0000","last_undegraded":"2024-09-12T18:03:19.685585+0000","last_fullsized":"2024-09-12T18:03:19.685585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"50'200","reported_seq":280,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.509473+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:03:22.509473+0000","last_peered":"2024-09-12T18:03:22.509473+0000","last_clean":"2024-09-12T18:03:22.509473+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:03:22.509473+0000","last_undegraded":"2024-09-12T18:03:22.509473+0000","last_fullsized":"2024-09-12T18:03:22.509473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13245429,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":5,"num_read_kb":985,"num_write":200,"num_write_kb":9829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682638+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:19.682638+0000","last_peered":"2024-09-12T18:03:19.682638+0000","last_clean":"2024-09-12T18:03:19.682638+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:19.682638+0000","last_undegraded":"2024-09-12T18:03:19.682638+0000","last_fullsized":"2024-09-12T18:03:19.682638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"50'193","reported_seq":286,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.433329+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:22.433329+0000","last_peered":"2024-09-12T18:03:22.433329+0000","last_clean":"2024-09-12T18:03:22.433329+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:22.433329+0000","last_undegraded":"2024-09-12T18:03:22.433329+0000","last_fullsized":"2024-09-12T18:03:22.433329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30195347,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":193,"num_write_kb":66646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.697404+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:19.697404+0000","last_peered":"2024-09-12T18:03:19.697404+0000","last_clean":"2024-09-12T18:03:19.697404+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:19.697404+0000","last_undegraded":"2024-09-12T18:03:19.697404+0000","last_fullsized":"2024-09-12T18:03:19.697404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"50'167","reported_seq":251,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.519118+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:22.519118+0000","last_peered":"2024-09-12T18:03:22.519118+0000","last_clean":"2024-09-12T18:03:22.519118+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:22.519118+0000","last_undegraded":"2024-09-12T18:03:22.519118+0000","last_fullsized":"2024-09-12T18:03:22.519118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20353415,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":9,"num_read_kb":1909,"num_write":166,"num_write_kb":25846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.696104+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:03:19.696104+0000","last_peered":"2024-09-12T18:03:19.696104+0000","last_clean":"2024-09-12T18:03:19.696104+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:03:19.696104+0000","last_undegraded":"2024-09-12T18:03:19.696104+0000","last_fullsized":"2024-09-12T18:03:19.696104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"50'167","reported_seq":252,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.473445+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:22.473445+0000","last_peered":"2024-09-12T18:03:22.473445+0000","last_clean":"2024-09-12T18:03:22.473445+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:22.473445+0000","last_undegraded":"2024-09-12T18:03:22.473445+0000","last_fullsized":"2024-09-12T18:03:22.473445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10048548,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":11,"num_read_kb":4900,"num_write":166,"num_write_kb":13114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":227,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682390+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:19.682390+0000","last_peered":"2024-09-12T18:03:19.682390+0000","last_clean":"2024-09-12T18:03:19.682390+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:19.682390+0000","last_undegraded":"2024-09-12T18:03:19.682390+0000","last_fullsized":"2024-09-12T18:03:19.682390+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":91,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685080+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:19.685080+0000","last_peered":"2024-09-12T18:03:19.685080+0000","last_clean":"2024-09-12T18:03:19.685080+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:19.685080+0000","last_undegraded":"2024-09-12T18:03:19.685080+0000","last_fullsized":"2024-09-12T18:03:19.685080+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"50'193","reported_seq":269,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:20.336999+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:20.336999+0000","last_peered":"2024-09-12T18:03:20.336999+0000","last_clean":"2024-09-12T18:03:20.336999+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:20.336999+0000","last_undegraded":"2024-09-12T18:03:20.336999+0000","last_fullsized":"2024-09-12T18:03:20.336999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"50'194","reported_seq":282,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.629858+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:22.629858+0000","last_peered":"2024-09-12T18:03:22.629858+0000","last_clean":"2024-09-12T18:03:22.629858+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:22.629858+0000","last_undegraded":"2024-09-12T18:03:22.629858+0000","last_fullsized":"2024-09-12T18:03:22.629858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20498988,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":13,"num_read_kb":5514,"num_write":192,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682274+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:19.682274+0000","last_peered":"2024-09-12T18:03:19.682274+0000","last_clean":"2024-09-12T18:03:19.682274+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:19.682274+0000","last_undegraded":"2024-09-12T18:03:19.682274+0000","last_fullsized":"2024-09-12T18:03:19.682274+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"50'7","reported_seq":88,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.744508+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:03:21.744508+0000","last_peered":"2024-09-12T18:03:21.744508+0000","last_clean":"2024-09-12T18:03:21.744508+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:03:21.744508+0000","last_undegraded":"2024-09-12T18:03:21.744508+0000","last_fullsized":"2024-09-12T18:03:21.744508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"50'216","reported_seq":321,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.555118+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:03:22.555118+0000","last_peered":"2024-09-12T18:03:22.555118+0000","last_clean":"2024-09-12T18:03:22.555118+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:03:22.555118+0000","last_undegraded":"2024-09-12T18:03:22.555118+0000","last_fullsized":"2024-09-12T18:03:22.555118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34201486,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":32,"num_read_kb":16023,"num_write":216,"num_write_kb":43305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685453+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:19.685453+0000","last_peered":"2024-09-12T18:03:19.685453+0000","last_clean":"2024-09-12T18:03:19.685453+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:19.685453+0000","last_undegraded":"2024-09-12T18:03:19.685453+0000","last_fullsized":"2024-09-12T18:03:19.685453+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"50'312","reported_seq":388,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.218061+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:21.218061+0000","last_peered":"2024-09-12T18:03:21.218061+0000","last_clean":"2024-09-12T18:03:21.218061+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:21.218061+0000","last_undegraded":"2024-09-12T18:03:21.218061+0000","last_fullsized":"2024-09-12T18:03:21.218061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"50'152","reported_seq":229,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.691351+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:03:21.691351+0000","last_peered":"2024-09-12T18:03:21.691351+0000","last_clean":"2024-09-12T18:03:21.691351+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:03:21.691351+0000","last_undegraded":"2024-09-12T18:03:21.691351+0000","last_fullsized":"2024-09-12T18:03:21.691351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7027245,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":3,"num_read_kb":618,"num_write":152,"num_write_kb":8996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":102,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682726+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:19.682726+0000","last_peered":"2024-09-12T18:03:19.682726+0000","last_clean":"2024-09-12T18:03:19.682726+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:19.682726+0000","last_undegraded":"2024-09-12T18:03:19.682726+0000","last_fullsized":"2024-09-12T18:03:19.682726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684957+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:19.684957+0000","last_peered":"2024-09-12T18:03:19.684957+0000","last_clean":"2024-09-12T18:03:19.684957+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:19.684957+0000","last_undegraded":"2024-09-12T18:03:19.684957+0000","last_fullsized":"2024-09-12T18:03:19.684957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"50'191","reported_seq":316,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.519204+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:22.519204+0000","last_peered":"2024-09-12T18:03:22.519204+0000","last_clean":"2024-09-12T18:03:22.519204+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:22.519204+0000","last_undegraded":"2024-09-12T18:03:22.519204+0000","last_fullsized":"2024-09-12T18:03:22.519204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36913136,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":51,"num_read_kb":21361,"num_write":191,"num_write_kb":59517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684440+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:19.684440+0000","last_peered":"2024-09-12T18:03:19.684440+0000","last_clean":"2024-09-12T18:03:19.684440+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:19.684440+0000","last_undegraded":"2024-09-12T18:03:19.684440+0000","last_fullsized":"2024-09-12T18:03:19.684440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685457+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:19.685457+0000","last_peered":"2024-09-12T18:03:19.685457+0000","last_clean":"2024-09-12T18:03:19.685457+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:19.685457+0000","last_undegraded":"2024-09-12T18:03:19.685457+0000","last_fullsized":"2024-09-12T18:03:19.685457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"50'162","reported_seq":240,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.749402+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:21.749402+0000","last_peered":"2024-09-12T18:03:21.749402+0000","last_clean":"2024-09-12T18:03:21.749402+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:21.749402+0000","last_undegraded":"2024-09-12T18:03:21.749402+0000","last_fullsized":"2024-09-12T18:03:21.749402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570184,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":4,"num_read_kb":719,"num_write":160,"num_write_kb":21518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685295+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:03:19.685295+0000","last_peered":"2024-09-12T18:03:19.685295+0000","last_clean":"2024-09-12T18:03:19.685295+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:03:19.685295+0000","last_undegraded":"2024-09-12T18:03:19.685295+0000","last_fullsized":"2024-09-12T18:03:19.685295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.700071+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:03:19.700071+0000","last_peered":"2024-09-12T18:03:19.700071+0000","last_clean":"2024-09-12T18:03:19.700071+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:03:19.700071+0000","last_undegraded":"2024-09-12T18:03:19.700071+0000","last_fullsized":"2024-09-12T18:03:19.700071+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"50'171","reported_seq":261,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.421410+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:22.421410+0000","last_peered":"2024-09-12T18:03:22.421410+0000","last_clean":"2024-09-12T18:03:22.421410+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:22.421410+0000","last_undegraded":"2024-09-12T18:03:22.421410+0000","last_fullsized":"2024-09-12T18:03:22.421410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7843653,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":16,"num_read_kb":4437,"num_write":170,"num_write_kb":17497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.687444+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:03:19.687444+0000","last_peered":"2024-09-12T18:03:19.687444+0000","last_clean":"2024-09-12T18:03:19.687444+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:03:19.687444+0000","last_undegraded":"2024-09-12T18:03:19.687444+0000","last_fullsized":"2024-09-12T18:03:19.687444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.687254+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:03:19.687254+0000","last_peered":"2024-09-12T18:03:19.687254+0000","last_clean":"2024-09-12T18:03:19.687254+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:03:19.687254+0000","last_undegraded":"2024-09-12T18:03:19.687254+0000","last_fullsized":"2024-09-12T18:03:19.687254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"50'173","reported_seq":247,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:20.632718+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:03:20.632718+0000","last_peered":"2024-09-12T18:03:20.632718+0000","last_clean":"2024-09-12T18:03:20.632718+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:03:20.632718+0000","last_undegraded":"2024-09-12T18:03:20.632718+0000","last_fullsized":"2024-09-12T18:03:20.632718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9270753,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":13039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"50'27","reported_seq":103,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:20.738602+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:03:20.738602+0000","last_peered":"2024-09-12T18:03:20.738602+0000","last_clean":"2024-09-12T18:03:20.738602+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:03:20.738602+0000","last_undegraded":"2024-09-12T18:03:20.738602+0000","last_fullsized":"2024-09-12T18:03:20.738602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685666+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:19.685666+0000","last_peered":"2024-09-12T18:03:19.685666+0000","last_clean":"2024-09-12T18:03:19.685666+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:19.685666+0000","last_undegraded":"2024-09-12T18:03:19.685666+0000","last_fullsized":"2024-09-12T18:03:19.685666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"50'171","reported_seq":266,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.436588+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:22.436588+0000","last_peered":"2024-09-12T18:03:22.436588+0000","last_clean":"2024-09-12T18:03:22.436588+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:22.436588+0000","last_undegraded":"2024-09-12T18:03:22.436588+0000","last_fullsized":"2024-09-12T18:03:22.436588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11971922,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":21,"num_read_kb":5517,"num_write":171,"num_write_kb":6228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"50'182","reported_seq":265,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.573367+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:22.573367+0000","last_peered":"2024-09-12T18:03:22.573367+0000","last_clean":"2024-09-12T18:03:22.573367+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:22.573367+0000","last_undegraded":"2024-09-12T18:03:22.573367+0000","last_fullsized":"2024-09-12T18:03:22.573367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29666525,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":8,"num_read_kb":8232,"num_write":182,"num_write_kb":63700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"49'22","reported_seq":99,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684932+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:19.684932+0000","last_peered":"2024-09-12T18:03:19.684932+0000","last_clean":"2024-09-12T18:03:19.684932+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:19.684932+0000","last_undegraded":"2024-09-12T18:03:19.684932+0000","last_fullsized":"2024-09-12T18:03:19.684932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"50'200","reported_seq":279,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.228331+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:22.228331+0000","last_peered":"2024-09-12T18:03:22.228331+0000","last_clean":"2024-09-12T18:03:22.228331+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:22.228331+0000","last_undegraded":"2024-09-12T18:03:22.228331+0000","last_fullsized":"2024-09-12T18:03:22.228331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36105865,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":5,"num_read_kb":1334,"num_write":199,"num_write_kb":63085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"50'7","reported_seq":83,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.752308+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:19.752308+0000","last_peered":"2024-09-12T18:03:19.752308+0000","last_clean":"2024-09-12T18:03:19.752308+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:19.752308+0000","last_undegraded":"2024-09-12T18:03:19.752308+0000","last_fullsized":"2024-09-12T18:03:19.752308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684682+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:03:19.684682+0000","last_peered":"2024-09-12T18:03:19.684682+0000","last_clean":"2024-09-12T18:03:19.684682+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:03:19.684682+0000","last_undegraded":"2024-09-12T18:03:19.684682+0000","last_fullsized":"2024-09-12T18:03:19.684682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"50'224","reported_seq":342,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.594134+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:22.594134+0000","last_peered":"2024-09-12T18:03:22.594134+0000","last_clean":"2024-09-12T18:03:22.594134+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:22.594134+0000","last_undegraded":"2024-09-12T18:03:22.594134+0000","last_fullsized":"2024-09-12T18:03:22.594134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32213711,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":44,"num_read_kb":30029,"num_write":224,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"49'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.687167+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:03:19.687167+0000","last_peered":"2024-09-12T18:03:19.687167+0000","last_clean":"2024-09-12T18:03:19.687167+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:03:19.687167+0000","last_undegraded":"2024-09-12T18:03:19.687167+0000","last_fullsized":"2024-09-12T18:03:19.687167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"50'202","reported_seq":288,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.603522+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:03:22.603522+0000","last_peered":"2024-09-12T18:03:22.603522+0000","last_clean":"2024-09-12T18:03:22.603522+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:03:22.603522+0000","last_undegraded":"2024-09-12T18:03:22.603522+0000","last_fullsized":"2024-09-12T18:03:22.603522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28635238,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":12,"num_read_kb":8782,"num_write":202,"num_write_kb":33963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"50'164","reported_seq":257,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.602373+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:22.602373+0000","last_peered":"2024-09-12T18:03:22.602373+0000","last_clean":"2024-09-12T18:03:22.602373+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:22.602373+0000","last_undegraded":"2024-09-12T18:03:22.602373+0000","last_fullsized":"2024-09-12T18:03:22.602373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23911930,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":19,"num_read_kb":12412,"num_write":164,"num_write_kb":26093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"50'203","reported_seq":277,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.641709+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:22.641709+0000","last_peered":"2024-09-12T18:03:22.641709+0000","last_clean":"2024-09-12T18:03:22.641709+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:22.641709+0000","last_undegraded":"2024-09-12T18:03:22.641709+0000","last_fullsized":"2024-09-12T18:03:22.641709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2760524,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":2780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"50'209","reported_seq":308,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.437964+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:03:22.437964+0000","last_peered":"2024-09-12T18:03:22.437964+0000","last_clean":"2024-09-12T18:03:22.437964+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:03:22.437964+0000","last_undegraded":"2024-09-12T18:03:22.437964+0000","last_fullsized":"2024-09-12T18:03:22.437964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24757709,"num_objects":174,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":174,"num_whiteouts":0,"num_read":25,"num_read_kb":6728,"num_write":208,"num_write_kb":52186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"50'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685321+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:03:19.685321+0000","last_peered":"2024-09-12T18:03:19.685321+0000","last_clean":"2024-09-12T18:03:19.685321+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:03:19.685321+0000","last_undegraded":"2024-09-12T18:03:19.685321+0000","last_fullsized":"2024-09-12T18:03:19.685321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"50'167","reported_seq":262,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.475959+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:22.475959+0000","last_peered":"2024-09-12T18:03:22.475959+0000","last_clean":"2024-09-12T18:03:22.475959+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:22.475959+0000","last_undegraded":"2024-09-12T18:03:22.475959+0000","last_fullsized":"2024-09-12T18:03:22.475959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17447903,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":21,"num_read_kb":7522,"num_write":166,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"47'4","reported_seq":80,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.700091+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:19.700091+0000","last_peered":"2024-09-12T18:03:19.700091+0000","last_clean":"2024-09-12T18:03:19.700091+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:19.700091+0000","last_undegraded":"2024-09-12T18:03:19.700091+0000","last_fullsized":"2024-09-12T18:03:19.700091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"50'162","reported_seq":236,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.382946+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:03:22.382946+0000","last_peered":"2024-09-12T18:03:22.382946+0000","last_clean":"2024-09-12T18:03:22.382946+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:03:22.382946+0000","last_undegraded":"2024-09-12T18:03:22.382946+0000","last_fullsized":"2024-09-12T18:03:22.382946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17696564,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.697473+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:19.697473+0000","last_peered":"2024-09-12T18:03:19.697473+0000","last_clean":"2024-09-12T18:03:19.697473+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:19.697473+0000","last_undegraded":"2024-09-12T18:03:19.697473+0000","last_fullsized":"2024-09-12T18:03:19.697473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"50'173","reported_seq":249,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.909890+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:03:21.909890+0000","last_peered":"2024-09-12T18:03:21.909890+0000","last_clean":"2024-09-12T18:03:21.909890+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:03:21.909890+0000","last_undegraded":"2024-09-12T18:03:21.909890+0000","last_fullsized":"2024-09-12T18:03:21.909890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1816840,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":1,"num_read_kb":788,"num_write":173,"num_write_kb":13338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"50'3","reported_seq":80,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.683665+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:03:19.683665+0000","last_peered":"2024-09-12T18:03:19.683665+0000","last_clean":"2024-09-12T18:03:19.683665+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:03:19.683665+0000","last_undegraded":"2024-09-12T18:03:19.683665+0000","last_fullsized":"2024-09-12T18:03:19.683665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"50'181","reported_seq":266,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.564611+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:03:22.564611+0000","last_peered":"2024-09-12T18:03:22.564611+0000","last_clean":"2024-09-12T18:03:22.564611+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:03:22.564611+0000","last_undegraded":"2024-09-12T18:03:22.564611+0000","last_fullsized":"2024-09-12T18:03:22.564611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10054778,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":10,"num_read_kb":5710,"num_write":181,"num_write_kb":17551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"49'75","reported_seq":151,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.699144+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:19.699144+0000","last_peered":"2024-09-12T18:03:19.699144+0000","last_clean":"2024-09-12T18:03:19.699144+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:19.699144+0000","last_undegraded":"2024-09-12T18:03:19.699144+0000","last_fullsized":"2024-09-12T18:03:19.699144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":8231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"50'176","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.253903+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:22.253903+0000","last_peered":"2024-09-12T18:03:22.253903+0000","last_clean":"2024-09-12T18:03:22.253903+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:22.253903+0000","last_undegraded":"2024-09-12T18:03:22.253903+0000","last_fullsized":"2024-09-12T18:03:22.253903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13213327,"num_objects":173,"num_object_clones":0,"num_object_copies":346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":13215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"47'3","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.686448+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:03:19.686448+0000","last_peered":"2024-09-12T18:03:19.686448+0000","last_clean":"2024-09-12T18:03:19.686448+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:03:19.686448+0000","last_undegraded":"2024-09-12T18:03:19.686448+0000","last_fullsized":"2024-09-12T18:03:19.686448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"50'197","reported_seq":296,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.680153+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:22.680153+0000","last_peered":"2024-09-12T18:03:22.680153+0000","last_clean":"2024-09-12T18:03:22.680153+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:22.680153+0000","last_undegraded":"2024-09-12T18:03:22.680153+0000","last_fullsized":"2024-09-12T18:03:22.680153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13062829,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":24,"num_read_kb":7535,"num_write":195,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"46'69","reported_seq":145,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.686888+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:03:19.686888+0000","last_peered":"2024-09-12T18:03:19.686888+0000","last_clean":"2024-09-12T18:03:19.686888+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:03:19.686888+0000","last_undegraded":"2024-09-12T18:03:19.686888+0000","last_fullsized":"2024-09-12T18:03:19.686888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":1242739419,"num_objects":11053,"num_object_clones":0,"num_object_copies":22106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11053,"num_whiteouts":0,"num_read":956,"num_read_kb":459720,"num_write":11908,"num_write_kb":2087438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":293765120,"data_stored":2316715916,"data_compressed":122568212,"data_compressed_allocated":161009664,"data_compressed_original":2237336972,"omap_allocated":0,"internal_metadata":0},"log_size":11929,"ondisk_log_size":11929,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":57292188,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5,"num_read_kb":8,"num_write":1361,"num_write_kb":57500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31211520,"data_stored":114654092,"data_compressed":17102220,"data_compressed_allocated":21200896,"data_compressed_original":104710144,"omap_allocated":0,"internal_metadata":0},"log_size":1335,"ondisk_log_size":1335,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162712,"kb_used_data":113468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94209128,"statfs":{"total":96636764160,"available":96470147072,"internally_reserved":0,"allocated":116191232,"data_stored":932112685,"data_compressed":51962253,"data_compressed_allocated":68128768,"data_compressed_original":904139958,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738392,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119092,"kb_used_data":92052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94252748,"statfs":{"total":96636764160,"available":96514813952,"internally_reserved":0,"allocated":94261248,"data_stored":588404379,"data_compressed":35562894,"data_compressed_allocated":46030848,"data_compressed_original":556775494,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738392,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136488,"kb_used_data":91412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94235352,"statfs":{"total":96636764160,"available":96497000448,"internally_reserved":0,"allocated":93605888,"data_stored":588678130,"data_compressed":36715505,"data_compressed_allocated":47419392,"data_compressed_original":559688098,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10993664,"data_stored":41948752,"data_compressed":6348682,"data_compressed_allocated":7786496,"data_compressed_original":38772736,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10903552,"data_stored":40544972,"data_compressed":6063373,"data_compressed_allocated":7516160,"data_compressed_original":37179392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9314304,"data_stored":32160368,"data_compressed":4690165,"data_compressed_allocated":5898240,"data_compressed_original":28758016,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89108480,"data_stored":654011768,"data_compressed":35415865,"data_compressed_allocated":46374912,"data_compressed_original":628310167,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98009088,"data_stored":760935166,"data_compressed":39787189,"data_compressed_allocated":52277248,"data_compressed_original":731693814,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106647552,"data_stored":901768982,"data_compressed":47365158,"data_compressed_allocated":62357504,"data_compressed_original":877332991,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:27.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:27.295 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:27.291+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:27.311 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:27.312 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:27.326 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:27.395 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:27.391+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:27.459 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:27.460 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:27.474 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:27.497 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:27.491+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:27.597 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:27.593+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:27.598 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:27.598 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:27.604 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:27.606 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:27.613 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:27.622 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-12T18:03:26.891623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1300621994,"num_objects":11093,"num_object_clones":0,"num_object_copies":22186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11093,"num_whiteouts":0,"num_read":1047,"num_read_kb":459801,"num_write":13416,"num_write_kb":2147612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13379,"ondisk_log_size":13379,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":418292,"kb_used_data":296932,"kb_used_omap":4,"kb_used_meta":121275,"kb_avail":282697228,"statfs":{"total":289910292480,"available":289481961472,"internally_reserved":0,"allocated":304058368,"data_stored":2109195194,"data_compressed":124240652,"data_compressed_allocated":161579008,"data_compressed_original":2020603550,"omap_allocated":4785,"internal_metadata":124185935},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1154067450,"num_objects":409,"num_object_clones":0,"num_object_copies":818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":409,"num_whiteouts":0,"num_read":940,"num_read_kb":454981,"num_write":2288,"num_write_kb":1979475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.311597"},"pg_stats":[{"pgid":"4.3f","version":"50'196","reported_seq":277,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.433633+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:22.433633+0000","last_peered":"2024-09-12T18:03:22.433633+0000","last_clean":"2024-09-12T18:03:22.433633+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:22.433633+0000","last_undegraded":"2024-09-12T18:03:22.433633+0000","last_fullsized":"2024-09-12T18:03:22.433633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34560028,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":7,"num_read_kb":4224,"num_write":196,"num_write_kb":50844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"50'224","reported_seq":342,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.552251+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:03:22.552251+0000","last_peered":"2024-09-12T18:03:22.552251+0000","last_clean":"2024-09-12T18:03:22.552251+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:03:22.552251+0000","last_undegraded":"2024-09-12T18:03:22.552251+0000","last_fullsized":"2024-09-12T18:03:22.552251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26733597,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":44,"num_read_kb":19191,"num_write":224,"num_write_kb":83645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"50'159","reported_seq":234,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.225178+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:21.225178+0000","last_peered":"2024-09-12T18:03:21.225178+0000","last_clean":"2024-09-12T18:03:21.225178+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:21.225178+0000","last_undegraded":"2024-09-12T18:03:21.225178+0000","last_fullsized":"2024-09-12T18:03:21.225178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4962741,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":4968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"50'163","reported_seq":239,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.288316+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:22.288316+0000","last_peered":"2024-09-12T18:03:22.288316+0000","last_clean":"2024-09-12T18:03:22.288316+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:22.288316+0000","last_undegraded":"2024-09-12T18:03:22.288316+0000","last_fullsized":"2024-09-12T18:03:22.288316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13769332,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":1,"num_read_kb":208,"num_write":161,"num_write_kb":13479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"50'210","reported_seq":305,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.637752+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:22.637752+0000","last_peered":"2024-09-12T18:03:22.637752+0000","last_clean":"2024-09-12T18:03:22.637752+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:22.637752+0000","last_undegraded":"2024-09-12T18:03:22.637752+0000","last_fullsized":"2024-09-12T18:03:22.637752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27745386,"num_objects":185,"num_object_clones":0,"num_object_copies":370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":185,"num_whiteouts":0,"num_read":21,"num_read_kb":12741,"num_write":210,"num_write_kb":59365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"50'166","reported_seq":240,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.327439+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:22.327439+0000","last_peered":"2024-09-12T18:03:22.327439+0000","last_clean":"2024-09-12T18:03:22.327439+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:22.327439+0000","last_undegraded":"2024-09-12T18:03:22.327439+0000","last_fullsized":"2024-09-12T18:03:22.327439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21578896,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":21719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"50'198","reported_seq":281,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.566937+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:22.566937+0000","last_peered":"2024-09-12T18:03:22.566937+0000","last_clean":"2024-09-12T18:03:22.566937+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:22.566937+0000","last_undegraded":"2024-09-12T18:03:22.566937+0000","last_fullsized":"2024-09-12T18:03:22.566937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28036621,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":8,"num_read_kb":4236,"num_write":198,"num_write_kb":38799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"50'181","reported_seq":295,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.476435+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:03:22.476435+0000","last_peered":"2024-09-12T18:03:22.476435+0000","last_clean":"2024-09-12T18:03:22.476435+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:03:22.476435+0000","last_undegraded":"2024-09-12T18:03:22.476435+0000","last_fullsized":"2024-09-12T18:03:22.476435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22584973,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":39,"num_read_kb":21518,"num_write":180,"num_write_kb":43009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"50'178","reported_seq":256,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.752261+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:21.752261+0000","last_peered":"2024-09-12T18:03:21.752261+0000","last_clean":"2024-09-12T18:03:21.752261+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:21.752261+0000","last_undegraded":"2024-09-12T18:03:21.752261+0000","last_fullsized":"2024-09-12T18:03:21.752261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9500005,"num_objects":174,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":174,"num_whiteouts":0,"num_read":4,"num_read_kb":839,"num_write":178,"num_write_kb":17663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"50'184","reported_seq":285,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.209388+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:03:22.209388+0000","last_peered":"2024-09-12T18:03:22.209388+0000","last_clean":"2024-09-12T18:03:22.209388+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:03:22.209388+0000","last_undegraded":"2024-09-12T18:03:22.209388+0000","last_fullsized":"2024-09-12T18:03:22.209388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32934421,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":27,"num_read_kb":10529,"num_write":184,"num_write_kb":46585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"50'174","reported_seq":273,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.372910+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:22.372910+0000","last_peered":"2024-09-12T18:03:22.372910+0000","last_clean":"2024-09-12T18:03:22.372910+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:22.372910+0000","last_undegraded":"2024-09-12T18:03:22.372910+0000","last_fullsized":"2024-09-12T18:03:22.372910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6023352,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":24,"num_read_kb":8883,"num_write":174,"num_write_kb":21808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"50'166","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.601395+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:22.601395+0000","last_peered":"2024-09-12T18:03:22.601395+0000","last_clean":"2024-09-12T18:03:22.601395+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:22.601395+0000","last_undegraded":"2024-09-12T18:03:22.601395+0000","last_fullsized":"2024-09-12T18:03:22.601395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16623791,"num_objects":155,"num_object_clones":0,"num_object_copies":310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":155,"num_whiteouts":0,"num_read":10,"num_read_kb":5299,"num_write":166,"num_write_kb":25683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"50'161","reported_seq":235,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.697272+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:19.697272+0000","last_peered":"2024-09-12T18:03:19.697272+0000","last_clean":"2024-09-12T18:03:19.697272+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:19.697272+0000","last_undegraded":"2024-09-12T18:03:19.697272+0000","last_fullsized":"2024-09-12T18:03:19.697272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4791593,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"50'191","reported_seq":286,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.589431+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:22.589431+0000","last_peered":"2024-09-12T18:03:22.589431+0000","last_clean":"2024-09-12T18:03:22.589431+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:22.589431+0000","last_undegraded":"2024-09-12T18:03:22.589431+0000","last_fullsized":"2024-09-12T18:03:22.589431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15183931,"num_objects":175,"num_object_clones":0,"num_object_copies":350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":0,"num_read":20,"num_read_kb":5193,"num_write":190,"num_write_kb":34645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"50'192","reported_seq":290,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.512973+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:22.512973+0000","last_peered":"2024-09-12T18:03:22.512973+0000","last_clean":"2024-09-12T18:03:22.512973+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:22.512973+0000","last_undegraded":"2024-09-12T18:03:22.512973+0000","last_fullsized":"2024-09-12T18:03:22.512973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43439738,"num_objects":173,"num_object_clones":0,"num_object_copies":346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":173,"num_whiteouts":0,"num_read":17,"num_read_kb":8782,"num_write":192,"num_write_kb":79411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"50'217","reported_seq":315,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.304750+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:22.304750+0000","last_peered":"2024-09-12T18:03:22.304750+0000","last_clean":"2024-09-12T18:03:22.304750+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:22.304750+0000","last_undegraded":"2024-09-12T18:03:22.304750+0000","last_fullsized":"2024-09-12T18:03:22.304750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31146291,"num_objects":188,"num_object_clones":0,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":0,"num_read":23,"num_read_kb":15455,"num_write":215,"num_write_kb":55383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"50'190","reported_seq":282,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.421999+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:22.421999+0000","last_peered":"2024-09-12T18:03:22.421999+0000","last_clean":"2024-09-12T18:03:22.421999+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:22.421999+0000","last_undegraded":"2024-09-12T18:03:22.421999+0000","last_fullsized":"2024-09-12T18:03:22.421999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16639147,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":18,"num_read_kb":10022,"num_write":190,"num_write_kb":30342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"50'183","reported_seq":259,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.361953+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:03:22.361953+0000","last_peered":"2024-09-12T18:03:22.361953+0000","last_clean":"2024-09-12T18:03:22.361953+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:03:22.361953+0000","last_undegraded":"2024-09-12T18:03:22.361953+0000","last_fullsized":"2024-09-12T18:03:22.361953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28374384,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":2,"num_read_kb":135,"num_write":182,"num_write_kb":46152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"50'208","reported_seq":306,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.552497+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:03:22.552497+0000","last_peered":"2024-09-12T18:03:22.552497+0000","last_clean":"2024-09-12T18:03:22.552497+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:03:22.552497+0000","last_undegraded":"2024-09-12T18:03:22.552497+0000","last_fullsized":"2024-09-12T18:03:22.552497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23594205,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":24,"num_read_kb":17125,"num_write":208,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"50'189","reported_seq":265,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.260115+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:22.260115+0000","last_peered":"2024-09-12T18:03:22.260115+0000","last_clean":"2024-09-12T18:03:22.260115+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:22.260115+0000","last_undegraded":"2024-09-12T18:03:22.260115+0000","last_fullsized":"2024-09-12T18:03:22.260115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6070333,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":1,"num_read_kb":100,"num_write":189,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"50'171","reported_seq":252,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.550473+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:03:22.550473+0000","last_peered":"2024-09-12T18:03:22.550473+0000","last_clean":"2024-09-12T18:03:22.550473+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:03:22.550473+0000","last_undegraded":"2024-09-12T18:03:22.550473+0000","last_fullsized":"2024-09-12T18:03:22.550473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14221602,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":6,"num_read_kb":1371,"num_write":183,"num_write_kb":17533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"50'201","reported_seq":292,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.655459+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:22.655459+0000","last_peered":"2024-09-12T18:03:22.655459+0000","last_clean":"2024-09-12T18:03:22.655459+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:22.655459+0000","last_undegraded":"2024-09-12T18:03:22.655459+0000","last_fullsized":"2024-09-12T18:03:22.655459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14101425,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":17,"num_read_kb":3382,"num_write":200,"num_write_kb":34393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"50'178","reported_seq":264,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.310425+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:03:22.310425+0000","last_peered":"2024-09-12T18:03:22.310425+0000","last_clean":"2024-09-12T18:03:22.310425+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:03:22.310425+0000","last_undegraded":"2024-09-12T18:03:22.310425+0000","last_fullsized":"2024-09-12T18:03:22.310425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17962291,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":12,"num_read_kb":8192,"num_write":178,"num_write_kb":38251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"50'217","reported_seq":311,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.562220+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:03:22.562220+0000","last_peered":"2024-09-12T18:03:22.562220+0000","last_clean":"2024-09-12T18:03:22.562220+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:03:22.562220+0000","last_undegraded":"2024-09-12T18:03:22.562220+0000","last_fullsized":"2024-09-12T18:03:22.562220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29311840,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":20,"num_read_kb":7675,"num_write":217,"num_write_kb":59638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"50'184","reported_seq":266,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.160059+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:22.160059+0000","last_peered":"2024-09-12T18:03:22.160059+0000","last_clean":"2024-09-12T18:03:22.160059+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:22.160059+0000","last_undegraded":"2024-09-12T18:03:22.160059+0000","last_fullsized":"2024-09-12T18:03:22.160059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":752503,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":8,"num_read_kb":8192,"num_write":182,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"50'211","reported_seq":307,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.592025+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:22.592025+0000","last_peered":"2024-09-12T18:03:22.592025+0000","last_clean":"2024-09-12T18:03:22.592025+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:22.592025+0000","last_undegraded":"2024-09-12T18:03:22.592025+0000","last_fullsized":"2024-09-12T18:03:22.592025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24537103,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":22,"num_read_kb":6182,"num_write":209,"num_write_kb":46989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"50'181","reported_seq":265,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.638048+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:22.638048+0000","last_peered":"2024-09-12T18:03:22.638048+0000","last_clean":"2024-09-12T18:03:22.638048+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:22.638048+0000","last_undegraded":"2024-09-12T18:03:22.638048+0000","last_fullsized":"2024-09-12T18:03:22.638048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25151997,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":9,"num_read_kb":8328,"num_write":181,"num_write_kb":34456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"50'184","reported_seq":281,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.559294+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:22.559294+0000","last_peered":"2024-09-12T18:03:22.559294+0000","last_clean":"2024-09-12T18:03:22.559294+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:22.559294+0000","last_undegraded":"2024-09-12T18:03:22.559294+0000","last_fullsized":"2024-09-12T18:03:22.559294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28407055,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":23,"num_read_kb":13269,"num_write":182,"num_write_kb":30154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"50'190","reported_seq":274,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.360402+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:03:22.360402+0000","last_peered":"2024-09-12T18:03:22.360402+0000","last_clean":"2024-09-12T18:03:22.360402+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:03:22.360402+0000","last_undegraded":"2024-09-12T18:03:22.360402+0000","last_fullsized":"2024-09-12T18:03:22.360402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30641521,"num_objects":167,"num_object_clones":0,"num_object_copies":334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":0,"num_read":10,"num_read_kb":1411,"num_write":190,"num_write_kb":50841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"50'210","reported_seq":274,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.189700+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:22.189700+0000","last_peered":"2024-09-12T18:03:22.189700+0000","last_clean":"2024-09-12T18:03:22.189700+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:22.189700+0000","last_undegraded":"2024-09-12T18:03:22.189700+0000","last_fullsized":"2024-09-12T18:03:22.189700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21732444,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":26,"num_read_kb":14101,"num_write":209,"num_write_kb":38237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"50'203","reported_seq":298,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.511475+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:03:22.511475+0000","last_peered":"2024-09-12T18:03:22.511475+0000","last_clean":"2024-09-12T18:03:22.511475+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:03:22.511475+0000","last_undegraded":"2024-09-12T18:03:22.511475+0000","last_fullsized":"2024-09-12T18:03:22.511475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20172290,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":21,"num_read_kb":10488,"num_write":203,"num_write_kb":42726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"50'188","reported_seq":277,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.567916+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:22.567916+0000","last_peered":"2024-09-12T18:03:22.567916+0000","last_clean":"2024-09-12T18:03:22.567916+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:22.567916+0000","last_undegraded":"2024-09-12T18:03:22.567916+0000","last_fullsized":"2024-09-12T18:03:22.567916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15396585,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":14,"num_read_kb":8387,"num_write":188,"num_write_kb":14940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"50'178","reported_seq":281,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.601178+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:22.601178+0000","last_peered":"2024-09-12T18:03:22.601178+0000","last_clean":"2024-09-12T18:03:22.601178+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:22.601178+0000","last_undegraded":"2024-09-12T18:03:22.601178+0000","last_fullsized":"2024-09-12T18:03:22.601178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37489084,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":29,"num_read_kb":13718,"num_write":177,"num_write_kb":42512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"50'379","reported_seq":456,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.061613+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:22.061613+0000","last_peered":"2024-09-12T18:03:22.061613+0000","last_clean":"2024-09-12T18:03:22.061613+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:22.061613+0000","last_undegraded":"2024-09-12T18:03:22.061613+0000","last_fullsized":"2024-09-12T18:03:22.061613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"50'170","reported_seq":263,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.016558+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:22.016558+0000","last_peered":"2024-09-12T18:03:22.016558+0000","last_clean":"2024-09-12T18:03:22.016558+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:22.016558+0000","last_undegraded":"2024-09-12T18:03:22.016558+0000","last_fullsized":"2024-09-12T18:03:22.016558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9867130,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":19,"num_read_kb":8834,"num_write":169,"num_write_kb":9106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.688380+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:19.688380+0000","last_peered":"2024-09-12T18:03:19.688380+0000","last_clean":"2024-09-12T18:03:19.688380+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:19.688380+0000","last_undegraded":"2024-09-12T18:03:19.688380+0000","last_fullsized":"2024-09-12T18:03:19.688380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"50'183","reported_seq":260,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.189314+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:21.189314+0000","last_peered":"2024-09-12T18:03:21.189314+0000","last_clean":"2024-09-12T18:03:21.189314+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:21.189314+0000","last_undegraded":"2024-09-12T18:03:21.189314+0000","last_fullsized":"2024-09-12T18:03:21.189314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9191417,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":3,"num_read_kb":475,"num_write":183,"num_write_kb":13455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.697134+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:19.697134+0000","last_peered":"2024-09-12T18:03:19.697134+0000","last_clean":"2024-09-12T18:03:19.697134+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:19.697134+0000","last_undegraded":"2024-09-12T18:03:19.697134+0000","last_fullsized":"2024-09-12T18:03:19.697134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"50'175","reported_seq":263,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.455465+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:22.455465+0000","last_peered":"2024-09-12T18:03:22.455465+0000","last_clean":"2024-09-12T18:03:22.455465+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:22.455465+0000","last_undegraded":"2024-09-12T18:03:22.455465+0000","last_fullsized":"2024-09-12T18:03:22.455465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18382471,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":14,"num_read_kb":8308,"num_write":174,"num_write_kb":18054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":85,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682381+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:19.682381+0000","last_peered":"2024-09-12T18:03:19.682381+0000","last_clean":"2024-09-12T18:03:19.682381+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:19.682381+0000","last_undegraded":"2024-09-12T18:03:19.682381+0000","last_fullsized":"2024-09-12T18:03:19.682381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685603+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:19.685603+0000","last_peered":"2024-09-12T18:03:19.685603+0000","last_clean":"2024-09-12T18:03:19.685603+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:19.685603+0000","last_undegraded":"2024-09-12T18:03:19.685603+0000","last_fullsized":"2024-09-12T18:03:19.685603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"50'185","reported_seq":265,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.369487+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:22.369487+0000","last_peered":"2024-09-12T18:03:22.369487+0000","last_clean":"2024-09-12T18:03:22.369487+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:22.369487+0000","last_undegraded":"2024-09-12T18:03:22.369487+0000","last_fullsized":"2024-09-12T18:03:22.369487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4922695,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":6,"num_read_kb":1156,"num_write":184,"num_write_kb":21443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.702423+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:19.702423+0000","last_peered":"2024-09-12T18:03:19.702423+0000","last_clean":"2024-09-12T18:03:19.702423+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:19.702423+0000","last_undegraded":"2024-09-12T18:03:19.702423+0000","last_fullsized":"2024-09-12T18:03:19.702423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'210","reported_seq":297,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.514785+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:03:22.514785+0000","last_peered":"2024-09-12T18:03:22.514785+0000","last_clean":"2024-09-12T18:03:22.514785+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:03:22.514785+0000","last_undegraded":"2024-09-12T18:03:22.514785+0000","last_fullsized":"2024-09-12T18:03:22.514785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18828476,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":13,"num_read_kb":6070,"num_write":210,"num_write_kb":34870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"50'3","reported_seq":80,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684603+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:19.684603+0000","last_peered":"2024-09-12T18:03:19.684603+0000","last_clean":"2024-09-12T18:03:19.684603+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:19.684603+0000","last_undegraded":"2024-09-12T18:03:19.684603+0000","last_fullsized":"2024-09-12T18:03:19.684603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'190","reported_seq":282,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.426006+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:22.426006+0000","last_peered":"2024-09-12T18:03:22.426006+0000","last_clean":"2024-09-12T18:03:22.426006+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:22.426006+0000","last_undegraded":"2024-09-12T18:03:22.426006+0000","last_fullsized":"2024-09-12T18:03:22.426006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18547308,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":17,"num_read_kb":9090,"num_write":189,"num_write_kb":26103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685291+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:19.685291+0000","last_peered":"2024-09-12T18:03:19.685291+0000","last_clean":"2024-09-12T18:03:19.685291+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:19.685291+0000","last_undegraded":"2024-09-12T18:03:19.685291+0000","last_fullsized":"2024-09-12T18:03:19.685291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"50'196","reported_seq":295,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.270762+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:03:22.270762+0000","last_peered":"2024-09-12T18:03:22.270762+0000","last_clean":"2024-09-12T18:03:22.270762+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:03:22.270762+0000","last_undegraded":"2024-09-12T18:03:22.270762+0000","last_fullsized":"2024-09-12T18:03:22.270762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13106092,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":25,"num_read_kb":13268,"num_write":196,"num_write_kb":34177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'5","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685585+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:03:19.685585+0000","last_peered":"2024-09-12T18:03:19.685585+0000","last_clean":"2024-09-12T18:03:19.685585+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:03:19.685585+0000","last_undegraded":"2024-09-12T18:03:19.685585+0000","last_fullsized":"2024-09-12T18:03:19.685585+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"50'200","reported_seq":280,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.509473+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:03:22.509473+0000","last_peered":"2024-09-12T18:03:22.509473+0000","last_clean":"2024-09-12T18:03:22.509473+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:03:22.509473+0000","last_undegraded":"2024-09-12T18:03:22.509473+0000","last_fullsized":"2024-09-12T18:03:22.509473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13245429,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":5,"num_read_kb":985,"num_write":200,"num_write_kb":9829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682638+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:19.682638+0000","last_peered":"2024-09-12T18:03:19.682638+0000","last_clean":"2024-09-12T18:03:19.682638+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:19.682638+0000","last_undegraded":"2024-09-12T18:03:19.682638+0000","last_fullsized":"2024-09-12T18:03:19.682638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"50'193","reported_seq":286,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.433329+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:22.433329+0000","last_peered":"2024-09-12T18:03:22.433329+0000","last_clean":"2024-09-12T18:03:22.433329+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:22.433329+0000","last_undegraded":"2024-09-12T18:03:22.433329+0000","last_fullsized":"2024-09-12T18:03:22.433329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30195347,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":193,"num_write_kb":66646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.697404+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:19.697404+0000","last_peered":"2024-09-12T18:03:19.697404+0000","last_clean":"2024-09-12T18:03:19.697404+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:19.697404+0000","last_undegraded":"2024-09-12T18:03:19.697404+0000","last_fullsized":"2024-09-12T18:03:19.697404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"50'167","reported_seq":251,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.519118+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:22.519118+0000","last_peered":"2024-09-12T18:03:22.519118+0000","last_clean":"2024-09-12T18:03:22.519118+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:22.519118+0000","last_undegraded":"2024-09-12T18:03:22.519118+0000","last_fullsized":"2024-09-12T18:03:22.519118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20353415,"num_objects":158,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":158,"num_whiteouts":0,"num_read":9,"num_read_kb":1909,"num_write":166,"num_write_kb":25846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.696104+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:03:19.696104+0000","last_peered":"2024-09-12T18:03:19.696104+0000","last_clean":"2024-09-12T18:03:19.696104+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:03:19.696104+0000","last_undegraded":"2024-09-12T18:03:19.696104+0000","last_fullsized":"2024-09-12T18:03:19.696104+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"50'167","reported_seq":252,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.473445+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:22.473445+0000","last_peered":"2024-09-12T18:03:22.473445+0000","last_clean":"2024-09-12T18:03:22.473445+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:22.473445+0000","last_undegraded":"2024-09-12T18:03:22.473445+0000","last_fullsized":"2024-09-12T18:03:22.473445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10048548,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":11,"num_read_kb":4900,"num_write":166,"num_write_kb":13114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":227,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682390+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:19.682390+0000","last_peered":"2024-09-12T18:03:19.682390+0000","last_clean":"2024-09-12T18:03:19.682390+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:19.682390+0000","last_undegraded":"2024-09-12T18:03:19.682390+0000","last_fullsized":"2024-09-12T18:03:19.682390+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":91,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685080+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:19.685080+0000","last_peered":"2024-09-12T18:03:19.685080+0000","last_clean":"2024-09-12T18:03:19.685080+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:19.685080+0000","last_undegraded":"2024-09-12T18:03:19.685080+0000","last_fullsized":"2024-09-12T18:03:19.685080+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"50'193","reported_seq":269,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:20.336999+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:20.336999+0000","last_peered":"2024-09-12T18:03:20.336999+0000","last_clean":"2024-09-12T18:03:20.336999+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:20.336999+0000","last_undegraded":"2024-09-12T18:03:20.336999+0000","last_fullsized":"2024-09-12T18:03:20.336999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":4171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"50'194","reported_seq":282,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.629858+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:22.629858+0000","last_peered":"2024-09-12T18:03:22.629858+0000","last_clean":"2024-09-12T18:03:22.629858+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:22.629858+0000","last_undegraded":"2024-09-12T18:03:22.629858+0000","last_fullsized":"2024-09-12T18:03:22.629858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20498988,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":13,"num_read_kb":5514,"num_write":192,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682274+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:19.682274+0000","last_peered":"2024-09-12T18:03:19.682274+0000","last_clean":"2024-09-12T18:03:19.682274+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:19.682274+0000","last_undegraded":"2024-09-12T18:03:19.682274+0000","last_fullsized":"2024-09-12T18:03:19.682274+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"50'7","reported_seq":88,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.744508+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:03:21.744508+0000","last_peered":"2024-09-12T18:03:21.744508+0000","last_clean":"2024-09-12T18:03:21.744508+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:03:21.744508+0000","last_undegraded":"2024-09-12T18:03:21.744508+0000","last_fullsized":"2024-09-12T18:03:21.744508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4242,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"50'216","reported_seq":321,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.555118+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:03:22.555118+0000","last_peered":"2024-09-12T18:03:22.555118+0000","last_clean":"2024-09-12T18:03:22.555118+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:03:22.555118+0000","last_undegraded":"2024-09-12T18:03:22.555118+0000","last_fullsized":"2024-09-12T18:03:22.555118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34201486,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":32,"num_read_kb":16023,"num_write":216,"num_write_kb":43305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685453+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:19.685453+0000","last_peered":"2024-09-12T18:03:19.685453+0000","last_clean":"2024-09-12T18:03:19.685453+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:19.685453+0000","last_undegraded":"2024-09-12T18:03:19.685453+0000","last_fullsized":"2024-09-12T18:03:19.685453+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"50'312","reported_seq":388,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.218061+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:21.218061+0000","last_peered":"2024-09-12T18:03:21.218061+0000","last_clean":"2024-09-12T18:03:21.218061+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:21.218061+0000","last_undegraded":"2024-09-12T18:03:21.218061+0000","last_fullsized":"2024-09-12T18:03:21.218061+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"50'152","reported_seq":229,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.691351+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:03:21.691351+0000","last_peered":"2024-09-12T18:03:21.691351+0000","last_clean":"2024-09-12T18:03:21.691351+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:03:21.691351+0000","last_undegraded":"2024-09-12T18:03:21.691351+0000","last_fullsized":"2024-09-12T18:03:21.691351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7027245,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":3,"num_read_kb":618,"num_write":152,"num_write_kb":8996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":102,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.682726+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:19.682726+0000","last_peered":"2024-09-12T18:03:19.682726+0000","last_clean":"2024-09-12T18:03:19.682726+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:19.682726+0000","last_undegraded":"2024-09-12T18:03:19.682726+0000","last_fullsized":"2024-09-12T18:03:19.682726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684957+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:19.684957+0000","last_peered":"2024-09-12T18:03:19.684957+0000","last_clean":"2024-09-12T18:03:19.684957+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:19.684957+0000","last_undegraded":"2024-09-12T18:03:19.684957+0000","last_fullsized":"2024-09-12T18:03:19.684957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"50'191","reported_seq":316,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.519204+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:22.519204+0000","last_peered":"2024-09-12T18:03:22.519204+0000","last_clean":"2024-09-12T18:03:22.519204+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:22.519204+0000","last_undegraded":"2024-09-12T18:03:22.519204+0000","last_fullsized":"2024-09-12T18:03:22.519204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36913136,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":51,"num_read_kb":21361,"num_write":191,"num_write_kb":59517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684440+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:19.684440+0000","last_peered":"2024-09-12T18:03:19.684440+0000","last_clean":"2024-09-12T18:03:19.684440+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:19.684440+0000","last_undegraded":"2024-09-12T18:03:19.684440+0000","last_fullsized":"2024-09-12T18:03:19.684440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685457+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:19.685457+0000","last_peered":"2024-09-12T18:03:19.685457+0000","last_clean":"2024-09-12T18:03:19.685457+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:19.685457+0000","last_undegraded":"2024-09-12T18:03:19.685457+0000","last_fullsized":"2024-09-12T18:03:19.685457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"50'162","reported_seq":240,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.749402+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:21.749402+0000","last_peered":"2024-09-12T18:03:21.749402+0000","last_clean":"2024-09-12T18:03:21.749402+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:21.749402+0000","last_undegraded":"2024-09-12T18:03:21.749402+0000","last_fullsized":"2024-09-12T18:03:21.749402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570184,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":4,"num_read_kb":719,"num_write":160,"num_write_kb":21518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":76,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685295+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:03:19.685295+0000","last_peered":"2024-09-12T18:03:19.685295+0000","last_clean":"2024-09-12T18:03:19.685295+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:03:19.685295+0000","last_undegraded":"2024-09-12T18:03:19.685295+0000","last_fullsized":"2024-09-12T18:03:19.685295+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.700071+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:03:19.700071+0000","last_peered":"2024-09-12T18:03:19.700071+0000","last_clean":"2024-09-12T18:03:19.700071+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:03:19.700071+0000","last_undegraded":"2024-09-12T18:03:19.700071+0000","last_fullsized":"2024-09-12T18:03:19.700071+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"50'171","reported_seq":261,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.421410+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:22.421410+0000","last_peered":"2024-09-12T18:03:22.421410+0000","last_clean":"2024-09-12T18:03:22.421410+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:22.421410+0000","last_undegraded":"2024-09-12T18:03:22.421410+0000","last_fullsized":"2024-09-12T18:03:22.421410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7843653,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":16,"num_read_kb":4437,"num_write":170,"num_write_kb":17497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.687444+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:03:19.687444+0000","last_peered":"2024-09-12T18:03:19.687444+0000","last_clean":"2024-09-12T18:03:19.687444+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:03:19.687444+0000","last_undegraded":"2024-09-12T18:03:19.687444+0000","last_fullsized":"2024-09-12T18:03:19.687444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.687254+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:03:19.687254+0000","last_peered":"2024-09-12T18:03:19.687254+0000","last_clean":"2024-09-12T18:03:19.687254+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:03:19.687254+0000","last_undegraded":"2024-09-12T18:03:19.687254+0000","last_fullsized":"2024-09-12T18:03:19.687254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"50'173","reported_seq":247,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:20.632718+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:03:20.632718+0000","last_peered":"2024-09-12T18:03:20.632718+0000","last_clean":"2024-09-12T18:03:20.632718+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:03:20.632718+0000","last_undegraded":"2024-09-12T18:03:20.632718+0000","last_fullsized":"2024-09-12T18:03:20.632718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9270753,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":13039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"50'27","reported_seq":103,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:20.738602+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:03:20.738602+0000","last_peered":"2024-09-12T18:03:20.738602+0000","last_clean":"2024-09-12T18:03:20.738602+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:03:20.738602+0000","last_undegraded":"2024-09-12T18:03:20.738602+0000","last_fullsized":"2024-09-12T18:03:20.738602+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685666+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:19.685666+0000","last_peered":"2024-09-12T18:03:19.685666+0000","last_clean":"2024-09-12T18:03:19.685666+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:19.685666+0000","last_undegraded":"2024-09-12T18:03:19.685666+0000","last_fullsized":"2024-09-12T18:03:19.685666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"50'171","reported_seq":266,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.436588+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:22.436588+0000","last_peered":"2024-09-12T18:03:22.436588+0000","last_clean":"2024-09-12T18:03:22.436588+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:22.436588+0000","last_undegraded":"2024-09-12T18:03:22.436588+0000","last_fullsized":"2024-09-12T18:03:22.436588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11971922,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":21,"num_read_kb":5517,"num_write":171,"num_write_kb":6228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"50'182","reported_seq":265,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.573367+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:22.573367+0000","last_peered":"2024-09-12T18:03:22.573367+0000","last_clean":"2024-09-12T18:03:22.573367+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:22.573367+0000","last_undegraded":"2024-09-12T18:03:22.573367+0000","last_fullsized":"2024-09-12T18:03:22.573367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29666525,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":8,"num_read_kb":8232,"num_write":182,"num_write_kb":63700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"49'22","reported_seq":99,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684932+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:19.684932+0000","last_peered":"2024-09-12T18:03:19.684932+0000","last_clean":"2024-09-12T18:03:19.684932+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:19.684932+0000","last_undegraded":"2024-09-12T18:03:19.684932+0000","last_fullsized":"2024-09-12T18:03:19.684932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"50'200","reported_seq":279,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.228331+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:22.228331+0000","last_peered":"2024-09-12T18:03:22.228331+0000","last_clean":"2024-09-12T18:03:22.228331+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:22.228331+0000","last_undegraded":"2024-09-12T18:03:22.228331+0000","last_fullsized":"2024-09-12T18:03:22.228331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36105865,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":5,"num_read_kb":1334,"num_write":199,"num_write_kb":63085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"50'7","reported_seq":83,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.752308+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:19.752308+0000","last_peered":"2024-09-12T18:03:19.752308+0000","last_clean":"2024-09-12T18:03:19.752308+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:19.752308+0000","last_undegraded":"2024-09-12T18:03:19.752308+0000","last_fullsized":"2024-09-12T18:03:19.752308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.684682+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:03:19.684682+0000","last_peered":"2024-09-12T18:03:19.684682+0000","last_clean":"2024-09-12T18:03:19.684682+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:03:19.684682+0000","last_undegraded":"2024-09-12T18:03:19.684682+0000","last_fullsized":"2024-09-12T18:03:19.684682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"50'224","reported_seq":342,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.594134+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:22.594134+0000","last_peered":"2024-09-12T18:03:22.594134+0000","last_clean":"2024-09-12T18:03:22.594134+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:22.594134+0000","last_undegraded":"2024-09-12T18:03:22.594134+0000","last_fullsized":"2024-09-12T18:03:22.594134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32213711,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":44,"num_read_kb":30029,"num_write":224,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"49'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.687167+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:03:19.687167+0000","last_peered":"2024-09-12T18:03:19.687167+0000","last_clean":"2024-09-12T18:03:19.687167+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:03:19.687167+0000","last_undegraded":"2024-09-12T18:03:19.687167+0000","last_fullsized":"2024-09-12T18:03:19.687167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"50'202","reported_seq":288,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.603522+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:03:22.603522+0000","last_peered":"2024-09-12T18:03:22.603522+0000","last_clean":"2024-09-12T18:03:22.603522+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:03:22.603522+0000","last_undegraded":"2024-09-12T18:03:22.603522+0000","last_fullsized":"2024-09-12T18:03:22.603522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28635238,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":12,"num_read_kb":8782,"num_write":202,"num_write_kb":33963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"50'164","reported_seq":257,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.602373+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:22.602373+0000","last_peered":"2024-09-12T18:03:22.602373+0000","last_clean":"2024-09-12T18:03:22.602373+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:22.602373+0000","last_undegraded":"2024-09-12T18:03:22.602373+0000","last_fullsized":"2024-09-12T18:03:22.602373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23911930,"num_objects":159,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":19,"num_read_kb":12412,"num_write":164,"num_write_kb":26093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"50'203","reported_seq":277,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.641709+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:22.641709+0000","last_peered":"2024-09-12T18:03:22.641709+0000","last_clean":"2024-09-12T18:03:22.641709+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:22.641709+0000","last_undegraded":"2024-09-12T18:03:22.641709+0000","last_fullsized":"2024-09-12T18:03:22.641709+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2760524,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":2780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"50'209","reported_seq":308,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.437964+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:03:22.437964+0000","last_peered":"2024-09-12T18:03:22.437964+0000","last_clean":"2024-09-12T18:03:22.437964+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:03:22.437964+0000","last_undegraded":"2024-09-12T18:03:22.437964+0000","last_fullsized":"2024-09-12T18:03:22.437964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24757709,"num_objects":174,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":174,"num_whiteouts":0,"num_read":25,"num_read_kb":6728,"num_write":208,"num_write_kb":52186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"50'1","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.685321+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:03:19.685321+0000","last_peered":"2024-09-12T18:03:19.685321+0000","last_clean":"2024-09-12T18:03:19.685321+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:03:19.685321+0000","last_undegraded":"2024-09-12T18:03:19.685321+0000","last_fullsized":"2024-09-12T18:03:19.685321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"50'167","reported_seq":262,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.475959+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:22.475959+0000","last_peered":"2024-09-12T18:03:22.475959+0000","last_clean":"2024-09-12T18:03:22.475959+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:22.475959+0000","last_undegraded":"2024-09-12T18:03:22.475959+0000","last_fullsized":"2024-09-12T18:03:22.475959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17447903,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":21,"num_read_kb":7522,"num_write":166,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"47'4","reported_seq":80,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.700091+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:19.700091+0000","last_peered":"2024-09-12T18:03:19.700091+0000","last_clean":"2024-09-12T18:03:19.700091+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:19.700091+0000","last_undegraded":"2024-09-12T18:03:19.700091+0000","last_fullsized":"2024-09-12T18:03:19.700091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"50'162","reported_seq":236,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.382946+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:03:22.382946+0000","last_peered":"2024-09-12T18:03:22.382946+0000","last_clean":"2024-09-12T18:03:22.382946+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:03:22.382946+0000","last_undegraded":"2024-09-12T18:03:22.382946+0000","last_fullsized":"2024-09-12T18:03:22.382946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17696564,"num_objects":157,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":17597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":81,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.697473+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:19.697473+0000","last_peered":"2024-09-12T18:03:19.697473+0000","last_clean":"2024-09-12T18:03:19.697473+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:19.697473+0000","last_undegraded":"2024-09-12T18:03:19.697473+0000","last_fullsized":"2024-09-12T18:03:19.697473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"50'173","reported_seq":249,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:21.909890+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:03:21.909890+0000","last_peered":"2024-09-12T18:03:21.909890+0000","last_clean":"2024-09-12T18:03:21.909890+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:03:21.909890+0000","last_undegraded":"2024-09-12T18:03:21.909890+0000","last_fullsized":"2024-09-12T18:03:21.909890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1816840,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":1,"num_read_kb":788,"num_write":173,"num_write_kb":13338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"50'3","reported_seq":80,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.683665+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:03:19.683665+0000","last_peered":"2024-09-12T18:03:19.683665+0000","last_clean":"2024-09-12T18:03:19.683665+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:03:19.683665+0000","last_undegraded":"2024-09-12T18:03:19.683665+0000","last_fullsized":"2024-09-12T18:03:19.683665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"50'181","reported_seq":266,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.564611+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:03:22.564611+0000","last_peered":"2024-09-12T18:03:22.564611+0000","last_clean":"2024-09-12T18:03:22.564611+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:03:22.564611+0000","last_undegraded":"2024-09-12T18:03:22.564611+0000","last_fullsized":"2024-09-12T18:03:22.564611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10054778,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":10,"num_read_kb":5710,"num_write":181,"num_write_kb":17551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"49'75","reported_seq":151,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.699144+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:19.699144+0000","last_peered":"2024-09-12T18:03:19.699144+0000","last_clean":"2024-09-12T18:03:19.699144+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:19.699144+0000","last_undegraded":"2024-09-12T18:03:19.699144+0000","last_fullsized":"2024-09-12T18:03:19.699144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":8231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"50'176","reported_seq":250,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.253903+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:22.253903+0000","last_peered":"2024-09-12T18:03:22.253903+0000","last_clean":"2024-09-12T18:03:22.253903+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:22.253903+0000","last_undegraded":"2024-09-12T18:03:22.253903+0000","last_fullsized":"2024-09-12T18:03:22.253903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13213327,"num_objects":173,"num_object_clones":0,"num_object_copies":346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":173,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":13215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"47'3","reported_seq":79,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.686448+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:03:19.686448+0000","last_peered":"2024-09-12T18:03:19.686448+0000","last_clean":"2024-09-12T18:03:19.686448+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:03:19.686448+0000","last_undegraded":"2024-09-12T18:03:19.686448+0000","last_fullsized":"2024-09-12T18:03:19.686448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"50'197","reported_seq":296,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:22.680153+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:22.680153+0000","last_peered":"2024-09-12T18:03:22.680153+0000","last_clean":"2024-09-12T18:03:22.680153+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:22.680153+0000","last_undegraded":"2024-09-12T18:03:22.680153+0000","last_fullsized":"2024-09-12T18:03:22.680153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13062829,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":24,"num_read_kb":7535,"num_write":195,"num_write_kb":9464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"46'69","reported_seq":145,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-12T18:03:19.686888+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:03:19.686888+0000","last_peered":"2024-09-12T18:03:19.686888+0000","last_clean":"2024-09-12T18:03:19.686888+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:03:19.686888+0000","last_undegraded":"2024-09-12T18:03:19.686888+0000","last_fullsized":"2024-09-12T18:03:19.686888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":1242739419,"num_objects":11053,"num_object_clones":0,"num_object_copies":22106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11053,"num_whiteouts":0,"num_read":956,"num_read_kb":459720,"num_write":11908,"num_write_kb":2087438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":293765120,"data_stored":2316715916,"data_compressed":122568212,"data_compressed_allocated":161009664,"data_compressed_original":2237336972,"omap_allocated":0,"internal_metadata":0},"log_size":11929,"ondisk_log_size":11929,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":57292188,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":5,"num_read_kb":8,"num_write":1361,"num_write_kb":57500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31211520,"data_stored":114654092,"data_compressed":17102220,"data_compressed_allocated":21200896,"data_compressed_original":104710144,"omap_allocated":0,"internal_metadata":0},"log_size":1335,"ondisk_log_size":1335,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162712,"kb_used_data":113468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94209128,"statfs":{"total":96636764160,"available":96470147072,"internally_reserved":0,"allocated":116191232,"data_stored":932112685,"data_compressed":51962253,"data_compressed_allocated":68128768,"data_compressed_original":904139958,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738392,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119092,"kb_used_data":92052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94252748,"statfs":{"total":96636764160,"available":96514813952,"internally_reserved":0,"allocated":94261248,"data_stored":588404379,"data_compressed":35562894,"data_compressed_allocated":46030848,"data_compressed_original":556775494,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738392,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136488,"kb_used_data":91412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94235352,"statfs":{"total":96636764160,"available":96497000448,"internally_reserved":0,"allocated":93605888,"data_stored":588678130,"data_compressed":36715505,"data_compressed_allocated":47419392,"data_compressed_original":559688098,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10993664,"data_stored":41948752,"data_compressed":6348682,"data_compressed_allocated":7786496,"data_compressed_original":38772736,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10903552,"data_stored":40544972,"data_compressed":6063373,"data_compressed_allocated":7516160,"data_compressed_original":37179392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9314304,"data_stored":32160368,"data_compressed":4690165,"data_compressed_allocated":5898240,"data_compressed_original":28758016,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":89108480,"data_stored":654011768,"data_compressed":35415865,"data_compressed_allocated":46374912,"data_compressed_original":628310167,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98009088,"data_stored":760935166,"data_compressed":39787189,"data_compressed_allocated":52277248,"data_compressed_original":731693814,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106647552,"data_stored":901768982,"data_compressed":47365158,"data_compressed_allocated":62357504,"data_compressed_original":877332991,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:27.626 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:03:27.626 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:03:27.626 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T18:03:27.626 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T18:03:27.627 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T18:03:27.627 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T18:03:27.703 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:27.701+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:27.782 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:27.782 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "" 2024-09-12T18:03:27.782 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:27.800 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:27.795+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:27.805 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:27.805 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:27.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:27.900 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:27.899+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:27.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:03:27.937 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:27.937 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:27.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:28.001 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:27.999+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:28.077 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:28.077 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:28.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:28.138 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:28.135+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:28.204 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:28.201+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:28.217 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:28.217 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:28.232 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:28.304 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:28.299+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:28.363 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:28.363 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:28.377 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:28.405 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:28.401+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:28.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:28.506 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:28.499+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:28.546 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:28.546 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:28.560 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:28.579 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:28.579 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:28.602 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:28.602 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:28.606 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:28.601+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:28.624 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:28.679 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.622950599999999, 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:28.680 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:28.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:28.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:28.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.687 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10795 4.22 4:4414d34e:::1000000315b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:28.687 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:28.687 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.7249330159999996, 2024-09-12T18:03:28.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03153454, 2024-09-12T18:03:28.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10795 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952771+0000", 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9290000000000001e-06 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960575+0000", 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078039479999999998 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960595+0000", 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9644e-05 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960609+0000", 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4246999999999999e-05 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960772+0000", 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016263000000000001 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960936+0000", 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016446899999999999 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.961298+0000", 2024-09-12T18:03:28.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036151899999999998 2024-09-12T18:03:28.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.981362+0000", 2024-09-12T18:03:28.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020064015000000001 2024-09-12T18:03:28.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984110+0000", 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00274852 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984227+0000", 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116267 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984304+0000", 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7352000000000001e-05 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11134 4.30 4:0ea0a8b4:::10000003186.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.1673319590000002, 2024-09-12T18:03:28.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037582955000000001, 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11134 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000001e-07 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518086+0000", 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077143059999999998 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518103+0000", 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7441000000000001e-05 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518116+0000", 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2573e-05 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518192+0000", 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518319+0000", 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012724599999999999 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518439+0000", 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119436 2024-09-12T18:03:28.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.527060+0000", 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086211320000000001 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547881+0000", 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02082063 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547921+0000", 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0411999999999999e-05 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547954+0000", 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2583000000000003e-05 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11577 4.35 4:acdeb9c5:::1000000332a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.5120513339999997, 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032699999, 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11577 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:28.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165652+0000", 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0920000000000001e-06 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175860+0000", 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010207233 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175874+0000", 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4229999999999999e-05 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175882+0000", 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7330000000000003e-06 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175941+0000", 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8996000000000002e-05 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176090+0000", 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014994800000000001 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176209+0000", 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118825 2024-09-12T18:03:28.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.184925+0000", 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008715558 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198295+0000", 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013369804000000001 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198327+0000", 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1942e-05 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198351+0000", 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.708 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14036 4.31 4:8eca8ddf:::100000031b8.00000000:head [write 0~4194304 [4@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4132010729999998, 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034286130999999997, 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14036 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264505+0000", 2024-09-12T18:03:28.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0570000000000001e-06 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273393+0000", 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088884240000000007 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273426+0000", 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3256999999999997e-05 2024-09-12T18:03:28.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273441+0000", 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4445e-05 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273550+0000", 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010887099999999999 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273689+0000", 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139178 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273844+0000", 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155291 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.282512+0000", 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086676940000000001 2024-09-12T18:03:28.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298736+0000", 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016224160000000001 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298766+0000", 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9961e-05 2024-09-12T18:03:28.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298788+0000", 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1793e-05 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14099 4.18 4:18c6d816:::10000003304.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:28.715 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.334840356, 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031590162999999997, 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14099 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342865+0000", 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.74e-06 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350699+0000", 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078345069999999992 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350738+0000", 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.837e-05 2024-09-12T18:03:28.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350757+0000", 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9519000000000001e-05 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350912+0000", 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015452099999999999 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351291+0000", 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037953800000000001 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351691+0000", 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000399379 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.362505+0000", 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010814503 2024-09-12T18:03:28.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374285+0000", 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011780135000000001 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374369+0000", 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3429000000000004e-05 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374452+0000", 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3522000000000004e-05 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14111 4.a 4:530380b1:::10000003584.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3140811120000002, 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032405549999999998, 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.722 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14111 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363624+0000", 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3329999999999999e-06 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369957+0000", 2024-09-12T18:03:28.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063336720000000003 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369986+0000", 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8269e-05 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370001+0000", 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-05 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370257+0000", 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025585799999999998 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370536+0000", 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027879400000000001 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370979+0000", 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044307100000000001 2024-09-12T18:03:28.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.380399+0000", 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094193109999999997 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395936+0000", 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01553759 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395987+0000", 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1249999999999999e-05 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.396027+0000", 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9651999999999999e-05 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.728 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14165 4.32 4:4ea4de87:::100000037a0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.2393398849999997, 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030909196, 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14165 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.729 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438365+0000", 2024-09-12T18:03:28.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0540000000000002e-06 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446256+0000", 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078916520000000007 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446295+0000", 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000003e-05 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446311+0000", 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6696000000000001e-05 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446418+0000", 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010707199999999999 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446610+0000", 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019208499999999999 2024-09-12T18:03:28.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446827+0000", 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216939 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.452206+0000", 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053787210000000004 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469114+0000", 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016907493999999999 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469196+0000", 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2237999999999994e-05 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469272+0000", 2024-09-12T18:03:28.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6114999999999999e-05 2024-09-12T18:03:28.735 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.735 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.735 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.735 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14176 4.5 4:a36cb72d:::10000003716.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:28.735 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:28.735 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.2310764890000003, 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.040437328000000002, 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14176 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446629+0000", 2024-09-12T18:03:28.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.429e-06 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460229+0000", 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013600736 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460276+0000", 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6721999999999998e-05 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460297+0000", 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1308999999999999e-05 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460554+0000", 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025637199999999999 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460983+0000", 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042940099999999999 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.461353+0000", 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036966199999999999 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.484975+0000", 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023622647 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486801+0000", 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00182548 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486933+0000", 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013208800000000001 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.487063+0000", 2024-09-12T18:03:28.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013048199999999999 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14374 4.38 4:1dead311:::10000003395.00000000:head [write 0~4194304 [2@357324]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.0076962250000001, 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039429224999999998, 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.742 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14374 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670009+0000", 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.497e-06 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682349+0000", 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012339785000000001 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682387+0000", 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8633000000000001e-05 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682404+0000", 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7005999999999999e-05 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682514+0000", 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010951900000000001 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682649+0000", 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013563799999999999 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682836+0000", 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186424 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.701541+0000", 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018705016000000001 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709313+0000", 2024-09-12T18:03:28.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077725889999999999 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709392+0000", 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8860000000000001e-05 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709436+0000", 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14734 4.32 4:4f3042f2:::1000000322e.00000000:head [write 0~4194304 [3@261943]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.6162826240000001, 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033021488000000002, 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.749 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14734 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061421+0000", 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069604+0000", 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081825100000000005 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069626+0000", 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2849000000000001e-05 2024-09-12T18:03:28.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069645+0000", 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8926000000000001e-05 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069736+0000", 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0107999999999999e-05 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069861+0000", 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125704 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.070200+0000", 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000338308 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.080698+0000", 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010498182 2024-09-12T18:03:28.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094351+0000", 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013653168 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094404+0000", 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3424999999999998e-05 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094441+0000", 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7131000000000001e-05 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14827 4.8 e52/17 4:1171651b:::100000030fc.00000001:head v 52'208, mlcod=52'206)", 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.4457201350000002, 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032040617, 2024-09-12T18:03:28.755 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231983+0000", 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.16e-07 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239015+0000", 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070313540000000001 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239054+0000", 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9675000000000002e-05 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239070+0000", 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239237+0000", 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016739399999999999 2024-09-12T18:03:28.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239285+0000", 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7500999999999998e-05 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.263984+0000", 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024699115000000001 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264023+0000", 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9431999999999998e-05 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14831 4.18 4:19f6b122:::1000000364a.00000000:head [write 0~4194304 [2@3284618]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.760 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.4437398570000002, 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03242449, 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.761 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14831 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233964+0000", 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8700000000000004e-07 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242877+0000", 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089131509999999994 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242914+0000", 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7376999999999998e-05 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242929+0000", 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4728e-05 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252348+0000", 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094188910000000004 2024-09-12T18:03:28.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252475+0000", 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126735 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252712+0000", 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000237075 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264747+0000", 2024-09-12T18:03:28.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012034977000000001 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266308+0000", 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015612130000000001 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266348+0000", 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0278999999999998e-05 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266387+0000", 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9076999999999999e-05 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14964 4.22 4:442ef67f:::10000003341.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.2979667429999999, 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030833801000000001, 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.767 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14964 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379737+0000", 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386729+0000", 2024-09-12T18:03:28.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069922450000000002 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386748+0000", 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386759+0000", 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1522000000000001e-05 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386849+0000", 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0255999999999998e-05 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386982+0000", 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013296400000000001 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.387166+0000", 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018323100000000001 2024-09-12T18:03:28.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.395195+0000", 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080296380000000004 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410331+0000", 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01513607 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410451+0000", 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119546 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410570+0000", 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118687 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14971 4.e 4:73867252:::1000000382a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.773 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.285035996, 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031669396000000002, 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14971 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392668+0000", 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.629e-06 2024-09-12T18:03:28.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399618+0000", 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069498049999999999 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399636+0000", 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8045000000000001e-05 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399647+0000", 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0482000000000001e-05 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399738+0000", 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1737999999999995e-05 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399886+0000", 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014755700000000001 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.400110+0000", 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224565 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408175+0000", 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080649520000000002 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424146+0000", 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015970997000000001 2024-09-12T18:03:28.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424205+0000", 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8638999999999999e-05 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424336+0000", 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130987 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14973 4.13 4:c81d059c:::100000038e4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.2780285889999998, 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032659724000000001, 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.780 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14973 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399676+0000", 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404945+0000", 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052687569999999998 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404964+0000", 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:03:28.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404979+0000", 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5290000000000001e-05 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405106+0000", 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127126 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405251+0000", 2024-09-12T18:03:28.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014441200000000001 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405392+0000", 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014160600000000001 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.414573+0000", 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091801000000000001 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432244+0000", 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017671630000000001 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432295+0000", 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0729000000000002e-05 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432334+0000", 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8773999999999998e-05 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.785 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14978 4.22 4:4562f5e1:::10000003754.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.269027173, 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.049933508000000001, 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.786 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14978 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408677+0000", 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3489999999999999e-06 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416648+0000", 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079712930000000008 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416680+0000", 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2005999999999998e-05 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416698+0000", 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416815+0000", 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011641099999999999 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417000+0000", 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018498000000000001 2024-09-12T18:03:28.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417272+0000", 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027257699999999998 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.429341+0000", 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012068314 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458491+0000", 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029150250999999999 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458553+0000", 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2539999999999994e-05 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458609+0000", 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5461999999999999e-05 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.791 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14990 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.251222909, 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032296710999999999, 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.792 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14990 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426481+0000", 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.433997+0000", 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075159520000000002 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434013+0000", 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5702e-05 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434021+0000", 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434090+0000", 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9029000000000006e-05 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434202+0000", 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011158999999999999 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434358+0000", 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001562 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.442632+0000", 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082736500000000004 2024-09-12T18:03:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458688+0000", 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016056844000000001 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458737+0000", 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8204999999999997e-05 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458776+0000", 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9789000000000001e-05 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15095 4.e 4:7041e79b:::10000003456.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.1218117109999999, 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032716585999999999, 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.798 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15095 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555892+0000", 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564584+0000", 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086921359999999996 2024-09-12T18:03:28.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564596+0000", 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1704e-05 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564602+0000", 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1079999999999998e-06 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564695+0000", 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3370999999999998e-05 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564964+0000", 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026938500000000002 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:28.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.565178+0000", 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021372200000000001 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.571064+0000", 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058862769999999997 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588548+0000", 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017483561000000002 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588582+0000", 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4436e-05 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588607+0000", 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5006000000000001e-05 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15239 4.3d 4:bfe5f3d1:::10000003901.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 2.935275007, 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037369946000000001, 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15239 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:28.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742429+0000", 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.897e-06 2024-09-12T18:03:28.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749874+0000", 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074448259999999999 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749907+0000", 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2419999999999998e-05 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749925+0000", 2024-09-12T18:03:28.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8376000000000002e-05 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750112+0000", 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186923 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750409+0000", 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029714999999999999 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750642+0000", 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023328199999999999 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.764931+0000", 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014288842 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:28.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779720+0000", 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014788737999999999 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779765+0000", 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779798+0000", 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2601999999999997e-05 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.810 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:28.811 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:28.811 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:28.812 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:28.813 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:28.807+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:28.899 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:03:28.913 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:28.909+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:28.986 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:28.986 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:28.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.986 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:4768 4.15 4:a844ffc4:::10000003842.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T18:03:28.986 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.984333+0000", 2024-09-12T18:03:28.986 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0014639989999999999, 2024-09-12T18:03:28.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0014803119999999999, 2024-09-12T18:03:28.986 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984333+0000", 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984333+0000", 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984333+0000", 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.23e-07 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984337+0000", 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8029999999999998e-06 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984348+0000", 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0621e-05 2024-09-12T18:03:28.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984355+0000", 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7739999999999999e-06 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984403+0000", 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8773999999999998e-05 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984525+0000", 2024-09-12T18:03:28.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000121468 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:4769 4.2 4:4178e480:::10000003843.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.984371+0000", 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.001425929, 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0014761430000000001, 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984371+0000", 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984371+0000", 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984371+0000", 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7199999999999998e-07 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984374+0000", 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.6129999999999998e-06 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984382+0000", 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4089999999999997e-06 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984398+0000", 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5993000000000001e-05 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984437+0000", 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9141999999999999e-05 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984544+0000", 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106889 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.993 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:4772 4.2a 4:563e22c9:::10000003849.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.984424+0000", 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0013728989999999999, 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0014540849999999999, 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984424+0000", 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984424+0000", 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984424+0000", 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2900000000000003e-07 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984427+0000", 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9500000000000001e-06 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984435+0000", 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5089999999999996e-06 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984440+0000", 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4160000000000003e-06 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984714+0000", 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027409500000000002 2024-09-12T18:03:28.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984829+0000", 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011422 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:4773 4.33 4:cdcf4750:::10000003a3f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.984452+0000", 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0013446529999999999, 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001461026, 2024-09-12T18:03:28.997 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984452+0000", 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984452+0000", 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984453+0000", 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5799999999999999e-07 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984454+0000", 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9039999999999999e-06 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984462+0000", 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2710000000000003e-06 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:28.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984466+0000", 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4129999999999999e-06 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984513+0000", 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6780000000000003e-05 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984633+0000", 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011964999999999999 2024-09-12T18:03:29.000 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "pg_update_log_missing(4.13 epoch 55/17 rep_tid 6098 entries 55'222 (0'0) error 4:c998783e:::1000000383e.00000000:head by mds.0.3:4767 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 55'220)", 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.984867+0000", 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00092999700000000001, 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010840170000000001, 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "reached pg", 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984867+0000", 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984867+0000", 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984867+0000", 2024-09-12T18:03:29.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0200000000000001e-07 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984874+0000", 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.8519999999999998e-06 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984888+0000", 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4134000000000001e-05 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984901+0000", 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3101999999999999e-05 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984964+0000", 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2349999999999998e-05 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "pg_update_log_missing(4.f epoch 55/17 rep_tid 5513 entries 55'204 (0'0) error 4:f1068ecf:::10000003846.00000000:head by mds.0.3:4771 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 55'202)", 2024-09-12T18:03:29.004 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.984873+0000", 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00092395300000000004, 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0011076790000000001, 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "reached pg", 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984873+0000", 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984873+0000", 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984873+0000", 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984881+0000", 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8110000000000003e-06 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984900+0000", 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.891e-05 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.984915+0000", 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5024e-05 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985150+0000", 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00023524700000000001 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.007 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "pg_update_log_missing(4.32 epoch 55/17 rep_tid 6100 entries 55'236 (0'0) error 4:4d4056df:::10000003a56.00000000:head by mds.0.3:4776 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 55'234)", 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.985037+0000", 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00075915900000000003, 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0009847250000000001, 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "reached pg", 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.008 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985037+0000", 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985037+0000", 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985038+0000", 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7700000000000005e-07 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985044+0000", 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9349999999999999e-06 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985064+0000", 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9666000000000001e-05 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985077+0000", 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3304e-05 2024-09-12T18:03:29.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985143+0000", 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5634000000000002e-05 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:4783 4.15 4:ab525014:::10000003873.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.985468+0000", 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00032860399999999997, 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00057954899999999995, 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.011 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985468+0000", 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985468+0000", 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985469+0000", 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.13e-07 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985472+0000", 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.8870000000000001e-06 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985481+0000", 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2070000000000001e-06 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.013 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985487+0000", 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0270000000000001e-06 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985536+0000", 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9373000000000003e-05 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985631+0000", 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4804999999999998e-05 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.014 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:4786 4.8 4:11185c39:::1000000387e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.985584+0000", 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00021275999999999999, 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00049340400000000002, 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.015 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985584+0000", 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985584+0000", 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985585+0000", 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7199999999999998e-07 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.016 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985588+0000", 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3850000000000002e-06 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985596+0000", 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7610000000000007e-06 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985602+0000", 2024-09-12T18:03:29.017 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8250000000000001e-06 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985641+0000", 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9276000000000001e-05 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985711+0000", 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0560000000000002e-05 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.018 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:4790 4.9 4:9398252a:::1000000388e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.985879+0000", 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 4294967295.999918, 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000226414, 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.019 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985879+0000", 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985879+0000", 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.020 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985879+0000", 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.0100000000000004e-07 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985883+0000", 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9670000000000003e-06 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985891+0000", 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.9889999999999992e-06 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.021 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985898+0000", 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3890000000000002e-06 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985935+0000", 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7725000000000002e-05 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.986001+0000", 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5461000000000002e-05 2024-09-12T18:03:29.022 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "pg_update_log_missing(4.32 epoch 55/17 rep_tid 6106 entries 55'237 (0'0) error 4:4eaaf535:::10000003852.00000000:head by mds.0.3:4780 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 55'234)", 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:28.985938+0000", 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 4294967295.9998589, 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019914299999999999, 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "reached pg", 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.023 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985938+0000", 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985938+0000", 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985938+0000", 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6600000000000002e-07 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.024 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985944+0000", 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2820000000000002e-06 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985958+0000", 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4001e-05 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.985968+0000", 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1919999999999994e-06 2024-09-12T18:03:29.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:28.986020+0000", 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2275999999999999e-05 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 11 2024-09-12T18:03:29.026 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:29.027 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:29.028 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:29.023+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:29.128 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:29.125+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:29.194 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:29.194 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:29.194 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:29.194 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:29.194 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:29.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:29.251 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:29.249+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:29.329 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:29.327+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:29.381 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:29.381 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.713211423000001, 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.382 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.384 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.385 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:29.386 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.387 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.388 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.713174417000001, 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.389 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.390 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.391 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.392 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.393 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:29.394 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:29.394 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.394 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.394 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.394 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:29.394 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:29.395 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.713131075, 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.397 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:29.399 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:29.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.399 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.399 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.399 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:29.399 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:29.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.399 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.400 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.401 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.402 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.713093426, 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.404 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.405 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:29.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.410 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.713053717000001, 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.411 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.412 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.413 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.414 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:29.415 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:29.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.417 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.713015921, 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.418 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:29.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:29.420 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.421 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.422 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:29.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712955929, 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.425 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.426 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:29.427 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:29.428 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.428 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.428 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.428 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:29.428 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:29.428 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.428 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.428 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.429 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.430 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.431 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.432 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712860845000002, 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.433 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:29.435 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.436 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.437 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:29.438 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:29.439 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712794516999999, 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.440 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.441 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.442 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:29.444 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:29.444 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.444 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.444 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.444 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:29.444 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:29.444 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.444 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.445 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.446 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712737638, 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.447 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.448 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.448 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.448 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.448 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:29.448 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.448 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.448 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.448 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.449 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.450 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.451 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:29.452 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:29.453 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:29.454 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712681632999999, 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.455 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.457 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:29.458 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.459 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.460 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712616450999999, 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:29.461 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.462 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.464 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.465 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:29.466 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.467 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712575669, 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.468 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.469 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.470 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.471 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.472 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:29.473 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:29.474 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712540013000002, 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.475 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.476 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.477 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.478 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:29.479 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:29.480 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.481 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712493971000001, 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:29.482 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:29.483 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.484 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:29.485 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.486 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.487 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.488 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712455795, 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.489 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.490 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:29.491 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.492 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.493 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.494 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.495 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.712409339000001, 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.496 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.497 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:29.498 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.499 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.500 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.501 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.671785292999999, 2024-09-12T18:03:29.502 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.503 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.504 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:29.505 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:29.506 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.507 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.508 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:29.509 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.67176959, 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.510 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.511 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.512 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:29.513 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.514 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.515 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:29.516 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 16.664039268, 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:29.517 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.518 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:29.520 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:29.521 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:29.522 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:29.523 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:29.524 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.524 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.524 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.524 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:29.524 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:29.524 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:29.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:29.527 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:29.523+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:29.626 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:29.623+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:29.659 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:29.659 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:29.659 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:29.659 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:29.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:29.727 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:29.725+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:29.828 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:29.823+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:29.879 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:29.879 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:29.879 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:29.880 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:29.880 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:29.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:29.942 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:29.939+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:30.030 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:30.027+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.397343117999998, 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:30.066 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:30.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.397309368999998, 2024-09-12T18:03:30.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:30.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:30.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:30.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:30.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:30.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:30.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.078 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.397268, 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:30.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:30.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:30.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:30.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.084 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.365196388000001, 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:30.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:30.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.365129095, 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.090 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:30.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:30.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:30.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.365095273000001, 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.096 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:30.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:30.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:30.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.365047304000001, 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:30.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:30.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.107 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.365006107999999, 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:30.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:30.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:30.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.361575039000002, 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:30.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:30.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:30.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:30.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.361383684, 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.120 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:30.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 2532501~3109 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:30.126 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.395760312, 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038228275999999999, 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667287+0000", 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667297+0000", 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0837e-05 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667318+0000", 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0132e-05 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667333+0000", 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5464e-05 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682093+0000", 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014760517000000001 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682239+0000", 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145704 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682429+0000", 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189419 2024-09-12T18:03:30.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687963+0000", 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055348469999999999 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705429+0000", 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017465897000000001 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705472+0000", 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705513+0000", 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0395000000000002e-05 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 2535610~33089 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:30.132 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.395656837000001, 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038208328999999999, 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667389+0000", 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667437+0000", 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8296e-05 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667461+0000", 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3315999999999998e-05 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667475+0000", 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4806e-05 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683310+0000", 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015835025999999999 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683414+0000", 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103782 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683558+0000", 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144222 2024-09-12T18:03:30.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687979+0000", 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044206499999999999 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705541+0000", 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017561879999999998 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705573+0000", 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1513000000000001e-05 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705596+0000", 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3598e-05 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:393 3.2 3:4272d415:::200.0000000b:head [write 2568699~16268 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.395537552, 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038174923999999999, 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:30.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667508+0000", 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.26e-06 2024-09-12T18:03:30.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667540+0000", 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1544999999999997e-05 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667560+0000", 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.965e-05 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667581+0000", 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1073e-05 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684213+0000", 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016632040000000001 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684298+0000", 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700999999999998e-05 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684441+0000", 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142325 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.688223+0000", 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037828240000000002 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705621+0000", 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017397394 2024-09-12T18:03:30.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705661+0000", 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9725000000000003e-05 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705682+0000", 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1387e-05 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:394 3.2 3:4272d415:::200.0000000b:head [write 2584967~9560 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.394959857, 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037725440999999998, 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:30.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668087+0000", 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4269999999999998e-06 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668114+0000", 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6475999999999999e-05 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668140+0000", 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5896000000000001e-05 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668159+0000", 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8936999999999998e-05 2024-09-12T18:03:30.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686422+0000", 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018263577999999999 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686807+0000", 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000385263 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687150+0000", 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034306300000000001 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.689567+0000", 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002416961 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705716+0000", 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016148172999999998 2024-09-12T18:03:30.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705773+0000", 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7275999999999998e-05 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705810+0000", 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7391000000000002e-05 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10722 4.12 4:4a23efdb:::100000030fe.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.390275194999999, 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039390537000000003, 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10722 2024-09-12T18:03:30.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672772+0000", 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2400000000000002e-06 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680073+0000", 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073009110000000002 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680106+0000", 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3812000000000001e-05 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680121+0000", 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.486e-05 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690602+0000", 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010480952999999999 2024-09-12T18:03:30.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690789+0000", 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018728399999999999 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690975+0000", 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000185613 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.706973+0000", 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015997546000000001 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712089+0000", 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051161699999999997 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712130+0000", 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1069000000000003e-05 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712160+0000", 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0079000000000001e-05 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10804 4.b 4:d006e46e:::10000003140.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.070779357999999, 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044910052999999998, 2024-09-12T18:03:30.157 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10804 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992268+0000", 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7870000000000002e-06 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012102+0000", 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019833542999999999 2024-09-12T18:03:30.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012139+0000", 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012163+0000", 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3998999999999998e-05 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012267+0000", 2024-09-12T18:03:30.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010427100000000001 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012333+0000", 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5907000000000004e-05 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012775+0000", 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000442058 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.021332+0000", 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008556882 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037041+0000", 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015709548 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037115+0000", 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3645000000000004e-05 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037175+0000", 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0183000000000003e-05 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11578 4.2d 4:b54e928a:::10000003360.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 8.8945408599999993, 2024-09-12T18:03:30.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041673711000000002, 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11578 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:30.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168505+0000", 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5899999999999995e-07 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182775+0000", 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014270628 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182793+0000", 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8156e-05 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182813+0000", 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9602e-05 2024-09-12T18:03:30.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182897+0000", 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3688000000000002e-05 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182995+0000", 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7826999999999997e-05 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.183185+0000", 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019040999999999999 2024-09-12T18:03:30.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.193832+0000", 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010646901 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210041+0000", 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016209214 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210116+0000", 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4482999999999998e-05 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210177+0000", 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1943e-05 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14233 4.10 4:0a00b3f9:::100000032b1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5651398140000001, 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039262674999999997, 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14233 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:30.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497907+0000", 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8020000000000001e-06 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509871+0000", 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011964415000000001 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509889+0000", 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7779999999999999e-05 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509900+0000", 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.164e-05 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509977+0000", 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6831999999999999e-05 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510106+0000", 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012833000000000001 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510271+0000", 2024-09-12T18:03:30.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000165052 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.519886+0000", 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096156620000000005 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537057+0000", 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017170843000000002 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.174 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537114+0000", 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.694e-05 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537167+0000", 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3378999999999998e-05 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14948 4.2d 4:b49e434b:::10000003309.00000001:head [write 0~3932160 [3@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:30.175 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6980396429999995, 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042463101000000003, 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14948 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365007+0000", 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9199999999999998e-06 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374409+0000", 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009402143 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374448+0000", 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8574e-05 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374471+0000", 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3088e-05 2024-09-12T18:03:30.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374581+0000", 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010991 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374719+0000", 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013811699999999999 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374916+0000", 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000196806 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.384792+0000", 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009876569 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407248+0000", 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022455788000000001 2024-09-12T18:03:30.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407377+0000", 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012914799999999999 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407468+0000", 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1038000000000005e-05 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14963 4.2d 4:b5ada52e:::100000031f2.00000000:head [write 0~4194304 [2@3933023]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 4.6835610189999999, 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044482647, 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14963 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.182 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379485+0000", 2024-09-12T18:03:30.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1880000000000001e-06 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389066+0000", 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095813919999999993 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389110+0000", 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3992999999999997e-05 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389126+0000", 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6308999999999999e-05 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389323+0000", 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019653699999999999 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389581+0000", 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025770200000000001 2024-09-12T18:03:30.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389961+0000", 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038002100000000003 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.406604+0000", 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016643390000000001 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423676+0000", 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017071683000000001 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423843+0000", 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000167467 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423966+0000", 2024-09-12T18:03:30.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122965 2024-09-12T18:03:30.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:30.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:30.188 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:30.190 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:30.187+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:30.190 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:30.290 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:30.285+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:30.325 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:30.325 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:30.325 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:03:30.325 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:30.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:30.390 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:30.389+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:30.467 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:30.467 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:30.468 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:30.468 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:30.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:30.492 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:30.489+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:30.592 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:30.587+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:30.605 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.547536144, 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10795 4.22 4:4414d34e:::1000000315b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.649518560000001, 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03153454, 2024-09-12T18:03:30.612 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10795 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952771+0000", 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9290000000000001e-06 2024-09-12T18:03:30.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960575+0000", 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078039479999999998 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960595+0000", 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9644e-05 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.615 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960609+0000", 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4246999999999999e-05 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960772+0000", 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016263000000000001 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960936+0000", 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016446899999999999 2024-09-12T18:03:30.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.961298+0000", 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036151899999999998 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.981362+0000", 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020064015000000001 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984110+0000", 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00274852 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984227+0000", 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116267 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984304+0000", 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7352000000000001e-05 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11134 4.30 4:0ea0a8b4:::10000003186.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.091917502999999, 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037582955000000001, 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.619 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11134 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:30.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000001e-07 2024-09-12T18:03:30.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518086+0000", 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077143059999999998 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518103+0000", 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7441000000000001e-05 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518116+0000", 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2573e-05 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518192+0000", 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518319+0000", 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012724599999999999 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518439+0000", 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119436 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.527060+0000", 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086211320000000001 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547881+0000", 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02082063 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547921+0000", 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0411999999999999e-05 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547954+0000", 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2583000000000003e-05 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11577 4.35 4:acdeb9c5:::1000000332a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.4366368779999998, 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032699999, 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.626 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11577 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:30.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165652+0000", 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0920000000000001e-06 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175860+0000", 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010207233 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175874+0000", 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4229999999999999e-05 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175882+0000", 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7330000000000003e-06 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175941+0000", 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8996000000000002e-05 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176090+0000", 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014994800000000001 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176209+0000", 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118825 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.184925+0000", 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008715558 2024-09-12T18:03:30.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198295+0000", 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013369804000000001 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198327+0000", 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1942e-05 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198351+0000", 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14036 4.31 4:8eca8ddf:::100000031b8.00000000:head [write 0~4194304 [4@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.3377866169999999, 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034286130999999997, 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.632 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14036 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264505+0000", 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0570000000000001e-06 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273393+0000", 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088884240000000007 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273426+0000", 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3256999999999997e-05 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273441+0000", 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4445e-05 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273550+0000", 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010887099999999999 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273689+0000", 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139178 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273844+0000", 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155291 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.282512+0000", 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086676940000000001 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298736+0000", 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016224160000000001 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298766+0000", 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9961e-05 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298788+0000", 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1793e-05 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14099 4.18 4:18c6d816:::10000003304.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.2594259000000001, 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031590162999999997, 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14099 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.639 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342865+0000", 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.74e-06 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350699+0000", 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078345069999999992 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350738+0000", 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.837e-05 2024-09-12T18:03:30.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350757+0000", 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9519000000000001e-05 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350912+0000", 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015452099999999999 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351291+0000", 2024-09-12T18:03:30.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037953800000000001 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351691+0000", 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000399379 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.362505+0000", 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010814503 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374285+0000", 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011780135000000001 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374369+0000", 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3429000000000004e-05 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374452+0000", 2024-09-12T18:03:30.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3522000000000004e-05 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14111 4.a 4:530380b1:::10000003584.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.2386666560000004, 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032405549999999998, 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.645 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14111 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363624+0000", 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3329999999999999e-06 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369957+0000", 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063336720000000003 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369986+0000", 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8269e-05 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370001+0000", 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-05 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370257+0000", 2024-09-12T18:03:30.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025585799999999998 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370536+0000", 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027879400000000001 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370979+0000", 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044307100000000001 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.380399+0000", 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094193109999999997 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395936+0000", 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01553759 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395987+0000", 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1249999999999999e-05 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.396027+0000", 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9651999999999999e-05 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14165 4.32 4:4ea4de87:::100000037a0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.1639254289999998, 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030909196, 2024-09-12T18:03:30.651 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14165 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:30.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438365+0000", 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0540000000000002e-06 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446256+0000", 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078916520000000007 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446295+0000", 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000003e-05 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446311+0000", 2024-09-12T18:03:30.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6696000000000001e-05 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446418+0000", 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010707199999999999 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446610+0000", 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019208499999999999 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446827+0000", 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216939 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.452206+0000", 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053787210000000004 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469114+0000", 2024-09-12T18:03:30.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016907493999999999 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469196+0000", 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2237999999999994e-05 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469272+0000", 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6114999999999999e-05 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14176 4.5 4:a36cb72d:::10000003716.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.1556620329999996, 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.040437328000000002, 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.658 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14176 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446629+0000", 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.429e-06 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460229+0000", 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013600736 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460276+0000", 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6721999999999998e-05 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460297+0000", 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1308999999999999e-05 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460554+0000", 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025637199999999999 2024-09-12T18:03:30.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460983+0000", 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042940099999999999 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.461353+0000", 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036966199999999999 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.484975+0000", 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023622647 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486801+0000", 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00182548 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486933+0000", 2024-09-12T18:03:30.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013208800000000001 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.487063+0000", 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013048199999999999 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14374 4.38 4:1dead311:::10000003395.00000000:head [write 0~4194304 [2@357324]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:30.664 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.9322817690000003, 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039429224999999998, 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14374 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670009+0000", 2024-09-12T18:03:30.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.497e-06 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682349+0000", 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012339785000000001 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682387+0000", 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8633000000000001e-05 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682404+0000", 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7005999999999999e-05 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682514+0000", 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010951900000000001 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682649+0000", 2024-09-12T18:03:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013563799999999999 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682836+0000", 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186424 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.701541+0000", 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018705016000000001 2024-09-12T18:03:30.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709313+0000", 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077725889999999999 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709392+0000", 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8860000000000001e-05 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709436+0000", 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14734 4.32 4:4f3042f2:::1000000322e.00000000:head [write 0~4194304 [3@261943]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.5408681680000003, 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033021488000000002, 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.671 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14734 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061421+0000", 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069604+0000", 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081825100000000005 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069626+0000", 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2849000000000001e-05 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069645+0000", 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8926000000000001e-05 2024-09-12T18:03:30.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069736+0000", 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0107999999999999e-05 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069861+0000", 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125704 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.070200+0000", 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000338308 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.080698+0000", 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010498182 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094351+0000", 2024-09-12T18:03:30.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013653168 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094404+0000", 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3424999999999998e-05 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094441+0000", 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7131000000000001e-05 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14827 4.8 e52/17 4:1171651b:::100000030fc.00000001:head v 52'208, mlcod=52'206)", 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.3703056790000003, 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032040617, 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231983+0000", 2024-09-12T18:03:30.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.16e-07 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239015+0000", 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070313540000000001 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239054+0000", 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9675000000000002e-05 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239070+0000", 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239237+0000", 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016739399999999999 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239285+0000", 2024-09-12T18:03:30.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7500999999999998e-05 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.263984+0000", 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024699115000000001 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264023+0000", 2024-09-12T18:03:30.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9431999999999998e-05 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14831 4.18 4:19f6b122:::1000000364a.00000000:head [write 0~4194304 [2@3284618]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.3683254009999999, 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03242449, 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.683 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14831 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233964+0000", 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8700000000000004e-07 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242877+0000", 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089131509999999994 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242914+0000", 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7376999999999998e-05 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242929+0000", 2024-09-12T18:03:30.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4728e-05 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252348+0000", 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094188910000000004 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252475+0000", 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126735 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252712+0000", 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000237075 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264747+0000", 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012034977000000001 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266308+0000", 2024-09-12T18:03:30.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015612130000000001 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266348+0000", 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0278999999999998e-05 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266387+0000", 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9076999999999999e-05 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14964 4.22 4:442ef67f:::10000003341.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2225522870000001, 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030833801000000001, 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14964 2024-09-12T18:03:30.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379737+0000", 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386729+0000", 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069922450000000002 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386748+0000", 2024-09-12T18:03:30.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386759+0000", 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1522000000000001e-05 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386849+0000", 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0255999999999998e-05 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386982+0000", 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013296400000000001 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.387166+0000", 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018323100000000001 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.395195+0000", 2024-09-12T18:03:30.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080296380000000004 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410331+0000", 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01513607 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410451+0000", 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119546 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410570+0000", 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118687 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14971 4.e 4:73867252:::1000000382a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2096215399999997, 2024-09-12T18:03:30.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031669396000000002, 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14971 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:30.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392668+0000", 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.629e-06 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399618+0000", 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069498049999999999 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399636+0000", 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8045000000000001e-05 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399647+0000", 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0482000000000001e-05 2024-09-12T18:03:30.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399738+0000", 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1737999999999995e-05 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399886+0000", 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014755700000000001 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.400110+0000", 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224565 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408175+0000", 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080649520000000002 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424146+0000", 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015970997000000001 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424205+0000", 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8638999999999999e-05 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424336+0000", 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130987 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14973 4.13 4:c81d059c:::100000038e4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.202614133, 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032659724000000001, 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14973 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.703 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399676+0000", 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404945+0000", 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052687569999999998 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404964+0000", 2024-09-12T18:03:30.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404979+0000", 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5290000000000001e-05 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405106+0000", 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127126 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405251+0000", 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014441200000000001 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405392+0000", 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014160600000000001 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.414573+0000", 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091801000000000001 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432244+0000", 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017671630000000001 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432295+0000", 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0729000000000002e-05 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432334+0000", 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8773999999999998e-05 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14978 4.22 4:4562f5e1:::10000003754.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.1936127169999997, 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.049933508000000001, 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.709 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14978 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408677+0000", 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3489999999999999e-06 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416648+0000", 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079712930000000008 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416680+0000", 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2005999999999998e-05 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416698+0000", 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416815+0000", 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011641099999999999 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417000+0000", 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018498000000000001 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417272+0000", 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027257699999999998 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.429341+0000", 2024-09-12T18:03:30.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012068314 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458491+0000", 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029150250999999999 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458553+0000", 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2539999999999994e-05 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458609+0000", 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5461999999999999e-05 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14990 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.1758084530000001, 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032296710999999999, 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.715 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14990 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426481+0000", 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.433997+0000", 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075159520000000002 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434013+0000", 2024-09-12T18:03:30.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5702e-05 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434021+0000", 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434090+0000", 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9029000000000006e-05 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434202+0000", 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011158999999999999 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434358+0000", 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001562 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.442632+0000", 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082736500000000004 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458688+0000", 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016056844000000001 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458737+0000", 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8204999999999997e-05 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458776+0000", 2024-09-12T18:03:30.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9789000000000001e-05 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15095 4.e 4:7041e79b:::10000003456.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.0463972549999996, 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032716585999999999, 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.721 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15095 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555892+0000", 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564584+0000", 2024-09-12T18:03:30.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086921359999999996 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564596+0000", 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1704e-05 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564602+0000", 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1079999999999998e-06 2024-09-12T18:03:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564695+0000", 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3370999999999998e-05 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564964+0000", 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026938500000000002 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.565178+0000", 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021372200000000001 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.571064+0000", 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058862769999999997 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588548+0000", 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017483561000000002 2024-09-12T18:03:30.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588582+0000", 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4436e-05 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588607+0000", 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5006000000000001e-05 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15239 4.3d 4:bfe5f3d1:::10000003901.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.8598605509999997, 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037369946000000001, 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:30.728 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15239 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742429+0000", 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.897e-06 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749874+0000", 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074448259999999999 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749907+0000", 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2419999999999998e-05 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749925+0000", 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8376000000000002e-05 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750112+0000", 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186923 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750409+0000", 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029714999999999999 2024-09-12T18:03:30.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750642+0000", 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023328199999999999 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.764931+0000", 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014288842 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779720+0000", 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014788737999999999 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779765+0000", 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779798+0000", 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2601999999999997e-05 2024-09-12T18:03:30.733 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:30.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:30.734 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:30.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:30.737 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:03:30.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:03:30.737 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:30.738 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:30.733+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:30.837 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:30.831+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:30.896 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:30.896 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:03:30.897 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:30.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:30.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:03:30.938 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:30.935+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:30.948 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:30.949 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:30.967 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:30.968 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:30.990 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:30.990 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:31.034 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:31.034 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:31.039 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:31.035+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:31.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:31.140 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:31.135+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:31.167 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:31.167 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:31.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:31.241 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:31.235+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:31.314 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:31.314 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:31.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:31.374 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:31.371+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:31.442 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:31.439+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:31.494 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:31.494 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:31.508 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:31.554 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:31.551+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:31.644 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:31.639+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:31.682 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:31.682 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:31.697 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:31.745 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:31.739+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:31.846 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:31.841+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:31.859 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:31.859 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:31.880 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:31.916 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:03:31.947 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:31.943+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:32.001 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:32.001 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:32.017 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:32.061 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:32.059+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:32.149 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:32.143+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:32.190 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:32.190 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:32.206 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:32.250 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:32.247+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:32.337 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:32.337 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:32.351 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:32.349+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:32.352 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:32.452 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:32.447+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:32.518 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:32.519 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:32.533 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:32.553 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:32.547+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:32.655 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:32.651+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:32.657 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:32.658 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:32.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:32.756 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:32.751+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:32.802 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:03:32.803 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:03:32.803 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T18:03:32.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T18:03:32.807 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:32.807 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:32.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:32.857 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:32.853+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:32.957 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:32.953+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:32.990 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:32.990 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:33.004 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:33.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:33.058 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:33.055+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:33.125 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:33.125 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:33.140 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:33.150 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:33.150 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:03:33.150 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 56, 2024-09-12T18:03:33.150 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "da5a949a-216b-4267-953a-8d92e3d25b1d", 2024-09-12T18:03:33.150 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-09-12T18:01:33.537080+0000", 2024-09-12T18:03:33.150 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-09-12T18:03:31.908635+0000", 2024-09-12T18:03:33.150 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-09-12T18:01:42.466111+0000", 2024-09-12T18:03:33.150 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-09-12T18:01:34.442067+0000", 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5799936, 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 4, 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T18:03:33.151 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 4, 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "luminous", 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "squid", 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-09-12T18:03:33.152 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:42.598261+0000", 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:03:33.153 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "11", 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:03:33.154 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:03:33.155 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:03:33.156 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-09-12T18:03:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2.9900000095367432, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2.9900000095367432, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:03:33.158 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:48.792102+0000", 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 8193, 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:03:33.159 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:03:33.160 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "15", 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 2, 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 15, 2024-09-12T18:03:33.161 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:03:33.162 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:03:33.163 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.5, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.5, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-09-12T18:03:33.164 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:53.545540+0000", 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:03:33.165 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-09-12T18:03:33.166 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "18", 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:03:33.167 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:03:33.168 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:03:33.169 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-09-12T18:03:33.170 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-12T18:03:33.171 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-09-12T18:01:54.024396+0000", 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-09-12T18:03:33.172 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "is_stretch_pool": false, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-09-12T18:03:33.173 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "19", 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-09-12T18:03:33.174 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-09-12T18:03:33.175 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-09-12T18:03:33.176 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-09-12T18:03:33.177 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "score_type": "Fair distribution", 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.0800000429153442, 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.0800000429153442, 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.0800000429153442, 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.0800000429153442, 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 1, 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-09-12T18:03:33.178 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 1 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "f692452d-28b8-4aad-928e-fe1805e23b68", 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:03:33.179 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 36, 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6800", 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6801", 2024-09-12T18:03:33.180 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6802", 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6803", 2024-09-12T18:03:33.181 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6806", 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6807", 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:03:33.182 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6804", 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.111:6805", 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 177809282 2024-09-12T18:03:33.183 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.111:6801/177809282", 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.111:6803/177809282", 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.111:6807/177809282", 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.111:6805/177809282", 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:03:33.184 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "b5b3807e-e3b5-4530-adc6-af19dd31e340", 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.185 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6800", 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6801", 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.186 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6802", 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6803", 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.187 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6806", 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6807", 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.188 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6804", 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.121:6805", 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3534339867 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.189 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.121:6801/3534339867", 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.121:6803/3534339867", 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.121:6807/3534339867", 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.121:6805/3534339867", 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "926e4870-279e-45c7-9d6c-5841397a5e6c", 2024-09-12T18:03:33.190 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 8, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 17, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.191 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6800", 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6801", 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-09-12T18:03:33.192 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6802", 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6803", 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-09-12T18:03:33.193 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6806", 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6807", 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.194 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6804", 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.153:6805", 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 284634690 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.195 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.153:6801/284634690", 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.153:6803/284634690", 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.153:6807/284634690", 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.153:6805/284634690", 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-09-12T18:03:33.196 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.382866+0000", 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:03:33.197 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.379192+0000", 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540719139924082687, 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-09-12T18:01:40.336708+0000", 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:03:33.198 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [ 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: "pgid": "2.2", 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: 0, 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: 1 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: "pgid": "4.22", 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: 0, 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: 2 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.199 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: "pgid": "4.31", 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: 0, 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: 2 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-09-12T18:03:33.200 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-09-12T18:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-12T18:03:33.202 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:03:33.203 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:33.204 INFO:tasks.thrashosds.thrasher:j is {'epoch': 56, 'fsid': 'da5a949a-216b-4267-953a-8d92e3d25b1d', 'created': '2024-09-12T18:01:33.537080+0000', 'modified': '2024-09-12T18:03:31.908635+0000', 'last_up_change': '2024-09-12T18:01:42.466111+0000', 'last_in_change': '2024-09-12T18:01:34.442067+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T18:01:42.598261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T18:01:48.792102+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 15, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T18:01:53.545540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T18:01:54.024396+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f692452d-28b8-4aad-928e-fe1805e23b68', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 36, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 177809282}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 177809282}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 177809282}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 177809282}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 177809282}]}, 'public_addr': '172.21.15.111:6801/177809282', 'cluster_addr': '172.21.15.111:6803/177809282', 'heartbeat_back_addr': '172.21.15.111:6807/177809282', 'heartbeat_front_addr': '172.21.15.111:6805/177809282', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'b5b3807e-e3b5-4530-adc6-af19dd31e340', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6800', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6801', 'nonce': 3534339867}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6802', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6803', 'nonce': 3534339867}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6806', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6807', 'nonce': 3534339867}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6804', 'nonce': 3534339867}, {'type': 'v1', 'addr': '172.21.15.121:6805', 'nonce': 3534339867}]}, 'public_addr': '172.21.15.121:6801/3534339867', 'cluster_addr': '172.21.15.121:6803/3534339867', 'heartbeat_back_addr': '172.21.15.121:6807/3534339867', 'heartbeat_front_addr': '172.21.15.121:6805/3534339867', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '926e4870-279e-45c7-9d6c-5841397a5e6c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6800', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6801', 'nonce': 284634690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6802', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6803', 'nonce': 284634690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6806', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6807', 'nonce': 284634690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6804', 'nonce': 284634690}, {'type': 'v1', 'addr': '172.21.15.153:6805', 'nonce': 284634690}]}, 'public_addr': '172.21.15.153:6801/284634690', 'cluster_addr': '172.21.15.153:6803/284634690', 'heartbeat_back_addr': '172.21.15.153:6807/284634690', 'heartbeat_front_addr': '172.21.15.153:6805/284634690', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.382866+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.379192+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T18:01:40.336708+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.2', 'osds': [0, 1]}, {'pgid': '4.22', 'osds': [0, 2]}, {'pgid': '4.31', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T18:03:33.205 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:33.205 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:33.206 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:33.206 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:33.199+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:33.272 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:33.272 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:33.272 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:03:33.272 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:33.286 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:33.304 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:33.301+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:33.405 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:33.399+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:33.459 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:33.459 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:33.459 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:33.459 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:33.460 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:33.474 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:33.506 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:33.499+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:33.538 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-12T18:03:32.582161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2240431165,"num_objects":11415,"num_object_clones":0,"num_object_copies":22830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11415,"num_whiteouts":0,"num_read":2650,"num_read_kb":1270882,"num_write":15807,"num_write_kb":4107518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15921,"ondisk_log_size":15921,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":604084,"kb_used_data":443904,"kb_used_omap":4,"kb_used_meta":160123,"kb_avail":282511436,"statfs":{"total":289910292480,"available":289291710464,"internally_reserved":0,"allocated":454557696,"data_stored":4196177840,"data_compressed":225132333,"data_compressed_allocated":296886272,"data_compressed_original":4094788015,"omap_allocated":4785,"internal_metadata":163966287},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":939809171,"num_objects":322,"num_object_clones":0,"num_object_copies":644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":0,"num_read":1603,"num_read_kb":811081,"num_write":2391,"num_write_kb":1959906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001353"},"pg_stats":[{"pgid":"4.3f","version":"53'225","reported_seq":356,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903220+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:26.903220+0000","last_peered":"2024-09-12T18:03:26.903220+0000","last_clean":"2024-09-12T18:03:26.903220+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:26.903220+0000","last_undegraded":"2024-09-12T18:03:26.903220+0000","last_fullsized":"2024-09-12T18:03:26.903220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34017535,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":224,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"53'249","reported_seq":402,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902958+0000","last_change":"2024-09-12T18:01:55.592410+0000","last_active":"2024-09-12T18:03:26.902958+0000","last_peered":"2024-09-12T18:03:26.902958+0000","last_clean":"2024-09-12T18:03:26.902958+0000","last_became_active":"2024-09-12T18:01:55.591618+0000","last_became_peered":"2024-09-12T18:01:55.591618+0000","last_unstale":"2024-09-12T18:03:26.902958+0000","last_undegraded":"2024-09-12T18:03:26.902958+0000","last_fullsized":"2024-09-12T18:03:26.902958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49784462,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":246,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"53'179","reported_seq":276,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897637+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:26.897637+0000","last_peered":"2024-09-12T18:03:26.897637+0000","last_clean":"2024-09-12T18:03:26.897637+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:26.897637+0000","last_undegraded":"2024-09-12T18:03:26.897637+0000","last_fullsized":"2024-09-12T18:03:26.897637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31999532,"num_objects":167,"num_object_clones":0,"num_object_copies":334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":174,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"53'182","reported_seq":288,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897160+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:26.897160+0000","last_peered":"2024-09-12T18:03:26.897160+0000","last_clean":"2024-09-12T18:03:26.897160+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:26.897160+0000","last_undegraded":"2024-09-12T18:03:26.897160+0000","last_fullsized":"2024-09-12T18:03:26.897160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18041644,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":178,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"53'238","reported_seq":390,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903017+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:26.903017+0000","last_peered":"2024-09-12T18:03:26.903017+0000","last_clean":"2024-09-12T18:03:26.903017+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:26.903017+0000","last_undegraded":"2024-09-12T18:03:26.903017+0000","last_fullsized":"2024-09-12T18:03:26.903017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40961969,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":237,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"52'178","reported_seq":276,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896667+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:26.896667+0000","last_peered":"2024-09-12T18:03:26.896667+0000","last_clean":"2024-09-12T18:03:26.896667+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:26.896667+0000","last_undegraded":"2024-09-12T18:03:26.896667+0000","last_fullsized":"2024-09-12T18:03:26.896667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22100412,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":178,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"53'219","reported_seq":368,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897183+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:26.897183+0000","last_peered":"2024-09-12T18:03:26.897183+0000","last_clean":"2024-09-12T18:03:26.897183+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:26.897183+0000","last_undegraded":"2024-09-12T18:03:26.897183+0000","last_fullsized":"2024-09-12T18:03:26.897183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36364855,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":217,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"52'213","reported_seq":367,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.895964+0000","last_change":"2024-09-12T18:01:55.584738+0000","last_active":"2024-09-12T18:03:26.895964+0000","last_peered":"2024-09-12T18:03:26.895964+0000","last_clean":"2024-09-12T18:03:26.895964+0000","last_became_active":"2024-09-12T18:01:55.584096+0000","last_became_peered":"2024-09-12T18:01:55.584096+0000","last_unstale":"2024-09-12T18:03:26.895964+0000","last_undegraded":"2024-09-12T18:03:26.895964+0000","last_fullsized":"2024-09-12T18:03:26.895964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50635626,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":209,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"53'186","reported_seq":278,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897918+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:26.897918+0000","last_peered":"2024-09-12T18:03:26.897918+0000","last_clean":"2024-09-12T18:03:26.897918+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:26.897918+0000","last_undegraded":"2024-09-12T18:03:26.897918+0000","last_fullsized":"2024-09-12T18:03:26.897918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14405361,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":183,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'201","reported_seq":347,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903342+0000","last_change":"2024-09-12T18:01:55.590468+0000","last_active":"2024-09-12T18:03:26.903342+0000","last_peered":"2024-09-12T18:03:26.903342+0000","last_clean":"2024-09-12T18:03:26.903342+0000","last_became_active":"2024-09-12T18:01:55.587653+0000","last_became_peered":"2024-09-12T18:01:55.587653+0000","last_unstale":"2024-09-12T18:03:26.903342+0000","last_undegraded":"2024-09-12T18:03:26.903342+0000","last_fullsized":"2024-09-12T18:03:26.903342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:06.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34212740,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":200,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"53'188","reported_seq":314,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898002+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:26.898002+0000","last_peered":"2024-09-12T18:03:26.898002+0000","last_clean":"2024-09-12T18:03:26.898002+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:26.898002+0000","last_undegraded":"2024-09-12T18:03:26.898002+0000","last_fullsized":"2024-09-12T18:03:26.898002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8459040,"num_objects":160,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":160,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":185,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"53'179","reported_seq":292,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902571+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:26.902571+0000","last_peered":"2024-09-12T18:03:26.902571+0000","last_clean":"2024-09-12T18:03:26.902571+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:26.902571+0000","last_undegraded":"2024-09-12T18:03:26.902571+0000","last_fullsized":"2024-09-12T18:03:26.902571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22911547,"num_objects":156,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":156,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":179,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"53'180","reported_seq":275,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902460+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:26.902460+0000","last_peered":"2024-09-12T18:03:26.902460+0000","last_clean":"2024-09-12T18:03:26.902460+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:26.902460+0000","last_undegraded":"2024-09-12T18:03:26.902460+0000","last_fullsized":"2024-09-12T18:03:26.902460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29186816,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":179,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"53'217","reported_seq":348,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896610+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:26.896610+0000","last_peered":"2024-09-12T18:03:26.896610+0000","last_clean":"2024-09-12T18:03:26.896610+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:26.896610+0000","last_undegraded":"2024-09-12T18:03:26.896610+0000","last_fullsized":"2024-09-12T18:03:26.896610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34202701,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":214,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"53'221","reported_seq":341,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896934+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:26.896934+0000","last_peered":"2024-09-12T18:03:26.896934+0000","last_clean":"2024-09-12T18:03:26.896934+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:26.896934+0000","last_undegraded":"2024-09-12T18:03:26.896934+0000","last_fullsized":"2024-09-12T18:03:26.896934+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57238960,"num_objects":177,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":217,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"52'244","reported_seq":402,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896072+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:26.896072+0000","last_peered":"2024-09-12T18:03:26.896072+0000","last_clean":"2024-09-12T18:03:26.896072+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:26.896072+0000","last_undegraded":"2024-09-12T18:03:26.896072+0000","last_fullsized":"2024-09-12T18:03:26.896072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44230292,"num_objects":193,"num_object_clones":0,"num_object_copies":386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":240,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"52'214","reported_seq":333,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898781+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:26.898781+0000","last_peered":"2024-09-12T18:03:26.898781+0000","last_clean":"2024-09-12T18:03:26.898781+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:26.898781+0000","last_undegraded":"2024-09-12T18:03:26.898781+0000","last_fullsized":"2024-09-12T18:03:26.898781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35400058,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":214,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'203","reported_seq":313,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903946+0000","last_change":"2024-09-12T18:01:55.577995+0000","last_active":"2024-09-12T18:03:26.903946+0000","last_peered":"2024-09-12T18:03:26.903946+0000","last_clean":"2024-09-12T18:03:26.903946+0000","last_became_active":"2024-09-12T18:01:55.576848+0000","last_became_peered":"2024-09-12T18:01:55.576848+0000","last_unstale":"2024-09-12T18:03:26.903946+0000","last_undegraded":"2024-09-12T18:03:26.903946+0000","last_fullsized":"2024-09-12T18:03:26.903946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:03.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32929116,"num_objects":170,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":170,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":199,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"53'239","reported_seq":376,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898139+0000","last_change":"2024-09-12T18:01:55.602843+0000","last_active":"2024-09-12T18:03:26.898139+0000","last_peered":"2024-09-12T18:03:26.898139+0000","last_clean":"2024-09-12T18:03:26.898139+0000","last_became_active":"2024-09-12T18:01:55.602148+0000","last_became_peered":"2024-09-12T18:01:55.602148+0000","last_unstale":"2024-09-12T18:03:26.898139+0000","last_undegraded":"2024-09-12T18:03:26.898139+0000","last_fullsized":"2024-09-12T18:03:26.898139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:47.145354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36364275,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":237,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"52'207","reported_seq":310,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897448+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:26.897448+0000","last_peered":"2024-09-12T18:03:26.897448+0000","last_clean":"2024-09-12T18:03:26.897448+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:26.897448+0000","last_undegraded":"2024-09-12T18:03:26.897448+0000","last_fullsized":"2024-09-12T18:03:26.897448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24096280,"num_objects":190,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":190,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":204,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"53'189","reported_seq":289,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897388+0000","last_change":"2024-09-12T18:01:55.578300+0000","last_active":"2024-09-12T18:03:26.897388+0000","last_peered":"2024-09-12T18:03:26.897388+0000","last_clean":"2024-09-12T18:03:26.897388+0000","last_became_active":"2024-09-12T18:01:55.577481+0000","last_became_peered":"2024-09-12T18:01:55.577481+0000","last_unstale":"2024-09-12T18:03:26.897388+0000","last_undegraded":"2024-09-12T18:03:26.897388+0000","last_fullsized":"2024-09-12T18:03:26.897388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:33.348439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36094281,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":200,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"53'218","reported_seq":353,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902175+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:26.902175+0000","last_peered":"2024-09-12T18:03:26.902175+0000","last_clean":"2024-09-12T18:03:26.902175+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:26.902175+0000","last_undegraded":"2024-09-12T18:03:26.902175+0000","last_fullsized":"2024-09-12T18:03:26.902175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37422692,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":216,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"53'198","reported_seq":300,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896144+0000","last_change":"2024-09-12T18:01:55.587300+0000","last_active":"2024-09-12T18:03:26.896144+0000","last_peered":"2024-09-12T18:03:26.896144+0000","last_clean":"2024-09-12T18:03:26.896144+0000","last_became_active":"2024-09-12T18:01:55.586653+0000","last_became_peered":"2024-09-12T18:01:55.586653+0000","last_unstale":"2024-09-12T18:03:26.896144+0000","last_undegraded":"2024-09-12T18:03:26.896144+0000","last_fullsized":"2024-09-12T18:03:26.896144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:41.706401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39777401,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":193,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"52'236","reported_seq":371,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.901603+0000","last_change":"2024-09-12T18:01:55.579701+0000","last_active":"2024-09-12T18:03:26.901603+0000","last_peered":"2024-09-12T18:03:26.901603+0000","last_clean":"2024-09-12T18:03:26.901603+0000","last_became_active":"2024-09-12T18:01:55.578648+0000","last_became_peered":"2024-09-12T18:01:55.578648+0000","last_unstale":"2024-09-12T18:03:26.901603+0000","last_undegraded":"2024-09-12T18:03:26.901603+0000","last_fullsized":"2024-09-12T18:03:26.901603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:35.070450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47799672,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":235,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"52'191","reported_seq":289,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903334+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:26.903334+0000","last_peered":"2024-09-12T18:03:26.903334+0000","last_clean":"2024-09-12T18:03:26.903334+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:26.903334+0000","last_undegraded":"2024-09-12T18:03:26.903334+0000","last_fullsized":"2024-09-12T18:03:26.903334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6419264,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":188,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"53'236","reported_seq":350,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898177+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:26.898177+0000","last_peered":"2024-09-12T18:03:26.898177+0000","last_clean":"2024-09-12T18:03:26.898177+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:26.898177+0000","last_undegraded":"2024-09-12T18:03:26.898177+0000","last_fullsized":"2024-09-12T18:03:26.898177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37165670,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":227,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'207","reported_seq":333,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898153+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:26.898153+0000","last_peered":"2024-09-12T18:03:26.898153+0000","last_clean":"2024-09-12T18:03:26.898153+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:26.898153+0000","last_undegraded":"2024-09-12T18:03:26.898153+0000","last_fullsized":"2024-09-12T18:03:26.898153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42884412,"num_objects":172,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":172,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":205,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"53'213","reported_seq":346,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903430+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:26.903430+0000","last_peered":"2024-09-12T18:03:26.903430+0000","last_clean":"2024-09-12T18:03:26.903430+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:26.903430+0000","last_undegraded":"2024-09-12T18:03:26.903430+0000","last_fullsized":"2024-09-12T18:03:26.903430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61204125,"num_objects":175,"num_object_clones":0,"num_object_copies":350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":175,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":211,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"53'215","reported_seq":351,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896981+0000","last_change":"2024-09-12T18:01:55.597648+0000","last_active":"2024-09-12T18:03:26.896981+0000","last_peered":"2024-09-12T18:03:26.896981+0000","last_clean":"2024-09-12T18:03:26.896981+0000","last_became_active":"2024-09-12T18:01:55.596419+0000","last_became_peered":"2024-09-12T18:01:55.596419+0000","last_unstale":"2024-09-12T18:03:26.896981+0000","last_undegraded":"2024-09-12T18:03:26.896981+0000","last_fullsized":"2024-09-12T18:03:26.896981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30422960,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":212,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'239","reported_seq":338,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896464+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:26.896464+0000","last_peered":"2024-09-12T18:03:26.896464+0000","last_clean":"2024-09-12T18:03:26.896464+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:26.896464+0000","last_undegraded":"2024-09-12T18:03:26.896464+0000","last_fullsized":"2024-09-12T18:03:26.896464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47332924,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":237,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"52'237","reported_seq":353,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896230+0000","last_change":"2024-09-12T18:01:55.598457+0000","last_active":"2024-09-12T18:03:26.896230+0000","last_peered":"2024-09-12T18:03:26.896230+0000","last_clean":"2024-09-12T18:03:26.896230+0000","last_became_active":"2024-09-12T18:01:55.596555+0000","last_became_peered":"2024-09-12T18:01:55.596555+0000","last_unstale":"2024-09-12T18:03:26.896230+0000","last_undegraded":"2024-09-12T18:03:26.896230+0000","last_fullsized":"2024-09-12T18:03:26.896230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:28.187477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37969774,"num_objects":189,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":189,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":236,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"52'204","reported_seq":317,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896221+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:26.896221+0000","last_peered":"2024-09-12T18:03:26.896221+0000","last_clean":"2024-09-12T18:03:26.896221+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:26.896221+0000","last_undegraded":"2024-09-12T18:03:26.896221+0000","last_fullsized":"2024-09-12T18:03:26.896221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27596695,"num_objects":191,"num_object_clones":0,"num_object_copies":382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":191,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":203,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"52'200","reported_seq":358,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903059+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:26.903059+0000","last_peered":"2024-09-12T18:03:26.903059+0000","last_clean":"2024-09-12T18:03:26.903059+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:26.903059+0000","last_undegraded":"2024-09-12T18:03:26.903059+0000","last_fullsized":"2024-09-12T18:03:26.903059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51190509,"num_objects":171,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":171,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":198,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"50'379","reported_seq":464,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897562+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:26.897562+0000","last_peered":"2024-09-12T18:03:26.897562+0000","last_clean":"2024-09-12T18:03:26.897562+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:26.897562+0000","last_undegraded":"2024-09-12T18:03:26.897562+0000","last_fullsized":"2024-09-12T18:03:26.897562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"53'182","reported_seq":301,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903233+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:26.903233+0000","last_peered":"2024-09-12T18:03:26.903233+0000","last_clean":"2024-09-12T18:03:26.903233+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:26.903233+0000","last_undegraded":"2024-09-12T18:03:26.903233+0000","last_fullsized":"2024-09-12T18:03:26.903233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20277827,"num_objects":169,"num_object_clones":0,"num_object_copies":338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":169,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":179,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"53'1","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896613+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:26.896613+0000","last_peered":"2024-09-12T18:03:26.896613+0000","last_clean":"2024-09-12T18:03:26.896613+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:26.896613+0000","last_undegraded":"2024-09-12T18:03:26.896613+0000","last_fullsized":"2024-09-12T18:03:26.896613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"52'200","reported_seq":308,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898468+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:26.898468+0000","last_peered":"2024-09-12T18:03:26.898468+0000","last_clean":"2024-09-12T18:03:26.898468+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:26.898468+0000","last_undegraded":"2024-09-12T18:03:26.898468+0000","last_fullsized":"2024-09-12T18:03:26.898468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24134744,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":196,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.901988+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:26.901988+0000","last_peered":"2024-09-12T18:03:26.901988+0000","last_clean":"2024-09-12T18:03:26.901988+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:26.901988+0000","last_undegraded":"2024-09-12T18:03:26.901988+0000","last_fullsized":"2024-09-12T18:03:26.901988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"52'204","reported_seq":322,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898117+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:26.898117+0000","last_peered":"2024-09-12T18:03:26.898117+0000","last_clean":"2024-09-12T18:03:26.898117+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:26.898117+0000","last_undegraded":"2024-09-12T18:03:26.898117+0000","last_fullsized":"2024-09-12T18:03:26.898117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40189573,"num_objects":174,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":174,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":200,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":93,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896223+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:26.896223+0000","last_peered":"2024-09-12T18:03:26.896223+0000","last_clean":"2024-09-12T18:03:26.896223+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:26.896223+0000","last_undegraded":"2024-09-12T18:03:26.896223+0000","last_fullsized":"2024-09-12T18:03:26.896223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"53'3","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898086+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:26.898086+0000","last_peered":"2024-09-12T18:03:26.898086+0000","last_clean":"2024-09-12T18:03:26.898086+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:26.898086+0000","last_undegraded":"2024-09-12T18:03:26.898086+0000","last_fullsized":"2024-09-12T18:03:26.898086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"53'214","reported_seq":322,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.901648+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:26.901648+0000","last_peered":"2024-09-12T18:03:26.901648+0000","last_clean":"2024-09-12T18:03:26.901648+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:26.901648+0000","last_undegraded":"2024-09-12T18:03:26.901648+0000","last_fullsized":"2024-09-12T18:03:26.901648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29883616,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":211,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"51'5","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903951+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:26.903951+0000","last_peered":"2024-09-12T18:03:26.903951+0000","last_clean":"2024-09-12T18:03:26.903951+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:26.903951+0000","last_undegraded":"2024-09-12T18:03:26.903951+0000","last_fullsized":"2024-09-12T18:03:26.903951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"52'226","reported_seq":341,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.901603+0000","last_change":"2024-09-12T18:01:55.583263+0000","last_active":"2024-09-12T18:03:26.901603+0000","last_peered":"2024-09-12T18:03:26.901603+0000","last_clean":"2024-09-12T18:03:26.901603+0000","last_became_active":"2024-09-12T18:01:55.582344+0000","last_became_peered":"2024-09-12T18:01:55.582344+0000","last_unstale":"2024-09-12T18:03:26.901603+0000","last_undegraded":"2024-09-12T18:03:26.901603+0000","last_fullsized":"2024-09-12T18:03:26.901603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:41.021776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27658174,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":226,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"53'330","reported_seq":415,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898344+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:26.898344+0000","last_peered":"2024-09-12T18:03:26.898344+0000","last_clean":"2024-09-12T18:03:26.898344+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:26.898344+0000","last_undegraded":"2024-09-12T18:03:26.898344+0000","last_fullsized":"2024-09-12T18:03:26.898344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"53'207","reported_seq":331,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896741+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:26.896741+0000","last_peered":"2024-09-12T18:03:26.896741+0000","last_clean":"2024-09-12T18:03:26.896741+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:26.896741+0000","last_undegraded":"2024-09-12T18:03:26.896741+0000","last_fullsized":"2024-09-12T18:03:26.896741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32857825,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":205,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"51'2","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897934+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:26.897934+0000","last_peered":"2024-09-12T18:03:26.897934+0000","last_clean":"2024-09-12T18:03:26.897934+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:26.897934+0000","last_undegraded":"2024-09-12T18:03:26.897934+0000","last_fullsized":"2024-09-12T18:03:26.897934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"53'226","reported_seq":343,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896780+0000","last_change":"2024-09-12T18:01:55.589220+0000","last_active":"2024-09-12T18:03:26.896780+0000","last_peered":"2024-09-12T18:03:26.896780+0000","last_clean":"2024-09-12T18:03:26.896780+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:03:26.896780+0000","last_undegraded":"2024-09-12T18:03:26.896780+0000","last_fullsized":"2024-09-12T18:03:26.896780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24869446,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":220,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'5","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897298+0000","last_change":"2024-09-12T18:01:54.710454+0000","last_active":"2024-09-12T18:03:26.897298+0000","last_peered":"2024-09-12T18:03:26.897298+0000","last_clean":"2024-09-12T18:03:26.897298+0000","last_became_active":"2024-09-12T18:01:54.709574+0000","last_became_peered":"2024-09-12T18:01:54.709574+0000","last_unstale":"2024-09-12T18:03:26.897298+0000","last_undegraded":"2024-09-12T18:03:26.897298+0000","last_fullsized":"2024-09-12T18:03:26.897298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:36.749968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"52'220","reported_seq":342,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897742+0000","last_change":"2024-09-12T18:01:55.583001+0000","last_active":"2024-09-12T18:03:26.897742+0000","last_peered":"2024-09-12T18:03:26.897742+0000","last_clean":"2024-09-12T18:03:26.897742+0000","last_became_active":"2024-09-12T18:01:55.582140+0000","last_became_peered":"2024-09-12T18:01:55.582140+0000","last_unstale":"2024-09-12T18:03:26.897742+0000","last_undegraded":"2024-09-12T18:03:26.897742+0000","last_fullsized":"2024-09-12T18:03:26.897742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:50.425136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42848917,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":219,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897102+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:26.897102+0000","last_peered":"2024-09-12T18:03:26.897102+0000","last_clean":"2024-09-12T18:03:26.897102+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:26.897102+0000","last_undegraded":"2024-09-12T18:03:26.897102+0000","last_fullsized":"2024-09-12T18:03:26.897102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"53'208","reported_seq":346,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898250+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:26.898250+0000","last_peered":"2024-09-12T18:03:26.898250+0000","last_clean":"2024-09-12T18:03:26.898250+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:26.898250+0000","last_undegraded":"2024-09-12T18:03:26.898250+0000","last_fullsized":"2024-09-12T18:03:26.898250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34389651,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":205,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902287+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:26.902287+0000","last_peered":"2024-09-12T18:03:26.902287+0000","last_clean":"2024-09-12T18:03:26.902287+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:26.902287+0000","last_undegraded":"2024-09-12T18:03:26.902287+0000","last_fullsized":"2024-09-12T18:03:26.902287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"53'188","reported_seq":307,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897319+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:26.897319+0000","last_peered":"2024-09-12T18:03:26.897319+0000","last_clean":"2024-09-12T18:03:26.897319+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:26.897319+0000","last_undegraded":"2024-09-12T18:03:26.897319+0000","last_fullsized":"2024-09-12T18:03:26.897319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43012228,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":185,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"53'429","reported_seq":513,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.901950+0000","last_change":"2024-09-12T18:01:54.703737+0000","last_active":"2024-09-12T18:03:26.901950+0000","last_peered":"2024-09-12T18:03:26.901950+0000","last_clean":"2024-09-12T18:03:26.901950+0000","last_became_active":"2024-09-12T18:01:54.702931+0000","last_became_peered":"2024-09-12T18:01:54.702931+0000","last_unstale":"2024-09-12T18:03:26.901950+0000","last_undegraded":"2024-09-12T18:03:26.901950+0000","last_fullsized":"2024-09-12T18:03:26.901950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:17.561296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"53'180","reported_seq":281,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898192+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:26.898192+0000","last_peered":"2024-09-12T18:03:26.898192+0000","last_clean":"2024-09-12T18:03:26.898192+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:26.898192+0000","last_undegraded":"2024-09-12T18:03:26.898192+0000","last_fullsized":"2024-09-12T18:03:26.898192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16339266,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":178,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":235,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896508+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:26.896508+0000","last_peered":"2024-09-12T18:03:26.896508+0000","last_clean":"2024-09-12T18:03:26.896508+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:26.896508+0000","last_undegraded":"2024-09-12T18:03:26.896508+0000","last_fullsized":"2024-09-12T18:03:26.896508+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897834+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:26.897834+0000","last_peered":"2024-09-12T18:03:26.897834+0000","last_clean":"2024-09-12T18:03:26.897834+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:26.897834+0000","last_undegraded":"2024-09-12T18:03:26.897834+0000","last_fullsized":"2024-09-12T18:03:26.897834+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"54'360","reported_seq":444,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:27.646246+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:27.646246+0000","last_peered":"2024-09-12T18:03:27.646246+0000","last_clean":"2024-09-12T18:03:27.646246+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:27.646246+0000","last_undegraded":"2024-09-12T18:03:27.646246+0000","last_fullsized":"2024-09-12T18:03:27.646246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7918054,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":7894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'222","reported_seq":326,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898344+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:26.898344+0000","last_peered":"2024-09-12T18:03:26.898344+0000","last_clean":"2024-09-12T18:03:26.898344+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:26.898344+0000","last_undegraded":"2024-09-12T18:03:26.898344+0000","last_fullsized":"2024-09-12T18:03:26.898344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32907218,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":217,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896428+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:26.896428+0000","last_peered":"2024-09-12T18:03:26.896428+0000","last_clean":"2024-09-12T18:03:26.896428+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:26.896428+0000","last_undegraded":"2024-09-12T18:03:26.896428+0000","last_fullsized":"2024-09-12T18:03:26.896428+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"53'18","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897065+0000","last_change":"2024-09-12T18:01:54.713293+0000","last_active":"2024-09-12T18:03:26.897065+0000","last_peered":"2024-09-12T18:03:26.897065+0000","last_clean":"2024-09-12T18:03:26.897065+0000","last_became_active":"2024-09-12T18:01:54.711781+0000","last_became_peered":"2024-09-12T18:01:54.711781+0000","last_unstale":"2024-09-12T18:03:26.897065+0000","last_undegraded":"2024-09-12T18:03:26.897065+0000","last_fullsized":"2024-09-12T18:03:26.897065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22220,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":34,"num_write":15,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"52'236","reported_seq":385,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903670+0000","last_change":"2024-09-12T18:01:55.580448+0000","last_active":"2024-09-12T18:03:26.903670+0000","last_peered":"2024-09-12T18:03:26.903670+0000","last_clean":"2024-09-12T18:03:26.903670+0000","last_became_active":"2024-09-12T18:01:55.578751+0000","last_became_peered":"2024-09-12T18:01:55.578751+0000","last_unstale":"2024-09-12T18:03:26.903670+0000","last_undegraded":"2024-09-12T18:03:26.903670+0000","last_fullsized":"2024-09-12T18:03:26.903670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:03.878437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493485,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":236,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897315+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:26.897315+0000","last_peered":"2024-09-12T18:03:26.897315+0000","last_clean":"2024-09-12T18:03:26.897315+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:26.897315+0000","last_undegraded":"2024-09-12T18:03:26.897315+0000","last_fullsized":"2024-09-12T18:03:26.897315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"50'312","reported_seq":396,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.901979+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:26.901979+0000","last_peered":"2024-09-12T18:03:26.901979+0000","last_clean":"2024-09-12T18:03:26.901979+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:26.901979+0000","last_undegraded":"2024-09-12T18:03:26.901979+0000","last_fullsized":"2024-09-12T18:03:26.901979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"53'166","reported_seq":258,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898346+0000","last_change":"2024-09-12T18:01:55.605325+0000","last_active":"2024-09-12T18:03:26.898346+0000","last_peered":"2024-09-12T18:03:26.898346+0000","last_clean":"2024-09-12T18:03:26.898346+0000","last_became_active":"2024-09-12T18:01:55.604756+0000","last_became_peered":"2024-09-12T18:01:55.604756+0000","last_unstale":"2024-09-12T18:03:26.898346+0000","last_undegraded":"2024-09-12T18:03:26.898346+0000","last_fullsized":"2024-09-12T18:03:26.898346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6341526,"num_objects":153,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":153,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":164,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":110,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897392+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:26.897392+0000","last_peered":"2024-09-12T18:03:26.897392+0000","last_clean":"2024-09-12T18:03:26.897392+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:26.897392+0000","last_undegraded":"2024-09-12T18:03:26.897392+0000","last_fullsized":"2024-09-12T18:03:26.897392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"52'1","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897546+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:26.897546+0000","last_peered":"2024-09-12T18:03:26.897546+0000","last_clean":"2024-09-12T18:03:26.897546+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:26.897546+0000","last_undegraded":"2024-09-12T18:03:26.897546+0000","last_fullsized":"2024-09-12T18:03:26.897546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"53'218","reported_seq":386,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897616+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:26.897616+0000","last_peered":"2024-09-12T18:03:26.897616+0000","last_clean":"2024-09-12T18:03:26.897616+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:26.897616+0000","last_undegraded":"2024-09-12T18:03:26.897616+0000","last_fullsized":"2024-09-12T18:03:26.897616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44509526,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":215,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"50'1","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898415+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:26.898415+0000","last_peered":"2024-09-12T18:03:26.898415+0000","last_clean":"2024-09-12T18:03:26.898415+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:26.898415+0000","last_undegraded":"2024-09-12T18:03:26.898415+0000","last_fullsized":"2024-09-12T18:03:26.898415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897995+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:26.897995+0000","last_peered":"2024-09-12T18:03:26.897995+0000","last_clean":"2024-09-12T18:03:26.897995+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:26.897995+0000","last_undegraded":"2024-09-12T18:03:26.897995+0000","last_fullsized":"2024-09-12T18:03:26.897995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"52'174","reported_seq":283,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902483+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:26.902483+0000","last_peered":"2024-09-12T18:03:26.902483+0000","last_clean":"2024-09-12T18:03:26.902483+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:26.902483+0000","last_undegraded":"2024-09-12T18:03:26.902483+0000","last_fullsized":"2024-09-12T18:03:26.902483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21780168,"num_objects":156,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":156,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":170,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"52'1","reported_seq":85,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897719+0000","last_change":"2024-09-12T18:01:54.711572+0000","last_active":"2024-09-12T18:03:26.897719+0000","last_peered":"2024-09-12T18:03:26.897719+0000","last_clean":"2024-09-12T18:03:26.897719+0000","last_became_active":"2024-09-12T18:01:54.710455+0000","last_became_peered":"2024-09-12T18:01:54.710455+0000","last_unstale":"2024-09-12T18:03:26.897719+0000","last_undegraded":"2024-09-12T18:03:26.897719+0000","last_fullsized":"2024-09-12T18:03:26.897719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.904120+0000","last_change":"2024-09-12T18:01:52.539387+0000","last_active":"2024-09-12T18:03:26.904120+0000","last_peered":"2024-09-12T18:03:26.904120+0000","last_clean":"2024-09-12T18:03:26.904120+0000","last_became_active":"2024-09-12T18:01:50.536333+0000","last_became_peered":"2024-09-12T18:01:50.536333+0000","last_unstale":"2024-09-12T18:03:26.904120+0000","last_undegraded":"2024-09-12T18:03:26.904120+0000","last_fullsized":"2024-09-12T18:03:26.904120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:16.410464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"53'189","reported_seq":304,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902752+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:26.902752+0000","last_peered":"2024-09-12T18:03:26.902752+0000","last_clean":"2024-09-12T18:03:26.902752+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:26.902752+0000","last_undegraded":"2024-09-12T18:03:26.902752+0000","last_fullsized":"2024-09-12T18:03:26.902752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23291975,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":184,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898982+0000","last_change":"2024-09-12T18:01:54.713122+0000","last_active":"2024-09-12T18:03:26.898982+0000","last_peered":"2024-09-12T18:03:26.898982+0000","last_clean":"2024-09-12T18:03:26.898982+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:03:26.898982+0000","last_undegraded":"2024-09-12T18:03:26.898982+0000","last_fullsized":"2024-09-12T18:03:26.898982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898736+0000","last_change":"2024-09-12T18:01:52.547210+0000","last_active":"2024-09-12T18:03:26.898736+0000","last_peered":"2024-09-12T18:03:26.898736+0000","last_clean":"2024-09-12T18:03:26.898736+0000","last_became_active":"2024-09-12T18:01:50.538375+0000","last_became_peered":"2024-09-12T18:01:50.538375+0000","last_unstale":"2024-09-12T18:03:26.898736+0000","last_undegraded":"2024-09-12T18:03:26.898736+0000","last_fullsized":"2024-09-12T18:03:26.898736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:29.653601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001652153,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"52'187","reported_seq":274,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896039+0000","last_change":"2024-09-12T18:01:55.587280+0000","last_active":"2024-09-12T18:03:26.896039+0000","last_peered":"2024-09-12T18:03:26.896039+0000","last_clean":"2024-09-12T18:03:26.896039+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:03:26.896039+0000","last_undegraded":"2024-09-12T18:03:26.896039+0000","last_fullsized":"2024-09-12T18:03:26.896039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:38.210737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20707494,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":186,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'33","reported_seq":117,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898734+0000","last_change":"2024-09-12T18:01:54.710694+0000","last_active":"2024-09-12T18:03:26.898734+0000","last_peered":"2024-09-12T18:03:26.898734+0000","last_clean":"2024-09-12T18:03:26.898734+0000","last_became_active":"2024-09-12T18:01:54.709922+0000","last_became_peered":"2024-09-12T18:01:54.709922+0000","last_unstale":"2024-09-12T18:03:26.898734+0000","last_undegraded":"2024-09-12T18:03:26.898734+0000","last_fullsized":"2024-09-12T18:03:26.898734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898078+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:26.898078+0000","last_peered":"2024-09-12T18:03:26.898078+0000","last_clean":"2024-09-12T18:03:26.898078+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:26.898078+0000","last_undegraded":"2024-09-12T18:03:26.898078+0000","last_fullsized":"2024-09-12T18:03:26.898078+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"53'193","reported_seq":325,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.901753+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:26.901753+0000","last_peered":"2024-09-12T18:03:26.901753+0000","last_clean":"2024-09-12T18:03:26.901753+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:26.901753+0000","last_undegraded":"2024-09-12T18:03:26.901753+0000","last_fullsized":"2024-09-12T18:03:26.901753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31730461,"num_objects":164,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":164,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":190,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"53'201","reported_seq":325,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897137+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:26.897137+0000","last_peered":"2024-09-12T18:03:26.897137+0000","last_clean":"2024-09-12T18:03:26.897137+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:26.897137+0000","last_undegraded":"2024-09-12T18:03:26.897137+0000","last_fullsized":"2024-09-12T18:03:26.897137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53228727,"num_objects":167,"num_object_clones":0,"num_object_copies":334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":167,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":198,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"51'23","reported_seq":108,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897947+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:26.897947+0000","last_peered":"2024-09-12T18:03:26.897947+0000","last_clean":"2024-09-12T18:03:26.897947+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:26.897947+0000","last_undegraded":"2024-09-12T18:03:26.897947+0000","last_fullsized":"2024-09-12T18:03:26.897947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"53'222","reported_seq":345,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896325+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:26.896325+0000","last_peered":"2024-09-12T18:03:26.896325+0000","last_clean":"2024-09-12T18:03:26.896325+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:26.896325+0000","last_undegraded":"2024-09-12T18:03:26.896325+0000","last_fullsized":"2024-09-12T18:03:26.896325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39825310,"num_objects":187,"num_object_clones":0,"num_object_copies":374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":220,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"53'17","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903907+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:26.903907+0000","last_peered":"2024-09-12T18:03:26.903907+0000","last_clean":"2024-09-12T18:03:26.903907+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:26.903907+0000","last_undegraded":"2024-09-12T18:03:26.903907+0000","last_fullsized":"2024-09-12T18:03:26.903907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"53'3","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897628+0000","last_change":"2024-09-12T18:01:54.714244+0000","last_active":"2024-09-12T18:03:26.897628+0000","last_peered":"2024-09-12T18:03:26.897628+0000","last_clean":"2024-09-12T18:03:26.897628+0000","last_became_active":"2024-09-12T18:01:54.713365+0000","last_became_peered":"2024-09-12T18:01:54.713365+0000","last_unstale":"2024-09-12T18:03:26.897628+0000","last_undegraded":"2024-09-12T18:03:26.897628+0000","last_fullsized":"2024-09-12T18:03:26.897628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:48.497134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"53'255","reported_seq":427,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896457+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:26.896457+0000","last_peered":"2024-09-12T18:03:26.896457+0000","last_clean":"2024-09-12T18:03:26.896457+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:26.896457+0000","last_undegraded":"2024-09-12T18:03:26.896457+0000","last_fullsized":"2024-09-12T18:03:26.896457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49167977,"num_objects":201,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":201,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":252,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"51'2","reported_seq":86,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898724+0000","last_change":"2024-09-12T18:01:54.713935+0000","last_active":"2024-09-12T18:03:26.898724+0000","last_peered":"2024-09-12T18:03:26.898724+0000","last_clean":"2024-09-12T18:03:26.898724+0000","last_became_active":"2024-09-12T18:01:54.712526+0000","last_became_peered":"2024-09-12T18:01:54.712526+0000","last_unstale":"2024-09-12T18:03:26.898724+0000","last_undegraded":"2024-09-12T18:03:26.898724+0000","last_fullsized":"2024-09-12T18:03:26.898724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'231","reported_seq":363,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.895960+0000","last_change":"2024-09-12T18:01:55.596437+0000","last_active":"2024-09-12T18:03:26.895960+0000","last_peered":"2024-09-12T18:03:26.895960+0000","last_clean":"2024-09-12T18:03:26.895960+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:03:26.895960+0000","last_undegraded":"2024-09-12T18:03:26.895960+0000","last_fullsized":"2024-09-12T18:03:26.895960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:06.111461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47302726,"num_objects":202,"num_object_clones":0,"num_object_copies":404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":202,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":231,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'184","reported_seq":303,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903541+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:26.903541+0000","last_peered":"2024-09-12T18:03:26.903541+0000","last_clean":"2024-09-12T18:03:26.903541+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:26.903541+0000","last_undegraded":"2024-09-12T18:03:26.903541+0000","last_fullsized":"2024-09-12T18:03:26.903541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34923969,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":183,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"51'432","reported_seq":516,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896142+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:26.896142+0000","last_peered":"2024-09-12T18:03:26.896142+0000","last_clean":"2024-09-12T18:03:26.896142+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:26.896142+0000","last_undegraded":"2024-09-12T18:03:26.896142+0000","last_fullsized":"2024-09-12T18:03:26.896142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'233","reported_seq":377,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897898+0000","last_change":"2024-09-12T18:01:55.596388+0000","last_active":"2024-09-12T18:03:26.897898+0000","last_peered":"2024-09-12T18:03:26.897898+0000","last_clean":"2024-09-12T18:03:26.897898+0000","last_became_active":"2024-09-12T18:01:55.595613+0000","last_became_peered":"2024-09-12T18:01:55.595613+0000","last_unstale":"2024-09-12T18:03:26.897898+0000","last_undegraded":"2024-09-12T18:03:26.897898+0000","last_fullsized":"2024-09-12T18:03:26.897898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35562959,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":229,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"52'3","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896757+0000","last_change":"2024-09-12T18:01:54.710364+0000","last_active":"2024-09-12T18:03:26.896757+0000","last_peered":"2024-09-12T18:03:26.896757+0000","last_clean":"2024-09-12T18:03:26.896757+0000","last_became_active":"2024-09-12T18:01:54.709267+0000","last_became_peered":"2024-09-12T18:01:54.709267+0000","last_unstale":"2024-09-12T18:03:26.896757+0000","last_undegraded":"2024-09-12T18:03:26.896757+0000","last_fullsized":"2024-09-12T18:03:26.896757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"52'192","reported_seq":312,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902549+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:26.902549+0000","last_peered":"2024-09-12T18:03:26.902549+0000","last_clean":"2024-09-12T18:03:26.902549+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:26.902549+0000","last_undegraded":"2024-09-12T18:03:26.902549+0000","last_fullsized":"2024-09-12T18:03:26.902549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52743100,"num_objects":161,"num_object_clones":0,"num_object_copies":322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":161,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":189,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"47'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902772+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:26.902772+0000","last_peered":"2024-09-12T18:03:26.902772+0000","last_clean":"2024-09-12T18:03:26.902772+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:26.902772+0000","last_undegraded":"2024-09-12T18:03:26.902772+0000","last_fullsized":"2024-09-12T18:03:26.902772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"52'182","reported_seq":277,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902872+0000","last_change":"2024-09-12T18:01:55.587492+0000","last_active":"2024-09-12T18:03:26.902872+0000","last_peered":"2024-09-12T18:03:26.902872+0000","last_clean":"2024-09-12T18:03:26.902872+0000","last_became_active":"2024-09-12T18:01:55.584857+0000","last_became_peered":"2024-09-12T18:01:55.584857+0000","last_unstale":"2024-09-12T18:03:26.902872+0000","last_undegraded":"2024-09-12T18:03:26.902872+0000","last_fullsized":"2024-09-12T18:03:26.902872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:14.376660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28171596,"num_objects":163,"num_object_clones":0,"num_object_copies":326,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":163,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":181,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"52'7","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903319+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:26.903319+0000","last_peered":"2024-09-12T18:03:26.903319+0000","last_clean":"2024-09-12T18:03:26.903319+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:26.903319+0000","last_undegraded":"2024-09-12T18:03:26.903319+0000","last_fullsized":"2024-09-12T18:03:26.903319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"52'182","reported_seq":278,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897082+0000","last_change":"2024-09-12T18:01:55.586038+0000","last_active":"2024-09-12T18:03:26.897082+0000","last_peered":"2024-09-12T18:03:26.897082+0000","last_clean":"2024-09-12T18:03:26.897082+0000","last_became_active":"2024-09-12T18:01:55.585287+0000","last_became_peered":"2024-09-12T18:01:55.585287+0000","last_unstale":"2024-09-12T18:03:26.897082+0000","last_undegraded":"2024-09-12T18:03:26.897082+0000","last_fullsized":"2024-09-12T18:03:26.897082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:45.773295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13999389,"num_objects":164,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":164,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":182,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"51'4","reported_seq":89,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.897806+0000","last_change":"2024-09-12T18:01:54.719058+0000","last_active":"2024-09-12T18:03:26.897806+0000","last_peered":"2024-09-12T18:03:26.897806+0000","last_clean":"2024-09-12T18:03:26.897806+0000","last_became_active":"2024-09-12T18:01:54.718221+0000","last_became_peered":"2024-09-12T18:01:54.718221+0000","last_unstale":"2024-09-12T18:03:26.897806+0000","last_undegraded":"2024-09-12T18:03:26.897806+0000","last_fullsized":"2024-09-12T18:03:26.897806+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:45.993030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"53'193","reported_seq":298,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896971+0000","last_change":"2024-09-12T18:01:55.582609+0000","last_active":"2024-09-12T18:03:26.896971+0000","last_peered":"2024-09-12T18:03:26.896971+0000","last_clean":"2024-09-12T18:03:26.896971+0000","last_became_active":"2024-09-12T18:01:55.581919+0000","last_became_peered":"2024-09-12T18:01:55.581919+0000","last_unstale":"2024-09-12T18:03:26.896971+0000","last_undegraded":"2024-09-12T18:03:26.896971+0000","last_fullsized":"2024-09-12T18:03:26.896971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:45.313081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31196327,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":192,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"51'76","reported_seq":160,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.903527+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:26.903527+0000","last_peered":"2024-09-12T18:03:26.903527+0000","last_clean":"2024-09-12T18:03:26.903527+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:26.903527+0000","last_undegraded":"2024-09-12T18:03:26.903527+0000","last_fullsized":"2024-09-12T18:03:26.903527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":8231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"52'189","reported_seq":296,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.902555+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:26.902555+0000","last_peered":"2024-09-12T18:03:26.902555+0000","last_clean":"2024-09-12T18:03:26.902555+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:26.902555+0000","last_undegraded":"2024-09-12T18:03:26.902555+0000","last_fullsized":"2024-09-12T18:03:26.902555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17424745,"num_objects":176,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":176,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":184,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"51'4","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898410+0000","last_change":"2024-09-12T18:01:54.712808+0000","last_active":"2024-09-12T18:03:26.898410+0000","last_peered":"2024-09-12T18:03:26.898410+0000","last_clean":"2024-09-12T18:03:26.898410+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:03:26.898410+0000","last_undegraded":"2024-09-12T18:03:26.898410+0000","last_fullsized":"2024-09-12T18:03:26.898410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'223","reported_seq":375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.896336+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:26.896336+0000","last_peered":"2024-09-12T18:03:26.896336+0000","last_clean":"2024-09-12T18:03:26.896336+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:26.896336+0000","last_undegraded":"2024-09-12T18:03:26.896336+0000","last_fullsized":"2024-09-12T18:03:26.896336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38390929,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":220,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"46'69","reported_seq":153,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T18:03:26.898467+0000","last_change":"2024-09-12T18:01:54.713525+0000","last_active":"2024-09-12T18:03:26.898467+0000","last_peered":"2024-09-12T18:03:26.898467+0000","last_clean":"2024-09-12T18:03:26.898467+0000","last_became_active":"2024-09-12T18:01:54.711908+0000","last_became_peered":"2024-09-12T18:01:54.711908+0000","last_unstale":"2024-09-12T18:03:26.898467+0000","last_undegraded":"2024-09-12T18:03:26.898467+0000","last_fullsized":"2024-09-12T18:03:26.898467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":2168984474,"num_objects":11372,"num_object_clones":0,"num_object_copies":22744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11372,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":13122,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":406667264,"data_stored":4030167960,"data_compressed":203746598,"data_compressed_allocated":269516800,"data_compressed_original":3948452290,"omap_allocated":0,"internal_metadata":0},"log_size":13272,"ondisk_log_size":13272,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":70856304,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":15,"num_read_kb":34,"num_write":2538,"num_write_kb":71349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46059520,"data_stored":141784973,"data_compressed":20576283,"data_compressed_allocated":26337280,"data_compressed_original":122126336,"omap_allocated":0,"internal_metadata":0},"log_size":2534,"ondisk_log_size":2534,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738393,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":212564,"kb_used_data":155012,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94159276,"statfs":{"total":96636764160,"available":96419098624,"internally_reserved":0,"allocated":158732288,"data_stored":1503802421,"data_compressed":79725869,"data_compressed_allocated":105467904,"data_compressed_original":1471433102,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738393,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200392,"kb_used_data":147000,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94171448,"statfs":{"total":96636764160,"available":96431562752,"internally_reserved":0,"allocated":150528000,"data_stored":1339199736,"data_compressed":72155997,"data_compressed_allocated":95203328,"data_compressed_original":1301323157,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191128,"kb_used_data":141892,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94180712,"statfs":{"total":96636764160,"available":96441049088,"internally_reserved":0,"allocated":145297408,"data_stored":1353175683,"data_compressed":73250467,"data_compressed_allocated":96215040,"data_compressed_original":1322031756,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13262848,"data_stored":46161034,"data_compressed":6922525,"data_compressed_allocated":8626176,"data_compressed_original":41553920,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18317312,"data_stored":54107544,"data_compressed":7802502,"data_compressed_allocated":10088448,"data_compressed_original":45899776,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14479360,"data_stored":41516395,"data_compressed":5851256,"data_compressed_allocated":7622656,"data_compressed_original":34672640,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131514368,"data_stored":1306215528,"data_compressed":66292690,"data_compressed_allocated":87543808,"data_compressed_original":1279904396,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131198976,"data_stored":1261538515,"data_compressed":63530228,"data_compressed_allocated":84049920,"data_compressed_original":1231525288,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":143953920,"data_stored":1462413917,"data_compressed":73923680,"data_compressed_allocated":97923072,"data_compressed_original":1437022606,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:33.542 INFO:tasks.thrashosds.thrasher:Setting 3.11 to [2, 1, 0] 2024-09-12T18:03:33.542 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.11', '2', '1', '0'] 2024-09-12T18:03:33.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.11 2 1 0 2024-09-12T18:03:33.607 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:33.607+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:33.648 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:33.648 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:33.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:33.648 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:33.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.591498484999999, 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:33.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:33.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:33.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.654 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10795 4.22 4:4414d34e:::1000000315b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.693480901000001, 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03153454, 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.655 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10795 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952771+0000", 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9290000000000001e-06 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960575+0000", 2024-09-12T18:03:33.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078039479999999998 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960595+0000", 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9644e-05 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960609+0000", 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4246999999999999e-05 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960772+0000", 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016263000000000001 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960936+0000", 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016446899999999999 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.961298+0000", 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036151899999999998 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.981362+0000", 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020064015000000001 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984110+0000", 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00274852 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984227+0000", 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116267 2024-09-12T18:03:33.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984304+0000", 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7352000000000001e-05 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11134 4.30 4:0ea0a8b4:::10000003186.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.135879844, 2024-09-12T18:03:33.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037582955000000001, 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11134 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:33.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000001e-07 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518086+0000", 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077143059999999998 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518103+0000", 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7441000000000001e-05 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518116+0000", 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2573e-05 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518192+0000", 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518319+0000", 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012724599999999999 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518439+0000", 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119436 2024-09-12T18:03:33.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.527060+0000", 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086211320000000001 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547881+0000", 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02082063 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547921+0000", 2024-09-12T18:03:33.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0411999999999999e-05 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547954+0000", 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2583000000000003e-05 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11577 4.35 4:acdeb9c5:::1000000332a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.480599219, 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032699999, 2024-09-12T18:03:33.667 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11577 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165652+0000", 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0920000000000001e-06 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175860+0000", 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010207233 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175874+0000", 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4229999999999999e-05 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175882+0000", 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7330000000000003e-06 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175941+0000", 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8996000000000002e-05 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176090+0000", 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014994800000000001 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176209+0000", 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118825 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.184925+0000", 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008715558 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198295+0000", 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013369804000000001 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198327+0000", 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1942e-05 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198351+0000", 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14036 4.31 4:8eca8ddf:::100000031b8.00000000:head [write 0~4194304 [4@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.3817489579999993, 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034286130999999997, 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14036 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.674 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264505+0000", 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0570000000000001e-06 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273393+0000", 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088884240000000007 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273426+0000", 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3256999999999997e-05 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273441+0000", 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4445e-05 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273550+0000", 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010887099999999999 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273689+0000", 2024-09-12T18:03:33.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139178 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273844+0000", 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155291 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.282512+0000", 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086676940000000001 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298736+0000", 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016224160000000001 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298766+0000", 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9961e-05 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298788+0000", 2024-09-12T18:03:33.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1793e-05 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14099 4.18 4:18c6d816:::10000003304.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.3033882410000004, 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031590162999999997, 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.680 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14099 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342865+0000", 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.74e-06 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350699+0000", 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078345069999999992 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350738+0000", 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.837e-05 2024-09-12T18:03:33.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350757+0000", 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9519000000000001e-05 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350912+0000", 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015452099999999999 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351291+0000", 2024-09-12T18:03:33.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037953800000000001 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351691+0000", 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000399379 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.362505+0000", 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010814503 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374285+0000", 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011780135000000001 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374369+0000", 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3429000000000004e-05 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374452+0000", 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3522000000000004e-05 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14111 4.a 4:530380b1:::10000003584.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.2826289969999998, 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032405549999999998, 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14111 2024-09-12T18:03:33.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363624+0000", 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3329999999999999e-06 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369957+0000", 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063336720000000003 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369986+0000", 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8269e-05 2024-09-12T18:03:33.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370001+0000", 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-05 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370257+0000", 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025585799999999998 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370536+0000", 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027879400000000001 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370979+0000", 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044307100000000001 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.380399+0000", 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094193109999999997 2024-09-12T18:03:33.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395936+0000", 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01553759 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395987+0000", 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1249999999999999e-05 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.396027+0000", 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9651999999999999e-05 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14165 4.32 4:4ea4de87:::100000037a0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.2078877699999993, 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030909196, 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.692 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14165 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438365+0000", 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0540000000000002e-06 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446256+0000", 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078916520000000007 2024-09-12T18:03:33.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446295+0000", 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000003e-05 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446311+0000", 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6696000000000001e-05 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446418+0000", 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010707199999999999 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446610+0000", 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019208499999999999 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446827+0000", 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216939 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.452206+0000", 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053787210000000004 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469114+0000", 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016907493999999999 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469196+0000", 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2237999999999994e-05 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469272+0000", 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6114999999999999e-05 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14176 4.5 4:a36cb72d:::10000003716.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:33.698 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.1996243740000008, 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.040437328000000002, 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14176 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446629+0000", 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.429e-06 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460229+0000", 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013600736 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460276+0000", 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6721999999999998e-05 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460297+0000", 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1308999999999999e-05 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460554+0000", 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025637199999999999 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460983+0000", 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042940099999999999 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.461353+0000", 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036966199999999999 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.484975+0000", 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023622647 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486801+0000", 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00182548 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486933+0000", 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013208800000000001 2024-09-12T18:03:33.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.487063+0000", 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013048199999999999 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14374 4.38 4:1dead311:::10000003395.00000000:head [write 0~4194304 [2@357324]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.9762441099999997, 2024-09-12T18:03:33.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039429224999999998, 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14374 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:33.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670009+0000", 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.497e-06 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682349+0000", 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012339785000000001 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682387+0000", 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8633000000000001e-05 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682404+0000", 2024-09-12T18:03:33.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7005999999999999e-05 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682514+0000", 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010951900000000001 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682649+0000", 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013563799999999999 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682836+0000", 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186424 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.701541+0000", 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018705016000000001 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709313+0000", 2024-09-12T18:03:33.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077725889999999999 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709392+0000", 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8860000000000001e-05 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709436+0000", 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.710 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14734 4.32 4:4f3042f2:::1000000322e.00000000:head [write 0~4194304 [3@261943]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.5848305089999997, 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033021488000000002, 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14734 2024-09-12T18:03:33.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061421+0000", 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069604+0000", 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081825100000000005 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069626+0000", 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2849000000000001e-05 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069645+0000", 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8926000000000001e-05 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069736+0000", 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0107999999999999e-05 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069861+0000", 2024-09-12T18:03:33.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125704 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.070200+0000", 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000338308 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.080698+0000", 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010498182 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094351+0000", 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013653168 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094404+0000", 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3424999999999998e-05 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094441+0000", 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7131000000000001e-05 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14827 4.8 e52/17 4:1171651b:::100000030fc.00000001:head v 52'208, mlcod=52'206)", 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4142680199999997, 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032040617, 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231983+0000", 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.16e-07 2024-09-12T18:03:33.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239015+0000", 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070313540000000001 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239054+0000", 2024-09-12T18:03:33.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9675000000000002e-05 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239070+0000", 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239237+0000", 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016739399999999999 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239285+0000", 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7500999999999998e-05 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.263984+0000", 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024699115000000001 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264023+0000", 2024-09-12T18:03:33.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9431999999999998e-05 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14831 4.18 4:19f6b122:::1000000364a.00000000:head [write 0~4194304 [2@3284618]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4122877420000002, 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03242449, 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14831 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233964+0000", 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8700000000000004e-07 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242877+0000", 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089131509999999994 2024-09-12T18:03:33.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242914+0000", 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7376999999999998e-05 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242929+0000", 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4728e-05 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252348+0000", 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094188910000000004 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252475+0000", 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126735 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252712+0000", 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000237075 2024-09-12T18:03:33.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264747+0000", 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012034977000000001 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266308+0000", 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015612130000000001 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266348+0000", 2024-09-12T18:03:33.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0278999999999998e-05 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266387+0000", 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9076999999999999e-05 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14964 4.22 4:442ef67f:::10000003341.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.728 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.2665146279999995, 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030833801000000001, 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14964 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379737+0000", 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:03:33.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386729+0000", 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069922450000000002 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386748+0000", 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386759+0000", 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1522000000000001e-05 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386849+0000", 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0255999999999998e-05 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386982+0000", 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013296400000000001 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.387166+0000", 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018323100000000001 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.395195+0000", 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080296380000000004 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410331+0000", 2024-09-12T18:03:33.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01513607 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410451+0000", 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119546 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410570+0000", 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118687 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14971 4.e 4:73867252:::1000000382a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.2535838810000008, 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031669396000000002, 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14971 2024-09-12T18:03:33.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392668+0000", 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.629e-06 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399618+0000", 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069498049999999999 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399636+0000", 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8045000000000001e-05 2024-09-12T18:03:33.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399647+0000", 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0482000000000001e-05 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399738+0000", 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1737999999999995e-05 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399886+0000", 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014755700000000001 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.400110+0000", 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224565 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408175+0000", 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080649520000000002 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424146+0000", 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015970997000000001 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424205+0000", 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8638999999999999e-05 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424336+0000", 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130987 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14973 4.13 4:c81d059c:::100000038e4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.2465764739999994, 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032659724000000001, 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.741 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14973 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:33.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399676+0000", 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404945+0000", 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052687569999999998 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404964+0000", 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404979+0000", 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5290000000000001e-05 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405106+0000", 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127126 2024-09-12T18:03:33.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405251+0000", 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014441200000000001 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405392+0000", 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014160600000000001 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.414573+0000", 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091801000000000001 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432244+0000", 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017671630000000001 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432295+0000", 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0729000000000002e-05 2024-09-12T18:03:33.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432334+0000", 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8773999999999998e-05 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14978 4.22 4:4562f5e1:::10000003754.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.2375750580000009, 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.049933508000000001, 2024-09-12T18:03:33.747 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14978 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408677+0000", 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3489999999999999e-06 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416648+0000", 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079712930000000008 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416680+0000", 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2005999999999998e-05 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416698+0000", 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416815+0000", 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011641099999999999 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417000+0000", 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018498000000000001 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417272+0000", 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027257699999999998 2024-09-12T18:03:33.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.429341+0000", 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012068314 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458491+0000", 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029150250999999999 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458553+0000", 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2539999999999994e-05 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458609+0000", 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5461999999999999e-05 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.753 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14990 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.2197707940000004, 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032296710999999999, 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14990 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426481+0000", 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-09-12T18:03:33.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.433997+0000", 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075159520000000002 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434013+0000", 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5702e-05 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434021+0000", 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434090+0000", 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9029000000000006e-05 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434202+0000", 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011158999999999999 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434358+0000", 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001562 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.442632+0000", 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082736500000000004 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458688+0000", 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016056844000000001 2024-09-12T18:03:33.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458737+0000", 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8204999999999997e-05 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458776+0000", 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9789000000000001e-05 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.759 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15095 4.e 4:7041e79b:::10000003456.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.0903595960000008, 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032716585999999999, 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15095 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555892+0000", 2024-09-12T18:03:33.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564584+0000", 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086921359999999996 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564596+0000", 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1704e-05 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564602+0000", 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1079999999999998e-06 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564695+0000", 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3370999999999998e-05 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564964+0000", 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026938500000000002 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.565178+0000", 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021372200000000001 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.571064+0000", 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058862769999999997 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588548+0000", 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017483561000000002 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588582+0000", 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4436e-05 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588607+0000", 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5006000000000001e-05 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15239 4.3d 4:bfe5f3d1:::10000003901.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 7.903822892, 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037369946000000001, 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15239 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.766 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742429+0000", 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.897e-06 2024-09-12T18:03:33.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749874+0000", 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074448259999999999 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749907+0000", 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2419999999999998e-05 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749925+0000", 2024-09-12T18:03:33.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8376000000000002e-05 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750112+0000", 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186923 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750409+0000", 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029714999999999999 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:33.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750642+0000", 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023328199999999999 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.764931+0000", 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014288842 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779720+0000", 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014788737999999999 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779765+0000", 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779798+0000", 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2601999999999997e-05 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:33.771 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:33.773 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:33.773 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:33.767+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:33.874 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:33.871+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:33.913 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-09-12T18:03:33.920 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T18:03:33.921 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-09-12T18:03:33.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:03:33.953 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:33.953 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:33.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8022 4.2e 4:75d9f0ca:::10000001d1e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.950774+0000", 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0020081130000000002, 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020299559999999999, 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950774+0000", 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950774+0000", 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950775+0000", 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.032e-06 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950779+0000", 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0770000000000001e-06 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950790+0000", 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1343e-05 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950797+0000", 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6850000000000004e-06 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950857+0000", 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9935000000000001e-05 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951003+0000", 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014641200000000001 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951100+0000", 2024-09-12T18:03:33.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6419e-05 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951854+0000", 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00075421099999999997 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8024 4.1 4:8009eff1:::10000001d20.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.950974+0000", 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0018081270000000001, 2024-09-12T18:03:33.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001900451, 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950974+0000", 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950974+0000", 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950974+0000", 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3399999999999998e-07 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950978+0000", 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.501e-06 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950985+0000", 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7299999999999999e-06 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950989+0000", 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4730000000000002e-06 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951040+0000", 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1112999999999997e-05 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951154+0000", 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011398799999999999 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951291+0000", 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013634699999999999 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952445+0000", 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001154122 2024-09-12T18:03:33.962 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8029 4.28 4:15de3ec8:::10000001d25.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.951491+0000", 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0012910840000000001, 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0014491079999999999, 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951491+0000", 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951491+0000", 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951492+0000", 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6300000000000004e-07 2024-09-12T18:03:33.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951495+0000", 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7459999999999998e-06 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951503+0000", 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.9400000000000002e-06 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951510+0000", 2024-09-12T18:03:33.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5239999999999997e-06 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951572+0000", 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1957000000000003e-05 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951650+0000", 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7936999999999996e-05 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951704+0000", 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4030999999999998e-05 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8031 4.34 4:2f2a9b88:::10000001d27.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.951918+0000", 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00086408399999999999, 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001092768, 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.967 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951918+0000", 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951918+0000", 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.968 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951918+0000", 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7599999999999997e-07 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951921+0000", 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1949999999999999e-06 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951931+0000", 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3340000000000008e-06 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951936+0000", 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.0420000000000002e-06 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952001+0000", 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5086000000000007e-05 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952153+0000", 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015199500000000001 2024-09-12T18:03:33.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952251+0000", 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7906999999999996e-05 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8033 3.1b 3:de203f51:::10000001d53.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.951950+0000", 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00083128900000000003, 2024-09-12T18:03:33.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0011143139999999999, 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951950+0000", 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951950+0000", 2024-09-12T18:03:33.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951951+0000", 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.01e-07 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951952+0000", 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5149999999999999e-06 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951956+0000", 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9820000000000002e-06 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951959+0000", 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9550000000000001e-06 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952004+0000", 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4347000000000001e-05 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952138+0000", 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000134077 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "pg_update_log_missing(3.1e epoch 56/16 rep_tid 6377 entries 56'26 (0'0) error 3:7dfefd1e:::10000001d21.00000000:head by mds.0.3:8025 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 55'24)", 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.951937+0000", 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00084492200000000001, 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0011637310000000001, 2024-09-12T18:03:33.975 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "reached pg", 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951937+0000", 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951937+0000", 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951937+0000", 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7100000000000001e-07 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951945+0000", 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.9759999999999995e-06 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951965+0000", 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9525999999999999e-05 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951981+0000", 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6450999999999999e-05 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952085+0000", 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103434 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.978 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8034 4.34 4:2e903790:::10000001d54.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.951967+0000", 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00081520799999999999, 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001178487, 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951967+0000", 2024-09-12T18:03:33.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951967+0000", 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951967+0000", 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4000000000000002e-07 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.980 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951969+0000", 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.869e-06 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951976+0000", 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3749999999999997e-06 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951981+0000", 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9860000000000002e-06 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952659+0000", 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00067829999999999995 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952752+0000", 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2336000000000005e-05 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:33.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952808+0000", 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.609e-05 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8036 4.15 4:abce5614:::10000001d56.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.951993+0000", 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.000788491, 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0011872930000000001, 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:33.983 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951993+0000", 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951993+0000", 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951994+0000", 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.68e-07 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.951996+0000", 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952003+0000", 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.199e-06 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952008+0000", 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8919999999999999e-06 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952052+0000", 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4002000000000003e-05 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952277+0000", 2024-09-12T18:03:33.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000225286 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952378+0000", 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101022 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(mds.0.3:8027 4.e e56/17 4:72b245f8:::10000001d23.00000000:head v 56'242, mlcod=56'240)", 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.952112+0000", 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00066995399999999995, 2024-09-12T18:03:33.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0010979869999999999, 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952112+0000", 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952112+0000", 2024-09-12T18:03:33.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952112+0000", 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5900000000000003e-07 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952116+0000", 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.642e-06 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952137+0000", 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0854000000000001e-05 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952142+0000", 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1699999999999996e-06 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952257+0000", 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011503 2024-09-12T18:03:33.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952276+0000", 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.9474e-05 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8037 4.6 4:6212f968:::10000001d57.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.952490+0000", 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00029190299999999999, 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00075236400000000005, 2024-09-12T18:03:33.991 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952490+0000", 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952490+0000", 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952491+0000", 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4900000000000005e-07 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952494+0000", 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4489999999999999e-06 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.993 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952508+0000", 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3521e-05 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952514+0000", 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9970000000000004e-06 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952600+0000", 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6279000000000005e-05 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952730+0000", 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00012990300000000001 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952788+0000", 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8749000000000003e-05 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.995 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_repop(mds.0.3:8038 4.23 e56/17 4:c7731e0e:::10000001d58.00000000:head v 56'274, mlcod=56'272)", 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.952570+0000", 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00021171699999999999, 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00070598000000000004, 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952570+0000", 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952570+0000", 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952571+0000", 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3399999999999999e-07 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952575+0000", 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9929999999999997e-06 2024-09-12T18:03:33.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952583+0000", 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6379999999999993e-06 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952590+0000", 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5189999999999998e-06 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:33.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952647+0000", 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7362999999999999e-05 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952658+0000", 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1365e-05 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8012 4.3f 4:fc4f00fe:::10000001d04.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.949293+0000", 2024-09-12T18:03:33.999 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0034888620000000001, 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040282989999999999, 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949293+0000", 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949293+0000", 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949294+0000", 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5199999999999996e-07 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949296+0000", 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.8049999999999998e-06 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949302+0000", 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.2349999999999999e-06 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949306+0000", 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7729999999999999e-06 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949823+0000", 2024-09-12T18:03:34.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000516539 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949900+0000", 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6872999999999994e-05 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.949958+0000", 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8267000000000003e-05 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.950978+0000", 2024-09-12T18:03:34.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001019743 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:8043 4.33 4:cf0d8cea:::10000001d5d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:33.952604+0000", 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.00017785399999999999, 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000768811, 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:34.004 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952604+0000", 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952604+0000", 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952605+0000", 2024-09-12T18:03:34.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.0299999999999998e-07 2024-09-12T18:03:34.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952608+0000", 2024-09-12T18:03:34.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1879999999999998e-06 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952620+0000", 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2024e-05 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952627+0000", 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5449999999999998e-06 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952666+0000", 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8705999999999998e-05 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952774+0000", 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000107538 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:33.952862+0000", 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8467999999999994e-05 2024-09-12T18:03:34.009 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.010 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.010 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.010 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.010 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-12T18:03:34.010 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 13 2024-09-12T18:03:34.010 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:34.011 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:34.012 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:34.009+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:34.112 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:34.107+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:34.178 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:34.178 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:34.178 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:34.179 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:34.179 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:34.193 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:34.213 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:34.211+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:34.314 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:34.311+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:34.324 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:34.324 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:34.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:34.324 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:34.324 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.324 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.324 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:34.324 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.654301818, 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:34.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:34.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:34.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.654264812000001, 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:34.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:34.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.336 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.65422147, 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:34.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.342 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.654183821, 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:34.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.347 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.654144112000001, 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.348 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:34.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:34.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.654106316, 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.354 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:34.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:34.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.359 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.654046323999999, 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.360 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.361 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:34.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:34.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653951240000001, 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.366 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:34.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.370 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:34.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:34.372 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653884911999999, 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:34.373 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.374 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:34.375 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.376 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:34.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653828033, 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.378 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.379 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.380 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:34.381 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.382 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.383 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653772027999999, 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:34.385 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.386 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.387 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:34.388 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.389 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653706845999999, 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:34.390 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.391 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.392 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.393 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.394 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.395 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653666063999999, 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.396 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:34.397 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:34.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.399 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653630408000001, 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:34.401 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.402 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:34.403 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.404 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:34.406 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653584366, 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:34.408 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.409 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:34.411 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.412 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.65354619, 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:34.413 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.414 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:34.415 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:34.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.416 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.418 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.419 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.653499734, 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.422 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.423 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.424 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:34.425 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.612875687999999, 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.426 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.427 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.428 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:34.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:34.430 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.431 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.612859985, 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.432 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:34.433 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.435 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.436 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.437 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 21.605129663, 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:34.438 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.439 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.440 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:34.441 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.442 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:34.443 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.444 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.444 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.444 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:34.444 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:34.444 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:34.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:34.446 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:34.443+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:34.547 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:34.543+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:34.581 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:34.581 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:34.581 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:34.595 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:34.647 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:34.643+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:34.748 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:34.743+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:34.762 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:34.762 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:34.762 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:34.762 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:34.762 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:34.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:34.850 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:34.843+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:34.923 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:03:34.950 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:34.945+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:34.977 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.310822050999999, 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:34.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:34.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:34.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:34.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:34.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:34.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:34.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:34.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.310788301999999, 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:34.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:34.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:34.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.310746933000001, 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:34.991 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:34.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:34.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:34.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:34.997 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.278675321000001, 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:34.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:35.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:35.003 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.004 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.278608028000001, 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:35.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.278574205999998, 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:35.010 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:35.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:35.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:35.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.278526237000001, 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.016 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:35.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.278485041, 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:35.022 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:35.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:35.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.275053971999998, 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:35.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:35.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 27.274862617, 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:35.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:35.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 2532501~3109 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:35.042 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.309239245000001, 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038228275999999999, 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667287+0000", 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667297+0000", 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0837e-05 2024-09-12T18:03:35.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667318+0000", 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0132e-05 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667333+0000", 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5464e-05 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682093+0000", 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014760517000000001 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682239+0000", 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145704 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682429+0000", 2024-09-12T18:03:35.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189419 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687963+0000", 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055348469999999999 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705429+0000", 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017465897000000001 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705472+0000", 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705513+0000", 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0395000000000002e-05 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 2535610~33089 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.309135769999999, 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038208328999999999, 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:35.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667389+0000", 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667437+0000", 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8296e-05 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667461+0000", 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3315999999999998e-05 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667475+0000", 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4806e-05 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683310+0000", 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015835025999999999 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683414+0000", 2024-09-12T18:03:35.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103782 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683558+0000", 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144222 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687979+0000", 2024-09-12T18:03:35.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044206499999999999 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705541+0000", 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017561879999999998 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705573+0000", 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1513000000000001e-05 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705596+0000", 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3598e-05 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:393 3.2 3:4272d415:::200.0000000b:head [write 2568699~16268 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.309016485000001, 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038174923999999999, 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.055 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667508+0000", 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.26e-06 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667540+0000", 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1544999999999997e-05 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667560+0000", 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.965e-05 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667581+0000", 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1073e-05 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684213+0000", 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016632040000000001 2024-09-12T18:03:35.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684298+0000", 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700999999999998e-05 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684441+0000", 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142325 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.688223+0000", 2024-09-12T18:03:35.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037828240000000002 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705621+0000", 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017397394 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705661+0000", 2024-09-12T18:03:35.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9725000000000003e-05 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705682+0000", 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1387e-05 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:394 3.2 3:4272d415:::200.0000000b:head [write 2584967~9560 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.30843879, 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037725440999999998, 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668087+0000", 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4269999999999998e-06 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668114+0000", 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6475999999999999e-05 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668140+0000", 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5896000000000001e-05 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668159+0000", 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8936999999999998e-05 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686422+0000", 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018263577999999999 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686807+0000", 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000385263 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687150+0000", 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034306300000000001 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.689567+0000", 2024-09-12T18:03:35.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002416961 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705716+0000", 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016148172999999998 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705773+0000", 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7275999999999998e-05 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705810+0000", 2024-09-12T18:03:35.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7391000000000002e-05 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10722 4.12 4:4a23efdb:::100000030fe.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.303754128, 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039390537000000003, 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:35.067 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10722 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:35.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672772+0000", 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2400000000000002e-06 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680073+0000", 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073009110000000002 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680106+0000", 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3812000000000001e-05 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680121+0000", 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.486e-05 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690602+0000", 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010480952999999999 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690789+0000", 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018728399999999999 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690975+0000", 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000185613 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.706973+0000", 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015997546000000001 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712089+0000", 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051161699999999997 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712130+0000", 2024-09-12T18:03:35.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1069000000000003e-05 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712160+0000", 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0079000000000001e-05 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10804 4.b 4:d006e46e:::10000003140.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.984258291, 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044910052999999998, 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10804 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.074 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992268+0000", 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7870000000000002e-06 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012102+0000", 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019833542999999999 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012139+0000", 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012163+0000", 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3998999999999998e-05 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012267+0000", 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010427100000000001 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012333+0000", 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5907000000000004e-05 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012775+0000", 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000442058 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.021332+0000", 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008556882 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037041+0000", 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015709548 2024-09-12T18:03:35.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037115+0000", 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3645000000000004e-05 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037175+0000", 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0183000000000003e-05 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11578 4.2d 4:b54e928a:::10000003360.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.808019793, 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041673711000000002, 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11578 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.080 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168505+0000", 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5899999999999995e-07 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182775+0000", 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014270628 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182793+0000", 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8156e-05 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182813+0000", 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9602e-05 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182897+0000", 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3688000000000002e-05 2024-09-12T18:03:35.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182995+0000", 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7826999999999997e-05 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.183185+0000", 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019040999999999999 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.193832+0000", 2024-09-12T18:03:35.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010646901 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210041+0000", 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016209214 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210116+0000", 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4482999999999998e-05 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210177+0000", 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1943e-05 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14233 4.10 4:0a00b3f9:::100000032b1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 10.478618747000001, 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039262674999999997, 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.086 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14233 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:35.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497907+0000", 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8020000000000001e-06 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509871+0000", 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011964415000000001 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509889+0000", 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7779999999999999e-05 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509900+0000", 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.164e-05 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509977+0000", 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6831999999999999e-05 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510106+0000", 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012833000000000001 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510271+0000", 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000165052 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.519886+0000", 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096156620000000005 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537057+0000", 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017170843000000002 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537114+0000", 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.694e-05 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537167+0000", 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3378999999999998e-05 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.091 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14948 4.2d 4:b49e434b:::10000003309.00000001:head [write 0~3932160 [3@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.6115185759999999, 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042463101000000003, 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.092 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14948 2024-09-12T18:03:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365007+0000", 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9199999999999998e-06 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374409+0000", 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009402143 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374448+0000", 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8574e-05 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374471+0000", 2024-09-12T18:03:35.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3088e-05 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374581+0000", 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010991 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374719+0000", 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013811699999999999 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374916+0000", 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000196806 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.384792+0000", 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009876569 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407248+0000", 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022455788000000001 2024-09-12T18:03:35.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407377+0000", 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012914799999999999 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407468+0000", 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1038000000000005e-05 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14963 4.2d 4:b5ada52e:::100000031f2.00000000:head [write 0~4194304 [2@3933023]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 9.5970399519999994, 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044482647, 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14963 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:35.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379485+0000", 2024-09-12T18:03:35.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1880000000000001e-06 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389066+0000", 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095813919999999993 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389110+0000", 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3992999999999997e-05 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:35.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389126+0000", 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6308999999999999e-05 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389323+0000", 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019653699999999999 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389581+0000", 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025770200000000001 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389961+0000", 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038002100000000003 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.406604+0000", 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016643390000000001 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423676+0000", 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017071683000000001 2024-09-12T18:03:35.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423843+0000", 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000167467 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423966+0000", 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122965 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:35.104 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:35.105 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:35.106 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:35.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:35.103+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:35.207 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:35.205+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:35.220 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:35.238 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:35.238 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:35.238 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:03:35.238 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:35.252 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:35.308 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:35.305+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:35.370 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:35.371 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:35.374 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:35.374 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:35.388 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:35.391 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:35.392 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:35.412 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:35.413 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:35.436 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:35.431+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:35.510 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:35.510 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:35.511 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:35.507+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:35.524 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:35.611 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:35.609+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:35.656 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:35.656 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:35.670 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:35.713 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:35.707+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:35.814 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:35.811+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:35.849 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:35.849 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:35.869 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:35.916 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:35.911+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:36.015 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:36.015 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:36.018 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:36.013+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:36.029 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:36.117 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:36.113+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:36.162 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:36.162 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:36.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:36.218 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:36.215+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:36.307 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:36.307 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:36.319 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:36.315+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:36.322 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:36.420 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:36.417+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:36.450 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:36.450 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:36.465 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:36.521 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:36.521+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:36.599 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:36.599 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:36.614 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:36.664 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:36.659+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:36.724 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:36.721+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:36.738 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:36.738 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:36.753 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:36.824 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:36.821+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:36.925 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:36.919+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:36.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:03:36.964 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:36.964 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:36.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:37.031 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:37.029+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:37.119 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:37.119 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:37.128 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:37.123+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:37.134 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:37.229 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:37.223+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:37.298 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:37.298 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:37.313 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:37.330 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:37.327+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:37.430 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:37.431 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:37.427+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:37.434 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:37.434 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:37.448 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:37.532 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:37.527+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:37.582 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:37.582 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:37.586 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:37.586 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:37.596 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:37.610 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:37.610 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:37.631 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:37.631 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:37.638 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:37.635+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:37.734 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:37.731+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:37.757 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:37.757 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:37.757 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:37.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:37.835 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:37.833+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:37.931 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:37.931 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:37.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:37.931 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.263473260000001, 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:37.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.937 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.263439511000001, 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.263398142, 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.943 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.948 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.23132653, 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.231259237, 2024-09-12T18:03:37.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.231225415000001, 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.960 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:37.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.231177446, 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:37.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:37.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:37.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.231136249999999, 2024-09-12T18:03:37.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:37.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.976 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.227705181000001, 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:37.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:37.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 30.227513825999999, 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:37.982 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:37.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:37.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:37.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 2532501~3109 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.261890454, 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038228275999999999, 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667287+0000", 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667297+0000", 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0837e-05 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667318+0000", 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0132e-05 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667333+0000", 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5464e-05 2024-09-12T18:03:37.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682093+0000", 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014760517000000001 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682239+0000", 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145704 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682429+0000", 2024-09-12T18:03:37.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189419 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687963+0000", 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055348469999999999 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705429+0000", 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017465897000000001 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705472+0000", 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705513+0000", 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0395000000000002e-05 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.993 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 2535610~33089 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.261786979, 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038208328999999999, 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667389+0000", 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667437+0000", 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8296e-05 2024-09-12T18:03:37.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667461+0000", 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3315999999999998e-05 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667475+0000", 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4806e-05 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:37.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683310+0000", 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015835025999999999 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683414+0000", 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103782 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683558+0000", 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144222 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:37.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687979+0000", 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044206499999999999 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705541+0000", 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017561879999999998 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705573+0000", 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1513000000000001e-05 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705596+0000", 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3598e-05 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:393 3.2 3:4272d415:::200.0000000b:head [write 2568699~16268 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.261667694, 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038174923999999999, 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:37.999 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:38.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667508+0000", 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.26e-06 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667540+0000", 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1544999999999997e-05 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667560+0000", 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.965e-05 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667581+0000", 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1073e-05 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684213+0000", 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016632040000000001 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684298+0000", 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700999999999998e-05 2024-09-12T18:03:38.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684441+0000", 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142325 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.688223+0000", 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037828240000000002 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705621+0000", 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017397394 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705661+0000", 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9725000000000003e-05 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705682+0000", 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1387e-05 2024-09-12T18:03:38.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:394 3.2 3:4272d415:::200.0000000b:head [write 2584967~9560 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.261089998999999, 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037725440999999998, 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:38.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668087+0000", 2024-09-12T18:03:38.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4269999999999998e-06 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668114+0000", 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6475999999999999e-05 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668140+0000", 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5896000000000001e-05 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668159+0000", 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8936999999999998e-05 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686422+0000", 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018263577999999999 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686807+0000", 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000385263 2024-09-12T18:03:38.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687150+0000", 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034306300000000001 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.689567+0000", 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002416961 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705716+0000", 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016148172999999998 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705773+0000", 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7275999999999998e-05 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705810+0000", 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7391000000000002e-05 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.010 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10722 4.12 4:4a23efdb:::100000030fe.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.256405337, 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039390537000000003, 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.011 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10722 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672772+0000", 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2400000000000002e-06 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680073+0000", 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073009110000000002 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680106+0000", 2024-09-12T18:03:38.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3812000000000001e-05 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680121+0000", 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.486e-05 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690602+0000", 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010480952999999999 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690789+0000", 2024-09-12T18:03:38.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018728399999999999 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690975+0000", 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000185613 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.706973+0000", 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015997546000000001 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712089+0000", 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051161699999999997 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712130+0000", 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1069000000000003e-05 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712160+0000", 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0079000000000001e-05 2024-09-12T18:03:38.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10804 4.b 4:d006e46e:::10000003140.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.936909499999999, 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044910052999999998, 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:38.017 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10804 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992268+0000", 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7870000000000002e-06 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012102+0000", 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019833542999999999 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012139+0000", 2024-09-12T18:03:38.019 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012163+0000", 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3998999999999998e-05 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012267+0000", 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010427100000000001 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:38.020 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012333+0000", 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5907000000000004e-05 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012775+0000", 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000442058 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.021332+0000", 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008556882 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037041+0000", 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015709548 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037115+0000", 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3645000000000004e-05 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037175+0000", 2024-09-12T18:03:38.022 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0183000000000003e-05 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11578 4.2d 4:b54e928a:::10000003360.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 16.760671001999999, 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041673711000000002, 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.023 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11578 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.024 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168505+0000", 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5899999999999995e-07 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182775+0000", 2024-09-12T18:03:38.025 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014270628 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182793+0000", 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8156e-05 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182813+0000", 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9602e-05 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.026 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182897+0000", 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3688000000000002e-05 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182995+0000", 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7826999999999997e-05 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.183185+0000", 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019040999999999999 2024-09-12T18:03:38.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.193832+0000", 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010646901 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210041+0000", 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016209214 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210116+0000", 2024-09-12T18:03:38.028 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4482999999999998e-05 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210177+0000", 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1943e-05 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14233 4.10 4:0a00b3f9:::100000032b1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 13.431269956, 2024-09-12T18:03:38.029 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039262674999999997, 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14233 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:38.030 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497907+0000", 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8020000000000001e-06 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.031 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509871+0000", 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011964415000000001 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509889+0000", 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7779999999999999e-05 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509900+0000", 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.164e-05 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.032 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509977+0000", 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6831999999999999e-05 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510106+0000", 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012833000000000001 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510271+0000", 2024-09-12T18:03:38.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000165052 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.519886+0000", 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096156620000000005 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537057+0000", 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017170843000000002 2024-09-12T18:03:38.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537114+0000", 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.694e-05 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537167+0000", 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3378999999999998e-05 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.035 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14948 4.2d 4:b49e434b:::10000003309.00000001:head [write 0~3932160 [3@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.564169785000001, 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042463101000000003, 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14948 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:38.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365007+0000", 2024-09-12T18:03:38.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9199999999999998e-06 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374409+0000", 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009402143 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374448+0000", 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8574e-05 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374471+0000", 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3088e-05 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374581+0000", 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010991 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:38.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374719+0000", 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013811699999999999 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374916+0000", 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000196806 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.384792+0000", 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009876569 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407248+0000", 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022455788000000001 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407377+0000", 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012914799999999999 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407468+0000", 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1038000000000005e-05 2024-09-12T18:03:38.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14963 4.2d 4:b5ada52e:::100000031f2.00000000:head [write 0~4194304 [2@3933023]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 12.549691161, 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044482647, 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:38.042 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14963 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:38.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379485+0000", 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1880000000000001e-06 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389066+0000", 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095813919999999993 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389110+0000", 2024-09-12T18:03:38.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3992999999999997e-05 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389126+0000", 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6308999999999999e-05 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389323+0000", 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019653699999999999 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389581+0000", 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025770200000000001 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389961+0000", 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038002100000000003 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.406604+0000", 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016643390000000001 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423676+0000", 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017071683000000001 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423843+0000", 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000167467 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423966+0000", 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122965 2024-09-12T18:03:38.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:38.048 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:38.048 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:38.049 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:38.043+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:38.050 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:03:38.050 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:38.150 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:38.149+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:38.165 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:38.165 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:38.165 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:03:38.165 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:38.179 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:38.250 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:38.245+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:38.304 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:38.304 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:38.304 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:38.319 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:38.365 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:38.363+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:38.449 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:38.449 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:38.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:38.449 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:38.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.449 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.391606119999999, 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:38.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:38.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.455 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10795 4.22 4:4414d34e:::1000000315b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.493588536000001, 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03153454, 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10795 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952771+0000", 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9290000000000001e-06 2024-09-12T18:03:38.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960575+0000", 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078039479999999998 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960595+0000", 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9644e-05 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960609+0000", 2024-09-12T18:03:38.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4246999999999999e-05 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960772+0000", 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016263000000000001 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960936+0000", 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016446899999999999 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.961298+0000", 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036151899999999998 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.981362+0000", 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020064015000000001 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984110+0000", 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00274852 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984227+0000", 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116267 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984304+0000", 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7352000000000001e-05 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11134 4.30 4:0ea0a8b4:::10000003186.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:38.461 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.935987479000001, 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037582955000000001, 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11134 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:38.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000001e-07 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518086+0000", 2024-09-12T18:03:38.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077143059999999998 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518103+0000", 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7441000000000001e-05 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518116+0000", 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2573e-05 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518192+0000", 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518319+0000", 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012724599999999999 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518439+0000", 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119436 2024-09-12T18:03:38.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.527060+0000", 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086211320000000001 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547881+0000", 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02082063 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547921+0000", 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0411999999999999e-05 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547954+0000", 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2583000000000003e-05 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11577 4.35 4:acdeb9c5:::1000000332a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.280706854000002, 2024-09-12T18:03:38.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032699999, 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11577 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165652+0000", 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0920000000000001e-06 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175860+0000", 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010207233 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175874+0000", 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4229999999999999e-05 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175882+0000", 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7330000000000003e-06 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175941+0000", 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8996000000000002e-05 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176090+0000", 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014994800000000001 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176209+0000", 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118825 2024-09-12T18:03:38.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.184925+0000", 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008715558 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198295+0000", 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013369804000000001 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198327+0000", 2024-09-12T18:03:38.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1942e-05 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198351+0000", 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14036 4.31 4:8eca8ddf:::100000031b8.00000000:head [write 0~4194304 [4@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.181856592999999, 2024-09-12T18:03:38.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034286130999999997, 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14036 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264505+0000", 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0570000000000001e-06 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273393+0000", 2024-09-12T18:03:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088884240000000007 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273426+0000", 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3256999999999997e-05 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273441+0000", 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4445e-05 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273550+0000", 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010887099999999999 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273689+0000", 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139178 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273844+0000", 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155291 2024-09-12T18:03:38.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.282512+0000", 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086676940000000001 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298736+0000", 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016224160000000001 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298766+0000", 2024-09-12T18:03:38.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9961e-05 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298788+0000", 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1793e-05 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14099 4.18 4:18c6d816:::10000003304.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.103495876, 2024-09-12T18:03:38.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031590162999999997, 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14099 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:38.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342865+0000", 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.74e-06 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350699+0000", 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078345069999999992 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350738+0000", 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.837e-05 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350757+0000", 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9519000000000001e-05 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350912+0000", 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015452099999999999 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351291+0000", 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037953800000000001 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351691+0000", 2024-09-12T18:03:38.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000399379 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.362505+0000", 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010814503 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374285+0000", 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011780135000000001 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374369+0000", 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3429000000000004e-05 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374452+0000", 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3522000000000004e-05 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14111 4.a 4:530380b1:::10000003584.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:38.485 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.082736632, 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032405549999999998, 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14111 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363624+0000", 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3329999999999999e-06 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369957+0000", 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063336720000000003 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369986+0000", 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8269e-05 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370001+0000", 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-05 2024-09-12T18:03:38.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370257+0000", 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025585799999999998 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370536+0000", 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027879400000000001 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370979+0000", 2024-09-12T18:03:38.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044307100000000001 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.380399+0000", 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094193109999999997 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395936+0000", 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01553759 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395987+0000", 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1249999999999999e-05 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.396027+0000", 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9651999999999999e-05 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14165 4.32 4:4ea4de87:::100000037a0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:38.491 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.007995405000001, 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030909196, 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14165 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438365+0000", 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0540000000000002e-06 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446256+0000", 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078916520000000007 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446295+0000", 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000003e-05 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446311+0000", 2024-09-12T18:03:38.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6696000000000001e-05 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446418+0000", 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010707199999999999 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446610+0000", 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019208499999999999 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446827+0000", 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216939 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.452206+0000", 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053787210000000004 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469114+0000", 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016907493999999999 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469196+0000", 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2237999999999994e-05 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469272+0000", 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6114999999999999e-05 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.497 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14176 4.5 4:a36cb72d:::10000003716.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.999732009000001, 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.040437328000000002, 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14176 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446629+0000", 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.429e-06 2024-09-12T18:03:38.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460229+0000", 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013600736 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460276+0000", 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6721999999999998e-05 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460297+0000", 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1308999999999999e-05 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460554+0000", 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025637199999999999 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460983+0000", 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042940099999999999 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.461353+0000", 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036966199999999999 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.484975+0000", 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023622647 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486801+0000", 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00182548 2024-09-12T18:03:38.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486933+0000", 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013208800000000001 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.487063+0000", 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013048199999999999 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14374 4.38 4:1dead311:::10000003395.00000000:head [write 0~4194304 [2@357324]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.776351744999999, 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039429224999999998, 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14374 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670009+0000", 2024-09-12T18:03:38.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.497e-06 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682349+0000", 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012339785000000001 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682387+0000", 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8633000000000001e-05 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682404+0000", 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7005999999999999e-05 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682514+0000", 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010951900000000001 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682649+0000", 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013563799999999999 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682836+0000", 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186424 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.701541+0000", 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018705016000000001 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709313+0000", 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077725889999999999 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709392+0000", 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8860000000000001e-05 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709436+0000", 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14734 4.32 4:4f3042f2:::1000000322e.00000000:head [write 0~4194304 [3@261943]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.384938143999999, 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033021488000000002, 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14734 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:38.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061421+0000", 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069604+0000", 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081825100000000005 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069626+0000", 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2849000000000001e-05 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069645+0000", 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8926000000000001e-05 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069736+0000", 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0107999999999999e-05 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069861+0000", 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125704 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.070200+0000", 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000338308 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.080698+0000", 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010498182 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094351+0000", 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013653168 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094404+0000", 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3424999999999998e-05 2024-09-12T18:03:38.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094441+0000", 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7131000000000001e-05 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14827 4.8 e52/17 4:1171651b:::100000030fc.00000001:head v 52'208, mlcod=52'206)", 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.214375655, 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032040617, 2024-09-12T18:03:38.515 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231983+0000", 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.16e-07 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239015+0000", 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070313540000000001 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239054+0000", 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9675000000000002e-05 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239070+0000", 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239237+0000", 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016739399999999999 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239285+0000", 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7500999999999998e-05 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.263984+0000", 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024699115000000001 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264023+0000", 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9431999999999998e-05 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14831 4.18 4:19f6b122:::1000000364a.00000000:head [write 0~4194304 [2@3284618]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.212395377, 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03242449, 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14831 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.520 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233964+0000", 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8700000000000004e-07 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242877+0000", 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089131509999999994 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242914+0000", 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7376999999999998e-05 2024-09-12T18:03:38.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242929+0000", 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4728e-05 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252348+0000", 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094188910000000004 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252475+0000", 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126735 2024-09-12T18:03:38.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252712+0000", 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000237075 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264747+0000", 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012034977000000001 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266308+0000", 2024-09-12T18:03:38.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015612130000000001 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266348+0000", 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0278999999999998e-05 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266387+0000", 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9076999999999999e-05 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.525 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14964 4.22 4:442ef67f:::10000003341.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.066622262999999, 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030833801000000001, 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14964 2024-09-12T18:03:38.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379737+0000", 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386729+0000", 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069922450000000002 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386748+0000", 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386759+0000", 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1522000000000001e-05 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386849+0000", 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0255999999999998e-05 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386982+0000", 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013296400000000001 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.387166+0000", 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018323100000000001 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.395195+0000", 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080296380000000004 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410331+0000", 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01513607 2024-09-12T18:03:38.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410451+0000", 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119546 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410570+0000", 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118687 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14971 4.e 4:73867252:::1000000382a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.053691516000001, 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031669396000000002, 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14971 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392668+0000", 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.629e-06 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399618+0000", 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069498049999999999 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399636+0000", 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8045000000000001e-05 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399647+0000", 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0482000000000001e-05 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399738+0000", 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1737999999999995e-05 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399886+0000", 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014755700000000001 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.400110+0000", 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224565 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408175+0000", 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080649520000000002 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424146+0000", 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015970997000000001 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424205+0000", 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8638999999999999e-05 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424336+0000", 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130987 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14973 4.13 4:c81d059c:::100000038e4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.046684108999999, 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032659724000000001, 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.538 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14973 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:38.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399676+0000", 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404945+0000", 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052687569999999998 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404964+0000", 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404979+0000", 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5290000000000001e-05 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405106+0000", 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127126 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405251+0000", 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014441200000000001 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405392+0000", 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014160600000000001 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.414573+0000", 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091801000000000001 2024-09-12T18:03:38.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432244+0000", 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017671630000000001 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432295+0000", 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0729000000000002e-05 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432334+0000", 2024-09-12T18:03:38.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8773999999999998e-05 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14978 4.22 4:4562f5e1:::10000003754.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.037682693000001, 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.049933508000000001, 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.544 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14978 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:38.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408677+0000", 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3489999999999999e-06 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416648+0000", 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079712930000000008 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416680+0000", 2024-09-12T18:03:38.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2005999999999998e-05 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416698+0000", 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416815+0000", 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011641099999999999 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417000+0000", 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018498000000000001 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417272+0000", 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027257699999999998 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.429341+0000", 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012068314 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458491+0000", 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029150250999999999 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458553+0000", 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2539999999999994e-05 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458609+0000", 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5461999999999999e-05 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.549 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14990 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.019878429, 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032296710999999999, 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14990 2024-09-12T18:03:38.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426481+0000", 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.433997+0000", 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075159520000000002 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434013+0000", 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5702e-05 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434021+0000", 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434090+0000", 2024-09-12T18:03:38.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9029000000000006e-05 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434202+0000", 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011158999999999999 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434358+0000", 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001562 2024-09-12T18:03:38.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.442632+0000", 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082736500000000004 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458688+0000", 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016056844000000001 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458737+0000", 2024-09-12T18:03:38.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8204999999999997e-05 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458776+0000", 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9789000000000001e-05 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15095 4.e 4:7041e79b:::10000003456.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.556 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.890467231000001, 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032716585999999999, 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15095 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555892+0000", 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:38.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564584+0000", 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086921359999999996 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564596+0000", 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1704e-05 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564602+0000", 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1079999999999998e-06 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564695+0000", 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3370999999999998e-05 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564964+0000", 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026938500000000002 2024-09-12T18:03:38.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.565178+0000", 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021372200000000001 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.571064+0000", 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058862769999999997 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588548+0000", 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017483561000000002 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588582+0000", 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4436e-05 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588607+0000", 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5006000000000001e-05 2024-09-12T18:03:38.562 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15239 4.3d 4:bfe5f3d1:::10000003901.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 12.703930527000001, 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037369946000000001, 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:38.563 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15239 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:38.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742429+0000", 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.897e-06 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749874+0000", 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074448259999999999 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749907+0000", 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2419999999999998e-05 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749925+0000", 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8376000000000002e-05 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750112+0000", 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186923 2024-09-12T18:03:38.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750409+0000", 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029714999999999999 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750642+0000", 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023328199999999999 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.764931+0000", 2024-09-12T18:03:38.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014288842 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779720+0000", 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014788737999999999 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779765+0000", 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:38.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:38.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779798+0000", 2024-09-12T18:03:38.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2601999999999997e-05 2024-09-12T18:03:38.569 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.569 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.569 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.569 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:38.569 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:38.569 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:38.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:38.571 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:38.567+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:38.672 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:38.669+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:38.703 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:38.703 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:38.703 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:03:38.703 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:38.718 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:38.773 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:38.767+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:38.873 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:38.869+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:38.904 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:38.904 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:38.904 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:38.904 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:38.904 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:38.922 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:03:38.922 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:03:38.923 INFO:tasks.thrashosds.thrasher:Reweighting osd 2 to 0.6004528897286696 2024-09-12T18:03:38.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 0.6004528897286696 2024-09-12T18:03:38.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:38.974 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:38.971+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:39.075 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:39.071+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:39.085 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:39.085 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:39.085 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:39.085 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:39.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.415377457999998, 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.086 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:39.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.089 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:39.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:39.092 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.415340451999999, 2024-09-12T18:03:39.093 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:39.093 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.093 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.093 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.093 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.093 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.093 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.094 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:39.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:39.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:39.099 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.415297110000001, 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.101 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.103 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:39.104 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.105 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.415259461000002, 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:39.106 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:39.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:39.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.111 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.415219751999999, 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.113 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.115 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:39.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.415181956000001, 2024-09-12T18:03:39.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:39.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:39.123 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.125 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.415121964000001, 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:39.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:39.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.132 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.415026879999999, 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.133 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:39.134 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.134 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.134 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:39.134 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.134 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:39.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:39.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:39.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:39.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:39.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414960552, 2024-09-12T18:03:39.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:39.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:39.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:39.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.146 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414903673000001, 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.147 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:39.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:39.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.152 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.153 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414847668, 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.157 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:39.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.160 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414782486, 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.161 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:39.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:39.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414741704000001, 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:39.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.171 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.173 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414706047999999, 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:39.175 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.176 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:39.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414660005999998, 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.181 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:39.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:39.186 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.187 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414621830000002, 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.191 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.192 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:39.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:39.194 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.414575374000002, 2024-09-12T18:03:39.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:39.195 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.195 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.195 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.195 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.195 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.195 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.196 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.199 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:39.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.373951328, 2024-09-12T18:03:39.201 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.202 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.203 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.204 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:39.205 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:39.206 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.207 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:39.208 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.373935625000001, 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.209 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.210 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.211 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:39.212 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.213 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.214 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.215 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 26.366205303000001, 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:39.216 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:39.217 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:39.218 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:39.219 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.220 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.221 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:39.222 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.223 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:39.224 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:39.224 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:39.225 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:39.226 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:39.219+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:39.326 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:39.321+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:39.363 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:39.363 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:39.363 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:39.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:39.427 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:39.423+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:39.503 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:39.503 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:39.503 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:39.517 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:39.528 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:39.523+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:39.629 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:39.623+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:39.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.015143954999999, 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.684 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:39.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:39.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.015110206000003, 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:39.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:39.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 32.015068837000001, 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:39.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:39.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:39.700 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.982997224999998, 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:39.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.982929932000001, 2024-09-12T18:03:39.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:39.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:39.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.982896109999999, 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:39.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:39.717 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.982848141000002, 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:39.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.720 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:39.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:39.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:39.723 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.982806945, 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:39.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:39.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.979375875999999, 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.730 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.732 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:39.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 31.979184521000001, 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.736 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:39.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:39.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:39.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 2532501~3109 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.013561149000001, 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038228275999999999, 2024-09-12T18:03:39.742 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667287+0000", 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667297+0000", 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0837e-05 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667318+0000", 2024-09-12T18:03:39.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0132e-05 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667333+0000", 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5464e-05 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682093+0000", 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014760517000000001 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.745 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682239+0000", 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145704 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682429+0000", 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189419 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687963+0000", 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055348469999999999 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705429+0000", 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017465897000000001 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705472+0000", 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705513+0000", 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0395000000000002e-05 2024-09-12T18:03:39.747 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 2535610~33089 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.013457674000001, 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038208328999999999, 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667389+0000", 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-12T18:03:39.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667437+0000", 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8296e-05 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667461+0000", 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3315999999999998e-05 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667475+0000", 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4806e-05 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683310+0000", 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015835025999999999 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683414+0000", 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103782 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683558+0000", 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144222 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687979+0000", 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044206499999999999 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705541+0000", 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017561879999999998 2024-09-12T18:03:39.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705573+0000", 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1513000000000001e-05 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705596+0000", 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3598e-05 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.753 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:393 3.2 3:4272d415:::200.0000000b:head [write 2568699~16268 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.013338389000001, 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038174923999999999, 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667508+0000", 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.26e-06 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667540+0000", 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1544999999999997e-05 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667560+0000", 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.965e-05 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667581+0000", 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1073e-05 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684213+0000", 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016632040000000001 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684298+0000", 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700999999999998e-05 2024-09-12T18:03:39.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684441+0000", 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142325 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.688223+0000", 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037828240000000002 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705621+0000", 2024-09-12T18:03:39.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017397394 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705661+0000", 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9725000000000003e-05 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705682+0000", 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1387e-05 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:394 3.2 3:4272d415:::200.0000000b:head [write 2584967~9560 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.012760694000001, 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037725440999999998, 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668087+0000", 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4269999999999998e-06 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668114+0000", 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6475999999999999e-05 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668140+0000", 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5896000000000001e-05 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668159+0000", 2024-09-12T18:03:39.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8936999999999998e-05 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686422+0000", 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018263577999999999 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686807+0000", 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000385263 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687150+0000", 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034306300000000001 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.689567+0000", 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002416961 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705716+0000", 2024-09-12T18:03:39.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016148172999999998 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705773+0000", 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7275999999999998e-05 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705810+0000", 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7391000000000002e-05 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10722 4.12 4:4a23efdb:::100000030fe.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 20.008076032000002, 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039390537000000003, 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10722 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672772+0000", 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2400000000000002e-06 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680073+0000", 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073009110000000002 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680106+0000", 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3812000000000001e-05 2024-09-12T18:03:39.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680121+0000", 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.486e-05 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690602+0000", 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010480952999999999 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690789+0000", 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018728399999999999 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690975+0000", 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000185613 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.706973+0000", 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015997546000000001 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712089+0000", 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051161699999999997 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712130+0000", 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1069000000000003e-05 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.771 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712160+0000", 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0079000000000001e-05 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10804 4.b 4:d006e46e:::10000003140.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 19.688580195, 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044910052999999998, 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.772 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10804 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992268+0000", 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7870000000000002e-06 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012102+0000", 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019833542999999999 2024-09-12T18:03:39.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012139+0000", 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012163+0000", 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3998999999999998e-05 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012267+0000", 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010427100000000001 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012333+0000", 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5907000000000004e-05 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012775+0000", 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000442058 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.021332+0000", 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008556882 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037041+0000", 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015709548 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037115+0000", 2024-09-12T18:03:39.777 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3645000000000004e-05 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037175+0000", 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0183000000000003e-05 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11578 4.2d 4:b54e928a:::10000003360.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:39.778 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.512341697, 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041673711000000002, 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11578 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.779 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168505+0000", 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5899999999999995e-07 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.780 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182775+0000", 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014270628 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182793+0000", 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8156e-05 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182813+0000", 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9602e-05 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182897+0000", 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3688000000000002e-05 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182995+0000", 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7826999999999997e-05 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.183185+0000", 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019040999999999999 2024-09-12T18:03:39.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.193832+0000", 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010646901 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210041+0000", 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016209214 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210116+0000", 2024-09-12T18:03:39.783 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4482999999999998e-05 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210177+0000", 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1943e-05 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14233 4.10 4:0a00b3f9:::100000032b1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:39.784 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 15.182940650999999, 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039262674999999997, 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14233 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.785 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497907+0000", 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8020000000000001e-06 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.786 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509871+0000", 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011964415000000001 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509889+0000", 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7779999999999999e-05 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509900+0000", 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.164e-05 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.787 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509977+0000", 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6831999999999999e-05 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510106+0000", 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012833000000000001 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510271+0000", 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000165052 2024-09-12T18:03:39.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.519886+0000", 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096156620000000005 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537057+0000", 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017170843000000002 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.789 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537114+0000", 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.694e-05 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537167+0000", 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3378999999999998e-05 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14948 4.2d 4:b49e434b:::10000003309.00000001:head [write 0~3932160 [3@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:39.790 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.31584048, 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042463101000000003, 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14948 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.791 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365007+0000", 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9199999999999998e-06 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.792 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374409+0000", 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009402143 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374448+0000", 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8574e-05 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374471+0000", 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3088e-05 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.793 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374581+0000", 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010991 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374719+0000", 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013811699999999999 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374916+0000", 2024-09-12T18:03:39.794 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000196806 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.384792+0000", 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009876569 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407248+0000", 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022455788000000001 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.795 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407377+0000", 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012914799999999999 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407468+0000", 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1038000000000005e-05 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.796 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14963 4.2d 4:b5ada52e:::100000031f2.00000000:head [write 0~4194304 [2@3933023]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 14.301361856, 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044482647, 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14963 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:39.797 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379485+0000", 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1880000000000001e-06 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.798 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389066+0000", 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095813919999999993 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389110+0000", 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3992999999999997e-05 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389126+0000", 2024-09-12T18:03:39.799 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6308999999999999e-05 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389323+0000", 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019653699999999999 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389581+0000", 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025770200000000001 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:39.800 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389961+0000", 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038002100000000003 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.406604+0000", 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016643390000000001 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423676+0000", 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017071683000000001 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.801 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423843+0000", 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000167467 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423966+0000", 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122965 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:39.802 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:39.803 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:39.804 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:39.805 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:39.805 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:39.799+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:39.812 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:39.812 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:39.840 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:39.840 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:39.905 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:39.901+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:39.942 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 0.600453 (99b7) 2024-09-12T18:03:39.971 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:39.971 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:39.985 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:40.030 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:40.027+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:40.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:03:40.098 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:40.099 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:40.107 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:40.105+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:40.112 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:40.208 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:40.203+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:40.272 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:40.273 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:40.288 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:40.309 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:40.307+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:40.410 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:40.405+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:40.420 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:40.420 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:40.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:40.511 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:40.511+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:40.605 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:40.605 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:40.612 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:40.611+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:40.620 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:40.713 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:40.707+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:40.739 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:40.739 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:40.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:40.814 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:40.809+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:40.886 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:40.886 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:40.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:40.915 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:40.915+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:40.953 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:03:41.015 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:41.011+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:41.026 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:41.027 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:41.041 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:41.122 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:41.121+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:41.166 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:41.166 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:41.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:41.218 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:41.217+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:41.315 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:41.315 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:41.318 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:41.315+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:41.330 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:41.418 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:41.415+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:41.451 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:41.451 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:41.465 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:41.550 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:41.547+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:41.619 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:41.617+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:41.627 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:41.628 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:41.641 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:41.721 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:41.715+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:41.772 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:41.772 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:41.786 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:41.821 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:41.815+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:41.858 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:41.909 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:41.909 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:41.922 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:41.919+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:41.923 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:42.023 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:42.019+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:42.046 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:42.046 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:42.075 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:42.075 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:42.078 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:42.078 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:42.078 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:42.078 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:42.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.078 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.078 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406798586000001, 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.079 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:42.080 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:42.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.082 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.083 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:42.083 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:42.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.083 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.083 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:42.083 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:42.084 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.085 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406761580000001, 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.086 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.087 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.088 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.089 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:42.090 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:42.091 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406718238, 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.092 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.094 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.095 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:42.096 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.097 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406680589, 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.098 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.099 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.100 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.101 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:42.102 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.103 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406640880000001, 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.104 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:42.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.106 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.107 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:42.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:42.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.108 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.108 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:42.108 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:42.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.108 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.109 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.110 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406603084, 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.112 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:42.113 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:42.114 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.115 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:42.116 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406543092, 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.117 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.118 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:42.119 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.120 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.121 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:42.122 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406448008000002, 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.123 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.124 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.125 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.126 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.127 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:42.128 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406381679999999, 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.129 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.130 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.131 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.132 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:42.133 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.134 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406324801, 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.135 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.136 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:42.137 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:42.138 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.139 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.140 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406268795999999, 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.141 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.142 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.143 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:42.145 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406203613999999, 2024-09-12T18:03:42.146 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.147 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.148 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.149 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.150 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.151 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406162832, 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.152 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:42.153 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:42.154 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.155 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.156 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.157 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406127175999998, 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.158 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.159 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.161 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.162 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406081134000001, 2024-09-12T18:03:42.163 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.164 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:42.165 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.166 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.167 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.168 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.169 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.406042958, 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.170 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.171 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.172 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:42.173 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.174 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.405996502000001, 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.175 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:42.176 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.177 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:42.178 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:42.179 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:42.180 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.365372455999999, 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:42.181 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.182 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:42.183 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:42.184 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:42.185 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.365356753, 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.186 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.187 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.187 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:42.187 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.187 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:42.188 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.189 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:42.190 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.191 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:42.192 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 29.357626431, 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.193 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:42.194 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.195 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.196 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.197 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:42.198 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:42.199 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:42.200 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:42.201 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:42.201 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:42.197+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:42.202 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:42.301 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:42.297+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:42.336 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:42.337 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:42.337 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:42.337 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:42.350 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:42.402 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:42.395+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:42.471 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:42.471 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:42.471 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:42.471 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:42.471 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:42.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:42.502 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:42.497+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:42.603 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:42.599+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:42.651 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:96 3.1f 3:f83d65d8:::200.00000004:head [write 1997241~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.983020373999999, 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038098143000000001, 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.652 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665702+0000", 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.8999999999999996e-07 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665707+0000", 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3470000000000001e-06 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665718+0000", 2024-09-12T18:03:42.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1851999999999999e-05 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665725+0000", 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0570000000000004e-06 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700014+0000", 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034288803 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700137+0000", 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012259400000000001 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.700385+0000", 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024797399999999998 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702541+0000", 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00215621 2024-09-12T18:03:42.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703642+0000", 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0011011630000000001 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703738+0000", 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5951000000000003e-05 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.703800+0000", 2024-09-12T18:03:42.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1501999999999995e-05 2024-09-12T18:03:42.658 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.658 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.658 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.658 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:97 3.1f 3:f83d65d8:::200.00000004:head [write 1998646~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.658 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.982986625000002, 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040449433999999999, 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:42.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665735+0000", 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665736+0000", 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665747+0000", 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-05 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665759+0000", 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2683e-05 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665767+0000", 2024-09-12T18:03:42.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.43e-06 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701531+0000", 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035764220999999999 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701591+0000", 2024-09-12T18:03:42.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9908999999999998e-05 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701691+0000", 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000100313 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.705901+0000", 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0042097649999999999 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706032+0000", 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000130808 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706106+0000", 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4617999999999996e-05 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706185+0000", 2024-09-12T18:03:42.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8443999999999996e-05 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 2000045~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.982945256000001, 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040702002000000001, 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665777+0000", 2024-09-12T18:03:42.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.0699999999999996e-07 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665781+0000", 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.6600000000000001e-06 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665790+0000", 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0059999999999998e-06 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.665798+0000", 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7170000000000008e-06 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702649+0000", 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.036850995999999997 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702776+0000", 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012726 2024-09-12T18:03:42.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.702959+0000", 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018254299999999999 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706273+0000", 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033145969999999999 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706300+0000", 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6415999999999999e-05 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706390+0000", 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9912000000000002e-05 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.706479+0000", 2024-09-12T18:03:42.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9087999999999998e-05 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:118 3.1f 3:f83d65d8:::200.00000004:head [write 2072508~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.950873643999998, 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038233179999999999, 2024-09-12T18:03:42.671 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697848+0000", 2024-09-12T18:03:42.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697849+0000", 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.2399999999999996e-07 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697869+0000", 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0100000000000001e-05 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697888+0000", 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9082000000000001e-05 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697898+0000", 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0073e-05 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731801+0000", 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.033902691999999998 2024-09-12T18:03:42.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731863+0000", 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1960999999999998e-05 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.731958+0000", 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5381e-05 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735828+0000", 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0038696949999999998 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735923+0000", 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4508999999999999e-05 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736007+0000", 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.4284999999999997e-05 2024-09-12T18:03:42.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736081+0000", 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4478000000000001e-05 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:119 3.1f 3:f83d65d8:::200.00000004:head [write 2076463~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.950806350999997, 2024-09-12T18:03:42.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.040994201000000001, 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:42.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697916+0000", 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7300000000000005e-07 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697921+0000", 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.386e-06 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697930+0000", 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6569999999999992e-06 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697939+0000", 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.8859999999999993e-06 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732578+0000", 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034638578000000003 2024-09-12T18:03:42.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732638+0000", 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0642e-05 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.732738+0000", 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9641000000000004e-05 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736766+0000", 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0040282790000000001 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738788+0000", 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0020218990000000002 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738858+0000", 2024-09-12T18:03:42.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.9831000000000003e-05 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738910+0000", 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1629000000000003e-05 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:120 3.1f 3:f83d65d8:::200.00000004:head [write 2079394~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:42.683 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.950772528999998, 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044480275999999999, 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697949+0000", 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697950+0000", 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697968+0000", 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7893e-05 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697979+0000", 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0533000000000001e-05 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697986+0000", 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9459999999999998e-06 2024-09-12T18:03:42.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733225+0000", 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035238347000000003 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733284+0000", 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8913000000000003e-05 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733386+0000", 2024-09-12T18:03:42.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102458 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736770+0000", 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033842469999999999 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742332+0000", 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055614849999999997 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742380+0000", 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8505999999999999e-05 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742430+0000", 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9218000000000002e-05 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.689 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:121 3.1f 3:f83d65d8:::200.00000004:head [write 2081303~2946 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.950724559999998, 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044590008, 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697997+0000", 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.697998+0000", 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.7299999999999995e-07 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698010+0000", 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.201e-05 2024-09-12T18:03:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698020+0000", 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5889999999999992e-06 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698027+0000", 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.294e-06 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.733885+0000", 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035858449000000001 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734080+0000", 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019512899999999999 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.734336+0000", 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025601699999999999 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.738923+0000", 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0045862969999999996 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742507+0000", 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0035846350000000001 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742558+0000", 2024-09-12T18:03:42.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0915999999999998e-05 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742587+0000", 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8999000000000001e-05 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:122 3.1f 3:f83d65d8:::200.00000004:head [write 2084249~2430 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.950683364, 2024-09-12T18:03:42.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044687174000000003, 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:42.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698039+0000", 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3e-07 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698043+0000", 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1529999999999999e-06 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698054+0000", 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0662999999999999e-05 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.698061+0000", 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.216e-06 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735115+0000", 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037053596000000001 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735181+0000", 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6327000000000004e-05 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.735281+0000", 2024-09-12T18:03:42.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9386e-05 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742445+0000", 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0071642659999999999 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742658+0000", 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021265999999999999 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742696+0000", 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8358000000000001e-05 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742726+0000", 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9819e-05 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.701 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:123 3.1f 3:f83d65d8:::200.00000004:head [write 2086679~3879 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.947252294999998, 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041366868000000001, 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701470+0000", 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701471+0000", 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.623e-06 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701486+0000", 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5146e-05 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701504+0000", 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.751e-05 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701515+0000", 2024-09-12T18:03:42.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1263e-05 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736148+0000", 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.034632616999999997 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736207+0000", 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8990999999999998e-05 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736301+0000", 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4370999999999995e-05 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742453+0000", 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.006152238 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742774+0000", 2024-09-12T18:03:42.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032060500000000001 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742810+0000", 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.5887999999999999e-05 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742836+0000", 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6616000000000001e-05 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.707 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:124 3.1f 3:f83d65d8:::200.00000004:head [write 2090558~1912 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 34.94706094, 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041377324, 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701661+0000", 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701662+0000", 2024-09-12T18:03:42.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3030000000000001e-06 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701668+0000", 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8030000000000002e-06 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701681+0000", 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3127e-05 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.701690+0000", 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6400000000000003e-06 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736824+0000", 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.035134546000000003 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.736953+0000", 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012835 2024-09-12T18:03:42.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.737198+0000", 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00024572400000000001 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742463+0000", 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0052640639999999997 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742911+0000", 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00044803699999999998 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.742977+0000", 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.6705999999999995e-05 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:07.743038+0000", 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1023999999999997e-05 2024-09-12T18:03:42.713 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:391 3.2 3:4272d415:::200.0000000b:head [write 2532501~3109 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.981437568, 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038228275999999999, 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.714 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667284+0000", 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667287+0000", 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2299999999999998e-06 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667297+0000", 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0837e-05 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667318+0000", 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0132e-05 2024-09-12T18:03:42.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667333+0000", 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5464e-05 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682093+0000", 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014760517000000001 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682239+0000", 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000145704 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.682429+0000", 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189419 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687963+0000", 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0055348469999999999 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705429+0000", 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017465897000000001 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705472+0000", 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.2833999999999997e-05 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705513+0000", 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.0395000000000002e-05 2024-09-12T18:03:42.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:392 3.2 3:4272d415:::200.0000000b:head [write 2535610~33089 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.981334093000001, 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038208328999999999, 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.720 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667388+0000", 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.721 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667389+0000", 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.24e-06 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667437+0000", 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8296e-05 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667461+0000", 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3315999999999998e-05 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.722 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667475+0000", 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4806e-05 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683310+0000", 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015835025999999999 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683414+0000", 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000103782 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.723 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.683558+0000", 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000144222 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687979+0000", 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0044206499999999999 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705541+0000", 2024-09-12T18:03:42.724 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017561879999999998 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705573+0000", 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1513000000000001e-05 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705596+0000", 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3598e-05 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.725 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:393 3.2 3:4272d415:::200.0000000b:head [write 2568699~16268 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.981214808000001, 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.038174923999999999, 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667507+0000", 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667508+0000", 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.26e-06 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.727 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667540+0000", 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.1544999999999997e-05 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667560+0000", 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.965e-05 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.728 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.667581+0000", 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1073e-05 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684213+0000", 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016632040000000001 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684298+0000", 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5700999999999998e-05 2024-09-12T18:03:42.729 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.684441+0000", 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000142325 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.688223+0000", 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037828240000000002 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.730 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705621+0000", 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017397394 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705661+0000", 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.9725000000000003e-05 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705682+0000", 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1387e-05 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.731 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:394 3.2 3:4272d415:::200.0000000b:head [write 2584967~9560 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.980637113, 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.037725440999999998, 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.732 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668085+0000", 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.733 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668087+0000", 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4269999999999998e-06 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668114+0000", 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6475999999999999e-05 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668140+0000", 2024-09-12T18:03:42.734 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.5896000000000001e-05 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.668159+0000", 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8936999999999998e-05 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686422+0000", 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.018263577999999999 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.735 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.686807+0000", 2024-09-12T18:03:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000385263 2024-09-12T18:03:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.687150+0000", 2024-09-12T18:03:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00034306300000000001 2024-09-12T18:03:42.736 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.689567+0000", 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002416961 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705716+0000", 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016148172999999998 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.737 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705773+0000", 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7275999999999998e-05 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.705810+0000", 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7391000000000002e-05 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10722 4.12 4:4a23efdb:::100000030fe.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-09-12T18:03:42.738 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.975952451000001, 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039390537000000003, 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10722 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.739 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672769+0000", 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.672772+0000", 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2400000000000002e-06 2024-09-12T18:03:42.740 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680073+0000", 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0073009110000000002 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680106+0000", 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3812000000000001e-05 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.741 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.680121+0000", 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.486e-05 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690602+0000", 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010480952999999999 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690789+0000", 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018728399999999999 2024-09-12T18:03:42.742 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.690975+0000", 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000185613 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.706973+0000", 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015997546000000001 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.743 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712089+0000", 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0051161699999999997 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712130+0000", 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.1069000000000003e-05 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.712160+0000", 2024-09-12T18:03:42.744 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0079000000000001e-05 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:10804 4.b 4:d006e46e:::10000003140.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 22.656456614, 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044910052999999998, 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.745 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 10804 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992265+0000", 2024-09-12T18:03:42.746 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:19.992268+0000", 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7870000000000002e-06 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012102+0000", 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.019833542999999999 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.747 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012139+0000", 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.7230000000000001e-05 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012163+0000", 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3998999999999998e-05 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012267+0000", 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010427100000000001 2024-09-12T18:03:42.748 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012333+0000", 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5907000000000004e-05 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.012775+0000", 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000442058 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.749 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.021332+0000", 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.008556882 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037041+0000", 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.015709548 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037115+0000", 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.3645000000000004e-05 2024-09-12T18:03:42.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:20.037175+0000", 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.0183000000000003e-05 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:11578 4.2d 4:b54e928a:::10000003360.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 21.480218116, 2024-09-12T18:03:42.751 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.041673711000000002, 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 11578 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:42.752 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168504+0000", 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.168505+0000", 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.5899999999999995e-07 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.753 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182775+0000", 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.014270628 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182793+0000", 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8156e-05 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.754 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182813+0000", 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9602e-05 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182897+0000", 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3688000000000002e-05 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.182995+0000", 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7826999999999997e-05 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.755 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.183185+0000", 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019040999999999999 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.193832+0000", 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010646901 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.756 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210041+0000", 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016209214 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210116+0000", 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.4482999999999998e-05 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:21.210177+0000", 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1943e-05 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.757 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14233 4.10 4:0a00b3f9:::100000032b1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 18.150817069999999, 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.039262674999999997, 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:42.758 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14233 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497905+0000", 2024-09-12T18:03:42.759 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.497907+0000", 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8020000000000001e-06 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509871+0000", 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011964415000000001 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.760 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509889+0000", 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7779999999999999e-05 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509900+0000", 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.164e-05 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.509977+0000", 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.6831999999999999e-05 2024-09-12T18:03:42.761 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510106+0000", 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012833000000000001 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.510271+0000", 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000165052 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.762 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.519886+0000", 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096156620000000005 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537057+0000", 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017170843000000002 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537114+0000", 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.694e-05 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.763 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:24.537167+0000", 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3378999999999998e-05 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14948 4.2d 4:b49e434b:::10000003309.00000001:head [write 0~3932160 [3@0]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.283716899000002, 2024-09-12T18:03:42.764 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.042463101000000003, 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14948 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:42.765 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365005+0000", 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.365007+0000", 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9199999999999998e-06 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.766 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374409+0000", 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009402143 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374448+0000", 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.8574e-05 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374471+0000", 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3088e-05 2024-09-12T18:03:42.767 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374581+0000", 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010991 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374719+0000", 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013811699999999999 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.768 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.374916+0000", 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000196806 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.384792+0000", 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.009876569 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407248+0000", 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.022455788000000001 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.769 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407377+0000", 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012914799999999999 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.407468+0000", 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1038000000000005e-05 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(client.4587.0:14963 4.2d 4:b5ada52e:::100000031f2.00000000:head [write 0~4194304 [2@3933023]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 17.269238274999999, 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.044482647, 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_info": { 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client": "client.4587", 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: "tid": 14963 2024-09-12T18:03:42.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379484+0000", 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.772 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.379485+0000", 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1880000000000001e-06 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389066+0000", 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095813919999999993 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389110+0000", 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.3992999999999997e-05 2024-09-12T18:03:42.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389126+0000", 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6308999999999999e-05 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389323+0000", 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00019653699999999999 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:42.774 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389581+0000", 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025770200000000001 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.389961+0000", 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038002100000000003 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.406604+0000", 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.016643390000000001 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.775 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423676+0000", 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.017071683000000001 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423843+0000", 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000167467 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:25.423966+0000", 2024-09-12T18:03:42.776 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000122965 2024-09-12T18:03:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:42.777 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:42.777 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:42.778 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:42.782 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:42.775+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:42.879 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:42.875+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:42.940 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:42.940 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:42.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:42.940 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDPGRecoveryDelete(4.1c e61,60 4:3b9db6d9:::100000016df.00000000:head,57'255)", 2024-09-12T18:03:42.940 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:42.940697+0000", 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.00012332000000000001, 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000173893, 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "queued for pg", 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:42.940697+0000", 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:42.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:42.940697+0000", 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:42.940699+0000", 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.77e-06 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:42.940709+0000", 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0173000000000001e-05 2024-09-12T18:03:42.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:42.940736+0000", 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7027999999999999e-05 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:42.940750+0000", 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.395e-05 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:42.943 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:03:42.944 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 1 2024-09-12T18:03:42.944 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:42.957 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:42.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:03:42.979 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:42.975+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:43.080 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:43.075+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:43.083 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:43.083 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:43.084 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:43.084 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:43.099 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:43.186 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:43.183+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:43.281 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:43.275+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.232136967999999, 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:43.291 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:43.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10795 4.22 4:4414d34e:::1000000315b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.334119384000001, 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03153454, 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.297 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10795 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952771+0000", 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9290000000000001e-06 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960575+0000", 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078039479999999998 2024-09-12T18:03:43.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960595+0000", 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9644e-05 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960609+0000", 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4246999999999999e-05 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960772+0000", 2024-09-12T18:03:43.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016263000000000001 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960936+0000", 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016446899999999999 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.961298+0000", 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036151899999999998 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.981362+0000", 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020064015000000001 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984110+0000", 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00274852 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984227+0000", 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116267 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.302 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984304+0000", 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7352000000000001e-05 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11134 4.30 4:0ea0a8b4:::10000003186.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.776518327000002, 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037582955000000001, 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.303 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11134 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000001e-07 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518086+0000", 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077143059999999998 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518103+0000", 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7441000000000001e-05 2024-09-12T18:03:43.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518116+0000", 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2573e-05 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518192+0000", 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518319+0000", 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012724599999999999 2024-09-12T18:03:43.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518439+0000", 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119436 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.527060+0000", 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086211320000000001 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547881+0000", 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02082063 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547921+0000", 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0411999999999999e-05 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547954+0000", 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2583000000000003e-05 2024-09-12T18:03:43.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11577 4.35 4:acdeb9c5:::1000000332a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.121237701999998, 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032699999, 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11577 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165652+0000", 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0920000000000001e-06 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175860+0000", 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010207233 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175874+0000", 2024-09-12T18:03:43.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4229999999999999e-05 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175882+0000", 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7330000000000003e-06 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175941+0000", 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8996000000000002e-05 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176090+0000", 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014994800000000001 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176209+0000", 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118825 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.184925+0000", 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008715558 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198295+0000", 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013369804000000001 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198327+0000", 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1942e-05 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198351+0000", 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-12T18:03:43.314 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14036 4.31 4:8eca8ddf:::100000031b8.00000000:head [write 0~4194304 [4@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.022387440999999, 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034286130999999997, 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14036 2024-09-12T18:03:43.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264505+0000", 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0570000000000001e-06 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273393+0000", 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088884240000000007 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273426+0000", 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3256999999999997e-05 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273441+0000", 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4445e-05 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273550+0000", 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010887099999999999 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273689+0000", 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139178 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273844+0000", 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155291 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.282512+0000", 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086676940000000001 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298736+0000", 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016224160000000001 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298766+0000", 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9961e-05 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298788+0000", 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1793e-05 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14099 4.18 4:18c6d816:::10000003304.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:43.320 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.944026724, 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031590162999999997, 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14099 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342865+0000", 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.74e-06 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350699+0000", 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078345069999999992 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350738+0000", 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.837e-05 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350757+0000", 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9519000000000001e-05 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350912+0000", 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015452099999999999 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351291+0000", 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037953800000000001 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351691+0000", 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000399379 2024-09-12T18:03:43.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.362505+0000", 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010814503 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374285+0000", 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011780135000000001 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374369+0000", 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3429000000000004e-05 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374452+0000", 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3522000000000004e-05 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14111 4.a 4:530380b1:::10000003584.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.92326748, 2024-09-12T18:03:43.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032405549999999998, 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14111 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363624+0000", 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3329999999999999e-06 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369957+0000", 2024-09-12T18:03:43.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063336720000000003 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369986+0000", 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8269e-05 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370001+0000", 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-05 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370257+0000", 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025585799999999998 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370536+0000", 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027879400000000001 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370979+0000", 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044307100000000001 2024-09-12T18:03:43.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.380399+0000", 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094193109999999997 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395936+0000", 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01553759 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395987+0000", 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1249999999999999e-05 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.396027+0000", 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9651999999999999e-05 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14165 4.32 4:4ea4de87:::100000037a0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:43.332 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.848526252999999, 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030909196, 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14165 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:43.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438365+0000", 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0540000000000002e-06 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446256+0000", 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078916520000000007 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446295+0000", 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000003e-05 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446311+0000", 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6696000000000001e-05 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446418+0000", 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010707199999999999 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446610+0000", 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019208499999999999 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446827+0000", 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216939 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.452206+0000", 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053787210000000004 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469114+0000", 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016907493999999999 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469196+0000", 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2237999999999994e-05 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469272+0000", 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6114999999999999e-05 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14176 4.5 4:a36cb72d:::10000003716.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:43.338 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.840262856999999, 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.040437328000000002, 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14176 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446629+0000", 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.429e-06 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460229+0000", 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013600736 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460276+0000", 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6721999999999998e-05 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460297+0000", 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1308999999999999e-05 2024-09-12T18:03:43.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460554+0000", 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025637199999999999 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460983+0000", 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042940099999999999 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.461353+0000", 2024-09-12T18:03:43.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036966199999999999 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.484975+0000", 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023622647 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486801+0000", 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00182548 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486933+0000", 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013208800000000001 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.487063+0000", 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013048199999999999 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14374 4.38 4:1dead311:::10000003395.00000000:head [write 0~4194304 [2@357324]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:43.344 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.616882593, 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039429224999999998, 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14374 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670009+0000", 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.497e-06 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682349+0000", 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012339785000000001 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682387+0000", 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8633000000000001e-05 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682404+0000", 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7005999999999999e-05 2024-09-12T18:03:43.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682514+0000", 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010951900000000001 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682649+0000", 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013563799999999999 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682836+0000", 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186424 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.701541+0000", 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018705016000000001 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709313+0000", 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077725889999999999 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709392+0000", 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8860000000000001e-05 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709436+0000", 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.350 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14734 4.32 4:4f3042f2:::1000000322e.00000000:head [write 0~4194304 [3@261943]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.225468992, 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033021488000000002, 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14734 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061421+0000", 2024-09-12T18:03:43.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069604+0000", 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081825100000000005 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069626+0000", 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2849000000000001e-05 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069645+0000", 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8926000000000001e-05 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069736+0000", 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0107999999999999e-05 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069861+0000", 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125704 2024-09-12T18:03:43.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.070200+0000", 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000338308 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.080698+0000", 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010498182 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094351+0000", 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013653168 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094404+0000", 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3424999999999998e-05 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094441+0000", 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7131000000000001e-05 2024-09-12T18:03:43.356 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14827 4.8 e52/17 4:1171651b:::100000030fc.00000001:head v 52'208, mlcod=52'206)", 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.054906503000002, 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032040617, 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231983+0000", 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.16e-07 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239015+0000", 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070313540000000001 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239054+0000", 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9675000000000002e-05 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239070+0000", 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239237+0000", 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016739399999999999 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239285+0000", 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7500999999999998e-05 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.263984+0000", 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024699115000000001 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264023+0000", 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9431999999999998e-05 2024-09-12T18:03:43.362 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14831 4.18 4:19f6b122:::1000000364a.00000000:head [write 0~4194304 [2@3284618]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 18.052926225, 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03242449, 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.363 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14831 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:43.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233964+0000", 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8700000000000004e-07 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242877+0000", 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089131509999999994 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242914+0000", 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7376999999999998e-05 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242929+0000", 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4728e-05 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252348+0000", 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094188910000000004 2024-09-12T18:03:43.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252475+0000", 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126735 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252712+0000", 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000237075 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264747+0000", 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012034977000000001 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266308+0000", 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015612130000000001 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266348+0000", 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0278999999999998e-05 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266387+0000", 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9076999999999999e-05 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14964 4.22 4:442ef67f:::10000003341.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.907153111, 2024-09-12T18:03:43.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030833801000000001, 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14964 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379737+0000", 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386729+0000", 2024-09-12T18:03:43.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069922450000000002 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386748+0000", 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386759+0000", 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1522000000000001e-05 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386849+0000", 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0255999999999998e-05 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386982+0000", 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013296400000000001 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.387166+0000", 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018323100000000001 2024-09-12T18:03:43.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.395195+0000", 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080296380000000004 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410331+0000", 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01513607 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410451+0000", 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119546 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410570+0000", 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118687 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14971 4.e 4:73867252:::1000000382a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.894222364000001, 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031669396000000002, 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14971 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392668+0000", 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.629e-06 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399618+0000", 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069498049999999999 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399636+0000", 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8045000000000001e-05 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399647+0000", 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0482000000000001e-05 2024-09-12T18:03:43.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399738+0000", 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1737999999999995e-05 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399886+0000", 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014755700000000001 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.400110+0000", 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224565 2024-09-12T18:03:43.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408175+0000", 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080649520000000002 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424146+0000", 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015970997000000001 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424205+0000", 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8638999999999999e-05 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424336+0000", 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130987 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14973 4.13 4:c81d059c:::100000038e4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.887214957000001, 2024-09-12T18:03:43.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032659724000000001, 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14973 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399676+0000", 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404945+0000", 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052687569999999998 2024-09-12T18:03:43.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404964+0000", 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404979+0000", 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5290000000000001e-05 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405106+0000", 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127126 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405251+0000", 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014441200000000001 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405392+0000", 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014160600000000001 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.414573+0000", 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091801000000000001 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432244+0000", 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017671630000000001 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432295+0000", 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0729000000000002e-05 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432334+0000", 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8773999999999998e-05 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14978 4.22 4:4562f5e1:::10000003754.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:43.387 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.878213541000001, 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.049933508000000001, 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14978 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408677+0000", 2024-09-12T18:03:43.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3489999999999999e-06 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416648+0000", 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079712930000000008 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416680+0000", 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2005999999999998e-05 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416698+0000", 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416815+0000", 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011641099999999999 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417000+0000", 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018498000000000001 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417272+0000", 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027257699999999998 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.429341+0000", 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012068314 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458491+0000", 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029150250999999999 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458553+0000", 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2539999999999994e-05 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458609+0000", 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5461999999999999e-05 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14990 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.860409276999999, 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032296710999999999, 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14990 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426481+0000", 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-09-12T18:03:43.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.433997+0000", 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075159520000000002 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434013+0000", 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5702e-05 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434021+0000", 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434090+0000", 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9029000000000006e-05 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434202+0000", 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011158999999999999 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434358+0000", 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001562 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.442632+0000", 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082736500000000004 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458688+0000", 2024-09-12T18:03:43.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016056844000000001 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458737+0000", 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8204999999999997e-05 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458776+0000", 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9789000000000001e-05 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15095 4.e 4:7041e79b:::10000003456.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.730998078999999, 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032716585999999999, 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.400 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15095 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555892+0000", 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564584+0000", 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086921359999999996 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564596+0000", 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1704e-05 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564602+0000", 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1079999999999998e-06 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564695+0000", 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3370999999999998e-05 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564964+0000", 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026938500000000002 2024-09-12T18:03:43.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.565178+0000", 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021372200000000001 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.571064+0000", 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058862769999999997 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588548+0000", 2024-09-12T18:03:43.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017483561000000002 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588582+0000", 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4436e-05 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588607+0000", 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5006000000000001e-05 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.405 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15239 4.3d 4:bfe5f3d1:::10000003901.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.544461375000001, 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037369946000000001, 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15239 2024-09-12T18:03:43.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:43.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742429+0000", 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.897e-06 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749874+0000", 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074448259999999999 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749907+0000", 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2419999999999998e-05 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749925+0000", 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8376000000000002e-05 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750112+0000", 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186923 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750409+0000", 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029714999999999999 2024-09-12T18:03:43.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750642+0000", 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023328199999999999 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.764931+0000", 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014288842 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779720+0000", 2024-09-12T18:03:43.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014788737999999999 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779765+0000", 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779798+0000", 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2601999999999997e-05 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:43.412 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:43.412 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:43.413 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:43.414 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:43.409+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:43.514 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:43.509+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:43.552 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:43.553 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:43.553 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:03:43.553 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:43.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:43.615 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:43.611+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:43.716 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:43.711+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:43.742 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:43.742 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:43.742 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:43.742 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:43.742 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:43.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:43.817 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:43.810+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:43.900 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:43.900 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:43.900 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:43.900 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:43.900 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.900 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:173 3.1d 3:bec1251c:::200.00000007:head [write 2322588~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.900 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:43.900 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230444591000001, 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053296283999999999, 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.901 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666835+0000", 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666836+0000", 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666840+0000", 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.89e-06 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.902 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666851+0000", 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1336e-05 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666860+0000", 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3130000000000004e-06 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.903 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712334+0000", 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045473636999999997 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712401+0000", 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6854999999999996e-05 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.712494+0000", 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3102000000000004e-05 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.904 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715473+0000", 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002979022 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719937+0000", 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004463753 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720028+0000", 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1667000000000002e-05 2024-09-12T18:03:43.905 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720131+0000", 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010296199999999999 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:174 3.1d 3:bec1251c:::200.00000007:head [write 2323991~2266 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230407584999998, 2024-09-12T18:03:43.906 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054429851000000001, 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666872+0000", 2024-09-12T18:03:43.907 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666873+0000", 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666882+0000", 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9490000000000002e-06 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.908 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666893+0000", 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1846e-05 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666903+0000", 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6639999999999993e-06 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713306+0000", 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.046402875000000003 2024-09-12T18:03:43.909 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713360+0000", 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3606000000000001e-05 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.713463+0000", 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010327000000000001 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.910 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718723+0000", 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052603750000000003 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721228+0000", 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.002504605 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721270+0000", 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2284999999999999e-05 2024-09-12T18:03:43.911 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721302+0000", 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1668999999999998e-05 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:175 3.1d 3:bec1251c:::200.00000007:head [write 2326257~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230364243, 2024-09-12T18:03:43.912 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054968250000000003, 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666915+0000", 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.913 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666916+0000", 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666921+0000", 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.914 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666932+0000", 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1129e-05 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666941+0000", 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5340000000000005e-06 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714169+0000", 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047227979000000003 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.915 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714350+0000", 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018078199999999999 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.714542+0000", 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019194599999999999 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.916 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721311+0000", 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067694599999999997 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721816+0000", 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00050489800000000004 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721855+0000", 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8761999999999999e-05 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.917 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721883+0000", 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.847e-05 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 2327657~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230326594000001, 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055044950000000002, 2024-09-12T18:03:43.918 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666953+0000", 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.919 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666954+0000", 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0999999999999998e-07 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666962+0000", 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3270000000000001e-06 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666974+0000", 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1671999999999999e-05 2024-09-12T18:03:43.920 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666983+0000", 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3300000000000005e-06 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715510+0000", 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048527110999999998 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715571+0000", 2024-09-12T18:03:43.921 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0571e-05 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.715666+0000", 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5309000000000005e-05 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721319+0000", 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056533599999999996 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.922 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721933+0000", 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00061373600000000003 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721969+0000", 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5716999999999997e-05 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721998+0000", 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9107000000000001e-05 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.923 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 2329056~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230286885000002, 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057668558000000002, 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.924 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666993+0000", 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5700000000000002e-07 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.925 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.666998+0000", 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3730000000000003e-06 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667009+0000", 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1372999999999999e-05 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667019+0000", 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6330000000000008e-06 2024-09-12T18:03:43.926 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048988146000000003 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716156+0000", 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014889699999999999 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716352+0000", 2024-09-12T18:03:43.927 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019631100000000001 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722047+0000", 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0056946430000000001 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724586+0000", 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0025389649999999998 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.928 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724629+0000", 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3492999999999998e-05 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724661+0000", 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1967000000000001e-05 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 2330457~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230249089000001, 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060884621999999999, 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.930 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667030+0000", 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667031+0000", 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4700000000000001e-07 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667040+0000", 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6899999999999998e-06 2024-09-12T18:03:43.931 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667049+0000", 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1819999999999995e-06 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667056+0000", 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717380+0000", 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.050324186999999999 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717577+0000", 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019663499999999999 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.717826+0000", 2024-09-12T18:03:43.933 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024979599999999999 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724671+0000", 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0068445870000000001 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727702+0000", 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030313800000000002 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.934 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727792+0000", 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9173999999999997e-05 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727915+0000", 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000123461 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.935 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 2331854~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230189097, 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061111629000000001, 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.936 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667090+0000", 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667091+0000", 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6000000000000002e-07 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667095+0000", 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1860000000000002e-06 2024-09-12T18:03:43.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667107+0000", 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1677e-05 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667173+0000", 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6267999999999996e-05 2024-09-12T18:03:43.938 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718826+0000", 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.051652608000000003 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.718997+0000", 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017137899999999999 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.939 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.719300+0000", 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030259699999999999 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725562+0000", 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062620339999999997 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728025+0000", 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0024631480000000001 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.940 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728144+0000", 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119187 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728202+0000", 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7685000000000001e-05 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.941 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 2333257~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230094012999999, 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061271826000000001, 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.942 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667185+0000", 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667186+0000", 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.47e-07 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667190+0000", 2024-09-12T18:03:43.943 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.053e-06 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667222+0000", 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1736000000000002e-05 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667235+0000", 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3353000000000001e-05 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.944 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720206+0000", 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052970053000000003 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720267+0000", 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1780999999999997e-05 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720360+0000", 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2214999999999997e-05 2024-09-12T18:03:43.945 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725568+0000", 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0052083779999999996 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728308+0000", 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0027402059999999998 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728393+0000", 2024-09-12T18:03:43.946 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4631999999999999e-05 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728457+0000", 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4572000000000005e-05 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 2334660~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:43.947 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.230027685, 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.061568009, 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667252+0000", 2024-09-12T18:03:43.948 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667253+0000", 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5000000000000001e-07 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667263+0000", 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.06e-05 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.949 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667273+0000", 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7929999999999992e-06 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667293+0000", 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0092999999999999e-05 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720662+0000", 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.053368895 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.950 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720717+0000", 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5109999999999999e-05 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.720809+0000", 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1528999999999997e-05 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725575+0000", 2024-09-12T18:03:43.951 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0047659419999999996 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728590+0000", 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0030151990000000001 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728664+0000", 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4331000000000004e-05 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.952 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.728820+0000", 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015566700000000001 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 2336060~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.229970806000001, 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064439129999999997, 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.953 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.954 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667309+0000", 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6000000000000003e-07 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667316+0000", 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3969999999999999e-06 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667338+0000", 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1772000000000001e-05 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.955 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667351+0000", 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721360+0000", 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054009085999999998 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.956 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721420+0000", 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9530000000000001e-05 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.721516+0000", 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6885999999999994e-05 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725581+0000", 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040648150000000003 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.957 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731590+0000", 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060089050000000001 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731683+0000", 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.3181000000000001e-05 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731748+0000", 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4467999999999993e-05 2024-09-12T18:03:43.958 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 2337466~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.229914801, 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064638172999999993, 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.959 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667365+0000", 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667366+0000", 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0699999999999996e-07 2024-09-12T18:03:43.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667391+0000", 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5239e-05 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667404+0000", 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3662999999999999e-05 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.961 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667415+0000", 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0356999999999999e-05 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722094+0000", 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054679350000000002 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722190+0000", 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6164999999999998e-05 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.962 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722297+0000", 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000106171 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725589+0000", 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003292601 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731855+0000", 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0062658740000000003 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.963 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.731946+0000", 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0873999999999998e-05 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732003+0000", 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6972000000000003e-05 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.964 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 2338869~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.229849618999999, 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.064929321999999998, 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667430+0000", 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667431+0000", 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1299999999999999e-07 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667435+0000", 2024-09-12T18:03:43.966 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2300000000000002e-06 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667447+0000", 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1722999999999999e-05 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667457+0000", 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9729999999999992e-06 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.967 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722824+0000", 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055367487999999999 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722883+0000", 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9015000000000003e-05 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.722977+0000", 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4009000000000001e-05 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.968 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725596+0000", 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026192749999999999 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732205+0000", 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0066086000000000001 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732300+0000", 2024-09-12T18:03:43.969 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5184000000000002e-05 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732359+0000", 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9011999999999997e-05 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 2340274~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.229808837, 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.065299365999999998, 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.971 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667471+0000", 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4000000000000001e-07 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667475+0000", 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.484e-06 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667486+0000", 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1523e-05 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667494+0000", 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7190000000000001e-06 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723338+0000", 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055844157999999998 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723399+0000", 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.0526000000000003e-05 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723503+0000", 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000103724 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.727598+0000", 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0040950240000000001 2024-09-12T18:03:43.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732498+0000", 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004900232 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732660+0000", 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000162153 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732770+0000", 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000110083 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.229773180999999, 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.976 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.979 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.229727139000001, 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:43.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:43.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.229688963000001, 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.987 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:43.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:43.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:43.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.229642507000001, 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.993 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:43.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:43.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.998 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 2436851~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.189018461, 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.055970091, 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:43.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708261+0000", 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5400000000000002e-07 2024-09-12T18:03:44.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708264+0000", 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1600000000000001e-06 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708268+0000", 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3270000000000002e-06 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:44.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708272+0000", 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2400000000000001e-06 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754125+0000", 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.045852684999999997 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754227+0000", 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101795 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.754379+0000", 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015250499999999999 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764012+0000", 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0096323859999999997 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764112+0000", 2024-09-12T18:03:44.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100509 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764185+0000", 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2430999999999998e-05 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.764231+0000", 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6598999999999999e-05 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:44.004 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 2438767~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.189002758000001, 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.060464795000000002, 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:44.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708277+0000", 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5999999999999999e-07 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708293+0000", 2024-09-12T18:03:44.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6195999999999999e-05 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708308+0000", 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4394e-05 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.708312+0000", 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0230000000000003e-06 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:44.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756496+0000", 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048184367999999998 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756646+0000", 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014982299999999999 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.756843+0000", 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019705800000000001 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766180+0000", 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0093370929999999994 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768540+0000", 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023602950000000001 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768660+0000", 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011983 2024-09-12T18:03:44.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768742+0000", 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1354999999999996e-05 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(client.4587.0:7832 4.1d 4:bad4e952:::100000023ad.00000000:head [write 0~7698] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 31.181272436, 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.052619849000000003, 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:44.010 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "client_info": { 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "client": "client.4587", 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "tid": 7832 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.011 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716007+0000", 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716008+0000", 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3179999999999999e-06 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716021+0000", 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2909e-05 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716038+0000", 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7022000000000001e-05 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.716052+0000", 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3597999999999999e-05 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.758957+0000", 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042905106999999998 2024-09-12T18:03:44.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759156+0000", 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000198755 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.759454+0000", 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029803700000000002 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.766191+0000", 2024-09-12T18:03:44.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067375899999999999 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768510+0000", 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0023187759999999998 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768581+0000", 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1211000000000006e-05 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:44.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:44.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.768627+0000", 2024-09-12T18:03:44.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5525999999999997e-05 2024-09-12T18:03:44.016 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:44.016 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:44.016 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:44.016 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:44.016 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:44.016 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:44.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:44.018 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.011+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.119 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.115+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.154 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:44.154 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:44.154 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:44.154 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:44.169 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:44.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:44.258 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.255+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.316 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:03:44.320 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.315+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.339 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:44.339 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:44.339 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:44.339 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:44.339 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:44.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:44.356 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:44.356 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:44.380 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:44.380 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:44.402 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:44.402 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:44.442 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.439+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.521 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.515+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.525 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:44.525 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:44.540 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:44.622 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.619+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.687 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:44.687 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:44.702 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:44.746 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:44.746+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:44.824 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.819+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.837 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:44.837 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:44.857 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:44.924 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:44.919+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:44.963 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T18:03:44.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:03:45.025 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:45.022+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:45.033 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:45.033 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:45.049 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:45.126 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:45.126+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:45.202 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:45.202 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:45.219 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:45.263 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:45.261+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:45.322 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:03:45.328 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:45.323+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:45.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:03:45.355 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:45.355 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:45.372 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:45.428 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:45.426+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:45.529 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:45.523+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:45.548 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:45.548 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:45.563 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:45.630 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:45.625+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:45.697 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:45.697 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:45.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:45.731 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:45.729+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:45.762 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-12T18:03:45.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:03:45.833 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:45.829+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:45.834 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:45.835 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:45.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:45.933 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:45.929+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:45.993 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:45.994 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:46.009 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:46.034 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:46.031+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:46.079 DEBUG:teuthology.parallel:result is None 2024-09-12T18:03:46.079 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:03:46.100 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:03:46.101 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T18:03:46.111 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T18:03:46.112 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:03:46.112 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T18:03:46.134 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:46.134+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:46.303 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:46.301+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:46.303 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:46.303 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:46.304 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:46.307 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:03:46.307 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T18:03:46.328 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:03:46.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T18:03:46.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T18:03:46.349 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:03:46.403 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:46.402+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:46.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:46.488 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:46.488 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:46.502 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:46.505 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:46.503+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:46.574 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:46.574 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:46.596 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:46.596 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:46.605 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:46.602+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:46.616 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:46.616 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:46.674 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:9757 4.13 4:ca460221:::10000002cd3.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-12T18:03:46.674 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.616699909000001, 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039158009000000001, 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 9757 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054752+0000", 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.054756+0000", 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.693e-06 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059776+0000", 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0050201220000000001 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059808+0000", 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2258999999999997e-05 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.059823+0000", 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060003+0000", 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000179665 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060416+0000", 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041289000000000001 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.060824+0000", 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040772300000000003 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.088281+0000", 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027457025999999999 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093759+0000", 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054781109999999999 2024-09-12T18:03:46.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093847+0000", 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8790999999999997e-05 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:16.093910+0000", 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2498999999999999e-05 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:10795 4.22 4:4414d34e:::1000000315b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.718682325, 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03153454, 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.681 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 10795 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952770+0000", 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.952771+0000", 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9290000000000001e-06 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960575+0000", 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078039479999999998 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960595+0000", 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9644e-05 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960609+0000", 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4246999999999999e-05 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960772+0000", 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016263000000000001 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.960936+0000", 2024-09-12T18:03:46.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016446899999999999 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.961298+0000", 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036151899999999998 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.981362+0000", 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020064015000000001 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984110+0000", 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00274852 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984227+0000", 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000116267 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:19.984304+0000", 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7352000000000001e-05 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11134 4.30 4:0ea0a8b4:::10000003186.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.161081268, 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037582955000000001, 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11134 2024-09-12T18:03:46.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.510371+0000", 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7100000000000001e-07 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518086+0000", 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077143059999999998 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518103+0000", 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7441000000000001e-05 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518116+0000", 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2573e-05 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518192+0000", 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518319+0000", 2024-09-12T18:03:46.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012724599999999999 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.518439+0000", 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119436 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.527060+0000", 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086211320000000001 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547881+0000", 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.02082063 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547921+0000", 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0411999999999999e-05 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:20.547954+0000", 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2583000000000003e-05 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:11577 4.35 4:acdeb9c5:::1000000332a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.505800643000001, 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032699999, 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.693 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 11577 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165651+0000", 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.165652+0000", 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0920000000000001e-06 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175860+0000", 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010207233 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175874+0000", 2024-09-12T18:03:46.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4229999999999999e-05 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175882+0000", 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7330000000000003e-06 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.175941+0000", 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8996000000000002e-05 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176090+0000", 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014994800000000001 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.176209+0000", 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118825 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.184925+0000", 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.008715558 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198295+0000", 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013369804000000001 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198327+0000", 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1942e-05 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:21.198351+0000", 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.698 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14036 4.31 4:8eca8ddf:::100000031b8.00000000:head [write 0~4194304 [4@4194304]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.406950382000002, 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034286130999999997, 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.699 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14036 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264501+0000", 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.264505+0000", 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0570000000000001e-06 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273393+0000", 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088884240000000007 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273426+0000", 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3256999999999997e-05 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273441+0000", 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4445e-05 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273550+0000", 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010887099999999999 2024-09-12T18:03:46.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273689+0000", 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139178 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.273844+0000", 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000155291 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.282512+0000", 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086676940000000001 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298736+0000", 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016224160000000001 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298766+0000", 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9961e-05 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.298788+0000", 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1793e-05 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14099 4.18 4:18c6d816:::10000003304.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.328589664999999, 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031590162999999997, 2024-09-12T18:03:46.705 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14099 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342862+0000", 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.342865+0000", 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.74e-06 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350699+0000", 2024-09-12T18:03:46.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078345069999999992 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350738+0000", 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.837e-05 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350757+0000", 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9519000000000001e-05 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.350912+0000", 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015452099999999999 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351291+0000", 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037953800000000001 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.351691+0000", 2024-09-12T18:03:46.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000399379 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.362505+0000", 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010814503 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374285+0000", 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011780135000000001 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374369+0000", 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3429000000000004e-05 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.374452+0000", 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3522000000000004e-05 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14111 4.a 4:530380b1:::10000003584.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:46.711 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.307830420999998, 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032405549999999998, 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14111 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:46.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363621+0000", 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.363624+0000", 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3329999999999999e-06 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369957+0000", 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063336720000000003 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.369986+0000", 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8269e-05 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370001+0000", 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.575e-05 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370257+0000", 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025585799999999998 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370536+0000", 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027879400000000001 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.370979+0000", 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044307100000000001 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.380399+0000", 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094193109999999997 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395936+0000", 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01553759 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.395987+0000", 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1249999999999999e-05 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.396027+0000", 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9651999999999999e-05 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14165 4.32 4:4ea4de87:::100000037a0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.233089194000001, 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030909196, 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.717 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14165 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438363+0000", 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.438365+0000", 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0540000000000002e-06 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446256+0000", 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078916520000000007 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446295+0000", 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000003e-05 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446311+0000", 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6696000000000001e-05 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446418+0000", 2024-09-12T18:03:46.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010707199999999999 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446610+0000", 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019208499999999999 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446827+0000", 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000216939 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.452206+0000", 2024-09-12T18:03:46.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053787210000000004 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469114+0000", 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016907493999999999 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469196+0000", 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2237999999999994e-05 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.469272+0000", 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6114999999999999e-05 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14176 4.5 4:a36cb72d:::10000003716.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.224825798000001, 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.040437328000000002, 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.723 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14176 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446626+0000", 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.446629+0000", 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.429e-06 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460229+0000", 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013600736 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460276+0000", 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6721999999999998e-05 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460297+0000", 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1308999999999999e-05 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460554+0000", 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025637199999999999 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.460983+0000", 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042940099999999999 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.461353+0000", 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036966199999999999 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.484975+0000", 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.023622647 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486801+0000", 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00182548 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.486933+0000", 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013208800000000001 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.487063+0000", 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013048199999999999 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14374 4.38 4:1dead311:::10000003395.00000000:head [write 0~4194304 [2@357324]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.001445533999998, 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.039429224999999998, 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14374 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.729 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670006+0000", 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.670009+0000", 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.497e-06 2024-09-12T18:03:46.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682349+0000", 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012339785000000001 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682387+0000", 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8633000000000001e-05 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682404+0000", 2024-09-12T18:03:46.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7005999999999999e-05 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682514+0000", 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010951900000000001 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682649+0000", 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013563799999999999 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.682836+0000", 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186424 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.701541+0000", 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018705016000000001 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709313+0000", 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077725889999999999 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709392+0000", 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8860000000000001e-05 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:24.709436+0000", 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3257999999999998e-05 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14734 4.32 4:4f3042f2:::1000000322e.00000000:head [write 0~4194304 [3@261943]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.734 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.610031932999998, 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033021488000000002, 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14734 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061420+0000", 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.061421+0000", 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1769999999999999e-06 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069604+0000", 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081825100000000005 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069626+0000", 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2849000000000001e-05 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069645+0000", 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8926000000000001e-05 2024-09-12T18:03:46.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069736+0000", 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0107999999999999e-05 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.069861+0000", 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000125704 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:46.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.070200+0000", 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000338308 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.080698+0000", 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010498182 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094351+0000", 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013653168 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094404+0000", 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3424999999999998e-05 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.094441+0000", 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7131000000000001e-05 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.740 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_repop(client.4587.0:14827 4.8 e52/17 4:1171651b:::100000030fc.00000001:head v 52'208, mlcod=52'206)", 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.439469444, 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032040617, 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231982+0000", 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.231983+0000", 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.16e-07 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239015+0000", 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0070313540000000001 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239054+0000", 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9675000000000002e-05 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239070+0000", 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.523e-05 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239237+0000", 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00016739399999999999 2024-09-12T18:03:46.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.239285+0000", 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7500999999999998e-05 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.263984+0000", 2024-09-12T18:03:46.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024699115000000001 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264023+0000", 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9431999999999998e-05 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14831 4.18 4:19f6b122:::1000000364a.00000000:head [write 0~4194304 [2@3284618]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:46.745 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.437489165999999, 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03242449, 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14831 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233963+0000", 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.233964+0000", 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8700000000000004e-07 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242877+0000", 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089131509999999994 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242914+0000", 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7376999999999998e-05 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.242929+0000", 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4728e-05 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252348+0000", 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094188910000000004 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252475+0000", 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126735 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.252712+0000", 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000237075 2024-09-12T18:03:46.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.264747+0000", 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012034977000000001 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266308+0000", 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0015612130000000001 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266348+0000", 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0278999999999998e-05 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.266387+0000", 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9076999999999999e-05 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14964 4.22 4:442ef67f:::10000003341.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.751 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.291716052000002, 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030833801000000001, 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14964 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379736+0000", 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.379737+0000", 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5600000000000004e-07 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386729+0000", 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069922450000000002 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386748+0000", 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8686e-05 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386759+0000", 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1522000000000001e-05 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386849+0000", 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0255999999999998e-05 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.386982+0000", 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013296400000000001 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.387166+0000", 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018323100000000001 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.395195+0000", 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080296380000000004 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410331+0000", 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01513607 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410451+0000", 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119546 2024-09-12T18:03:46.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.410570+0000", 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000118687 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14971 4.e 4:73867252:::1000000382a.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.278785305, 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.031669396000000002, 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.757 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14971 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392667+0000", 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.392668+0000", 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.629e-06 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399618+0000", 2024-09-12T18:03:46.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069498049999999999 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399636+0000", 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8045000000000001e-05 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399647+0000", 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0482000000000001e-05 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399738+0000", 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1737999999999995e-05 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399886+0000", 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014755700000000001 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.400110+0000", 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000224565 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408175+0000", 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080649520000000002 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424146+0000", 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015970997000000001 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424205+0000", 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8638999999999999e-05 2024-09-12T18:03:46.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.424336+0000", 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130987 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14973 4.13 4:c81d059c:::100000038e4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.271777898, 2024-09-12T18:03:46.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032659724000000001, 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14973 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399674+0000", 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.399676+0000", 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404945+0000", 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052687569999999998 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404964+0000", 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9539999999999999e-05 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.404979+0000", 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5290000000000001e-05 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405106+0000", 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127126 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405251+0000", 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014441200000000001 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.405392+0000", 2024-09-12T18:03:46.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014160600000000001 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.414573+0000", 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091801000000000001 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432244+0000", 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017671630000000001 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432295+0000", 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0729000000000002e-05 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.432334+0000", 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8773999999999998e-05 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14978 4.22 4:4562f5e1:::10000003754.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.262776482, 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.049933508000000001, 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14978 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408675+0000", 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.408677+0000", 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3489999999999999e-06 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416648+0000", 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079712930000000008 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416680+0000", 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2005999999999998e-05 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416698+0000", 2024-09-12T18:03:46.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8325000000000002e-05 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.416815+0000", 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011641099999999999 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417000+0000", 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018498000000000001 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.417272+0000", 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027257699999999998 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.429341+0000", 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012068314 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458491+0000", 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029150250999999999 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458553+0000", 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2539999999999994e-05 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458609+0000", 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5461999999999999e-05 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.775 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:14990 4.38 4:1c8d9fef:::100000033ed.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.244972218000001, 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032296710999999999, 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 14990 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426480+0000", 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.426481+0000", 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.562e-06 2024-09-12T18:03:46.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.433997+0000", 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075159520000000002 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434013+0000", 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5702e-05 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434021+0000", 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434090+0000", 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9029000000000006e-05 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434202+0000", 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011158999999999999 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.434358+0000", 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001562 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.442632+0000", 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082736500000000004 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458688+0000", 2024-09-12T18:03:46.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016056844000000001 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458737+0000", 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8204999999999997e-05 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.458776+0000", 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9789000000000001e-05 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15095 4.e 4:7041e79b:::10000003456.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.115561020000001, 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.032716585999999999, 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15095 2024-09-12T18:03:46.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555891+0000", 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.555892+0000", 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8000000000000004e-07 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564584+0000", 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086921359999999996 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564596+0000", 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1704e-05 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564602+0000", 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1079999999999998e-06 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564695+0000", 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3370999999999998e-05 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.564964+0000", 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026938500000000002 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.565178+0000", 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00021372200000000001 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.571064+0000", 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058862769999999997 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588548+0000", 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017483561000000002 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588582+0000", 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4436e-05 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.588607+0000", 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5006000000000001e-05 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4587.0:15239 4.3d 4:bfe5f3d1:::10000003901.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:46.787 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.929024316, 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.037369946000000001, 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4587", 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "192.168.0.1:0/3167685230", 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 15239 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:46.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742428+0000", 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.742429+0000", 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.897e-06 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:46.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749874+0000", 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074448259999999999 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749907+0000", 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2419999999999998e-05 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.749925+0000", 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8376000000000002e-05 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750112+0000", 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000186923 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750409+0000", 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029714999999999999 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for subops from 1", 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.750642+0000", 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023328199999999999 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.764931+0000", 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014288842 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779720+0000", 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014788737999999999 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779765+0000", 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4889999999999999e-05 2024-09-12T18:03:46.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:25.779798+0000", 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2601999999999997e-05 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:46.793 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:46.794 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-12T18:03:46.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:46.795 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:46.795+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:46.797 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-12T18:03:46.797 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T18:03:46.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T18:03:46.895 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:46.893+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:46.971 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:46.971 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18866 4.6 4.15a20506 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.916323+0000", 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.054297439000000003, 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.054312285000000002, 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.972 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916323+0000", 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916323+0000", 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916324+0000", 2024-09-12T18:03:46.973 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.68e-07 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916326+0000", 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7580000000000001e-06 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916334+0000", 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5170000000000002e-06 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.974 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916339+0000", 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4e-06 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916391+0000", 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1687999999999997e-05 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916403+0000", 2024-09-12T18:03:46.975 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1836e-05 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19012 4.36 4.dae11236 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.953564+0000", 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.017056532999999999, 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.017105781, 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:46.976 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953564+0000", 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953564+0000", 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:46.977 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953565+0000", 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953567+0000", 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.4430000000000002e-06 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953574+0000", 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.978 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953579+0000", 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7420000000000003e-06 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953627+0000", 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7240000000000002e-05 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953635+0000", 2024-09-12T18:03:46.979 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.0129999999999993e-06 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18608 4.36 4.fc5579f6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.864008+0000", 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.10661293500000001, 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.106691065, 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:46.980 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864008+0000", 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864008+0000", 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.981 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864008+0000", 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864012+0000", 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7780000000000001e-06 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864022+0000", 2024-09-12T18:03:46.982 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0056e-05 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864029+0000", 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2540000000000003e-06 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864149+0000", 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119727 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.983 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864160+0000", 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0953e-05 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19061 4.36 4.9e4778f6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.965331+0000", 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0052899059999999996, 2024-09-12T18:03:46.984 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0053960889999999997, 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965331+0000", 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965331+0000", 2024-09-12T18:03:46.985 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965331+0000", 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965334+0000", 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.6340000000000001e-06 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.986 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965341+0000", 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2799999999999998e-06 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965346+0000", 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8219999999999997e-06 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965446+0000", 2024-09-12T18:03:46.987 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9969000000000005e-05 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965463+0000", 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6767999999999999e-05 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.988 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18917 4.36 4.590ad8b6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.928733+0000", 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.041887529, 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.042022008999999999, 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928733+0000", 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928733+0000", 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928734+0000", 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6499999999999998e-07 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:46.990 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928737+0000", 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7110000000000001e-06 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928744+0000", 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9689999999999997e-06 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928749+0000", 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8049999999999997e-06 2024-09-12T18:03:46.991 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928797+0000", 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7555999999999997e-05 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928821+0000", 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.4207999999999999e-05 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.992 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18898 4.36 4.31bf1c36 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.922221+0000", 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.048399101, 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.048560160999999998, 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922221+0000", 2024-09-12T18:03:46.993 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922221+0000", 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922222+0000", 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9100000000000004e-07 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.994 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922225+0000", 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7920000000000001e-06 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922233+0000", 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7500000000000003e-06 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922239+0000", 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9179999999999997e-06 2024-09-12T18:03:46.995 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922295+0000", 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5254000000000003e-05 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922303+0000", 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.7220000000000005e-06 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:46.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18971 4.36 4.710f13f6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.939818+0000", 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.030802091, 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.030989599999999999, 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939818+0000", 2024-09-12T18:03:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939818+0000", 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939819+0000", 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0299999999999998e-07 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.998 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939822+0000", 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1889999999999999e-06 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939832+0000", 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7319999999999993e-06 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:46.999 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939838+0000", 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2650000000000002e-06 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939893+0000", 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4888e-05 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.000 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939902+0000", 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2199999999999998e-06 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18618 4.6 4.3aa46e86 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.865202+0000", 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.10541871799999999, 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.105632659, 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.001 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865202+0000", 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865202+0000", 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.002 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865203+0000", 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3600000000000003e-07 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865205+0000", 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.886e-06 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865215+0000", 2024-09-12T18:03:47.003 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5449999999999992e-06 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865222+0000", 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0190000000000001e-06 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865558+0000", 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033598100000000001 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.004 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865581+0000", 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3439999999999999e-05 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18599 4.36 4.4da03bb6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.857306+0000", 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.113314849, 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.113557461, 2024-09-12T18:03:47.005 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857306+0000", 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857306+0000", 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857306+0000", 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.54e-07 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857309+0000", 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9560000000000002e-06 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.007 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857316+0000", 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5350000000000001e-06 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857320+0000", 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4870000000000004e-06 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857372+0000", 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1328000000000001e-05 2024-09-12T18:03:47.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857388+0000", 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6648000000000001e-05 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18621 4.36 4.9a012c76 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.865694+0000", 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.10492654, 2024-09-12T18:03:47.009 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.105195333, 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865694+0000", 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865694+0000", 2024-09-12T18:03:47.010 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865695+0000", 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.0999999999999997e-07 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865699+0000", 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8449999999999996e-06 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.011 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865709+0000", 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0563e-05 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865719+0000", 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7799999999999995e-06 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865815+0000", 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6125000000000005e-05 2024-09-12T18:03:47.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865827+0000", 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2224e-05 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18903 4.36 4.b58c2e36 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.923252+0000", 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.047368234000000002, 2024-09-12T18:03:47.013 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.047663206, 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923252+0000", 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923252+0000", 2024-09-12T18:03:47.014 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923253+0000", 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9500000000000001e-07 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923257+0000", 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4960000000000001e-06 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.015 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923264+0000", 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4590000000000001e-06 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923269+0000", 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.403e-06 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923322+0000", 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3096999999999997e-05 2024-09-12T18:03:47.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923332+0000", 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19068 4.8 4:13a6c0ef:::10000002b5f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.967828+0000", 2024-09-12T18:03:47.017 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0027929719999999999, 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003116153, 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.967828+0000", 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.018 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.967828+0000", 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.967828+0000", 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4499999999999997e-07 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.967831+0000", 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0240000000000002e-06 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.019 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.967839+0000", 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6510000000000001e-06 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.967845+0000", 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.545e-06 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.967897+0000", 2024-09-12T18:03:47.020 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1331e-05 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.967991+0000", 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4481999999999994e-05 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19070 4.1c 4:3b907b69:::10000002b61.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.968076+0000", 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0025443689999999999, 2024-09-12T18:03:47.021 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0028944040000000002, 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968076+0000", 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968076+0000", 2024-09-12T18:03:47.022 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968077+0000", 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3600000000000002e-07 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968081+0000", 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7249999999999999e-06 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.023 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968090+0000", 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9679999999999995e-06 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968096+0000", 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2650000000000002e-06 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968144+0000", 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8143000000000003e-05 2024-09-12T18:03:47.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968245+0000", 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000100639 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968332+0000", 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.7453000000000004e-05 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.969025+0000", 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00069286399999999996 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19071 4.3 4:c0174c39:::10000002b62.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.968111+0000", 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.002509594, 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0028914919999999998, 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968111+0000", 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968111+0000", 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968111+0000", 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8400000000000005e-07 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968114+0000", 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1940000000000001e-06 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.028 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968120+0000", 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.8090000000000004e-06 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968125+0000", 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3769999999999998e-06 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968166+0000", 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1284e-05 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.029 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968271+0000", 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000104595 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968373+0000", 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010253 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.969044+0000", 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00067106900000000005 2024-09-12T18:03:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18659 4.6 4.a7acd9c6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.874735+0000", 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.095885583999999996, 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.096298954000000006, 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.031 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874735+0000", 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874735+0000", 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874736+0000", 2024-09-12T18:03:47.032 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874741+0000", 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9230000000000001e-06 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874753+0000", 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2489e-05 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.033 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874761+0000", 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1520000000000003e-06 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874814+0000", 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3399999999999997e-05 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874824+0000", 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219999999999992e-06 2024-09-12T18:03:47.034 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19005 4.6 4.1de76246 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.952387+0000", 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.018233470000000002, 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.018676663, 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.035 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952387+0000", 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952387+0000", 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.036 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952388+0000", 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952391+0000", 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0730000000000001e-06 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952397+0000", 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2169999999999999e-06 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952401+0000", 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2370000000000003e-06 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952445+0000", 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3560999999999998e-05 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952453+0000", 2024-09-12T18:03:47.038 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4959999999999996e-06 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19074 4.1d 4:b80cf914:::10000002b65.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.968479+0000", 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.0021416489999999998, 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026116759999999998, 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for sub ops", 2024-09-12T18:03:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968479+0000", 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968479+0000", 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968480+0000", 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.8100000000000001e-07 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968483+0000", 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.63e-06 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968492+0000", 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4859999999999997e-06 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968499+0000", 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7780000000000002e-06 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968544+0000", 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5178e-05 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968646+0000", 2024-09-12T18:03:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010185500000000001 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.968747+0000", 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101335 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.969408+0000", 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000660627 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18928 4.6 4.199e3f86 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.931859+0000", 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.038761628999999999, 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.039262753999999997, 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931859+0000", 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931859+0000", 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931860+0000", 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931863+0000", 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3440000000000001e-06 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931871+0000", 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1820000000000006e-06 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931876+0000", 2024-09-12T18:03:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9590000000000003e-06 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931928+0000", 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1768999999999999e-05 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931934+0000", 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.015e-06 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-12T18:03:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 18 2024-09-12T18:03:47.048 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:47.049 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:47.050 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:47.046+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:47.151 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:47.151+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:47.159 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2024-09-12T18:03:47.177 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi052.front.sepia.ceph.com... 2024-09-12T18:03:47.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:03:47.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T18:03:47.197 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:03:47.197 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[23648]: fuse finished with error 0 and tester_r 0 2024-09-12T18:03:47.226 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:47.226 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:47.226 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:47.226 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:47.226 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:47.251 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:47.252 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:47.249+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-09-12T18:03:47.339 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:03:47.353 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:47.350+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:47.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:03:47.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:47.396 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:47.396 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 2341673~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.727404899, 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069969300999999998, 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:47.397 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667506+0000", 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.398 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667507+0000", 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.8000000000000005e-07 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667516+0000", 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4770000000000003e-06 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667527+0000", 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1873e-05 2024-09-12T18:03:47.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667540+0000", 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2172e-05 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723910+0000", 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.056369966000000001 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.400 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.723963+0000", 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3485e-05 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724049+0000", 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.5919000000000002e-05 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732032+0000", 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079826059999999997 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.401 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.402 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:47.402 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737157+0000", 2024-09-12T18:03:47.402 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0051254040000000001 2024-09-12T18:03:47.402 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.402 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.402 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:47.402 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737335+0000", 2024-09-12T18:03:47.402 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000178052 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.737476+0000", 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000140567 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:187 3.1d 3:bec1251c:::200.00000007:head [write 2343070~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:47.403 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.727358856999999, 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072709526999999996, 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.404 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667552+0000", 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667553+0000", 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0699999999999996e-07 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667557+0000", 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7869999999999999e-06 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.405 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667568+0000", 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1433e-05 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667578+0000", 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0069e-05 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724713+0000", 2024-09-12T18:03:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057134328999999998 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724772+0000", 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9735000000000003e-05 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.724863+0000", 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0957000000000003e-05 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.407 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732048+0000", 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0071846729999999999 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.739977+0000", 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0079286619999999995 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740152+0000", 2024-09-12T18:03:47.408 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000175584 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.740262+0000", 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000109591 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:188 3.1d 3:bec1251c:::200.00000007:head [write 2344473~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.727320681000002, 2024-09-12T18:03:47.409 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074525135000000006, 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:47.410 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667591+0000", 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1699999999999997e-07 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667601+0000", 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5959999999999993e-06 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.411 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667613+0000", 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1892999999999999e-05 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667622+0000", 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6830000000000003e-06 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725157+0000", 2024-09-12T18:03:47.412 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057534773999999997 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725212+0000", 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5260000000000003e-05 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725297+0000", 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4714000000000002e-05 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.413 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732066+0000", 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067688890000000002 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.741960+0000", 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098941129999999995 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742045+0000", 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4771000000000005e-05 2024-09-12T18:03:47.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742116+0000", 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0724999999999998e-05 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:189 3.1d 3:bec1251c:::200.00000007:head [write 2345872~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 34.727274225000002, 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.074740665999999997, 2024-09-12T18:03:47.415 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667637+0000", 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667638+0000", 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667641+0000", 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6629999999999999e-06 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667653+0000", 2024-09-12T18:03:47.417 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1386000000000001e-05 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.667663+0000", 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0076e-05 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725638+0000", 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.057974829999999998 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.418 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725694+0000", 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6110000000000003e-05 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.725783+0000", 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9420999999999996e-05 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.732101+0000", 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0063179639999999997 2024-09-12T18:03:47.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742217+0000", 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.010115677 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742316+0000", 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9520999999999998e-05 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.420 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:12.742378+0000", 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1198000000000006e-05 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:16948 4.1c 4:3a408c1c:::10000001f61.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:43.842240+0000", 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 3.5526714940000002, 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.49101373100000001, 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.421 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:43.842240+0000", 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:43.842240+0000", 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.422 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:43.842258+0000", 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8206000000000002e-05 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:43.842267+0000", 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5130000000000002e-06 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:43.842293+0000", 2024-09-12T18:03:47.423 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.5890000000000001e-05 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:43.842311+0000", 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7501999999999999e-05 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:43.842377+0000", 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5848999999999999e-05 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.424 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:43.842385+0000", 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.9330000000000001e-06 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:44.330981+0000", 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.48859609199999998 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:44.331329+0000", 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00034787000000000002 2024-09-12T18:03:47.425 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:44.331660+0000", 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033162000000000003 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:44.333093+0000", 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0014326530000000001 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:44.333165+0000", 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2299999999999996e-05 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:44.333208+0000", 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2358999999999999e-05 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:44.333253+0000", 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5943999999999999e-05 2024-09-12T18:03:47.427 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19426 4.28 4:16ce2f56:::100000000ab.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.238803+0000", 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15610782100000001, 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.068610900000000002, 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.428 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238803+0000", 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238803+0000", 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.429 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238808+0000", 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3599999999999998e-06 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238813+0000", 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.0930000000000002e-06 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238831+0000", 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7836e-05 2024-09-12T18:03:47.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238844+0000", 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3473e-05 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.269044+0000", 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.030199921000000001 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.431 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.269634+0000", 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00058964900000000003 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.307414+0000", 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.037780568 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.432 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19430 4.8 4:12260154:::100000000af.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.238861+0000", 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15605001900000001, 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.068499776999999998, 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238861+0000", 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.433 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238861+0000", 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238865+0000", 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8299999999999998e-06 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238871+0000", 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.6960000000000002e-06 2024-09-12T18:03:47.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238889+0000", 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8236999999999998e-05 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.238902+0000", 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3046e-05 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.435 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.270057+0000", 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.03115536 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.270167+0000", 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00011001399999999999 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.307361+0000", 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.037193594000000003 2024-09-12T18:03:47.436 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19439 4.23 4:c7a7e7ed:::100000000b8.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.239156+0000", 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15575513499999999, 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.073458941999999999, 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.437 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239156+0000", 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239156+0000", 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239160+0000", 2024-09-12T18:03:47.438 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7670000000000001e-06 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239166+0000", 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7860000000000002e-06 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239178+0000", 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.255e-05 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.439 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239191+0000", 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.287e-05 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.279223+0000", 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.040031460999999997 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.279330+0000", 2024-09-12T18:03:47.440 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000107839 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.312615+0000", 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.033284669000000003 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19441 4.28 4:14bef4b2:::100000000ba.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.239279+0000", 2024-09-12T18:03:47.441 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15563200799999999, 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.068406976999999994, 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239279+0000", 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.442 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239279+0000", 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239283+0000", 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3239999999999999e-06 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239287+0000", 2024-09-12T18:03:47.443 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6399999999999996e-06 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239304+0000", 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6436e-05 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.239317+0000", 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3183000000000001e-05 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.444 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.270514+0000", 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.031197005999999999 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.270629+0000", 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000115395 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.307686+0000", 2024-09-12T18:03:47.445 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.037056993000000003 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19472 4.10 4:09e2658b:::100000000d9.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.240001+0000", 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15490985299999999, 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.067684096999999999, 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.446 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240001+0000", 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240001+0000", 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.447 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240005+0000", 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8630000000000001e-06 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240013+0000", 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7020000000000001e-06 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240025+0000", 2024-09-12T18:03:47.448 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2456999999999999e-05 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240038+0000", 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2614e-05 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.270972+0000", 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.030934203 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.449 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.271078+0000", 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010611999999999999 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.307685+0000", 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.036607137999999997 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.450 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19479 4.3 4:c239e8b3:::100000000e0.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.240171+0000", 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15474054500000001, 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.072577647999999995, 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240171+0000", 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.451 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240171+0000", 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240174+0000", 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.72e-06 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.452 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240180+0000", 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1429999999999997e-06 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240191+0000", 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1868000000000001e-05 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240204+0000", 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2223e-05 2024-09-12T18:03:47.453 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.280195+0000", 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.039991133999999998 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.280298+0000", 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010348699999999999 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.454 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.312748+0000", 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.032450073000000003 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19516 4.10 4:088ef71a:::10000000105.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.240911+0000", 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.154000097, 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.067011476, 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.455 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240911+0000", 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240911+0000", 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.456 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240916+0000", 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7770000000000002e-06 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240921+0000", 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.6260000000000003e-06 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240932+0000", 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1970999999999999e-05 2024-09-12T18:03:47.457 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.240945+0000", 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.216e-05 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.271547+0000", 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.030602586000000001 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.458 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.271674+0000", 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00012689099999999999 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.307923+0000", 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.036248465000000001 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19534 4.23 4:c507b3c5:::10000000117.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.459 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.241370+0000", 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15354146900000001, 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.071501899999999993, 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241370+0000", 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.460 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241370+0000", 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241373+0000", 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6459999999999999e-06 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241379+0000", 2024-09-12T18:03:47.461 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3909999999999997e-06 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241392+0000", 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3111e-05 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241405+0000", 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2768999999999999e-05 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.462 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.281154+0000", 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.039749393000000001 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.281247+0000", 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2801999999999997e-05 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.312872+0000", 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.031624788000000001 2024-09-12T18:03:47.463 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19536 4.3 4:c1b999d7:::10000000119.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.241422+0000", 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15348935, 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.071448455999999994, 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.464 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241422+0000", 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241422+0000", 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.465 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241426+0000", 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9199999999999997e-06 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241443+0000", 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7323e-05 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241460+0000", 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6994e-05 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.466 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241473+0000", 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2707999999999999e-05 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.281168+0000", 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.039695119000000001 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.281255+0000", 2024-09-12T18:03:47.467 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6837999999999998e-05 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.312870+0000", 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.031615553999999997 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19541 4.10 4:08a5cadf:::1000000011e.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.468 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.241603+0000", 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.153308422, 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.066797121000000001, 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241603+0000", 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.469 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241603+0000", 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241606+0000", 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.2200000000000001e-06 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241611+0000", 2024-09-12T18:03:47.470 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5199999999999999e-06 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241628+0000", 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7142e-05 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.471 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.241641+0000", 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3446e-05 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.273352+0000", 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.031711136000000001 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.274100+0000", 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00074791600000000005 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.472 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.308400+0000", 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.034299741000000002 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19563 4.2 4:40fdd18a:::10000000134.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.242350+0000", 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15256072800000001, 2024-09-12T18:03:47.473 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.067188839, 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.242350+0000", 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.474 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.242350+0000", 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.242355+0000", 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9230000000000001e-06 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.242360+0000", 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9599999999999999e-06 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.475 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.242372+0000", 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2014000000000001e-05 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.242384+0000", 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1751e-05 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.274208+0000", 2024-09-12T18:03:47.476 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.031824252999999997 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.274333+0000", 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00012490400000000001 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.309539+0000", 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.035206033999999997 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.477 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19590 4.2 4:42d137c4:::1000000014f.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.243048+0000", 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.151863633, 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.066653306999999995, 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.478 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243048+0000", 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243048+0000", 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243053+0000", 2024-09-12T18:03:47.479 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9309999999999999e-06 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243058+0000", 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.891e-06 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243070+0000", 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1863e-05 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243083+0000", 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2982999999999999e-05 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.274711+0000", 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.031628099999999999 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.274802+0000", 2024-09-12T18:03:47.481 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.0808000000000002e-05 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.309701+0000", 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.034898731000000002 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19608 4.3 4:c3d50dc8:::10000000161.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.243327+0000", 2024-09-12T18:03:47.482 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15158386700000001, 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069667746000000003, 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243327+0000", 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.483 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243327+0000", 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243328+0000", 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2800000000000005e-07 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243332+0000", 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.946e-06 2024-09-12T18:03:47.484 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243347+0000", 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4543e-05 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243358+0000", 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1625e-05 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.485 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.282090+0000", 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.038731599999999998 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.282205+0000", 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000115209 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.312995+0000", 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.030789895000000001 2024-09-12T18:03:47.486 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19632 4.23 4:c468a694:::10000000179.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.243711+0000", 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15120070099999999, 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069293930000000004, 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243711+0000", 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243711+0000", 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243711+0000", 2024-09-12T18:03:47.488 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.78e-07 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243730+0000", 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.8331000000000001e-05 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243747+0000", 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.7076e-05 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.489 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243758+0000", 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1314e-05 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.282127+0000", 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.038369216999999997 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.282193+0000", 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5704999999999995e-05 2024-09-12T18:03:47.490 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.313004+0000", 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.030811308999999999 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19634 4.23 4:c750a2e5:::1000000017b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.243823+0000", 2024-09-12T18:03:47.491 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 0.15108833999999999, 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.069257417000000002, 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "started", 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243823+0000", 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.492 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243823+0000", 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243824+0000", 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.02e-06 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243828+0000", 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8829999999999999e-06 2024-09-12T18:03:47.493 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243843+0000", 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5631e-05 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.243855+0000", 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1885000000000001e-05 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:47.494 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.282535+0000", 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.038679340999999999 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.282636+0000", 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010173700000000001 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.313080+0000", 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.030443919999999999 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.495 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.496 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.496 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:47.496 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:47.496 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:47.498 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:47.500 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:47.494+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:47.599 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:47.599+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:47.635 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19753 4.b 4.6cbd9e0b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29734174000000002, 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29738265899999999, 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.636 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336301+0000", 2024-09-12T18:03:47.637 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.043e-06 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336306+0000", 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2530000000000004e-06 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336325+0000", 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8243000000000001e-05 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.638 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336338+0000", 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3473e-05 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336388+0000", 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9381e-05 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336393+0000", 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5480000000000001e-06 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.639 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.349033+0000", 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012640175999999999 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.349054+0000", 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1016999999999999e-05 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18530 4.b 4.71f6324b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.640 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29856212799999998, 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.298710054, 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.641 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335083+0000", 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3699999999999999e-06 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335114+0000", 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0901000000000001e-05 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.642 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335143+0000", 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8932999999999999e-05 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335161+0000", 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8244999999999999e-05 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335271+0000", 2024-09-12T18:03:47.643 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010988 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335279+0000", 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1140000000000006e-06 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344500+0000", 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092206690000000008 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.644 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344528+0000", 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8181999999999999e-05 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18596 4.b 4.6942b58b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29843736300000001, 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29868062400000001, 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.645 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335206+0000", 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.212e-06 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335212+0000", 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5769999999999999e-06 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335230+0000", 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7955999999999999e-05 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335246+0000", 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5302999999999999e-05 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335372+0000", 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012597699999999999 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335378+0000", 2024-09-12T18:03:47.648 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720000000000003e-06 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344616+0000", 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092381770000000002 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344637+0000", 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699e-05 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.649 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18598 4.b 4.33ee45cb (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29836934700000001, 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.298705742, 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335274+0000", 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0109999999999999e-06 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.651 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335279+0000", 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6060000000000002e-06 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335297+0000", 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7676000000000002e-05 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335310+0000", 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2782999999999999e-05 2024-09-12T18:03:47.652 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335488+0000", 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017866599999999999 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335499+0000", 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1163e-05 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.653 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344720+0000", 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092202329999999996 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344742+0000", 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2048999999999998e-05 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18607 4.b 4.b3d18d0b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:47.654 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29830932900000001, 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29874115099999998, 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.655 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335334+0000", 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6299999999999993e-07 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335338+0000", 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6829999999999999e-06 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.656 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335356+0000", 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7655999999999998e-05 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335368+0000", 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-05 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335552+0000", 2024-09-12T18:03:47.657 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018376500000000001 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4410000000000001e-06 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345030+0000", 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0094724470000000002 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.658 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345053+0000", 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3683e-05 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18757 4.b 4.4cbc24cb (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29825074800000001, 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29877454399999998, 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.659 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.660 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335392+0000", 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9500000000000001e-07 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335397+0000", 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9219999999999996e-06 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335413+0000", 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5886e-05 2024-09-12T18:03:47.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335425+0000", 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2282e-05 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335612+0000", 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018647499999999999 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.662 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335620+0000", 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2430000000000005e-06 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345191+0000", 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095711770000000002 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345221+0000", 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9666e-05 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.663 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18814 4.b 4.d970f68b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.298173087, 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29878860400000001, 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335470+0000", 2024-09-12T18:03:47.665 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0690000000000001e-06 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335475+0000", 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3020000000000002e-06 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335493+0000", 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7949e-05 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.666 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335506+0000", 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2865e-05 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335663+0000", 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015690100000000001 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335668+0000", 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3469999999999998e-06 2024-09-12T18:03:47.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345320+0000", 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096513759999999997 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345342+0000", 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2056e-05 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18849 4.b 4.4975580b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29808498300000003, 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29879534800000002, 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:47.669 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335558+0000", 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0219999999999999e-06 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.670 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335563+0000", 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.429e-06 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335581+0000", 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7635999999999999e-05 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335594+0000", 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979999999999999e-05 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.671 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335708+0000", 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114351 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335716+0000", 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9899999999999997e-06 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347521+0000", 2024-09-12T18:03:47.672 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011804434000000001 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347547+0000", 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6393e-05 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18860 4.b 4.9eae664b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:47.673 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29802826500000001, 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29883105700000001, 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.674 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335615+0000", 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5099999999999998e-07 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335619+0000", 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6890000000000003e-06 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.675 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335636+0000", 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6211000000000001e-05 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335660+0000", 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4671000000000001e-05 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335742+0000", 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1735000000000003e-05 2024-09-12T18:03:47.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335747+0000", 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3020000000000002e-06 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347645+0000", 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011898089000000001 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347666+0000", 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0712000000000001e-05 2024-09-12T18:03:47.677 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18887 4.b 4.f40d510b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29795592399999998, 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29884955400000002, 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.678 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335687+0000", 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0669999999999999e-06 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.679 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335721+0000", 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4218999999999999e-05 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335744+0000", 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3116e-05 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335764+0000", 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9145999999999999e-05 2024-09-12T18:03:47.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335820+0000", 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6932000000000003e-05 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335826+0000", 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-06 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.681 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348074+0000", 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012248458 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348102+0000", 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7889999999999999e-05 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19179 4.b 4.634eee4b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:47.682 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29785038000000003, 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.298835611, 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:47.683 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335793+0000", 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.31e-06 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335798+0000", 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.684 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335818+0000", 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9695999999999999e-05 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335832+0000", 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4276e-05 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335883+0000", 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0751000000000002e-05 2024-09-12T18:03:47.685 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335888+0000", 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5260000000000001e-06 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348183+0000", 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012294312999999999 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348204+0000", 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1769000000000001e-05 2024-09-12T18:03:47.686 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19288 4.b 4.c12b0bcb (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29778503499999998, 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29886319300000003, 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.687 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335858+0000", 2024-09-12T18:03:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335863+0000", 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0000000000000004e-06 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335881+0000", 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8352999999999999e-05 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335895+0000", 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4073000000000001e-05 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335949+0000", 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3402999999999997e-05 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335954+0000", 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4879999999999998e-06 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.690 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348279+0000", 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012324504 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348301+0000", 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2056e-05 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.691 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19289 4.b 4.9ec6464b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29772215000000002, 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.298891829, 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.692 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335921+0000", 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335926+0000", 2024-09-12T18:03:47.693 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9230000000000001e-06 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335944+0000", 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7802999999999999e-05 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335957+0000", 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3883000000000001e-05 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.694 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336008+0000", 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0102999999999998e-05 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336013+0000", 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348363+0000", 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012350517 2024-09-12T18:03:47.695 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348383+0000", 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9729e-05 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19337 4.b 4.2a59f0cb (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29766129800000002, 2024-09-12T18:03:47.696 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29892871100000001, 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:47.697 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335982+0000", 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335987+0000", 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.006e-06 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.698 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336008+0000", 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1248999999999999e-05 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336022+0000", 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.448e-05 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336081+0000", 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8526000000000002e-05 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336087+0000", 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6919999999999999e-06 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348475+0000", 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012388771999999999 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348487+0000", 2024-09-12T18:03:47.700 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19467 4.b 4.ad21f40b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29759560400000001, 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29895624799999998, 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.701 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.702 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336047+0000", 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.094e-06 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336053+0000", 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.113e-06 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.703 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336074+0000", 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1506e-05 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336087+0000", 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3373000000000001e-05 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336138+0000", 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0217999999999999e-05 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.704 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336143+0000", 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4419999999999997e-06 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348572+0000", 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012429295999999999 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348595+0000", 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2671999999999999e-05 2024-09-12T18:03:47.705 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19501 4.b 4.d5658f8b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29753037900000001, 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29902076599999999, 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.706 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336113+0000", 2024-09-12T18:03:47.707 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-06 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336118+0000", 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0699999999999997e-06 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336136+0000", 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8286000000000001e-05 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.708 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336150+0000", 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3842999999999999e-05 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336200+0000", 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0123000000000001e-05 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336205+0000", 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3839999999999996e-06 2024-09-12T18:03:47.709 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348675+0000", 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012470088000000001 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348695+0000", 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9680000000000001e-05 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19539 4.b 4.2f7d004b (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29746841299999999, 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29904830100000002, 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.711 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336175+0000", 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.006e-06 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.712 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336180+0000", 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.023e-06 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336199+0000", 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9323000000000001e-05 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336213+0000", 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4187e-05 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.713 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336266+0000", 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2649999999999999e-05 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336271+0000", 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2700000000000004e-06 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348780+0000", 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012509456 2024-09-12T18:03:47.714 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348805+0000", 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4663000000000001e-05 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19587 4.b 4.77a43acb (undecoded) ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.29740449499999999, 2024-09-12T18:03:47.715 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.29907378099999998, 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "waiting for peered", 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:47.716 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336239+0000", 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.13e-06 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336243+0000", 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8860000000000003e-06 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:47.717 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336263+0000", 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9856000000000001e-05 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336276+0000", 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.293e-05 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336326+0000", 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9895999999999998e-05 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.718 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336332+0000", 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5419999999999996e-06 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348924+0000", 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012592671999999999 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348948+0000", 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3791e-05 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.719 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-12T18:03:47.720 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 18 2024-09-12T18:03:47.720 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:47.722 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:47.718+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:47.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:47.724 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:47.726 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:47.727 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-09-12T18:03:47.333082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136990027,"num_objects":2109,"num_object_clones":0,"num_object_copies":4218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3333,"num_objects_misplaced":19,"num_objects_unfound":0,"num_objects_dirty":2109,"num_whiteouts":0,"num_read":2682,"num_read_kb":1271992,"num_write":26667,"num_write_kb":4154813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":34141323,"num_keys_recovered":576,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29590,"ondisk_log_size":29590,"up":210,"acting":183,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":286736,"kb_used_data":116800,"kb_used_omap":4,"kb_used_meta":169787,"kb_avail":282828784,"statfs":{"total":289910292480,"available":289616674816,"internally_reserved":0,"allocated":119603200,"data_stored":282485487,"data_compressed":43399728,"data_compressed_allocated":55205888,"data_compressed_original":232267776,"omap_allocated":4785,"internal_metadata":173862223},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.015294"},"pg_stats":[{"pgid":"4.3f","version":"61'393","reported_seq":538,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.243437+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:42.243437+0000","last_peered":"2024-09-12T18:03:42.243437+0000","last_clean":"2024-09-12T18:03:42.243437+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:42.243437+0000","last_undegraded":"2024-09-12T18:03:42.243437+0000","last_fullsized":"2024-09-12T18:03:42.243437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282524,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":372,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"61'412","reported_seq":581,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.267664+0000","last_change":"2024-09-12T18:03:42.059630+0000","last_active":"2024-09-12T18:03:42.267664+0000","last_peered":"2024-09-12T18:03:42.267664+0000","last_clean":"2024-09-12T18:03:38.936262+0000","last_became_active":"2024-09-12T18:03:42.058566+0000","last_became_peered":"2024-09-12T18:03:42.058566+0000","last_unstale":"2024-09-12T18:03:42.267664+0000","last_undegraded":"2024-09-12T18:03:41.974628+0000","last_fullsized":"2024-09-12T18:03:41.972330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305806,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":186,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":384,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-21},{"shards":"1,2","objects":48}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"61'333","reported_seq":444,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.226683+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:42.226683+0000","last_peered":"2024-09-12T18:03:42.226683+0000","last_clean":"2024-09-12T18:03:42.226683+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:42.226683+0000","last_undegraded":"2024-09-12T18:03:42.226683+0000","last_fullsized":"2024-09-12T18:03:42.226683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144362,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":310,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"61'331","reported_seq":451,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.285836+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:42.285836+0000","last_peered":"2024-09-12T18:03:42.285836+0000","last_clean":"2024-09-12T18:03:42.285836+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:42.285836+0000","last_undegraded":"2024-09-12T18:03:42.285836+0000","last_fullsized":"2024-09-12T18:03:42.285836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169447,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":300,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"61'423","reported_seq":589,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.279007+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:42.279007+0000","last_peered":"2024-09-12T18:03:42.279007+0000","last_clean":"2024-09-12T18:03:42.279007+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:42.279007+0000","last_undegraded":"2024-09-12T18:03:42.279007+0000","last_fullsized":"2024-09-12T18:03:42.279007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111097,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":402,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"61'337","reported_seq":449,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.237288+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:42.237288+0000","last_peered":"2024-09-12T18:03:42.237288+0000","last_clean":"2024-09-12T18:03:42.237288+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:42.237288+0000","last_undegraded":"2024-09-12T18:03:42.237288+0000","last_fullsized":"2024-09-12T18:03:42.237288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209491,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":315,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"61'391","reported_seq":554,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.248717+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:42.248717+0000","last_peered":"2024-09-12T18:03:42.248717+0000","last_clean":"2024-09-12T18:03:42.248717+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:42.248717+0000","last_undegraded":"2024-09-12T18:03:42.248717+0000","last_fullsized":"2024-09-12T18:03:42.248717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528381,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":369,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"61'377","reported_seq":547,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.291371+0000","last_change":"2024-09-12T18:03:42.054549+0000","last_active":"2024-09-12T18:03:42.291371+0000","last_peered":"2024-09-12T18:03:42.291371+0000","last_clean":"2024-09-12T18:03:39.938070+0000","last_became_active":"2024-09-12T18:03:42.051143+0000","last_became_peered":"2024-09-12T18:03:42.051143+0000","last_unstale":"2024-09-12T18:03:42.291371+0000","last_undegraded":"2024-09-12T18:03:41.968420+0000","last_fullsized":"2024-09-12T18:03:41.961304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":479438,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":348,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-18},{"shards":"0,2","objects":26}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"61'347","reported_seq":453,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.285020+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:42.285020+0000","last_peered":"2024-09-12T18:03:42.285020+0000","last_clean":"2024-09-12T18:03:42.285020+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:42.285020+0000","last_undegraded":"2024-09-12T18:03:42.285020+0000","last_fullsized":"2024-09-12T18:03:42.285020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242458,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":320,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"61'356","reported_seq":518,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.248280+0000","last_change":"2024-09-12T18:03:42.056275+0000","last_active":"2024-09-12T18:03:42.248280+0000","last_peered":"2024-09-12T18:03:42.248280+0000","last_clean":"2024-09-12T18:03:39.946744+0000","last_became_active":"2024-09-12T18:03:42.054676+0000","last_became_peered":"2024-09-12T18:03:42.054676+0000","last_unstale":"2024-09-12T18:03:42.248280+0000","last_undegraded":"2024-09-12T18:03:41.971688+0000","last_fullsized":"2024-09-12T18:03:41.963105+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148524,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":342,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-23},{"shards":"1,2","objects":30}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"61'330","reported_seq":470,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.286028+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:42.286028+0000","last_peered":"2024-09-12T18:03:42.286028+0000","last_clean":"2024-09-12T18:03:42.286028+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:42.286028+0000","last_undegraded":"2024-09-12T18:03:42.286028+0000","last_fullsized":"2024-09-12T18:03:42.286028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121556,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":315,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"61'326","reported_seq":453,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.287981+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:42.287981+0000","last_peered":"2024-09-12T18:03:42.287981+0000","last_clean":"2024-09-12T18:03:42.287981+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:42.287981+0000","last_undegraded":"2024-09-12T18:03:42.287981+0000","last_fullsized":"2024-09-12T18:03:42.287981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115685,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":308,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"61'339","reported_seq":448,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.270116+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:42.270116+0000","last_peered":"2024-09-12T18:03:42.270116+0000","last_clean":"2024-09-12T18:03:42.270116+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:42.270116+0000","last_undegraded":"2024-09-12T18:03:42.270116+0000","last_fullsized":"2024-09-12T18:03:42.270116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212138,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":314,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"61'382","reported_seq":527,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.281565+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:42.281565+0000","last_peered":"2024-09-12T18:03:42.281565+0000","last_clean":"2024-09-12T18:03:42.281565+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:42.281565+0000","last_undegraded":"2024-09-12T18:03:42.281565+0000","last_fullsized":"2024-09-12T18:03:42.281565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265415,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":362,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"61'394","reported_seq":528,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.242763+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:42.242763+0000","last_peered":"2024-09-12T18:03:42.242763+0000","last_clean":"2024-09-12T18:03:42.242763+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:42.242763+0000","last_undegraded":"2024-09-12T18:03:42.242763+0000","last_fullsized":"2024-09-12T18:03:42.242763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630805,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":364,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"61'425","reported_seq":597,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.258650+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:42.258650+0000","last_peered":"2024-09-12T18:03:42.258650+0000","last_clean":"2024-09-12T18:03:42.258650+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:42.258650+0000","last_undegraded":"2024-09-12T18:03:42.258650+0000","last_fullsized":"2024-09-12T18:03:42.258650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362146,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":402,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"61'388","reported_seq":521,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.252372+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:42.252372+0000","last_peered":"2024-09-12T18:03:42.252372+0000","last_clean":"2024-09-12T18:03:42.252372+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:42.252372+0000","last_undegraded":"2024-09-12T18:03:42.252372+0000","last_fullsized":"2024-09-12T18:03:42.252372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170403,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":365,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"61'363","reported_seq":489,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.249861+0000","last_change":"2024-09-12T18:03:42.060803+0000","last_active":"2024-09-12T18:03:42.249861+0000","last_peered":"2024-09-12T18:03:42.249861+0000","last_clean":"2024-09-12T18:03:39.944065+0000","last_became_active":"2024-09-12T18:03:42.058753+0000","last_became_peered":"2024-09-12T18:03:42.058753+0000","last_unstale":"2024-09-12T18:03:42.249861+0000","last_undegraded":"2024-09-12T18:03:41.974699+0000","last_fullsized":"2024-09-12T18:03:41.972473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186427,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":338,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-25},{"shards":"1,2","objects":31}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"61'412","reported_seq":576,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.288318+0000","last_change":"2024-09-12T18:03:42.059328+0000","last_active":"2024-09-12T18:03:42.288318+0000","last_peered":"2024-09-12T18:03:42.288318+0000","last_clean":"2024-09-12T18:03:39.933624+0000","last_became_active":"2024-09-12T18:03:42.029653+0000","last_became_peered":"2024-09-12T18:03:42.029653+0000","last_unstale":"2024-09-12T18:03:42.288318+0000","last_undegraded":"2024-09-12T18:03:41.966171+0000","last_fullsized":"2024-09-12T18:03:41.962893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198173,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":380,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-13},{"shards":"1,2","objects":37}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'391","reported_seq":508,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.251950+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:42.251950+0000","last_peered":"2024-09-12T18:03:42.251950+0000","last_clean":"2024-09-12T18:03:42.251950+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:42.251950+0000","last_undegraded":"2024-09-12T18:03:42.251950+0000","last_fullsized":"2024-09-12T18:03:42.251950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174443,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":364,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"61'354","reported_seq":470,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.281850+0000","last_change":"2024-09-12T18:03:42.053468+0000","last_active":"2024-09-12T18:03:42.281850+0000","last_peered":"2024-09-12T18:03:42.281850+0000","last_clean":"2024-09-12T18:03:39.923110+0000","last_became_active":"2024-09-12T18:03:42.049745+0000","last_became_peered":"2024-09-12T18:03:42.049745+0000","last_unstale":"2024-09-12T18:03:42.281850+0000","last_undegraded":"2024-09-12T18:03:41.991593+0000","last_fullsized":"2024-09-12T18:03:41.978686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287651,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":343,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-19},{"shards":"0,2","objects":29}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'397","reported_seq":546,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.280455+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:42.280455+0000","last_peered":"2024-09-12T18:03:42.280455+0000","last_clean":"2024-09-12T18:03:42.280455+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:42.280455+0000","last_undegraded":"2024-09-12T18:03:42.280455+0000","last_fullsized":"2024-09-12T18:03:42.280455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":376,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"61'367","reported_seq":485,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.281819+0000","last_change":"2024-09-12T18:03:42.047639+0000","last_active":"2024-09-12T18:03:42.281819+0000","last_peered":"2024-09-12T18:03:42.281819+0000","last_clean":"2024-09-12T18:03:39.873173+0000","last_became_active":"2024-09-12T18:03:42.040585+0000","last_became_peered":"2024-09-12T18:03:42.040585+0000","last_unstale":"2024-09-12T18:03:42.281819+0000","last_undegraded":"2024-09-12T18:03:41.968284+0000","last_fullsized":"2024-09-12T18:03:41.961597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222795,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":335,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-17},{"shards":"0,2","objects":34}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"61'418","reported_seq":569,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.269903+0000","last_change":"2024-09-12T18:03:42.057282+0000","last_active":"2024-09-12T18:03:42.269903+0000","last_peered":"2024-09-12T18:03:42.269903+0000","last_clean":"2024-09-12T18:03:39.936313+0000","last_became_active":"2024-09-12T18:03:42.054140+0000","last_became_peered":"2024-09-12T18:03:42.054140+0000","last_unstale":"2024-09-12T18:03:42.269903+0000","last_undegraded":"2024-09-12T18:03:41.968807+0000","last_fullsized":"2024-09-12T18:03:41.962788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265559,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":396,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-19},{"shards":"1,2","objects":37}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"61'350","reported_seq":462,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.278966+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:42.278966+0000","last_peered":"2024-09-12T18:03:42.278966+0000","last_clean":"2024-09-12T18:03:42.278966+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:42.278966+0000","last_undegraded":"2024-09-12T18:03:42.278966+0000","last_fullsized":"2024-09-12T18:03:42.278966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375685,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":329,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"61'427","reported_seq":555,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.288380+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:42.288380+0000","last_peered":"2024-09-12T18:03:42.288380+0000","last_clean":"2024-09-12T18:03:42.288380+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:42.288380+0000","last_undegraded":"2024-09-12T18:03:42.288380+0000","last_fullsized":"2024-09-12T18:03:42.288380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656408,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":392,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"61'367","reported_seq":507,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.281674+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:42.281674+0000","last_peered":"2024-09-12T18:03:42.281674+0000","last_clean":"2024-09-12T18:03:42.281674+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:42.281674+0000","last_undegraded":"2024-09-12T18:03:42.281674+0000","last_fullsized":"2024-09-12T18:03:42.281674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231696,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":340,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"61'376","reported_seq":523,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.250191+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:42.250191+0000","last_peered":"2024-09-12T18:03:42.250191+0000","last_clean":"2024-09-12T18:03:42.250191+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:42.250191+0000","last_undegraded":"2024-09-12T18:03:42.250191+0000","last_fullsized":"2024-09-12T18:03:42.250191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177575,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":354,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"61'383","reported_seq":538,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.280166+0000","last_change":"2024-09-12T18:03:42.055335+0000","last_active":"2024-09-12T18:03:42.280166+0000","last_peered":"2024-09-12T18:03:42.280166+0000","last_clean":"2024-09-12T18:03:39.938932+0000","last_became_active":"2024-09-12T18:03:42.052344+0000","last_became_peered":"2024-09-12T18:03:42.052344+0000","last_unstale":"2024-09-12T18:03:42.280166+0000","last_undegraded":"2024-09-12T18:03:41.966574+0000","last_fullsized":"2024-09-12T18:03:41.962842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169992,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":352,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-13},{"shards":"1,2","objects":29}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'428","reported_seq":541,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.255703+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:42.255703+0000","last_peered":"2024-09-12T18:03:42.255703+0000","last_clean":"2024-09-12T18:03:42.255703+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:42.255703+0000","last_undegraded":"2024-09-12T18:03:42.255703+0000","last_fullsized":"2024-09-12T18:03:42.255703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174988,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":401,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'415","reported_seq":547,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.247747+0000","last_change":"2024-09-12T18:03:42.052483+0000","last_active":"2024-09-12T18:03:42.247747+0000","last_peered":"2024-09-12T18:03:42.247747+0000","last_clean":"2024-09-12T18:03:39.921701+0000","last_became_active":"2024-09-12T18:03:42.048662+0000","last_became_peered":"2024-09-12T18:03:42.048662+0000","last_unstale":"2024-09-12T18:03:42.247747+0000","last_undegraded":"2024-09-12T18:03:41.968614+0000","last_fullsized":"2024-09-12T18:03:41.963095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329987,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":399,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-21},{"shards":"1,2","objects":26}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'381","reported_seq":508,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.256522+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:42.256522+0000","last_peered":"2024-09-12T18:03:42.256522+0000","last_clean":"2024-09-12T18:03:42.256522+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:42.256522+0000","last_undegraded":"2024-09-12T18:03:42.256522+0000","last_fullsized":"2024-09-12T18:03:42.256522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670737,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":360,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"61'369","reported_seq":541,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.249876+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:42.249876+0000","last_peered":"2024-09-12T18:03:42.249876+0000","last_clean":"2024-09-12T18:03:42.249876+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:42.249876+0000","last_undegraded":"2024-09-12T18:03:42.249876+0000","last_fullsized":"2024-09-12T18:03:42.249876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174763,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":343,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"61'430","reported_seq":529,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.213331+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:42.213331+0000","last_peered":"2024-09-12T18:03:42.213331+0000","last_clean":"2024-09-12T18:03:42.213331+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:42.213331+0000","last_undegraded":"2024-09-12T18:03:42.213331+0000","last_fullsized":"2024-09-12T18:03:42.213331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"61'338","reported_seq":471,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.240610+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:42.240610+0000","last_peered":"2024-09-12T18:03:42.240610+0000","last_clean":"2024-09-12T18:03:42.240610+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:42.240610+0000","last_undegraded":"2024-09-12T18:03:42.240610+0000","last_fullsized":"2024-09-12T18:03:42.240610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179916,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":311,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"61'33","reported_seq":131,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.197186+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:42.197186+0000","last_peered":"2024-09-12T18:03:42.197186+0000","last_clean":"2024-09-12T18:03:42.197186+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:42.197186+0000","last_undegraded":"2024-09-12T18:03:42.197186+0000","last_fullsized":"2024-09-12T18:03:42.197186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"61'374","reported_seq":496,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.256191+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:42.256191+0000","last_peered":"2024-09-12T18:03:42.256191+0000","last_clean":"2024-09-12T18:03:42.256191+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:42.256191+0000","last_undegraded":"2024-09-12T18:03:42.256191+0000","last_fullsized":"2024-09-12T18:03:42.256191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220026,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":348,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"61'54","reported_seq":152,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.208377+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:42.208377+0000","last_peered":"2024-09-12T18:03:42.208377+0000","last_clean":"2024-09-12T18:03:42.208377+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:42.208377+0000","last_undegraded":"2024-09-12T18:03:42.208377+0000","last_fullsized":"2024-09-12T18:03:42.208377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"61'366","reported_seq":498,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.240653+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:42.240653+0000","last_peered":"2024-09-12T18:03:42.240653+0000","last_clean":"2024-09-12T18:03:42.240653+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:42.240653+0000","last_undegraded":"2024-09-12T18:03:42.240653+0000","last_fullsized":"2024-09-12T18:03:42.240653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256226,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":343,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"61'47","reported_seq":146,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.223154+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:42.223154+0000","last_peered":"2024-09-12T18:03:42.223154+0000","last_clean":"2024-09-12T18:03:42.223154+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:42.223154+0000","last_undegraded":"2024-09-12T18:03:42.223154+0000","last_fullsized":"2024-09-12T18:03:42.223154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'123","reported_seq":222,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.197058+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:42.197058+0000","last_peered":"2024-09-12T18:03:42.197058+0000","last_clean":"2024-09-12T18:03:42.197058+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:42.197058+0000","last_undegraded":"2024-09-12T18:03:42.197058+0000","last_fullsized":"2024-09-12T18:03:42.197058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"61'384","reported_seq":506,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.231893+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:42.231893+0000","last_peered":"2024-09-12T18:03:42.231893+0000","last_clean":"2024-09-12T18:03:42.231893+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:42.231893+0000","last_undegraded":"2024-09-12T18:03:42.231893+0000","last_fullsized":"2024-09-12T18:03:42.231893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261946,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":356,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'239","reported_seq":337,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.218187+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:42.218187+0000","last_peered":"2024-09-12T18:03:42.218187+0000","last_clean":"2024-09-12T18:03:42.218187+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:42.218187+0000","last_undegraded":"2024-09-12T18:03:42.218187+0000","last_fullsized":"2024-09-12T18:03:42.218187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"61'413","reported_seq":544,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.290652+0000","last_change":"2024-09-12T18:03:42.049969+0000","last_active":"2024-09-12T18:03:42.290652+0000","last_peered":"2024-09-12T18:03:42.290652+0000","last_clean":"2024-09-12T18:03:39.941028+0000","last_became_active":"2024-09-12T18:03:42.048007+0000","last_became_peered":"2024-09-12T18:03:42.048007+0000","last_unstale":"2024-09-12T18:03:42.290652+0000","last_undegraded":"2024-09-12T18:03:41.970376+0000","last_fullsized":"2024-09-12T18:03:41.962798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249782,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":383,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-18},{"shards":"1,2","objects":44}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"61'371","reported_seq":470,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.216203+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:42.216203+0000","last_peered":"2024-09-12T18:03:42.216203+0000","last_clean":"2024-09-12T18:03:42.216203+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:42.216203+0000","last_undegraded":"2024-09-12T18:03:42.216203+0000","last_fullsized":"2024-09-12T18:03:42.216203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'381","reported_seq":519,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.285814+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:42.285814+0000","last_peered":"2024-09-12T18:03:42.285814+0000","last_clean":"2024-09-12T18:03:42.285814+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:42.285814+0000","last_undegraded":"2024-09-12T18:03:42.285814+0000","last_fullsized":"2024-09-12T18:03:42.285814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281551,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":346,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'39","reported_seq":138,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.199761+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:42.199761+0000","last_peered":"2024-09-12T18:03:42.199761+0000","last_clean":"2024-09-12T18:03:42.199761+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:42.199761+0000","last_undegraded":"2024-09-12T18:03:42.199761+0000","last_fullsized":"2024-09-12T18:03:42.199761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"61'400","reported_seq":532,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.286050+0000","last_change":"2024-09-12T18:03:42.052385+0000","last_active":"2024-09-12T18:03:42.286050+0000","last_peered":"2024-09-12T18:03:42.286050+0000","last_clean":"2024-09-12T18:03:39.903630+0000","last_became_active":"2024-09-12T18:03:42.046109+0000","last_became_peered":"2024-09-12T18:03:42.046109+0000","last_unstale":"2024-09-12T18:03:42.286050+0000","last_undegraded":"2024-09-12T18:03:41.972774+0000","last_fullsized":"2024-09-12T18:03:41.961990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165519,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":373,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-20},{"shards":"0,2","objects":30}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"61'138","reported_seq":235,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.279167+0000","last_change":"2024-09-12T18:03:42.279167+0000","last_active":"2024-09-12T18:03:42.279167+0000","last_peered":"2024-09-12T18:03:42.279167+0000","last_clean":"2024-09-12T18:03:36.673274+0000","last_became_active":"2024-09-12T18:03:42.049138+0000","last_became_peered":"2024-09-12T18:03:42.049138+0000","last_unstale":"2024-09-12T18:03:42.279167+0000","last_undegraded":"2024-09-12T18:03:42.279167+0000","last_fullsized":"2024-09-12T18:03:41.976876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":3}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"61'410","reported_seq":548,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.255291+0000","last_change":"2024-09-12T18:03:42.038748+0000","last_active":"2024-09-12T18:03:42.255291+0000","last_peered":"2024-09-12T18:03:42.255291+0000","last_clean":"2024-09-12T18:03:39.945369+0000","last_became_active":"2024-09-12T18:03:42.030067+0000","last_became_peered":"2024-09-12T18:03:42.030067+0000","last_unstale":"2024-09-12T18:03:42.255291+0000","last_undegraded":"2024-09-12T18:03:41.978274+0000","last_fullsized":"2024-09-12T18:03:41.964450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386360,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":381,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-19},{"shards":"0,2","objects":41}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'103","reported_seq":202,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.233175+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:42.233175+0000","last_peered":"2024-09-12T18:03:42.233175+0000","last_clean":"2024-09-12T18:03:42.233175+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:42.233175+0000","last_undegraded":"2024-09-12T18:03:42.233175+0000","last_fullsized":"2024-09-12T18:03:42.233175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"61'377","reported_seq":529,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.252356+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:42.252356+0000","last_peered":"2024-09-12T18:03:42.252356+0000","last_clean":"2024-09-12T18:03:42.252356+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:42.252356+0000","last_undegraded":"2024-09-12T18:03:42.252356+0000","last_fullsized":"2024-09-12T18:03:42.252356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138042,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":354,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'40","reported_seq":138,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.215573+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:42.215573+0000","last_peered":"2024-09-12T18:03:42.215573+0000","last_clean":"2024-09-12T18:03:42.215573+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:42.215573+0000","last_undegraded":"2024-09-12T18:03:42.215573+0000","last_fullsized":"2024-09-12T18:03:42.215573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'344","reported_seq":477,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.270924+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:42.270924+0000","last_peered":"2024-09-12T18:03:42.270924+0000","last_clean":"2024-09-12T18:03:42.270924+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:42.270924+0000","last_undegraded":"2024-09-12T18:03:42.270924+0000","last_fullsized":"2024-09-12T18:03:42.270924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169889,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":318,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'468","reported_seq":572,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.132804+0000","last_change":"2024-09-12T18:03:42.132804+0000","last_active":"2024-09-12T18:03:42.132804+0000","last_peered":"2024-09-12T18:03:42.132804+0000","last_clean":"2024-09-12T18:03:39.902250+0000","last_became_active":"2024-09-12T18:03:42.054254+0000","last_became_peered":"2024-09-12T18:03:42.054254+0000","last_unstale":"2024-09-12T18:03:42.132804+0000","last_undegraded":"2024-09-12T18:03:42.132804+0000","last_fullsized":"2024-09-12T18:03:41.962793+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"61'341","reported_seq":456,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.252350+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:42.252350+0000","last_peered":"2024-09-12T18:03:42.252350+0000","last_clean":"2024-09-12T18:03:42.252350+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:42.252350+0000","last_undegraded":"2024-09-12T18:03:42.252350+0000","last_fullsized":"2024-09-12T18:03:42.252350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186045,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":306,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":249,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.980461+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:41.980461+0000","last_peered":"2024-09-12T18:03:41.980461+0000","last_clean":"2024-09-12T18:03:41.980461+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:41.980461+0000","last_undegraded":"2024-09-12T18:03:41.980461+0000","last_fullsized":"2024-09-12T18:03:41.980461+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.985253+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:41.985253+0000","last_peered":"2024-09-12T18:03:41.985253+0000","last_clean":"2024-09-12T18:03:41.985253+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:41.985253+0000","last_undegraded":"2024-09-12T18:03:41.985253+0000","last_fullsized":"2024-09-12T18:03:41.985253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'550","reported_seq":648,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.234908+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:42.234908+0000","last_peered":"2024-09-12T18:03:42.234908+0000","last_clean":"2024-09-12T18:03:42.234908+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:42.234908+0000","last_undegraded":"2024-09-12T18:03:42.234908+0000","last_fullsized":"2024-09-12T18:03:42.234908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"61'397","reported_seq":515,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.277530+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:42.277530+0000","last_peered":"2024-09-12T18:03:42.277530+0000","last_clean":"2024-09-12T18:03:42.277530+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:42.277530+0000","last_undegraded":"2024-09-12T18:03:42.277530+0000","last_fullsized":"2024-09-12T18:03:42.277530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359392,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":360,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.980026+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:41.980026+0000","last_peered":"2024-09-12T18:03:41.980026+0000","last_clean":"2024-09-12T18:03:41.980026+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:41.980026+0000","last_undegraded":"2024-09-12T18:03:41.980026+0000","last_fullsized":"2024-09-12T18:03:41.980026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"61'106","reported_seq":256,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.285876+0000","last_change":"2024-09-12T18:03:41.005215+0000","last_active":"2024-09-12T18:03:42.285876+0000","last_peered":"2024-09-12T18:03:42.285876+0000","last_clean":"2024-09-12T18:03:42.285876+0000","last_became_active":"2024-09-12T18:03:40.983480+0000","last_became_peered":"2024-09-12T18:03:40.983480+0000","last_unstale":"2024-09-12T18:03:42.285876+0000","last_undegraded":"2024-09-12T18:03:42.285876+0000","last_fullsized":"2024-09-12T18:03:42.285876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:26.563361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1219373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1144,"num_write":49,"num_write_kb":1225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1106253,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"61'413","reported_seq":578,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.244655+0000","last_change":"2024-09-12T18:03:42.056375+0000","last_active":"2024-09-12T18:03:42.244655+0000","last_peered":"2024-09-12T18:03:42.244655+0000","last_clean":"2024-09-12T18:03:39.941039+0000","last_became_active":"2024-09-12T18:03:42.054484+0000","last_became_peered":"2024-09-12T18:03:42.054484+0000","last_unstale":"2024-09-12T18:03:42.244655+0000","last_undegraded":"2024-09-12T18:03:41.972071+0000","last_fullsized":"2024-09-12T18:03:41.962975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428266,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":395,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-20},{"shards":"1,2","objects":41}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.961187+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:41.961187+0000","last_peered":"2024-09-12T18:03:41.961187+0000","last_clean":"2024-09-12T18:03:41.961187+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:41.961187+0000","last_undegraded":"2024-09-12T18:03:41.961187+0000","last_fullsized":"2024-09-12T18:03:41.961187+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"61'361","reported_seq":459,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.137974+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:42.137974+0000","last_peered":"2024-09-12T18:03:42.137974+0000","last_clean":"2024-09-12T18:03:42.137974+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:42.137974+0000","last_undegraded":"2024-09-12T18:03:42.137974+0000","last_fullsized":"2024-09-12T18:03:42.137974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"61'320","reported_seq":737,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.641185+0000","last_change":"2024-09-12T18:03:42.641185+0000","last_active":"2024-09-12T18:03:42.641185+0000","last_peered":"2024-09-12T18:03:42.641185+0000","last_clean":"2024-09-12T18:03:39.906018+0000","last_became_active":"2024-09-12T18:03:42.029327+0000","last_became_peered":"2024-09-12T18:03:42.029327+0000","last_unstale":"2024-09-12T18:03:42.641185+0000","last_undegraded":"2024-09-12T18:03:42.641185+0000","last_fullsized":"2024-09-12T18:03:41.963571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130192,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":295,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1","objects":22}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":124,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.964335+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:41.964335+0000","last_peered":"2024-09-12T18:03:41.964335+0000","last_clean":"2024-09-12T18:03:41.964335+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:41.964335+0000","last_undegraded":"2024-09-12T18:03:41.964335+0000","last_fullsized":"2024-09-12T18:03:41.964335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'61","reported_seq":160,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.205065+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:42.205065+0000","last_peered":"2024-09-12T18:03:42.205065+0000","last_clean":"2024-09-12T18:03:42.205065+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:42.205065+0000","last_undegraded":"2024-09-12T18:03:42.205065+0000","last_fullsized":"2024-09-12T18:03:42.205065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'385","reported_seq":567,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.224930+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:42.224930+0000","last_peered":"2024-09-12T18:03:42.224930+0000","last_clean":"2024-09-12T18:03:42.224930+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:42.224930+0000","last_undegraded":"2024-09-12T18:03:42.224930+0000","last_fullsized":"2024-09-12T18:03:42.224930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123722,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":358,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"61'48","reported_seq":147,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.103744+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:42.103744+0000","last_peered":"2024-09-12T18:03:42.103744+0000","last_clean":"2024-09-12T18:03:42.103744+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:42.103744+0000","last_undegraded":"2024-09-12T18:03:42.103744+0000","last_fullsized":"2024-09-12T18:03:42.103744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.962721+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:41.962721+0000","last_peered":"2024-09-12T18:03:41.962721+0000","last_clean":"2024-09-12T18:03:41.962721+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:41.962721+0000","last_undegraded":"2024-09-12T18:03:41.962721+0000","last_fullsized":"2024-09-12T18:03:41.962721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"61'327","reported_seq":450,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.213300+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:42.213300+0000","last_peered":"2024-09-12T18:03:42.213300+0000","last_clean":"2024-09-12T18:03:42.213300+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:42.213300+0000","last_undegraded":"2024-09-12T18:03:42.213300+0000","last_fullsized":"2024-09-12T18:03:42.213300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88150,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":301,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"61'35","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.231847+0000","last_change":"2024-09-12T18:03:40.978262+0000","last_active":"2024-09-12T18:03:42.231847+0000","last_peered":"2024-09-12T18:03:42.231847+0000","last_clean":"2024-09-12T18:03:42.231847+0000","last_became_active":"2024-09-12T18:03:40.977028+0000","last_became_peered":"2024-09-12T18:03:40.977028+0000","last_unstale":"2024-09-12T18:03:42.231847+0000","last_undegraded":"2024-09-12T18:03:42.231847+0000","last_fullsized":"2024-09-12T18:03:42.231847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.970846+0000","last_change":"2024-09-12T18:03:40.977985+0000","last_active":"2024-09-12T18:03:41.970846+0000","last_peered":"2024-09-12T18:03:41.970846+0000","last_clean":"2024-09-12T18:03:41.970846+0000","last_became_active":"2024-09-12T18:03:40.975455+0000","last_became_peered":"2024-09-12T18:03:40.975455+0000","last_unstale":"2024-09-12T18:03:41.970846+0000","last_undegraded":"2024-09-12T18:03:41.970846+0000","last_fullsized":"2024-09-12T18:03:41.970846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:08.975777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'351","reported_seq":480,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.287923+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:42.287923+0000","last_peered":"2024-09-12T18:03:42.287923+0000","last_clean":"2024-09-12T18:03:42.287923+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:42.287923+0000","last_undegraded":"2024-09-12T18:03:42.287923+0000","last_fullsized":"2024-09-12T18:03:42.287923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102549,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":325,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"61'43","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.153121+0000","last_change":"2024-09-12T18:03:40.988959+0000","last_active":"2024-09-12T18:03:42.153121+0000","last_peered":"2024-09-12T18:03:42.153121+0000","last_clean":"2024-09-12T18:03:42.153121+0000","last_became_active":"2024-09-12T18:03:40.977475+0000","last_became_peered":"2024-09-12T18:03:40.977475+0000","last_unstale":"2024-09-12T18:03:42.153121+0000","last_undegraded":"2024-09-12T18:03:42.153121+0000","last_fullsized":"2024-09-12T18:03:42.153121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:16.546031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.977524+0000","last_change":"2024-09-12T18:03:41.012135+0000","last_active":"2024-09-12T18:03:41.977524+0000","last_peered":"2024-09-12T18:03:41.977524+0000","last_clean":"2024-09-12T18:03:41.977524+0000","last_became_active":"2024-09-12T18:03:41.007972+0000","last_became_peered":"2024-09-12T18:03:41.007972+0000","last_unstale":"2024-09-12T18:03:41.977524+0000","last_undegraded":"2024-09-12T18:03:41.977524+0000","last_fullsized":"2024-09-12T18:03:41.977524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:34.771948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'358","reported_seq":461,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.291197+0000","last_change":"2024-09-12T18:03:42.054380+0000","last_active":"2024-09-12T18:03:42.291197+0000","last_peered":"2024-09-12T18:03:42.291197+0000","last_clean":"2024-09-12T18:03:39.881401+0000","last_became_active":"2024-09-12T18:03:42.050483+0000","last_became_peered":"2024-09-12T18:03:42.050483+0000","last_unstale":"2024-09-12T18:03:42.291197+0000","last_undegraded":"2024-09-12T18:03:41.967738+0000","last_fullsized":"2024-09-12T18:03:41.961302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169598,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":336,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-19},{"shards":"0,2","objects":28}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'90","reported_seq":191,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.200102+0000","last_change":"2024-09-12T18:03:41.017409+0000","last_active":"2024-09-12T18:03:42.200102+0000","last_peered":"2024-09-12T18:03:42.200102+0000","last_clean":"2024-09-12T18:03:42.200102+0000","last_became_active":"2024-09-12T18:03:40.982409+0000","last_became_peered":"2024-09-12T18:03:40.982409+0000","last_unstale":"2024-09-12T18:03:42.200102+0000","last_undegraded":"2024-09-12T18:03:42.200102+0000","last_fullsized":"2024-09-12T18:03:42.200102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:13.263023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":576,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.971889+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:41.971889+0000","last_peered":"2024-09-12T18:03:41.971889+0000","last_clean":"2024-09-12T18:03:41.971889+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:41.971889+0000","last_undegraded":"2024-09-12T18:03:41.971889+0000","last_fullsized":"2024-09-12T18:03:41.971889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"61'345","reported_seq":491,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.267402+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:42.267402+0000","last_peered":"2024-09-12T18:03:42.267402+0000","last_clean":"2024-09-12T18:03:42.267402+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:42.267402+0000","last_undegraded":"2024-09-12T18:03:42.267402+0000","last_fullsized":"2024-09-12T18:03:42.267402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295418,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":313,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"61'358","reported_seq":496,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.242617+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:42.242617+0000","last_peered":"2024-09-12T18:03:42.242617+0000","last_clean":"2024-09-12T18:03:42.242617+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:42.242617+0000","last_undegraded":"2024-09-12T18:03:42.242617+0000","last_fullsized":"2024-09-12T18:03:42.242617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167501,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":336,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"61'218","reported_seq":317,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.218515+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:42.218515+0000","last_peered":"2024-09-12T18:03:42.218515+0000","last_clean":"2024-09-12T18:03:42.218515+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:42.218515+0000","last_undegraded":"2024-09-12T18:03:42.218515+0000","last_fullsized":"2024-09-12T18:03:42.218515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"61'398","reported_seq":535,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.239502+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:42.239502+0000","last_peered":"2024-09-12T18:03:42.239502+0000","last_clean":"2024-09-12T18:03:42.239502+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:42.239502+0000","last_undegraded":"2024-09-12T18:03:42.239502+0000","last_fullsized":"2024-09-12T18:03:42.239502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415237,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":371,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"61'75","reported_seq":173,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.200097+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:42.200097+0000","last_peered":"2024-09-12T18:03:42.200097+0000","last_clean":"2024-09-12T18:03:42.200097+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:42.200097+0000","last_undegraded":"2024-09-12T18:03:42.200097+0000","last_fullsized":"2024-09-12T18:03:42.200097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"61'166","reported_seq":271,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.670811+0000","last_change":"2024-09-12T18:03:42.306423+0000","last_active":"2024-09-12T18:03:42.670811+0000","last_peered":"2024-09-12T18:03:42.670811+0000","last_clean":"2024-09-12T18:03:39.944883+0000","last_became_active":"2024-09-12T18:03:42.051821+0000","last_became_peered":"2024-09-12T18:03:42.051821+0000","last_unstale":"2024-09-12T18:03:42.670811+0000","last_undegraded":"2024-09-12T18:03:42.670811+0000","last_fullsized":"2024-09-12T18:03:41.967679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3903637,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":3866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3329809,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'446","reported_seq":632,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.286107+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:42.286107+0000","last_peered":"2024-09-12T18:03:42.286107+0000","last_clean":"2024-09-12T18:03:42.286107+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:42.286107+0000","last_undegraded":"2024-09-12T18:03:42.286107+0000","last_fullsized":"2024-09-12T18:03:42.286107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231538,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":418,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"61'50","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.239882+0000","last_change":"2024-09-12T18:03:40.983792+0000","last_active":"2024-09-12T18:03:42.239882+0000","last_peered":"2024-09-12T18:03:42.239882+0000","last_clean":"2024-09-12T18:03:42.239882+0000","last_became_active":"2024-09-12T18:03:40.982653+0000","last_became_peered":"2024-09-12T18:03:40.982653+0000","last_unstale":"2024-09-12T18:03:42.239882+0000","last_undegraded":"2024-09-12T18:03:42.239882+0000","last_fullsized":"2024-09-12T18:03:42.239882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"61'431","reported_seq":578,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.291142+0000","last_change":"2024-09-12T18:03:42.057858+0000","last_active":"2024-09-12T18:03:42.291142+0000","last_peered":"2024-09-12T18:03:42.291142+0000","last_clean":"2024-09-12T18:03:39.929532+0000","last_became_active":"2024-09-12T18:03:42.055190+0000","last_became_peered":"2024-09-12T18:03:42.055190+0000","last_unstale":"2024-09-12T18:03:42.291142+0000","last_undegraded":"2024-09-12T18:03:41.973632+0000","last_fullsized":"2024-09-12T18:03:41.971256+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110474,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":408,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-32},{"shards":"1,2","objects":25}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'344","reported_seq":477,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.252569+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:42.252569+0000","last_peered":"2024-09-12T18:03:42.252569+0000","last_clean":"2024-09-12T18:03:42.252569+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:42.252569+0000","last_undegraded":"2024-09-12T18:03:42.252569+0000","last_fullsized":"2024-09-12T18:03:42.252569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79595,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":325,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"61'638","reported_seq":736,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.222621+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:42.222621+0000","last_peered":"2024-09-12T18:03:42.222621+0000","last_clean":"2024-09-12T18:03:42.222621+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:42.222621+0000","last_undegraded":"2024-09-12T18:03:42.222621+0000","last_fullsized":"2024-09-12T18:03:42.222621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"61'399","reported_seq":560,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.286115+0000","last_change":"2024-09-12T18:03:42.057394+0000","last_active":"2024-09-12T18:03:42.286115+0000","last_peered":"2024-09-12T18:03:42.286115+0000","last_clean":"2024-09-12T18:03:39.932171+0000","last_became_active":"2024-09-12T18:03:42.054957+0000","last_became_peered":"2024-09-12T18:03:42.054957+0000","last_unstale":"2024-09-12T18:03:42.286115+0000","last_undegraded":"2024-09-12T18:03:41.977297+0000","last_fullsized":"2024-09-12T18:03:41.964490+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1550099,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":375,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-16},{"shards":"0,2","objects":34}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"61'206","reported_seq":308,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.280875+0000","last_change":"2024-09-12T18:03:42.182647+0000","last_active":"2024-09-12T18:03:42.280875+0000","last_peered":"2024-09-12T18:03:42.280875+0000","last_clean":"2024-09-12T18:03:39.381376+0000","last_became_active":"2024-09-12T18:03:42.039322+0000","last_became_peered":"2024-09-12T18:03:42.039322+0000","last_unstale":"2024-09-12T18:03:42.280875+0000","last_undegraded":"2024-09-12T18:03:42.280875+0000","last_fullsized":"2024-09-12T18:03:41.975194+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"61'354","reported_seq":488,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.267619+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:42.267619+0000","last_peered":"2024-09-12T18:03:42.267619+0000","last_clean":"2024-09-12T18:03:42.267619+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:42.267619+0000","last_undegraded":"2024-09-12T18:03:42.267619+0000","last_fullsized":"2024-09-12T18:03:42.267619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247056,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":324,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"61'84","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.233249+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:42.233249+0000","last_peered":"2024-09-12T18:03:42.233249+0000","last_clean":"2024-09-12T18:03:42.233249+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:42.233249+0000","last_undegraded":"2024-09-12T18:03:42.233249+0000","last_fullsized":"2024-09-12T18:03:42.233249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"61'341","reported_seq":463,"reported_epoch":61,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.665521+0000","last_change":"2024-09-12T18:03:42.642089+0000","last_active":"2024-09-12T18:03:42.665521+0000","last_peered":"2024-09-12T18:03:42.665521+0000","last_clean":"2024-09-12T18:03:39.935307+0000","last_became_active":"2024-09-12T18:03:42.035344+0000","last_became_peered":"2024-09-12T18:03:42.035344+0000","last_unstale":"2024-09-12T18:03:42.665521+0000","last_undegraded":"2024-09-12T18:03:41.970163+0000","last_fullsized":"2024-09-12T18:03:41.962841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307168,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14,"num_objects_misplaced":19,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":320,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-9},{"shards":"1,2","objects":19}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'43","reported_seq":141,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.098569+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:42.098569+0000","last_peered":"2024-09-12T18:03:42.098569+0000","last_clean":"2024-09-12T18:03:42.098569+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:42.098569+0000","last_undegraded":"2024-09-12T18:03:42.098569+0000","last_fullsized":"2024-09-12T18:03:42.098569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"61'337","reported_seq":449,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.248150+0000","last_change":"2024-09-12T18:03:42.051999+0000","last_active":"2024-09-12T18:03:42.248150+0000","last_peered":"2024-09-12T18:03:42.248150+0000","last_clean":"2024-09-12T18:03:39.940294+0000","last_became_active":"2024-09-12T18:03:42.046391+0000","last_became_peered":"2024-09-12T18:03:42.046391+0000","last_unstale":"2024-09-12T18:03:42.248150+0000","last_undegraded":"2024-09-12T18:03:41.972333+0000","last_fullsized":"2024-09-12T18:03:41.961784+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197214,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":318,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-18},{"shards":"0,2","objects":28}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'167","reported_seq":274,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.132206+0000","last_change":"2024-09-12T18:03:42.132206+0000","last_active":"2024-09-12T18:03:42.132206+0000","last_peered":"2024-09-12T18:03:42.132206+0000","last_clean":"2024-09-12T18:03:38.907259+0000","last_became_active":"2024-09-12T18:03:42.025295+0000","last_became_peered":"2024-09-12T18:03:42.025295+0000","last_unstale":"2024-09-12T18:03:42.132206+0000","last_undegraded":"2024-09-12T18:03:42.132206+0000","last_fullsized":"2024-09-12T18:03:41.965226+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"61'362","reported_seq":728,"reported_epoch":61,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.686694+0000","last_change":"2024-09-12T18:03:42.309635+0000","last_active":"2024-09-12T18:03:42.686694+0000","last_peered":"2024-09-12T18:03:42.686694+0000","last_clean":"2024-09-12T18:03:39.944833+0000","last_became_active":"2024-09-12T18:03:42.026552+0000","last_became_peered":"2024-09-12T18:03:42.026552+0000","last_unstale":"2024-09-12T18:03:42.686694+0000","last_undegraded":"2024-09-12T18:03:41.974228+0000","last_fullsized":"2024-09-12T18:03:41.963193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151595,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":340,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'262","reported_seq":360,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.247724+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:42.247724+0000","last_peered":"2024-09-12T18:03:42.247724+0000","last_clean":"2024-09-12T18:03:42.247724+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:42.247724+0000","last_undegraded":"2024-09-12T18:03:42.247724+0000","last_fullsized":"2024-09-12T18:03:42.247724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"61'350","reported_seq":471,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.246507+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:42.246507+0000","last_peered":"2024-09-12T18:03:42.246507+0000","last_clean":"2024-09-12T18:03:42.246507+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:42.246507+0000","last_undegraded":"2024-09-12T18:03:42.246507+0000","last_fullsized":"2024-09-12T18:03:42.246507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163750,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":326,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"61'47","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.232213+0000","last_change":"2024-09-12T18:03:41.059366+0000","last_active":"2024-09-12T18:03:42.232213+0000","last_peered":"2024-09-12T18:03:42.232213+0000","last_clean":"2024-09-12T18:03:42.232213+0000","last_became_active":"2024-09-12T18:03:40.982042+0000","last_became_peered":"2024-09-12T18:03:40.982042+0000","last_unstale":"2024-09-12T18:03:42.232213+0000","last_undegraded":"2024-09-12T18:03:42.232213+0000","last_fullsized":"2024-09-12T18:03:42.232213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"61'407","reported_seq":573,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.280181+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:42.280181+0000","last_peered":"2024-09-12T18:03:42.280181+0000","last_clean":"2024-09-12T18:03:42.280181+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:42.280181+0000","last_undegraded":"2024-09-12T18:03:42.280181+0000","last_fullsized":"2024-09-12T18:03:42.280181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198405,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":382,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'107","reported_seq":157,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.245056+0000","last_change":"2024-09-12T18:03:42.073116+0000","last_active":"2024-09-12T18:03:42.245056+0000","last_peered":"2024-09-12T18:03:42.245056+0000","last_clean":"2024-09-12T18:03:07.826588+0000","last_became_active":"2024-09-12T18:03:42.006307+0000","last_became_peered":"2024-09-12T18:03:42.006307+0000","last_unstale":"2024-09-12T18:03:42.245056+0000","last_undegraded":"2024-09-12T18:03:42.245056+0000","last_fullsized":"2024-09-12T18:03:41.967661+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":3}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":18028952,"num_objects":2055,"num_object_clones":0,"num_object_copies":4110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3333,"num_objects_misplaced":19,"num_objects_unfound":0,"num_objects_dirty":2055,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":22439,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":344532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35180544,"data_stored":38048198,"data_compressed":6772764,"data_compressed_allocated":8146944,"data_compressed_original":22159360,"omap_allocated":0,"internal_metadata":0},"log_size":24033,"ondisk_log_size":24033,"up":128,"acting":107,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":118370688,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":47,"num_read_kb":1144,"num_write":4081,"num_write_kb":118644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":33796772,"num_keys_recovered":576,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83046400,"data_stored":264178402,"data_compressed":40088380,"data_compressed_allocated":51101696,"data_compressed_original":232304640,"omap_allocated":0,"internal_metadata":0},"log_size":5442,"ondisk_log_size":5442,"up":64,"acting":58,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738396,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108248,"kb_used_data":36864,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94263592,"statfs":{"total":96636764160,"available":96525918208,"internally_reserved":0,"allocated":37748736,"data_stored":81682244,"data_compressed":12529567,"data_compressed_allocated":15921152,"data_compressed_original":64876544,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738396,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89536,"kb_used_data":40296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94282304,"statfs":{"total":96636764160,"available":96545079296,"internally_reserved":0,"allocated":41263104,"data_stored":93160216,"data_compressed":13879843,"data_compressed_allocated":17850368,"data_compressed_original":74883072,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88952,"kb_used_data":39640,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94282888,"statfs":{"total":96636764160,"available":96545677312,"internally_reserved":0,"allocated":40591360,"data_stored":107643027,"data_compressed":16990318,"data_compressed_allocated":21434368,"data_compressed_original":92508160,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28053504,"data_stored":93204864,"data_compressed":14423184,"data_compressed_allocated":18395136,"data_compressed_original":83578880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32423936,"data_stored":105772787,"data_compressed":16087864,"data_compressed_allocated":20324352,"data_compressed_original":93700096,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22568960,"data_stored":65200751,"data_compressed":9577332,"data_compressed_allocated":12382208,"data_compressed_original":55025664,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10915840,"data_stored":13124286,"data_compressed":2403853,"data_compressed_allocated":2867200,"data_compressed_original":8298496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9601024,"data_stored":8684130,"data_compressed":1416676,"data_compressed_allocated":1740800,"data_compressed_original":4009984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14663680,"data_stored":16239782,"data_compressed":2952235,"data_compressed_allocated":3538944,"data_compressed_original":9850880,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:47.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:47.822 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:47.822+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:47.892 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:47.893 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:47.893 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:47.893 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:47.893 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:47.908 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:47.923 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:47.922+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:48.024 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:48.022+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19283 4.16 4:6a54d456:::1000000001c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.80072106300000001, 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067243629999999999, 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231965+0000", 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231968+0000", 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3629999999999998e-06 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231978+0000", 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9990000000000003e-06 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231985+0000", 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0140000000000001e-06 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232114+0000", 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012873600000000001 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232343+0000", 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022858399999999999 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299208+0000", 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066865220000000003 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19298 4.26 4:645408ac:::1000000002b.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.232114+0000", 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.80057139700000002, 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066582493000000006, 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232114+0000", 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232114+0000", 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232115+0000", 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2470000000000001e-06 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232120+0000", 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0100000000000003e-06 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232132+0000", 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1786e-05 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232139+0000", 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1670000000000002e-06 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232259+0000", 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000120073 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232585+0000", 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032549500000000003 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.298696+0000", 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066111715000000001 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19300 4.26 4:660982fc:::1000000002d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.232155+0000", 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.80053061800000003, 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066647135999999996, 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232155+0000", 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232155+0000", 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232156+0000", 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232161+0000", 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1259999999999997e-06 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232178+0000", 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7164e-05 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232192+0000", 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3801999999999999e-05 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233604+0000", 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001411813 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233988+0000", 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00038432899999999999 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.298802+0000", 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064813782 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19311 4.26 4:65f9ba37:::10000000038.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.232295+0000", 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.80039027799999996, 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066693852999999997, 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232295+0000", 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232295+0000", 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232296+0000", 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.017e-06 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232301+0000", 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3090000000000003e-06 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232319+0000", 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7350000000000002e-05 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232331+0000", 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.278e-05 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235986+0000", 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036550979999999999 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236293+0000", 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00030693199999999999 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.298989+0000", 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.062695367000000002 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19322 4.16 4:6a415a36:::10000000043.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.232408+0000", 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.80027714100000003, 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066896786, 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232408+0000", 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232408+0000", 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232409+0000", 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.08e-06 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232414+0000", 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0200000000000002e-06 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232432+0000", 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7408999999999999e-05 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232446+0000", 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4253000000000001e-05 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235258+0000", 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002812251 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235605+0000", 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000347108 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299305+0000", 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.063699665000000003 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19325 4.26 4:678705fb:::10000000046.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.232465+0000", 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.80022049299999998, 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066657806999999999, 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232465+0000", 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232465+0000", 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232466+0000", 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.08e-06 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232471+0000", 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8930000000000004e-06 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232488+0000", 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6946999999999999e-05 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232501+0000", 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3602e-05 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.237273+0000", 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0047719889999999999 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.237627+0000", 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00035366800000000002 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299122+0000", 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.061495627999999997 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19335 4.16 4:69de5632:::10000000050.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.232667+0000", 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.80001833099999997, 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066823225999999999, 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232667+0000", 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232667+0000", 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232668+0000", 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.7600000000000006e-07 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232673+0000", 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9570000000000001e-06 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232695+0000", 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1722e-05 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232708+0000", 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3074000000000001e-05 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.239237+0000", 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0065297350000000001 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.239542+0000", 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000305035 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299490+0000", 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.059947726999999999 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19338 4.16 4:6a23747e:::10000000053.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.232725+0000", 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79995993700000001, 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067167305999999996, 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232725+0000", 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232725+0000", 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232726+0000", 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232731+0000", 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1329999999999998e-06 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232749+0000", 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7516999999999998e-05 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232761+0000", 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2266000000000001e-05 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.240761+0000", 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0079993660000000008 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.241047+0000", 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028650300000000002 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299893+0000", 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058845484000000003 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19354 4.26 4:66f1e28f:::10000000063.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.232779+0000", 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79990648799999997, 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066599493999999995, 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232779+0000", 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232779+0000", 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232780+0000", 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0300000000000001e-06 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232784+0000", 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7770000000000002e-06 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232801+0000", 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6858999999999999e-05 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232819+0000", 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7329999999999998e-05 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.240650+0000", 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0078311140000000001 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.241005+0000", 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00035530400000000003 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299378+0000", 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.058373080000000001 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19386 4.26 4:67d353d7:::10000000083.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.233155+0000", 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79953012099999998, 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066357005999999996, 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233155+0000", 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233155+0000", 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233156+0000", 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0999999999999997e-07 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233161+0000", 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.7559999999999999e-06 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233177+0000", 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6693000000000001e-05 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233190+0000", 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2417e-05 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.241970+0000", 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0087796980000000007 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.242265+0000", 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029525299999999999 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299512+0000", 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.057247278999999998 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19396 4.26 4:67acbfb4:::1000000008d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.233346+0000", 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79933879600000002, 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066356709999999999, 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233346+0000", 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233346+0000", 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233348+0000", 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9130000000000001e-06 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233354+0000", 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5899999999999998e-06 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233370+0000", 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6273000000000002e-05 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233386+0000", 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6161999999999999e-05 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.243230+0000", 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0098437009999999998 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.243544+0000", 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031437799999999998 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299703+0000", 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.056158693000000003 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19427 4.26 4:65e71c10:::100000000ac.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.233628+0000", 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79905759099999996, 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066214296000000006, 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233628+0000", 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233628+0000", 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233629+0000", 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.13e-06 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233634+0000", 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2639999999999999e-06 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233654+0000", 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9568999999999998e-05 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233666+0000", 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2490000000000001e-05 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.244508+0000", 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010841903999999999 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.244752+0000", 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000244443 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299842+0000", 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055089496000000002 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19452 4.16 4:680c46c7:::100000000c5.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.233813+0000", 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79887239200000004, 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066230005999999994, 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233813+0000", 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233813+0000", 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233814+0000", 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.11e-06 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233819+0000", 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2100000000000001e-06 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233838+0000", 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8561999999999999e-05 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.233852+0000", 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.43e-05 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.244475+0000", 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010622593 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.244772+0000", 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00029777200000000002 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.300043+0000", 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.055270459000000001 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19476 4.26 4:65f6e386:::100000000dd.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.234277+0000", 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79840865400000005, 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065830163999999997, 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234277+0000", 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234277+0000", 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234278+0000", 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3090000000000001e-06 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234284+0000", 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3729999999999998e-06 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234306+0000", 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1597e-05 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234319+0000", 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3209e-05 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.245628+0000", 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011309212000000001 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.245930+0000", 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000301448 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.300107+0000", 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054177016000000001 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19511 4.16 4:69f8b284:::10000000100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.234991+0000", 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79769432699999998, 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065172219000000003, 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234991+0000", 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234991+0000", 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.234991+0000", 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.3300000000000002e-07 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235051+0000", 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.9914999999999998e-05 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235074+0000", 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2563000000000001e-05 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235089+0000", 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4589999999999999e-05 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.245681+0000", 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.010592147 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.245885+0000", 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020479800000000001 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.300163+0000", 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.054277573000000003 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19524 4.26 4:67d72c52:::1000000010d.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.235174+0000", 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79751090199999997, 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065112953000000001, 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235174+0000", 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235174+0000", 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235175+0000", 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-06 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235181+0000", 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.7429999999999999e-06 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235199+0000", 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7912999999999999e-05 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235212+0000", 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3098999999999999e-05 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.246920+0000", 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011707924 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.247119+0000", 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000198679 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.300287+0000", 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.053168538000000001 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19527 4.26 4:64ce44bf:::10000000110.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.235231+0000", 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79745429400000001, 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.065255200999999999, 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235231+0000", 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235231+0000", 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235232+0000", 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0699999999999999e-06 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235237+0000", 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6999999999999999e-06 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235261+0000", 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4788999999999999e-05 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.235275+0000", 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3174e-05 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.247850+0000", 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012574947 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.248092+0000", 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000242601 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.300486+0000", 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.052393919999999997 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19611 4.26 4:679dc93b:::10000000164.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.236315+0000", 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79637028300000001, 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064377426000000001, 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236315+0000", 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236315+0000", 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236316+0000", 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.15e-06 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236321+0000", 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.1399999999999999e-06 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236339+0000", 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7612999999999999e-05 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236356+0000", 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7220000000000001e-05 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.248821+0000", 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.01246511 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.249046+0000", 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000225131 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.300692+0000", 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.051646062 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19624 4.26 4:67de5783:::10000000171.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.236496+0000", 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79618958399999995, 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064333764000000002, 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236496+0000", 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236496+0000", 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236497+0000", 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1200000000000001e-06 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236502+0000", 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0730000000000004e-06 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236521+0000", 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9626000000000001e-05 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236535+0000", 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3329999999999999e-05 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.249746+0000", 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013210840999999999 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.249950+0000", 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020479100000000001 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.300829+0000", 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050878983000000003 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19659 4.26 4:6669d7af:::10000000194.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.236731+0000", 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 0.79595432399999999, 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.064252450000000003, 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236731+0000", 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236731+0000", 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236732+0000", 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.19e-06 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236737+0000", 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.5739999999999997e-06 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236753+0000", 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6782e-05 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.236768+0000", 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4600000000000001e-05 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.250699+0000", 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.013931481000000001 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.250915+0000", 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021583799999999999 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.300983+0000", 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.050067985000000002 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:48.122 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-09-12T18:03:47.333082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136990027,"num_objects":2109,"num_object_clones":0,"num_object_copies":4218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3333,"num_objects_misplaced":19,"num_objects_unfound":0,"num_objects_dirty":2109,"num_whiteouts":0,"num_read":2682,"num_read_kb":1271992,"num_write":26667,"num_write_kb":4154813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":34141323,"num_keys_recovered":576,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29590,"ondisk_log_size":29590,"up":210,"acting":183,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":286736,"kb_used_data":116800,"kb_used_omap":4,"kb_used_meta":169787,"kb_avail":282828784,"statfs":{"total":289910292480,"available":289616674816,"internally_reserved":0,"allocated":119603200,"data_stored":282485487,"data_compressed":43399728,"data_compressed_allocated":55205888,"data_compressed_original":232267776,"omap_allocated":4785,"internal_metadata":173862223},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.015294"},"pg_stats":[{"pgid":"4.3f","version":"61'393","reported_seq":538,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.243437+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:42.243437+0000","last_peered":"2024-09-12T18:03:42.243437+0000","last_clean":"2024-09-12T18:03:42.243437+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:42.243437+0000","last_undegraded":"2024-09-12T18:03:42.243437+0000","last_fullsized":"2024-09-12T18:03:42.243437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282524,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":372,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"61'412","reported_seq":581,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.267664+0000","last_change":"2024-09-12T18:03:42.059630+0000","last_active":"2024-09-12T18:03:42.267664+0000","last_peered":"2024-09-12T18:03:42.267664+0000","last_clean":"2024-09-12T18:03:38.936262+0000","last_became_active":"2024-09-12T18:03:42.058566+0000","last_became_peered":"2024-09-12T18:03:42.058566+0000","last_unstale":"2024-09-12T18:03:42.267664+0000","last_undegraded":"2024-09-12T18:03:41.974628+0000","last_fullsized":"2024-09-12T18:03:41.972330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305806,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":186,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":384,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-21},{"shards":"1,2","objects":48}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"61'333","reported_seq":444,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.226683+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:42.226683+0000","last_peered":"2024-09-12T18:03:42.226683+0000","last_clean":"2024-09-12T18:03:42.226683+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:42.226683+0000","last_undegraded":"2024-09-12T18:03:42.226683+0000","last_fullsized":"2024-09-12T18:03:42.226683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144362,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":310,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"61'331","reported_seq":451,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.285836+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:42.285836+0000","last_peered":"2024-09-12T18:03:42.285836+0000","last_clean":"2024-09-12T18:03:42.285836+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:42.285836+0000","last_undegraded":"2024-09-12T18:03:42.285836+0000","last_fullsized":"2024-09-12T18:03:42.285836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169447,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":300,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"61'423","reported_seq":589,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.279007+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:42.279007+0000","last_peered":"2024-09-12T18:03:42.279007+0000","last_clean":"2024-09-12T18:03:42.279007+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:42.279007+0000","last_undegraded":"2024-09-12T18:03:42.279007+0000","last_fullsized":"2024-09-12T18:03:42.279007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111097,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":402,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"61'337","reported_seq":449,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.237288+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:42.237288+0000","last_peered":"2024-09-12T18:03:42.237288+0000","last_clean":"2024-09-12T18:03:42.237288+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:42.237288+0000","last_undegraded":"2024-09-12T18:03:42.237288+0000","last_fullsized":"2024-09-12T18:03:42.237288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209491,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":315,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"61'391","reported_seq":554,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.248717+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:42.248717+0000","last_peered":"2024-09-12T18:03:42.248717+0000","last_clean":"2024-09-12T18:03:42.248717+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:42.248717+0000","last_undegraded":"2024-09-12T18:03:42.248717+0000","last_fullsized":"2024-09-12T18:03:42.248717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528381,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":369,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"61'377","reported_seq":547,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.291371+0000","last_change":"2024-09-12T18:03:42.054549+0000","last_active":"2024-09-12T18:03:42.291371+0000","last_peered":"2024-09-12T18:03:42.291371+0000","last_clean":"2024-09-12T18:03:39.938070+0000","last_became_active":"2024-09-12T18:03:42.051143+0000","last_became_peered":"2024-09-12T18:03:42.051143+0000","last_unstale":"2024-09-12T18:03:42.291371+0000","last_undegraded":"2024-09-12T18:03:41.968420+0000","last_fullsized":"2024-09-12T18:03:41.961304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":479438,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":348,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-18},{"shards":"0,2","objects":26}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"61'347","reported_seq":453,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.285020+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:42.285020+0000","last_peered":"2024-09-12T18:03:42.285020+0000","last_clean":"2024-09-12T18:03:42.285020+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:42.285020+0000","last_undegraded":"2024-09-12T18:03:42.285020+0000","last_fullsized":"2024-09-12T18:03:42.285020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":242458,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":320,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"61'356","reported_seq":518,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.248280+0000","last_change":"2024-09-12T18:03:42.056275+0000","last_active":"2024-09-12T18:03:42.248280+0000","last_peered":"2024-09-12T18:03:42.248280+0000","last_clean":"2024-09-12T18:03:39.946744+0000","last_became_active":"2024-09-12T18:03:42.054676+0000","last_became_peered":"2024-09-12T18:03:42.054676+0000","last_unstale":"2024-09-12T18:03:42.248280+0000","last_undegraded":"2024-09-12T18:03:41.971688+0000","last_fullsized":"2024-09-12T18:03:41.963105+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148524,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":175,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":342,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-23},{"shards":"1,2","objects":30}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"61'330","reported_seq":470,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.286028+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:42.286028+0000","last_peered":"2024-09-12T18:03:42.286028+0000","last_clean":"2024-09-12T18:03:42.286028+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:42.286028+0000","last_undegraded":"2024-09-12T18:03:42.286028+0000","last_fullsized":"2024-09-12T18:03:42.286028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121556,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":315,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"61'326","reported_seq":453,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.287981+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:42.287981+0000","last_peered":"2024-09-12T18:03:42.287981+0000","last_clean":"2024-09-12T18:03:42.287981+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:42.287981+0000","last_undegraded":"2024-09-12T18:03:42.287981+0000","last_fullsized":"2024-09-12T18:03:42.287981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115685,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":308,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"61'339","reported_seq":448,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.270116+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:42.270116+0000","last_peered":"2024-09-12T18:03:42.270116+0000","last_clean":"2024-09-12T18:03:42.270116+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:42.270116+0000","last_undegraded":"2024-09-12T18:03:42.270116+0000","last_fullsized":"2024-09-12T18:03:42.270116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212138,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":314,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"61'382","reported_seq":527,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.281565+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:42.281565+0000","last_peered":"2024-09-12T18:03:42.281565+0000","last_clean":"2024-09-12T18:03:42.281565+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:42.281565+0000","last_undegraded":"2024-09-12T18:03:42.281565+0000","last_fullsized":"2024-09-12T18:03:42.281565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265415,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":362,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"61'394","reported_seq":528,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.242763+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:42.242763+0000","last_peered":"2024-09-12T18:03:42.242763+0000","last_clean":"2024-09-12T18:03:42.242763+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:42.242763+0000","last_undegraded":"2024-09-12T18:03:42.242763+0000","last_fullsized":"2024-09-12T18:03:42.242763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630805,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":364,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"61'425","reported_seq":597,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.258650+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:42.258650+0000","last_peered":"2024-09-12T18:03:42.258650+0000","last_clean":"2024-09-12T18:03:42.258650+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:42.258650+0000","last_undegraded":"2024-09-12T18:03:42.258650+0000","last_fullsized":"2024-09-12T18:03:42.258650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362146,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":402,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"61'388","reported_seq":521,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.252372+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:42.252372+0000","last_peered":"2024-09-12T18:03:42.252372+0000","last_clean":"2024-09-12T18:03:42.252372+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:42.252372+0000","last_undegraded":"2024-09-12T18:03:42.252372+0000","last_fullsized":"2024-09-12T18:03:42.252372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170403,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":365,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"61'363","reported_seq":489,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.249861+0000","last_change":"2024-09-12T18:03:42.060803+0000","last_active":"2024-09-12T18:03:42.249861+0000","last_peered":"2024-09-12T18:03:42.249861+0000","last_clean":"2024-09-12T18:03:39.944065+0000","last_became_active":"2024-09-12T18:03:42.058753+0000","last_became_peered":"2024-09-12T18:03:42.058753+0000","last_unstale":"2024-09-12T18:03:42.249861+0000","last_undegraded":"2024-09-12T18:03:41.974699+0000","last_fullsized":"2024-09-12T18:03:41.972473+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186427,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":171,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":338,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-25},{"shards":"1,2","objects":31}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"61'412","reported_seq":576,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.288318+0000","last_change":"2024-09-12T18:03:42.059328+0000","last_active":"2024-09-12T18:03:42.288318+0000","last_peered":"2024-09-12T18:03:42.288318+0000","last_clean":"2024-09-12T18:03:39.933624+0000","last_became_active":"2024-09-12T18:03:42.029653+0000","last_became_peered":"2024-09-12T18:03:42.029653+0000","last_unstale":"2024-09-12T18:03:42.288318+0000","last_undegraded":"2024-09-12T18:03:41.966171+0000","last_fullsized":"2024-09-12T18:03:41.962893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198173,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":380,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-13},{"shards":"1,2","objects":37}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"61'391","reported_seq":508,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.251950+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:42.251950+0000","last_peered":"2024-09-12T18:03:42.251950+0000","last_clean":"2024-09-12T18:03:42.251950+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:42.251950+0000","last_undegraded":"2024-09-12T18:03:42.251950+0000","last_fullsized":"2024-09-12T18:03:42.251950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174443,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":364,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"61'354","reported_seq":470,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.281850+0000","last_change":"2024-09-12T18:03:42.053468+0000","last_active":"2024-09-12T18:03:42.281850+0000","last_peered":"2024-09-12T18:03:42.281850+0000","last_clean":"2024-09-12T18:03:39.923110+0000","last_became_active":"2024-09-12T18:03:42.049745+0000","last_became_peered":"2024-09-12T18:03:42.049745+0000","last_unstale":"2024-09-12T18:03:42.281850+0000","last_undegraded":"2024-09-12T18:03:41.991593+0000","last_fullsized":"2024-09-12T18:03:41.978686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287651,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":343,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-19},{"shards":"0,2","objects":29}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"61'397","reported_seq":546,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.280455+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:42.280455+0000","last_peered":"2024-09-12T18:03:42.280455+0000","last_clean":"2024-09-12T18:03:42.280455+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:42.280455+0000","last_undegraded":"2024-09-12T18:03:42.280455+0000","last_fullsized":"2024-09-12T18:03:42.280455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":376,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"61'367","reported_seq":485,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.281819+0000","last_change":"2024-09-12T18:03:42.047639+0000","last_active":"2024-09-12T18:03:42.281819+0000","last_peered":"2024-09-12T18:03:42.281819+0000","last_clean":"2024-09-12T18:03:39.873173+0000","last_became_active":"2024-09-12T18:03:42.040585+0000","last_became_peered":"2024-09-12T18:03:42.040585+0000","last_unstale":"2024-09-12T18:03:42.281819+0000","last_undegraded":"2024-09-12T18:03:41.968284+0000","last_fullsized":"2024-09-12T18:03:41.961597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222795,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":335,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-17},{"shards":"0,2","objects":34}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"61'418","reported_seq":569,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.269903+0000","last_change":"2024-09-12T18:03:42.057282+0000","last_active":"2024-09-12T18:03:42.269903+0000","last_peered":"2024-09-12T18:03:42.269903+0000","last_clean":"2024-09-12T18:03:39.936313+0000","last_became_active":"2024-09-12T18:03:42.054140+0000","last_became_peered":"2024-09-12T18:03:42.054140+0000","last_unstale":"2024-09-12T18:03:42.269903+0000","last_undegraded":"2024-09-12T18:03:41.968807+0000","last_fullsized":"2024-09-12T18:03:41.962788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265559,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":396,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-19},{"shards":"1,2","objects":37}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"61'350","reported_seq":462,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.278966+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:42.278966+0000","last_peered":"2024-09-12T18:03:42.278966+0000","last_clean":"2024-09-12T18:03:42.278966+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:42.278966+0000","last_undegraded":"2024-09-12T18:03:42.278966+0000","last_fullsized":"2024-09-12T18:03:42.278966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375685,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":329,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"61'427","reported_seq":555,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.288380+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:42.288380+0000","last_peered":"2024-09-12T18:03:42.288380+0000","last_clean":"2024-09-12T18:03:42.288380+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:42.288380+0000","last_undegraded":"2024-09-12T18:03:42.288380+0000","last_fullsized":"2024-09-12T18:03:42.288380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":656408,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":392,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"61'367","reported_seq":507,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.281674+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:42.281674+0000","last_peered":"2024-09-12T18:03:42.281674+0000","last_clean":"2024-09-12T18:03:42.281674+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:42.281674+0000","last_undegraded":"2024-09-12T18:03:42.281674+0000","last_fullsized":"2024-09-12T18:03:42.281674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231696,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":340,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"61'376","reported_seq":523,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.250191+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:42.250191+0000","last_peered":"2024-09-12T18:03:42.250191+0000","last_clean":"2024-09-12T18:03:42.250191+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:42.250191+0000","last_undegraded":"2024-09-12T18:03:42.250191+0000","last_fullsized":"2024-09-12T18:03:42.250191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177575,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":354,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"61'383","reported_seq":538,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.280166+0000","last_change":"2024-09-12T18:03:42.055335+0000","last_active":"2024-09-12T18:03:42.280166+0000","last_peered":"2024-09-12T18:03:42.280166+0000","last_clean":"2024-09-12T18:03:39.938932+0000","last_became_active":"2024-09-12T18:03:42.052344+0000","last_became_peered":"2024-09-12T18:03:42.052344+0000","last_unstale":"2024-09-12T18:03:42.280166+0000","last_undegraded":"2024-09-12T18:03:41.966574+0000","last_fullsized":"2024-09-12T18:03:41.962842+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169992,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":352,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-13},{"shards":"1,2","objects":29}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"61'428","reported_seq":541,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.255703+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:42.255703+0000","last_peered":"2024-09-12T18:03:42.255703+0000","last_clean":"2024-09-12T18:03:42.255703+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:42.255703+0000","last_undegraded":"2024-09-12T18:03:42.255703+0000","last_fullsized":"2024-09-12T18:03:42.255703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174988,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":401,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"61'415","reported_seq":547,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.247747+0000","last_change":"2024-09-12T18:03:42.052483+0000","last_active":"2024-09-12T18:03:42.247747+0000","last_peered":"2024-09-12T18:03:42.247747+0000","last_clean":"2024-09-12T18:03:39.921701+0000","last_became_active":"2024-09-12T18:03:42.048662+0000","last_became_peered":"2024-09-12T18:03:42.048662+0000","last_unstale":"2024-09-12T18:03:42.247747+0000","last_undegraded":"2024-09-12T18:03:41.968614+0000","last_fullsized":"2024-09-12T18:03:41.963095+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329987,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":191,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":399,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-21},{"shards":"1,2","objects":26}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"61'381","reported_seq":508,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.256522+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:42.256522+0000","last_peered":"2024-09-12T18:03:42.256522+0000","last_clean":"2024-09-12T18:03:42.256522+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:42.256522+0000","last_undegraded":"2024-09-12T18:03:42.256522+0000","last_fullsized":"2024-09-12T18:03:42.256522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1670737,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":360,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"61'369","reported_seq":541,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.249876+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:42.249876+0000","last_peered":"2024-09-12T18:03:42.249876+0000","last_clean":"2024-09-12T18:03:42.249876+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:42.249876+0000","last_undegraded":"2024-09-12T18:03:42.249876+0000","last_fullsized":"2024-09-12T18:03:42.249876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174763,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":343,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"61'430","reported_seq":529,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.213331+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:42.213331+0000","last_peered":"2024-09-12T18:03:42.213331+0000","last_clean":"2024-09-12T18:03:42.213331+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:42.213331+0000","last_undegraded":"2024-09-12T18:03:42.213331+0000","last_fullsized":"2024-09-12T18:03:42.213331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"61'338","reported_seq":471,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.240610+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:42.240610+0000","last_peered":"2024-09-12T18:03:42.240610+0000","last_clean":"2024-09-12T18:03:42.240610+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:42.240610+0000","last_undegraded":"2024-09-12T18:03:42.240610+0000","last_fullsized":"2024-09-12T18:03:42.240610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179916,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":311,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"61'33","reported_seq":131,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.197186+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:42.197186+0000","last_peered":"2024-09-12T18:03:42.197186+0000","last_clean":"2024-09-12T18:03:42.197186+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:42.197186+0000","last_undegraded":"2024-09-12T18:03:42.197186+0000","last_fullsized":"2024-09-12T18:03:42.197186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"61'374","reported_seq":496,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.256191+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:42.256191+0000","last_peered":"2024-09-12T18:03:42.256191+0000","last_clean":"2024-09-12T18:03:42.256191+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:42.256191+0000","last_undegraded":"2024-09-12T18:03:42.256191+0000","last_fullsized":"2024-09-12T18:03:42.256191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220026,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":348,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"61'54","reported_seq":152,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.208377+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:42.208377+0000","last_peered":"2024-09-12T18:03:42.208377+0000","last_clean":"2024-09-12T18:03:42.208377+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:42.208377+0000","last_undegraded":"2024-09-12T18:03:42.208377+0000","last_fullsized":"2024-09-12T18:03:42.208377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"61'366","reported_seq":498,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.240653+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:42.240653+0000","last_peered":"2024-09-12T18:03:42.240653+0000","last_clean":"2024-09-12T18:03:42.240653+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:42.240653+0000","last_undegraded":"2024-09-12T18:03:42.240653+0000","last_fullsized":"2024-09-12T18:03:42.240653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":256226,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":343,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"61'47","reported_seq":146,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.223154+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:42.223154+0000","last_peered":"2024-09-12T18:03:42.223154+0000","last_clean":"2024-09-12T18:03:42.223154+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:42.223154+0000","last_undegraded":"2024-09-12T18:03:42.223154+0000","last_fullsized":"2024-09-12T18:03:42.223154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"61'123","reported_seq":222,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.197058+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:42.197058+0000","last_peered":"2024-09-12T18:03:42.197058+0000","last_clean":"2024-09-12T18:03:42.197058+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:42.197058+0000","last_undegraded":"2024-09-12T18:03:42.197058+0000","last_fullsized":"2024-09-12T18:03:42.197058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"61'384","reported_seq":506,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.231893+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:42.231893+0000","last_peered":"2024-09-12T18:03:42.231893+0000","last_clean":"2024-09-12T18:03:42.231893+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:42.231893+0000","last_undegraded":"2024-09-12T18:03:42.231893+0000","last_fullsized":"2024-09-12T18:03:42.231893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":261946,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":356,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"61'239","reported_seq":337,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.218187+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:42.218187+0000","last_peered":"2024-09-12T18:03:42.218187+0000","last_clean":"2024-09-12T18:03:42.218187+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:42.218187+0000","last_undegraded":"2024-09-12T18:03:42.218187+0000","last_fullsized":"2024-09-12T18:03:42.218187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"61'413","reported_seq":544,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.290652+0000","last_change":"2024-09-12T18:03:42.049969+0000","last_active":"2024-09-12T18:03:42.290652+0000","last_peered":"2024-09-12T18:03:42.290652+0000","last_clean":"2024-09-12T18:03:39.941028+0000","last_became_active":"2024-09-12T18:03:42.048007+0000","last_became_peered":"2024-09-12T18:03:42.048007+0000","last_unstale":"2024-09-12T18:03:42.290652+0000","last_undegraded":"2024-09-12T18:03:41.970376+0000","last_fullsized":"2024-09-12T18:03:41.962798+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":249782,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":202,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":383,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-18},{"shards":"1,2","objects":44}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"61'371","reported_seq":470,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.216203+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:42.216203+0000","last_peered":"2024-09-12T18:03:42.216203+0000","last_clean":"2024-09-12T18:03:42.216203+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:42.216203+0000","last_undegraded":"2024-09-12T18:03:42.216203+0000","last_fullsized":"2024-09-12T18:03:42.216203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"61'381","reported_seq":519,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.285814+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:42.285814+0000","last_peered":"2024-09-12T18:03:42.285814+0000","last_clean":"2024-09-12T18:03:42.285814+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:42.285814+0000","last_undegraded":"2024-09-12T18:03:42.285814+0000","last_fullsized":"2024-09-12T18:03:42.285814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281551,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":346,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"61'39","reported_seq":138,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.199761+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:42.199761+0000","last_peered":"2024-09-12T18:03:42.199761+0000","last_clean":"2024-09-12T18:03:42.199761+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:42.199761+0000","last_undegraded":"2024-09-12T18:03:42.199761+0000","last_fullsized":"2024-09-12T18:03:42.199761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"61'400","reported_seq":532,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.286050+0000","last_change":"2024-09-12T18:03:42.052385+0000","last_active":"2024-09-12T18:03:42.286050+0000","last_peered":"2024-09-12T18:03:42.286050+0000","last_clean":"2024-09-12T18:03:39.903630+0000","last_became_active":"2024-09-12T18:03:42.046109+0000","last_became_peered":"2024-09-12T18:03:42.046109+0000","last_unstale":"2024-09-12T18:03:42.286050+0000","last_undegraded":"2024-09-12T18:03:41.972774+0000","last_fullsized":"2024-09-12T18:03:41.961990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165519,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":373,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-20},{"shards":"0,2","objects":30}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"61'138","reported_seq":235,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.279167+0000","last_change":"2024-09-12T18:03:42.279167+0000","last_active":"2024-09-12T18:03:42.279167+0000","last_peered":"2024-09-12T18:03:42.279167+0000","last_clean":"2024-09-12T18:03:36.673274+0000","last_became_active":"2024-09-12T18:03:42.049138+0000","last_became_peered":"2024-09-12T18:03:42.049138+0000","last_unstale":"2024-09-12T18:03:42.279167+0000","last_undegraded":"2024-09-12T18:03:42.279167+0000","last_fullsized":"2024-09-12T18:03:41.976876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":3}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"61'410","reported_seq":548,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.255291+0000","last_change":"2024-09-12T18:03:42.038748+0000","last_active":"2024-09-12T18:03:42.255291+0000","last_peered":"2024-09-12T18:03:42.255291+0000","last_clean":"2024-09-12T18:03:39.945369+0000","last_became_active":"2024-09-12T18:03:42.030067+0000","last_became_peered":"2024-09-12T18:03:42.030067+0000","last_unstale":"2024-09-12T18:03:42.255291+0000","last_undegraded":"2024-09-12T18:03:41.978274+0000","last_fullsized":"2024-09-12T18:03:41.964450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":386360,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":381,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-19},{"shards":"0,2","objects":41}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"61'103","reported_seq":202,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.233175+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:42.233175+0000","last_peered":"2024-09-12T18:03:42.233175+0000","last_clean":"2024-09-12T18:03:42.233175+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:42.233175+0000","last_undegraded":"2024-09-12T18:03:42.233175+0000","last_fullsized":"2024-09-12T18:03:42.233175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"61'377","reported_seq":529,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.252356+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:42.252356+0000","last_peered":"2024-09-12T18:03:42.252356+0000","last_clean":"2024-09-12T18:03:42.252356+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:42.252356+0000","last_undegraded":"2024-09-12T18:03:42.252356+0000","last_fullsized":"2024-09-12T18:03:42.252356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138042,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":354,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"61'40","reported_seq":138,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.215573+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:42.215573+0000","last_peered":"2024-09-12T18:03:42.215573+0000","last_clean":"2024-09-12T18:03:42.215573+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:42.215573+0000","last_undegraded":"2024-09-12T18:03:42.215573+0000","last_fullsized":"2024-09-12T18:03:42.215573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"61'344","reported_seq":477,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.270924+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:42.270924+0000","last_peered":"2024-09-12T18:03:42.270924+0000","last_clean":"2024-09-12T18:03:42.270924+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:42.270924+0000","last_undegraded":"2024-09-12T18:03:42.270924+0000","last_fullsized":"2024-09-12T18:03:42.270924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169889,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":318,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"61'468","reported_seq":572,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.132804+0000","last_change":"2024-09-12T18:03:42.132804+0000","last_active":"2024-09-12T18:03:42.132804+0000","last_peered":"2024-09-12T18:03:42.132804+0000","last_clean":"2024-09-12T18:03:39.902250+0000","last_became_active":"2024-09-12T18:03:42.054254+0000","last_became_peered":"2024-09-12T18:03:42.054254+0000","last_unstale":"2024-09-12T18:03:42.132804+0000","last_undegraded":"2024-09-12T18:03:42.132804+0000","last_fullsized":"2024-09-12T18:03:41.962793+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"61'341","reported_seq":456,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.252350+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:42.252350+0000","last_peered":"2024-09-12T18:03:42.252350+0000","last_clean":"2024-09-12T18:03:42.252350+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:42.252350+0000","last_undegraded":"2024-09-12T18:03:42.252350+0000","last_fullsized":"2024-09-12T18:03:42.252350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186045,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":306,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":249,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.980461+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:41.980461+0000","last_peered":"2024-09-12T18:03:41.980461+0000","last_clean":"2024-09-12T18:03:41.980461+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:41.980461+0000","last_undegraded":"2024-09-12T18:03:41.980461+0000","last_fullsized":"2024-09-12T18:03:41.980461+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.985253+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:41.985253+0000","last_peered":"2024-09-12T18:03:41.985253+0000","last_clean":"2024-09-12T18:03:41.985253+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:41.985253+0000","last_undegraded":"2024-09-12T18:03:41.985253+0000","last_fullsized":"2024-09-12T18:03:41.985253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"61'550","reported_seq":648,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.234908+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:42.234908+0000","last_peered":"2024-09-12T18:03:42.234908+0000","last_clean":"2024-09-12T18:03:42.234908+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:42.234908+0000","last_undegraded":"2024-09-12T18:03:42.234908+0000","last_fullsized":"2024-09-12T18:03:42.234908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"61'397","reported_seq":515,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.277530+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:42.277530+0000","last_peered":"2024-09-12T18:03:42.277530+0000","last_clean":"2024-09-12T18:03:42.277530+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:42.277530+0000","last_undegraded":"2024-09-12T18:03:42.277530+0000","last_fullsized":"2024-09-12T18:03:42.277530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359392,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":360,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.980026+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:41.980026+0000","last_peered":"2024-09-12T18:03:41.980026+0000","last_clean":"2024-09-12T18:03:41.980026+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:41.980026+0000","last_undegraded":"2024-09-12T18:03:41.980026+0000","last_fullsized":"2024-09-12T18:03:41.980026+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"61'106","reported_seq":256,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.285876+0000","last_change":"2024-09-12T18:03:41.005215+0000","last_active":"2024-09-12T18:03:42.285876+0000","last_peered":"2024-09-12T18:03:42.285876+0000","last_clean":"2024-09-12T18:03:42.285876+0000","last_became_active":"2024-09-12T18:03:40.983480+0000","last_became_peered":"2024-09-12T18:03:40.983480+0000","last_unstale":"2024-09-12T18:03:42.285876+0000","last_undegraded":"2024-09-12T18:03:42.285876+0000","last_fullsized":"2024-09-12T18:03:42.285876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:26.563361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1219373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1144,"num_write":49,"num_write_kb":1225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1106253,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"61'413","reported_seq":578,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.244655+0000","last_change":"2024-09-12T18:03:42.056375+0000","last_active":"2024-09-12T18:03:42.244655+0000","last_peered":"2024-09-12T18:03:42.244655+0000","last_clean":"2024-09-12T18:03:39.941039+0000","last_became_active":"2024-09-12T18:03:42.054484+0000","last_became_peered":"2024-09-12T18:03:42.054484+0000","last_unstale":"2024-09-12T18:03:42.244655+0000","last_undegraded":"2024-09-12T18:03:41.972071+0000","last_fullsized":"2024-09-12T18:03:41.962975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428266,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":395,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-20},{"shards":"1,2","objects":41}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.961187+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:41.961187+0000","last_peered":"2024-09-12T18:03:41.961187+0000","last_clean":"2024-09-12T18:03:41.961187+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:41.961187+0000","last_undegraded":"2024-09-12T18:03:41.961187+0000","last_fullsized":"2024-09-12T18:03:41.961187+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"61'361","reported_seq":459,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.137974+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:42.137974+0000","last_peered":"2024-09-12T18:03:42.137974+0000","last_clean":"2024-09-12T18:03:42.137974+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:42.137974+0000","last_undegraded":"2024-09-12T18:03:42.137974+0000","last_fullsized":"2024-09-12T18:03:42.137974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"61'320","reported_seq":737,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.641185+0000","last_change":"2024-09-12T18:03:42.641185+0000","last_active":"2024-09-12T18:03:42.641185+0000","last_peered":"2024-09-12T18:03:42.641185+0000","last_clean":"2024-09-12T18:03:39.906018+0000","last_became_active":"2024-09-12T18:03:42.029327+0000","last_became_peered":"2024-09-12T18:03:42.029327+0000","last_unstale":"2024-09-12T18:03:42.641185+0000","last_undegraded":"2024-09-12T18:03:42.641185+0000","last_fullsized":"2024-09-12T18:03:41.963571+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130192,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":295,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","0","2"],"object_location_counts":[{"shards":"1","objects":22}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":124,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.964335+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:41.964335+0000","last_peered":"2024-09-12T18:03:41.964335+0000","last_clean":"2024-09-12T18:03:41.964335+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:41.964335+0000","last_undegraded":"2024-09-12T18:03:41.964335+0000","last_fullsized":"2024-09-12T18:03:41.964335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"61'61","reported_seq":160,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.205065+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:42.205065+0000","last_peered":"2024-09-12T18:03:42.205065+0000","last_clean":"2024-09-12T18:03:42.205065+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:42.205065+0000","last_undegraded":"2024-09-12T18:03:42.205065+0000","last_fullsized":"2024-09-12T18:03:42.205065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"61'385","reported_seq":567,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.224930+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:42.224930+0000","last_peered":"2024-09-12T18:03:42.224930+0000","last_clean":"2024-09-12T18:03:42.224930+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:42.224930+0000","last_undegraded":"2024-09-12T18:03:42.224930+0000","last_fullsized":"2024-09-12T18:03:42.224930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123722,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":358,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"61'48","reported_seq":147,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.103744+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:42.103744+0000","last_peered":"2024-09-12T18:03:42.103744+0000","last_clean":"2024-09-12T18:03:42.103744+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:42.103744+0000","last_undegraded":"2024-09-12T18:03:42.103744+0000","last_fullsized":"2024-09-12T18:03:42.103744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":111,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.962721+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:41.962721+0000","last_peered":"2024-09-12T18:03:41.962721+0000","last_clean":"2024-09-12T18:03:41.962721+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:41.962721+0000","last_undegraded":"2024-09-12T18:03:41.962721+0000","last_fullsized":"2024-09-12T18:03:41.962721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"61'327","reported_seq":450,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.213300+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:42.213300+0000","last_peered":"2024-09-12T18:03:42.213300+0000","last_clean":"2024-09-12T18:03:42.213300+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:42.213300+0000","last_undegraded":"2024-09-12T18:03:42.213300+0000","last_fullsized":"2024-09-12T18:03:42.213300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88150,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":301,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"61'35","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.231847+0000","last_change":"2024-09-12T18:03:40.978262+0000","last_active":"2024-09-12T18:03:42.231847+0000","last_peered":"2024-09-12T18:03:42.231847+0000","last_clean":"2024-09-12T18:03:42.231847+0000","last_became_active":"2024-09-12T18:03:40.977028+0000","last_became_peered":"2024-09-12T18:03:40.977028+0000","last_unstale":"2024-09-12T18:03:42.231847+0000","last_undegraded":"2024-09-12T18:03:42.231847+0000","last_fullsized":"2024-09-12T18:03:42.231847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.970846+0000","last_change":"2024-09-12T18:03:40.977985+0000","last_active":"2024-09-12T18:03:41.970846+0000","last_peered":"2024-09-12T18:03:41.970846+0000","last_clean":"2024-09-12T18:03:41.970846+0000","last_became_active":"2024-09-12T18:03:40.975455+0000","last_became_peered":"2024-09-12T18:03:40.975455+0000","last_unstale":"2024-09-12T18:03:41.970846+0000","last_undegraded":"2024-09-12T18:03:41.970846+0000","last_fullsized":"2024-09-12T18:03:41.970846+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:08.975777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"61'351","reported_seq":480,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.287923+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:42.287923+0000","last_peered":"2024-09-12T18:03:42.287923+0000","last_clean":"2024-09-12T18:03:42.287923+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:42.287923+0000","last_undegraded":"2024-09-12T18:03:42.287923+0000","last_fullsized":"2024-09-12T18:03:42.287923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102549,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":325,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"61'43","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.153121+0000","last_change":"2024-09-12T18:03:40.988959+0000","last_active":"2024-09-12T18:03:42.153121+0000","last_peered":"2024-09-12T18:03:42.153121+0000","last_clean":"2024-09-12T18:03:42.153121+0000","last_became_active":"2024-09-12T18:03:40.977475+0000","last_became_peered":"2024-09-12T18:03:40.977475+0000","last_unstale":"2024-09-12T18:03:42.153121+0000","last_undegraded":"2024-09-12T18:03:42.153121+0000","last_fullsized":"2024-09-12T18:03:42.153121+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:16.546031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.977524+0000","last_change":"2024-09-12T18:03:41.012135+0000","last_active":"2024-09-12T18:03:41.977524+0000","last_peered":"2024-09-12T18:03:41.977524+0000","last_clean":"2024-09-12T18:03:41.977524+0000","last_became_active":"2024-09-12T18:03:41.007972+0000","last_became_peered":"2024-09-12T18:03:41.007972+0000","last_unstale":"2024-09-12T18:03:41.977524+0000","last_undegraded":"2024-09-12T18:03:41.977524+0000","last_fullsized":"2024-09-12T18:03:41.977524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:34.771948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"61'358","reported_seq":461,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.291197+0000","last_change":"2024-09-12T18:03:42.054380+0000","last_active":"2024-09-12T18:03:42.291197+0000","last_peered":"2024-09-12T18:03:42.291197+0000","last_clean":"2024-09-12T18:03:39.881401+0000","last_became_active":"2024-09-12T18:03:42.050483+0000","last_became_peered":"2024-09-12T18:03:42.050483+0000","last_unstale":"2024-09-12T18:03:42.291197+0000","last_undegraded":"2024-09-12T18:03:41.967738+0000","last_fullsized":"2024-09-12T18:03:41.961302+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169598,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":336,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-19},{"shards":"0,2","objects":28}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"61'90","reported_seq":191,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.200102+0000","last_change":"2024-09-12T18:03:41.017409+0000","last_active":"2024-09-12T18:03:42.200102+0000","last_peered":"2024-09-12T18:03:42.200102+0000","last_clean":"2024-09-12T18:03:42.200102+0000","last_became_active":"2024-09-12T18:03:40.982409+0000","last_became_peered":"2024-09-12T18:03:40.982409+0000","last_unstale":"2024-09-12T18:03:42.200102+0000","last_undegraded":"2024-09-12T18:03:42.200102+0000","last_fullsized":"2024-09-12T18:03:42.200102+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:13.263023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":576,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:41.971889+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:41.971889+0000","last_peered":"2024-09-12T18:03:41.971889+0000","last_clean":"2024-09-12T18:03:41.971889+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:41.971889+0000","last_undegraded":"2024-09-12T18:03:41.971889+0000","last_fullsized":"2024-09-12T18:03:41.971889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"61'345","reported_seq":491,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.267402+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:42.267402+0000","last_peered":"2024-09-12T18:03:42.267402+0000","last_clean":"2024-09-12T18:03:42.267402+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:42.267402+0000","last_undegraded":"2024-09-12T18:03:42.267402+0000","last_fullsized":"2024-09-12T18:03:42.267402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295418,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":313,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"61'358","reported_seq":496,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.242617+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:42.242617+0000","last_peered":"2024-09-12T18:03:42.242617+0000","last_clean":"2024-09-12T18:03:42.242617+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:42.242617+0000","last_undegraded":"2024-09-12T18:03:42.242617+0000","last_fullsized":"2024-09-12T18:03:42.242617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167501,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":336,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"61'218","reported_seq":317,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.218515+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:42.218515+0000","last_peered":"2024-09-12T18:03:42.218515+0000","last_clean":"2024-09-12T18:03:42.218515+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:42.218515+0000","last_undegraded":"2024-09-12T18:03:42.218515+0000","last_fullsized":"2024-09-12T18:03:42.218515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":8283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"61'398","reported_seq":535,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.239502+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:42.239502+0000","last_peered":"2024-09-12T18:03:42.239502+0000","last_clean":"2024-09-12T18:03:42.239502+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:42.239502+0000","last_undegraded":"2024-09-12T18:03:42.239502+0000","last_fullsized":"2024-09-12T18:03:42.239502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415237,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":371,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"61'75","reported_seq":173,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.200097+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:42.200097+0000","last_peered":"2024-09-12T18:03:42.200097+0000","last_clean":"2024-09-12T18:03:42.200097+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:42.200097+0000","last_undegraded":"2024-09-12T18:03:42.200097+0000","last_fullsized":"2024-09-12T18:03:42.200097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"61'166","reported_seq":271,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.670811+0000","last_change":"2024-09-12T18:03:42.306423+0000","last_active":"2024-09-12T18:03:42.670811+0000","last_peered":"2024-09-12T18:03:42.670811+0000","last_clean":"2024-09-12T18:03:39.944883+0000","last_became_active":"2024-09-12T18:03:42.051821+0000","last_became_peered":"2024-09-12T18:03:42.051821+0000","last_unstale":"2024-09-12T18:03:42.670811+0000","last_undegraded":"2024-09-12T18:03:42.670811+0000","last_fullsized":"2024-09-12T18:03:41.967679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3903637,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":3866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3329809,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'446","reported_seq":632,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.286107+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:42.286107+0000","last_peered":"2024-09-12T18:03:42.286107+0000","last_clean":"2024-09-12T18:03:42.286107+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:42.286107+0000","last_undegraded":"2024-09-12T18:03:42.286107+0000","last_fullsized":"2024-09-12T18:03:42.286107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231538,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":418,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"61'50","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.239882+0000","last_change":"2024-09-12T18:03:40.983792+0000","last_active":"2024-09-12T18:03:42.239882+0000","last_peered":"2024-09-12T18:03:42.239882+0000","last_clean":"2024-09-12T18:03:42.239882+0000","last_became_active":"2024-09-12T18:03:40.982653+0000","last_became_peered":"2024-09-12T18:03:40.982653+0000","last_unstale":"2024-09-12T18:03:42.239882+0000","last_undegraded":"2024-09-12T18:03:42.239882+0000","last_fullsized":"2024-09-12T18:03:42.239882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"61'431","reported_seq":578,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.291142+0000","last_change":"2024-09-12T18:03:42.057858+0000","last_active":"2024-09-12T18:03:42.291142+0000","last_peered":"2024-09-12T18:03:42.291142+0000","last_clean":"2024-09-12T18:03:39.929532+0000","last_became_active":"2024-09-12T18:03:42.055190+0000","last_became_peered":"2024-09-12T18:03:42.055190+0000","last_unstale":"2024-09-12T18:03:42.291142+0000","last_undegraded":"2024-09-12T18:03:41.973632+0000","last_fullsized":"2024-09-12T18:03:41.971256+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110474,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":203,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":408,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-32},{"shards":"1,2","objects":25}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"61'344","reported_seq":477,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.252569+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:42.252569+0000","last_peered":"2024-09-12T18:03:42.252569+0000","last_clean":"2024-09-12T18:03:42.252569+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:42.252569+0000","last_undegraded":"2024-09-12T18:03:42.252569+0000","last_fullsized":"2024-09-12T18:03:42.252569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79595,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":325,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"61'638","reported_seq":736,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.222621+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:42.222621+0000","last_peered":"2024-09-12T18:03:42.222621+0000","last_clean":"2024-09-12T18:03:42.222621+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:42.222621+0000","last_undegraded":"2024-09-12T18:03:42.222621+0000","last_fullsized":"2024-09-12T18:03:42.222621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"61'399","reported_seq":560,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.286115+0000","last_change":"2024-09-12T18:03:42.057394+0000","last_active":"2024-09-12T18:03:42.286115+0000","last_peered":"2024-09-12T18:03:42.286115+0000","last_clean":"2024-09-12T18:03:39.932171+0000","last_became_active":"2024-09-12T18:03:42.054957+0000","last_became_peered":"2024-09-12T18:03:42.054957+0000","last_unstale":"2024-09-12T18:03:42.286115+0000","last_undegraded":"2024-09-12T18:03:41.977297+0000","last_fullsized":"2024-09-12T18:03:41.964490+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1550099,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":375,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-16},{"shards":"0,2","objects":34}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"61'206","reported_seq":308,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.280875+0000","last_change":"2024-09-12T18:03:42.182647+0000","last_active":"2024-09-12T18:03:42.280875+0000","last_peered":"2024-09-12T18:03:42.280875+0000","last_clean":"2024-09-12T18:03:39.381376+0000","last_became_active":"2024-09-12T18:03:42.039322+0000","last_became_peered":"2024-09-12T18:03:42.039322+0000","last_unstale":"2024-09-12T18:03:42.280875+0000","last_undegraded":"2024-09-12T18:03:42.280875+0000","last_fullsized":"2024-09-12T18:03:41.975194+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"61'354","reported_seq":488,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.267619+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:42.267619+0000","last_peered":"2024-09-12T18:03:42.267619+0000","last_clean":"2024-09-12T18:03:42.267619+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:42.267619+0000","last_undegraded":"2024-09-12T18:03:42.267619+0000","last_fullsized":"2024-09-12T18:03:42.267619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247056,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":324,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"61'84","reported_seq":182,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.233249+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:42.233249+0000","last_peered":"2024-09-12T18:03:42.233249+0000","last_clean":"2024-09-12T18:03:42.233249+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:42.233249+0000","last_undegraded":"2024-09-12T18:03:42.233249+0000","last_fullsized":"2024-09-12T18:03:42.233249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"61'341","reported_seq":463,"reported_epoch":61,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.665521+0000","last_change":"2024-09-12T18:03:42.642089+0000","last_active":"2024-09-12T18:03:42.665521+0000","last_peered":"2024-09-12T18:03:42.665521+0000","last_clean":"2024-09-12T18:03:39.935307+0000","last_became_active":"2024-09-12T18:03:42.035344+0000","last_became_peered":"2024-09-12T18:03:42.035344+0000","last_unstale":"2024-09-12T18:03:42.665521+0000","last_undegraded":"2024-09-12T18:03:41.970163+0000","last_fullsized":"2024-09-12T18:03:41.962841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307168,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14,"num_objects_misplaced":19,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":320,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26770,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":-9},{"shards":"1,2","objects":19}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"61'43","reported_seq":141,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.098569+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:42.098569+0000","last_peered":"2024-09-12T18:03:42.098569+0000","last_clean":"2024-09-12T18:03:42.098569+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:42.098569+0000","last_undegraded":"2024-09-12T18:03:42.098569+0000","last_fullsized":"2024-09-12T18:03:42.098569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"61'337","reported_seq":449,"reported_epoch":61,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.248150+0000","last_change":"2024-09-12T18:03:42.051999+0000","last_active":"2024-09-12T18:03:42.248150+0000","last_peered":"2024-09-12T18:03:42.248150+0000","last_clean":"2024-09-12T18:03:39.940294+0000","last_became_active":"2024-09-12T18:03:42.046391+0000","last_became_peered":"2024-09-12T18:03:42.046391+0000","last_unstale":"2024-09-12T18:03:42.248150+0000","last_undegraded":"2024-09-12T18:03:41.972333+0000","last_fullsized":"2024-09-12T18:03:41.961784+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197214,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":318,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":-18},{"shards":"0,2","objects":28}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"61'167","reported_seq":274,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.132206+0000","last_change":"2024-09-12T18:03:42.132206+0000","last_active":"2024-09-12T18:03:42.132206+0000","last_peered":"2024-09-12T18:03:42.132206+0000","last_clean":"2024-09-12T18:03:38.907259+0000","last_became_active":"2024-09-12T18:03:42.025295+0000","last_became_peered":"2024-09-12T18:03:42.025295+0000","last_unstale":"2024-09-12T18:03:42.132206+0000","last_undegraded":"2024-09-12T18:03:42.132206+0000","last_fullsized":"2024-09-12T18:03:41.965226+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"61'362","reported_seq":728,"reported_epoch":61,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:42.686694+0000","last_change":"2024-09-12T18:03:42.309635+0000","last_active":"2024-09-12T18:03:42.686694+0000","last_peered":"2024-09-12T18:03:42.686694+0000","last_clean":"2024-09-12T18:03:39.944833+0000","last_became_active":"2024-09-12T18:03:42.026552+0000","last_became_peered":"2024-09-12T18:03:42.026552+0000","last_unstale":"2024-09-12T18:03:42.686694+0000","last_undegraded":"2024-09-12T18:03:41.974228+0000","last_fullsized":"2024-09-12T18:03:41.963193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151595,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":340,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":9}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"61'262","reported_seq":360,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.247724+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:42.247724+0000","last_peered":"2024-09-12T18:03:42.247724+0000","last_clean":"2024-09-12T18:03:42.247724+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:42.247724+0000","last_undegraded":"2024-09-12T18:03:42.247724+0000","last_fullsized":"2024-09-12T18:03:42.247724+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"61'350","reported_seq":471,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.246507+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:42.246507+0000","last_peered":"2024-09-12T18:03:42.246507+0000","last_clean":"2024-09-12T18:03:42.246507+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:42.246507+0000","last_undegraded":"2024-09-12T18:03:42.246507+0000","last_fullsized":"2024-09-12T18:03:42.246507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163750,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":326,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"61'47","reported_seq":94,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.232213+0000","last_change":"2024-09-12T18:03:41.059366+0000","last_active":"2024-09-12T18:03:42.232213+0000","last_peered":"2024-09-12T18:03:42.232213+0000","last_clean":"2024-09-12T18:03:42.232213+0000","last_became_active":"2024-09-12T18:03:40.982042+0000","last_became_peered":"2024-09-12T18:03:40.982042+0000","last_unstale":"2024-09-12T18:03:42.232213+0000","last_undegraded":"2024-09-12T18:03:42.232213+0000","last_fullsized":"2024-09-12T18:03:42.232213+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"61'407","reported_seq":573,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T18:03:42.280181+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:42.280181+0000","last_peered":"2024-09-12T18:03:42.280181+0000","last_clean":"2024-09-12T18:03:42.280181+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:42.280181+0000","last_undegraded":"2024-09-12T18:03:42.280181+0000","last_fullsized":"2024-09-12T18:03:42.280181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198405,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":382,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"61'107","reported_seq":157,"reported_epoch":61,"state":"active+undersized+remapped","last_fresh":"2024-09-12T18:03:42.245056+0000","last_change":"2024-09-12T18:03:42.073116+0000","last_active":"2024-09-12T18:03:42.245056+0000","last_peered":"2024-09-12T18:03:42.245056+0000","last_clean":"2024-09-12T18:03:07.826588+0000","last_became_active":"2024-09-12T18:03:42.006307+0000","last_became_peered":"2024-09-12T18:03:42.006307+0000","last_unstale":"2024-09-12T18:03:42.245056+0000","last_undegraded":"2024-09-12T18:03:42.245056+0000","last_fullsized":"2024-09-12T18:03:41.967661+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1","2"],"object_location_counts":[{"shards":"0","objects":3}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":18028952,"num_objects":2055,"num_object_clones":0,"num_object_copies":4110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3333,"num_objects_misplaced":19,"num_objects_unfound":0,"num_objects_dirty":2055,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":22439,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":344532,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35180544,"data_stored":38048198,"data_compressed":6772764,"data_compressed_allocated":8146944,"data_compressed_original":22159360,"omap_allocated":0,"internal_metadata":0},"log_size":24033,"ondisk_log_size":24033,"up":128,"acting":107,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":118370688,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":47,"num_read_kb":1144,"num_write":4081,"num_write_kb":118644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":33796772,"num_keys_recovered":576,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83046400,"data_stored":264178402,"data_compressed":40088380,"data_compressed_allocated":51101696,"data_compressed_original":232304640,"omap_allocated":0,"internal_metadata":0},"log_size":5442,"ondisk_log_size":5442,"up":64,"acting":58,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738396,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108248,"kb_used_data":36864,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94263592,"statfs":{"total":96636764160,"available":96525918208,"internally_reserved":0,"allocated":37748736,"data_stored":81682244,"data_compressed":12529567,"data_compressed_allocated":15921152,"data_compressed_original":64876544,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738396,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89536,"kb_used_data":40296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94282304,"statfs":{"total":96636764160,"available":96545079296,"internally_reserved":0,"allocated":41263104,"data_stored":93160216,"data_compressed":13879843,"data_compressed_allocated":17850368,"data_compressed_original":74883072,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88952,"kb_used_data":39640,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94282888,"statfs":{"total":96636764160,"available":96545677312,"internally_reserved":0,"allocated":40591360,"data_stored":107643027,"data_compressed":16990318,"data_compressed_allocated":21434368,"data_compressed_original":92508160,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28053504,"data_stored":93204864,"data_compressed":14423184,"data_compressed_allocated":18395136,"data_compressed_original":83578880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32423936,"data_stored":105772787,"data_compressed":16087864,"data_compressed_allocated":20324352,"data_compressed_original":93700096,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22568960,"data_stored":65200751,"data_compressed":9577332,"data_compressed_allocated":12382208,"data_compressed_original":55025664,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10915840,"data_stored":13124286,"data_compressed":2403853,"data_compressed_allocated":2867200,"data_compressed_original":8298496,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9601024,"data_stored":8684130,"data_compressed":1416676,"data_compressed_allocated":1740800,"data_compressed_original":4009984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14663680,"data_stored":16239782,"data_compressed":2952235,"data_compressed_allocated":3538944,"data_compressed_original":9850880,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:48.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T18:03:48.131 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:48.130+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:48.231 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:48.230+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:48.261 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:48.262 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:48.262 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:03:48.262 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:48.277 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:48.362 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:48.362+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:48.432 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:48.430+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:48.464 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:48.464 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:48.464 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:48.465 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:48.465 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:48.478 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:48.515 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:48.516 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3333/4218 objects degraded (79.018%), 20 pgs degraded","count":20},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":134,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":68,"num_osds":3,"num_up_osds":3,"osd_up_since":1726164102,"num_in_osds":3,"osd_in_since":1726164094,"num_remapped_pgs":17},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":18},{"state_name":"active+undersized+remapped","count":7},{"state_name":"active+recovering+undersized+degraded+remapped","count":2}],"num_pgs":105,"num_pools":4,"num_objects":2109,"data_bytes":136990027,"bytes_used":293617664,"bytes_avail":289616674816,"bytes_total":289910292480,"degraded_objects":3333,"degraded_total":4218,"degraded_ratio":0.79018492176386912,"misplaced_objects":19,"misplaced_total":4218,"misplaced_ratio":0.0045045045045045045},"fsmap":{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4193}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-12T18:03:00.574702+0000","services":{}},"progress_events":{}} 2024-09-12T18:03:48.536 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T18:03:48.536 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:48.566 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:48.566+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:48.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:48.633 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:48.632+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18530 4.b 4.71f6324b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.842113+0000", 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.8045343229999999, 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.50406623900000003, 2024-09-12T18:03:48.648 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842113+0000", 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842113+0000", 2024-09-12T18:03:48.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842114+0000", 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842117+0000", 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7060000000000002e-06 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842128+0000", 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0146000000000001e-05 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842135+0000", 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8569999999999995e-06 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.843146+0000", 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010106500000000001 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.843169+0000", 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3019000000000001e-05 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346142+0000", 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.50297290299999997 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346179+0000", 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7067999999999998e-05 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18596 4.b 4.6942b58b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.857748+0000", 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.788899504, 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48851872800000001, 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.653 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857748+0000", 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857748+0000", 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857750+0000", 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-06 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857757+0000", 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5599999999999996e-06 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857780+0000", 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2585000000000001e-05 2024-09-12T18:03:48.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857799+0000", 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9516000000000001e-05 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857930+0000", 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130176 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857959+0000", 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8926000000000001e-05 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346248+0000", 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48828901000000002 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346266+0000", 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8879e-05 2024-09-12T18:03:48.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18598 4.b 4.33ee45cb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.857897+0000", 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.7887500549999999, 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48843313300000002, 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857897+0000", 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857897+0000", 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857899+0000", 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2089999999999999e-06 2024-09-12T18:03:48.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857907+0000", 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3730000000000004e-06 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857928+0000", 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1138999999999999e-05 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857946+0000", 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8139e-05 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.858082+0000", 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013644300000000001 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.858106+0000", 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3319000000000002e-05 2024-09-12T18:03:48.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346312+0000", 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48820612200000002 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346330+0000", 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8389e-05 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18607 4.b 4.b3d18d0b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.864653+0000", 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.781994211, 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48173963400000003, 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864653+0000", 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864653+0000", 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864655+0000", 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:48.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864663+0000", 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5150000000000006e-06 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864683+0000", 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9966000000000002e-05 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864700+0000", 2024-09-12T18:03:48.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6458999999999999e-05 2024-09-12T18:03:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864831+0000", 2024-09-12T18:03:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013129 2024-09-12T18:03:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864856+0000", 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4782000000000001e-05 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346376+0000", 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48152003700000001 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346393+0000", 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824999999999999e-05 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18757 4.b 4.4cbc24cb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.897357+0000", 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.749290121, 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.44911416599999998, 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.668 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897357+0000", 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897357+0000", 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897359+0000", 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.764e-06 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897365+0000", 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0170000000000002e-06 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897381+0000", 2024-09-12T18:03:48.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5959000000000001e-05 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897392+0000", 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0922e-05 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897510+0000", 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011803000000000001 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897531+0000", 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1165000000000001e-05 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346455+0000", 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.44892420599999999 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346471+0000", 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6103000000000002e-05 2024-09-12T18:03:48.672 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18814 4.b 4.d970f68b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.908234+0000", 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.7384130089999998, 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43829602499999998, 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908234+0000", 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908234+0000", 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908235+0000", 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908239+0000", 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7560000000000001e-06 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908250+0000", 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1589e-05 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908259+0000", 2024-09-12T18:03:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6440000000000006e-06 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908350+0000", 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0532999999999995e-05 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908360+0000", 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0077e-05 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346515+0000", 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43815544099999998 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346530+0000", 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5095e-05 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18849 4.b 4.4975580b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.913467+0000", 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.733180591, 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43313351900000002, 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913467+0000", 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913467+0000", 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913468+0000", 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913475+0000", 2024-09-12T18:03:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8820000000000003e-06 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913488+0000", 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2853e-05 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913498+0000", 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8830000000000001e-06 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913576+0000", 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8144000000000003e-05 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913587+0000", 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1005999999999999e-05 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346577+0000", 2024-09-12T18:03:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43299069299999998 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346600+0000", 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2704000000000001e-05 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18860 4.b 4.9eae664b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.915875+0000", 2024-09-12T18:03:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.7307724790000001, 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43078860200000002, 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915875+0000", 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915875+0000", 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915875+0000", 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4000000000000001e-07 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915879+0000", 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.343e-06 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915887+0000", 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6119999999999999e-06 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915895+0000", 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5909999999999998e-06 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915951+0000", 2024-09-12T18:03:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6310000000000001e-05 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915960+0000", 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1810000000000007e-06 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346643+0000", 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.430682444 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346663+0000", 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0480999999999999e-05 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18887 4.b 4.f40d510b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.921817+0000", 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.724829733, 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.42491394700000001, 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921817+0000", 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921817+0000", 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921818+0000", 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8100000000000001e-07 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921822+0000", 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921832+0000", 2024-09-12T18:03:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8220000000000002e-06 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921838+0000", 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4859999999999997e-06 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921952+0000", 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114109 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921965+0000", 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3642000000000001e-05 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346705+0000", 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.424739794 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346731+0000", 2024-09-12T18:03:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6163e-05 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19179 4.b 4.634eee4b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.006872+0000", 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.639775574, 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.33991898999999998, 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006872+0000", 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006872+0000", 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006872+0000", 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2e-07 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006874+0000", 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0020000000000001e-06 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006880+0000", 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4829999999999999e-06 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006883+0000", 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8229999999999997e-06 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006940+0000", 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6446999999999997e-05 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006960+0000", 2024-09-12T18:03:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.039e-05 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346775+0000", 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.33981520599999998 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346791+0000", 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5119e-05 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19288 4.b 4.c12b0bcb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.232901+0000", 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.4137460850000001, 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.113941142, 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232901+0000", 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232901+0000", 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232902+0000", 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-06 2024-09-12T18:03:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232906+0000", 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3200000000000001e-06 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232922+0000", 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5563e-05 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232935+0000", 2024-09-12T18:03:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3422e-05 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233063+0000", 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012770699999999999 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233086+0000", 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3249000000000001e-05 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346828+0000", 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.11374205799999999 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346842+0000", 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3774000000000001e-05 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19289 4.b 4.9ec6464b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.233110+0000", 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.41353697, 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.113790321, 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233110+0000", 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233110+0000", 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233112+0000", 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2839999999999999e-06 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233118+0000", 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3659999999999997e-06 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233135+0000", 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7082e-05 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233148+0000", 2024-09-12T18:03:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3196e-05 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233256+0000", 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107694 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233277+0000", 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0832999999999999e-05 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346887+0000", 2024-09-12T18:03:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.11361038499999999 2024-09-12T18:03:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346901+0000", 2024-09-12T18:03:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3481e-05 2024-09-12T18:03:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19337 4.b 4.2a59f0cb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.237518+0000", 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.4091290650000001, 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.109485293, 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237518+0000", 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237518+0000", 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237520+0000", 2024-09-12T18:03:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.37e-06 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237525+0000", 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9030000000000001e-06 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237544+0000", 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8306000000000001e-05 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237558+0000", 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3879e-05 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.238807+0000", 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001249682 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.238829+0000", 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2121999999999999e-05 2024-09-12T18:03:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346990+0000", 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.108160591 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347003+0000", 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.344e-05 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19409 4.0 4:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.243686+0000", 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.4029611370000001, 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.071428762000000007, 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243686+0000", 2024-09-12T18:03:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243686+0000", 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243688+0000", 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.844e-06 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243698+0000", 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9019999999999994e-06 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243767+0000", 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9677000000000004e-05 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243788+0000", 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0075e-05 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.258307+0000", 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014519489 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.258563+0000", 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025558599999999998 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.315115+0000", 2024-09-12T18:03:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.056552189000000003 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19467 4.b 4.ad21f40b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.247114+0000", 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.399533355, 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.099938953999999997, 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247114+0000", 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247114+0000", 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247115+0000", 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247139+0000", 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3760999999999998e-05 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247153+0000", 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4304999999999999e-05 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247164+0000", 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0703999999999999e-05 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.250670+0000", 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035068090000000001 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.250682+0000", 2024-09-12T18:03:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1144999999999999e-05 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347041+0000", 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.096359865000000003 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347053+0000", 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19501 4.b 4.d5658f8b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.247842+0000", 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.3988049120000001, 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.099281220000000003, 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247842+0000", 2024-09-12T18:03:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247842+0000", 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247843+0000", 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.95e-07 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247847+0000", 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8820000000000003e-06 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247860+0000", 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3015e-05 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247870+0000", 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8539999999999992e-06 2024-09-12T18:03:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.254003+0000", 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061333719999999998 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.254028+0000", 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4566000000000002e-05 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347108+0000", 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.09308052 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347124+0000", 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5016e-05 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19539 4.b 4.2f7d004b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.248400+0000", 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.3982466979999999, 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.098770102999999998, 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248400+0000", 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248400+0000", 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248401+0000", 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2200000000000003e-07 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248405+0000", 2024-09-12T18:03:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7179999999999998e-06 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248421+0000", 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6191000000000001e-05 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248435+0000", 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3672000000000001e-05 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.258519+0000", 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010084444 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.258542+0000", 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2524999999999999e-05 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347158+0000", 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.088615894000000001 2024-09-12T18:03:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347171+0000", 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2836999999999999e-05 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19550 4.0 4:03f08cc0:::10000000127.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.248612+0000", 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.3980352140000001, 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.069045260999999997, 2024-09-12T18:03:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248612+0000", 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248612+0000", 2024-09-12T18:03:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248613+0000", 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.06e-06 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248617+0000", 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0899999999999998e-06 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248630+0000", 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2941e-05 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248641+0000", 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0509999999999999e-05 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.276251+0000", 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027609977000000001 2024-09-12T18:03:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.276550+0000", 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029953599999999999 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.317657+0000", 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.041107146999999997 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19587 4.b 4.77a43acb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.251693+0000", 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.3949540630000001, 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.095553482999999995, 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251693+0000", 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251693+0000", 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251694+0000", 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2219999999999999e-06 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251699+0000", 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3749999999999996e-06 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251714+0000", 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4851999999999999e-05 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251729+0000", 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5356999999999999e-05 2024-09-12T18:03:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.263152+0000", 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011422773000000001 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.263171+0000", 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8842e-05 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347216+0000", 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.084045864999999997 2024-09-12T18:03:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347247+0000", 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0196999999999999e-05 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19753 4.b 4.6cbd9e0b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.269497+0000", 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.377150052, 2024-09-12T18:03:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.077792044000000005, 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269497+0000", 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269497+0000", 2024-09-12T18:03:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269498+0000", 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.203e-06 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269503+0000", 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3359999999999997e-06 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269518+0000", 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5279999999999999e-05 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269536+0000", 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8209000000000001e-05 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.286497+0000", 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016961266999999999 2024-09-12T18:03:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.286520+0000", 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2266999999999999e-05 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347278+0000", 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.060758210999999999 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347289+0000", 2024-09-12T18:03:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1270999999999999e-05 2024-09-12T18:03:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:48.744 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:48.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:48.746 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:48.742+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:48.783 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:48.783 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:48.803 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:48.803 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:48.825 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:48.846 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:48.849 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:48.844+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:48.863 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-09-12T18:03:48.585969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114546844,"num_objects":532,"num_object_clones":0,"num_object_copies":1064,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532,"num_whiteouts":0,"num_read":2517,"num_read_kb":1208906,"num_write":26624,"num_write_kb":3870091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1856,"num_bytes_recovered":14198054,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30036,"ondisk_log_size":30036,"up":210,"acting":205,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":318488,"kb_used_data":94624,"kb_used_omap":4,"kb_used_meta":223803,"kb_avail":282797032,"statfs":{"total":289910292480,"available":289584160768,"internally_reserved":0,"allocated":96894976,"data_stored":270516918,"data_compressed":42062365,"data_compressed_allocated":53465088,"data_compressed_original":232562688,"omap_allocated":4785,"internal_metadata":229174607},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,18],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-22443183,"num_objects":-1577,"num_object_clones":0,"num_object_copies":-3154,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":-3333,"num_objects_misplaced":-19,"num_objects_unfound":0,"num_objects_dirty":-1577,"num_whiteouts":0,"num_read":-165,"num_read_kb":-63086,"num_write":-43,"num_write_kb":-284722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1551,"num_bytes_recovered":-19943269,"num_keys_recovered":-576,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000892"},"pg_stats":[{"pgid":"4.3f","version":"66'431","reported_seq":588,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342618+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:47.342618+0000","last_peered":"2024-09-12T18:03:47.342618+0000","last_clean":"2024-09-12T18:03:47.342618+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:47.342618+0000","last_undegraded":"2024-09-12T18:03:47.342618+0000","last_fullsized":"2024-09-12T18:03:47.342618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":402,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"66'459","reported_seq":732,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.334383+0000","last_change":"2024-09-12T18:03:47.344901+0000","last_active":"2024-09-12T18:03:47.344901+0000","last_peered":"2024-09-12T18:03:47.334383+0000","last_clean":"2024-09-12T18:03:38.936262+0000","last_became_active":"2024-09-12T18:03:42.058566+0000","last_became_peered":"2024-09-12T18:03:42.058566+0000","last_unstale":"2024-09-12T18:03:47.334383+0000","last_undegraded":"2024-09-12T18:03:41.974628+0000","last_fullsized":"2024-09-12T18:03:41.972330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30760,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":427,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"66'368","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339198+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:47.339198+0000","last_peered":"2024-09-12T18:03:47.339198+0000","last_clean":"2024-09-12T18:03:47.339198+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:47.339198+0000","last_undegraded":"2024-09-12T18:03:47.339198+0000","last_fullsized":"2024-09-12T18:03:47.339198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":338,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"66'376","reported_seq":508,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337522+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:47.337522+0000","last_peered":"2024-09-12T18:03:47.337522+0000","last_clean":"2024-09-12T18:03:47.337522+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:47.337522+0000","last_undegraded":"2024-09-12T18:03:47.337522+0000","last_fullsized":"2024-09-12T18:03:47.337522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":337,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"66'448","reported_seq":626,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345430+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:47.345430+0000","last_peered":"2024-09-12T18:03:47.345430+0000","last_clean":"2024-09-12T18:03:47.345430+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:47.345430+0000","last_undegraded":"2024-09-12T18:03:47.345430+0000","last_fullsized":"2024-09-12T18:03:47.345430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16695,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":423,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"66'365","reported_seq":489,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336564+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:47.336564+0000","last_peered":"2024-09-12T18:03:47.336564+0000","last_clean":"2024-09-12T18:03:47.336564+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:47.336564+0000","last_undegraded":"2024-09-12T18:03:47.336564+0000","last_fullsized":"2024-09-12T18:03:47.336564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6570,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":337,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"66'425","reported_seq":600,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346020+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:47.346020+0000","last_peered":"2024-09-12T18:03:47.346020+0000","last_clean":"2024-09-12T18:03:47.346020+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:47.346020+0000","last_undegraded":"2024-09-12T18:03:47.346020+0000","last_fullsized":"2024-09-12T18:03:47.346020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26761,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":398,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"66'404","reported_seq":868,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.331063+0000","last_change":"2024-09-12T18:03:47.344226+0000","last_active":"2024-09-12T18:03:47.344226+0000","last_peered":"2024-09-12T18:03:47.331063+0000","last_clean":"2024-09-12T18:03:39.938070+0000","last_became_active":"2024-09-12T18:03:42.051143+0000","last_became_peered":"2024-09-12T18:03:42.051143+0000","last_unstale":"2024-09-12T18:03:47.331063+0000","last_undegraded":"2024-09-12T18:03:41.968420+0000","last_fullsized":"2024-09-12T18:03:41.961304+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345495,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":366,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"66'393","reported_seq":511,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.349849+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:47.349849+0000","last_peered":"2024-09-12T18:03:47.349849+0000","last_clean":"2024-09-12T18:03:47.349849+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:47.349849+0000","last_undegraded":"2024-09-12T18:03:47.349849+0000","last_fullsized":"2024-09-12T18:03:47.349849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29922,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":355,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"65'372","reported_seq":897,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.345185+0000","last_change":"2024-09-12T18:03:46.332377+0000","last_active":"2024-09-12T18:03:46.332377+0000","last_peered":"2024-09-12T18:03:45.972802+0000","last_clean":"2024-09-12T18:03:39.946744+0000","last_became_active":"2024-09-12T18:03:42.054676+0000","last_became_peered":"2024-09-12T18:03:42.054676+0000","last_unstale":"2024-09-12T18:03:47.345185+0000","last_undegraded":"2024-09-12T18:03:47.345185+0000","last_fullsized":"2024-09-12T18:03:47.345185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56312,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":358,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"66'359","reported_seq":511,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339660+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:47.339660+0000","last_peered":"2024-09-12T18:03:47.339660+0000","last_clean":"2024-09-12T18:03:47.339660+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:47.339660+0000","last_undegraded":"2024-09-12T18:03:47.339660+0000","last_fullsized":"2024-09-12T18:03:47.339660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18793,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":338,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"66'354","reported_seq":493,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341087+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:47.341087+0000","last_peered":"2024-09-12T18:03:47.341087+0000","last_clean":"2024-09-12T18:03:47.341087+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:47.341087+0000","last_undegraded":"2024-09-12T18:03:47.341087+0000","last_fullsized":"2024-09-12T18:03:47.341087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24461,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":329,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"66'382","reported_seq":503,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345188+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:47.345188+0000","last_peered":"2024-09-12T18:03:47.345188+0000","last_clean":"2024-09-12T18:03:47.345188+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:47.345188+0000","last_undegraded":"2024-09-12T18:03:47.345188+0000","last_fullsized":"2024-09-12T18:03:47.345188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":347,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"66'415","reported_seq":572,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336714+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:47.336714+0000","last_peered":"2024-09-12T18:03:47.336714+0000","last_clean":"2024-09-12T18:03:47.336714+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:47.336714+0000","last_undegraded":"2024-09-12T18:03:47.336714+0000","last_fullsized":"2024-09-12T18:03:47.336714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30382,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":388,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"66'430","reported_seq":576,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346330+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:47.346330+0000","last_peered":"2024-09-12T18:03:47.346330+0000","last_clean":"2024-09-12T18:03:47.346330+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:47.346330+0000","last_undegraded":"2024-09-12T18:03:47.346330+0000","last_fullsized":"2024-09-12T18:03:47.346330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1541,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":393,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"66'455","reported_seq":639,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342057+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:47.342057+0000","last_peered":"2024-09-12T18:03:47.342057+0000","last_clean":"2024-09-12T18:03:47.342057+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:47.342057+0000","last_undegraded":"2024-09-12T18:03:47.342057+0000","last_fullsized":"2024-09-12T18:03:47.342057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107438,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":423,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"66'421","reported_seq":566,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351372+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:47.351372+0000","last_peered":"2024-09-12T18:03:47.351372+0000","last_clean":"2024-09-12T18:03:47.351372+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:47.351372+0000","last_undegraded":"2024-09-12T18:03:47.351372+0000","last_fullsized":"2024-09-12T18:03:47.351372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63741,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":390,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"66'398","reported_seq":535,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.309045+0000","last_change":"2024-09-12T18:03:47.346596+0000","last_active":"2024-09-12T18:03:47.346596+0000","last_peered":"2024-09-12T18:03:47.309045+0000","last_clean":"2024-09-12T18:03:39.944065+0000","last_became_active":"2024-09-12T18:03:42.058753+0000","last_became_peered":"2024-09-12T18:03:42.058753+0000","last_unstale":"2024-09-12T18:03:47.309045+0000","last_undegraded":"2024-09-12T18:03:41.974699+0000","last_fullsized":"2024-09-12T18:03:41.972473+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24788,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":363,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"66'453","reported_seq":628,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.310360+0000","last_change":"2024-09-12T18:03:47.342842+0000","last_active":"2024-09-12T18:03:47.342842+0000","last_peered":"2024-09-12T18:03:47.310360+0000","last_clean":"2024-09-12T18:03:39.933624+0000","last_became_active":"2024-09-12T18:03:42.029653+0000","last_became_peered":"2024-09-12T18:03:42.029653+0000","last_unstale":"2024-09-12T18:03:47.310360+0000","last_undegraded":"2024-09-12T18:03:41.966171+0000","last_fullsized":"2024-09-12T18:03:41.962893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":414,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"66'427","reported_seq":556,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337921+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:47.337921+0000","last_peered":"2024-09-12T18:03:47.337921+0000","last_clean":"2024-09-12T18:03:47.337921+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:47.337921+0000","last_undegraded":"2024-09-12T18:03:47.337921+0000","last_fullsized":"2024-09-12T18:03:47.337921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":392,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"66'388","reported_seq":864,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.344348+0000","last_change":"2024-09-12T18:03:47.344348+0000","last_active":"2024-09-12T18:03:47.344348+0000","last_peered":"2024-09-12T18:03:47.317829+0000","last_clean":"2024-09-12T18:03:39.923110+0000","last_became_active":"2024-09-12T18:03:42.049745+0000","last_became_peered":"2024-09-12T18:03:42.049745+0000","last_unstale":"2024-09-12T18:03:47.344348+0000","last_undegraded":"2024-09-12T18:03:47.344348+0000","last_fullsized":"2024-09-12T18:03:47.344348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109013,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":366,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"66'435","reported_seq":596,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340093+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:47.340093+0000","last_peered":"2024-09-12T18:03:47.340093+0000","last_clean":"2024-09-12T18:03:47.340093+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:47.340093+0000","last_undegraded":"2024-09-12T18:03:47.340093+0000","last_fullsized":"2024-09-12T18:03:47.340093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15312,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":404,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.341554+0000","last_change":"2024-09-12T18:03:47.657951+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.341554+0000","last_undegraded":"2024-09-12T18:03:47.341554+0000","last_fullsized":"2024-09-12T18:03:47.341554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"66'455","reported_seq":1016,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.344371+0000","last_change":"2024-09-12T18:03:47.344371+0000","last_active":"2024-09-12T18:03:47.344371+0000","last_peered":"2024-09-12T18:03:47.308489+0000","last_clean":"2024-09-12T18:03:39.936313+0000","last_became_active":"2024-09-12T18:03:42.054140+0000","last_became_peered":"2024-09-12T18:03:42.054140+0000","last_unstale":"2024-09-12T18:03:47.344371+0000","last_undegraded":"2024-09-12T18:03:47.344371+0000","last_fullsized":"2024-09-12T18:03:47.344371+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41757,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":427,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"66'386","reported_seq":510,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342731+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:47.342731+0000","last_peered":"2024-09-12T18:03:47.342731+0000","last_clean":"2024-09-12T18:03:47.342731+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:47.342731+0000","last_undegraded":"2024-09-12T18:03:47.342731+0000","last_fullsized":"2024-09-12T18:03:47.342731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":363,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"66'465","reported_seq":605,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351830+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:47.351830+0000","last_peered":"2024-09-12T18:03:47.351830+0000","last_clean":"2024-09-12T18:03:47.351830+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:47.351830+0000","last_undegraded":"2024-09-12T18:03:47.351830+0000","last_fullsized":"2024-09-12T18:03:47.351830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72515,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":415,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"66'404","reported_seq":556,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342041+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:47.342041+0000","last_peered":"2024-09-12T18:03:47.342041+0000","last_clean":"2024-09-12T18:03:47.342041+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:47.342041+0000","last_undegraded":"2024-09-12T18:03:47.342041+0000","last_fullsized":"2024-09-12T18:03:47.342041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32467,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":371,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"66'407","reported_seq":566,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342230+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:47.342230+0000","last_peered":"2024-09-12T18:03:47.342230+0000","last_clean":"2024-09-12T18:03:47.342230+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:47.342230+0000","last_undegraded":"2024-09-12T18:03:47.342230+0000","last_fullsized":"2024-09-12T18:03:47.342230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":381,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.351543+0000","last_change":"2024-09-12T18:03:47.657983+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.351543+0000","last_undegraded":"2024-09-12T18:03:47.351543+0000","last_fullsized":"2024-09-12T18:03:47.351543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"66'464","reported_seq":589,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336442+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:47.336442+0000","last_peered":"2024-09-12T18:03:47.336442+0000","last_clean":"2024-09-12T18:03:47.336442+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:47.336442+0000","last_undegraded":"2024-09-12T18:03:47.336442+0000","last_fullsized":"2024-09-12T18:03:47.336442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":429,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.347203+0000","last_change":"2024-09-12T18:03:47.657903+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.347203+0000","last_undegraded":"2024-09-12T18:03:47.347203+0000","last_fullsized":"2024-09-12T18:03:47.347203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"66'420","reported_seq":559,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342189+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:47.342189+0000","last_peered":"2024-09-12T18:03:47.342189+0000","last_clean":"2024-09-12T18:03:47.342189+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:47.342189+0000","last_undegraded":"2024-09-12T18:03:47.342189+0000","last_fullsized":"2024-09-12T18:03:47.342189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9279,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":390,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"66'401","reported_seq":585,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341232+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:47.341232+0000","last_peered":"2024-09-12T18:03:47.341232+0000","last_clean":"2024-09-12T18:03:47.341232+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:47.341232+0000","last_undegraded":"2024-09-12T18:03:47.341232+0000","last_fullsized":"2024-09-12T18:03:47.341232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47373,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":364,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":557,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344206+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:47.344206+0000","last_peered":"2024-09-12T18:03:47.344206+0000","last_clean":"2024-09-12T18:03:47.344206+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:47.344206+0000","last_undegraded":"2024-09-12T18:03:47.344206+0000","last_fullsized":"2024-09-12T18:03:47.344206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'375","reported_seq":520,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342433+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:47.342433+0000","last_peered":"2024-09-12T18:03:47.342433+0000","last_clean":"2024-09-12T18:03:47.342433+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:47.342433+0000","last_undegraded":"2024-09-12T18:03:47.342433+0000","last_fullsized":"2024-09-12T18:03:47.342433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21606,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":342,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"66'48","reported_seq":158,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345412+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:47.345412+0000","last_peered":"2024-09-12T18:03:47.345412+0000","last_clean":"2024-09-12T18:03:47.345412+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:47.345412+0000","last_undegraded":"2024-09-12T18:03:47.345412+0000","last_fullsized":"2024-09-12T18:03:47.345412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'413","reported_seq":547,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.353039+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:47.353039+0000","last_peered":"2024-09-12T18:03:47.353039+0000","last_clean":"2024-09-12T18:03:47.353039+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:47.353039+0000","last_undegraded":"2024-09-12T18:03:47.353039+0000","last_fullsized":"2024-09-12T18:03:47.353039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63820,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":377,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":179,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340895+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:47.340895+0000","last_peered":"2024-09-12T18:03:47.340895+0000","last_clean":"2024-09-12T18:03:47.340895+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:47.340895+0000","last_undegraded":"2024-09-12T18:03:47.340895+0000","last_fullsized":"2024-09-12T18:03:47.340895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"66'403","reported_seq":547,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.350154+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:47.350154+0000","last_peered":"2024-09-12T18:03:47.350154+0000","last_clean":"2024-09-12T18:03:47.350154+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:47.350154+0000","last_undegraded":"2024-09-12T18:03:47.350154+0000","last_fullsized":"2024-09-12T18:03:47.350154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":371,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'58","reported_seq":169,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342330+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:47.342330+0000","last_peered":"2024-09-12T18:03:47.342330+0000","last_clean":"2024-09-12T18:03:47.342330+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:47.342330+0000","last_undegraded":"2024-09-12T18:03:47.342330+0000","last_fullsized":"2024-09-12T18:03:47.342330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"66'136","reported_seq":247,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341572+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:47.341572+0000","last_peered":"2024-09-12T18:03:47.341572+0000","last_clean":"2024-09-12T18:03:47.341572+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:47.341572+0000","last_undegraded":"2024-09-12T18:03:47.341572+0000","last_fullsized":"2024-09-12T18:03:47.341572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"66'426","reported_seq":560,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342883+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:47.342883+0000","last_peered":"2024-09-12T18:03:47.342883+0000","last_clean":"2024-09-12T18:03:47.342883+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:47.342883+0000","last_undegraded":"2024-09-12T18:03:47.342883+0000","last_fullsized":"2024-09-12T18:03:47.342883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23187,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":388,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":360,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346393+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:47.346393+0000","last_peered":"2024-09-12T18:03:47.346393+0000","last_clean":"2024-09-12T18:03:47.346393+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:47.346393+0000","last_undegraded":"2024-09-12T18:03:47.346393+0000","last_fullsized":"2024-09-12T18:03:47.346393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"66'450","reported_seq":1004,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.294765+0000","last_change":"2024-09-12T18:03:47.342090+0000","last_active":"2024-09-12T18:03:47.342090+0000","last_peered":"2024-09-12T18:03:47.294765+0000","last_clean":"2024-09-12T18:03:47.294765+0000","last_became_active":"2024-09-12T18:03:45.331702+0000","last_became_peered":"2024-09-12T18:03:45.331702+0000","last_unstale":"2024-09-12T18:03:47.294765+0000","last_undegraded":"2024-09-12T18:03:47.294765+0000","last_fullsized":"2024-09-12T18:03:47.294765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37829,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":418,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343646+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:47.343646+0000","last_peered":"2024-09-12T18:03:47.343646+0000","last_clean":"2024-09-12T18:03:47.343646+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:47.343646+0000","last_undegraded":"2024-09-12T18:03:47.343646+0000","last_fullsized":"2024-09-12T18:03:47.343646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"66'417","reported_seq":567,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336707+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:47.336707+0000","last_peered":"2024-09-12T18:03:47.336707+0000","last_clean":"2024-09-12T18:03:47.336707+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:47.336707+0000","last_undegraded":"2024-09-12T18:03:47.336707+0000","last_fullsized":"2024-09-12T18:03:47.336707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67729,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":377,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"66'52","reported_seq":163,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341954+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:47.341954+0000","last_peered":"2024-09-12T18:03:47.341954+0000","last_clean":"2024-09-12T18:03:47.341954+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:47.341954+0000","last_undegraded":"2024-09-12T18:03:47.341954+0000","last_fullsized":"2024-09-12T18:03:47.341954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"58'380","reported_seq":507,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.343478+0000","last_change":"2024-09-12T18:03:47.343478+0000","last_active":"2024-09-12T18:03:47.343478+0000","last_peered":"2024-09-12T18:03:39.930535+0000","last_clean":"2024-09-12T18:03:39.930535+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:03:47.343478+0000","last_undegraded":"2024-09-12T18:03:47.343478+0000","last_fullsized":"2024-09-12T18:03:47.343478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285729,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":353,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.346480+0000","last_change":"2024-09-12T18:03:47.657992+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.346480+0000","last_undegraded":"2024-09-12T18:03:47.346480+0000","last_fullsized":"2024-09-12T18:03:47.346480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"66'452","reported_seq":1015,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.314910+0000","last_change":"2024-09-12T18:03:47.339339+0000","last_active":"2024-09-12T18:03:47.339339+0000","last_peered":"2024-09-12T18:03:47.314910+0000","last_clean":"2024-09-12T18:03:47.314910+0000","last_became_active":"2024-09-12T18:03:45.332775+0000","last_became_peered":"2024-09-12T18:03:45.332775+0000","last_unstale":"2024-09-12T18:03:47.314910+0000","last_undegraded":"2024-09-12T18:03:47.314910+0000","last_fullsized":"2024-09-12T18:03:47.314910+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207450,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":417,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":228,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336949+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:47.336949+0000","last_peered":"2024-09-12T18:03:47.336949+0000","last_clean":"2024-09-12T18:03:47.336949+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:47.336949+0000","last_undegraded":"2024-09-12T18:03:47.336949+0000","last_fullsized":"2024-09-12T18:03:47.336949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":577,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342278+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:47.342278+0000","last_peered":"2024-09-12T18:03:47.342278+0000","last_clean":"2024-09-12T18:03:47.342278+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:47.342278+0000","last_undegraded":"2024-09-12T18:03:47.342278+0000","last_fullsized":"2024-09-12T18:03:47.342278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":162,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341026+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:47.341026+0000","last_peered":"2024-09-12T18:03:47.341026+0000","last_clean":"2024-09-12T18:03:47.341026+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:47.341026+0000","last_undegraded":"2024-09-12T18:03:47.341026+0000","last_fullsized":"2024-09-12T18:03:47.341026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"66'373","reported_seq":518,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348160+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:47.348160+0000","last_peered":"2024-09-12T18:03:47.348160+0000","last_clean":"2024-09-12T18:03:47.348160+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:47.348160+0000","last_undegraded":"2024-09-12T18:03:47.348160+0000","last_fullsized":"2024-09-12T18:03:47.348160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36721,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":342,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"66'481","reported_seq":602,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.949736+0000","last_change":"2024-09-12T18:03:47.339759+0000","last_active":"2024-09-12T18:03:47.339759+0000","last_peered":"2024-09-12T18:03:46.949736+0000","last_clean":"2024-09-12T18:03:46.949736+0000","last_became_active":"2024-09-12T18:03:43.330781+0000","last_became_peered":"2024-09-12T18:03:43.330781+0000","last_unstale":"2024-09-12T18:03:46.949736+0000","last_undegraded":"2024-09-12T18:03:46.949736+0000","last_fullsized":"2024-09-12T18:03:46.949736+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'379","reported_seq":506,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351079+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:47.351079+0000","last_peered":"2024-09-12T18:03:47.351079+0000","last_clean":"2024-09-12T18:03:47.351079+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:47.351079+0000","last_undegraded":"2024-09-12T18:03:47.351079+0000","last_fullsized":"2024-09-12T18:03:47.351079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32157,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":335,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":262,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343934+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:47.343934+0000","last_peered":"2024-09-12T18:03:47.343934+0000","last_clean":"2024-09-12T18:03:47.343934+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:47.343934+0000","last_undegraded":"2024-09-12T18:03:47.343934+0000","last_fullsized":"2024-09-12T18:03:47.343934+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":125,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346578+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:47.346578+0000","last_peered":"2024-09-12T18:03:47.346578+0000","last_clean":"2024-09-12T18:03:47.346578+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:47.346578+0000","last_undegraded":"2024-09-12T18:03:47.346578+0000","last_fullsized":"2024-09-12T18:03:47.346578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":679,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345859+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:47.345859+0000","last_peered":"2024-09-12T18:03:47.345859+0000","last_clean":"2024-09-12T18:03:47.345859+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:47.345859+0000","last_undegraded":"2024-09-12T18:03:47.345859+0000","last_fullsized":"2024-09-12T18:03:47.345859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"66'431","reported_seq":561,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342452+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:47.342452+0000","last_peered":"2024-09-12T18:03:47.342452+0000","last_clean":"2024-09-12T18:03:47.342452+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:47.342452+0000","last_undegraded":"2024-09-12T18:03:47.342452+0000","last_fullsized":"2024-09-12T18:03:47.342452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19446,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":389,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342703+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:47.342703+0000","last_peered":"2024-09-12T18:03:47.342703+0000","last_clean":"2024-09-12T18:03:47.342703+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:47.342703+0000","last_undegraded":"2024-09-12T18:03:47.342703+0000","last_fullsized":"2024-09-12T18:03:47.342703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.342797+0000","last_change":"2024-09-12T18:03:47.657939+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.342797+0000","last_undegraded":"2024-09-12T18:03:47.342797+0000","last_fullsized":"2024-09-12T18:03:47.342797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"65'433","reported_seq":1013,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.345716+0000","last_change":"2024-09-12T18:03:46.332516+0000","last_active":"2024-09-12T18:03:46.332516+0000","last_peered":"2024-09-12T18:03:45.999807+0000","last_clean":"2024-09-12T18:03:39.941039+0000","last_became_active":"2024-09-12T18:03:42.054484+0000","last_became_peered":"2024-09-12T18:03:42.054484+0000","last_unstale":"2024-09-12T18:03:47.345716+0000","last_undegraded":"2024-09-12T18:03:47.345716+0000","last_fullsized":"2024-09-12T18:03:47.345716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264752,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":415,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344469+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:47.344469+0000","last_peered":"2024-09-12T18:03:47.344469+0000","last_clean":"2024-09-12T18:03:47.344469+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:47.344469+0000","last_undegraded":"2024-09-12T18:03:47.344469+0000","last_fullsized":"2024-09-12T18:03:47.344469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"66'373","reported_seq":483,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343984+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:47.343984+0000","last_peered":"2024-09-12T18:03:47.343984+0000","last_clean":"2024-09-12T18:03:47.343984+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:47.343984+0000","last_undegraded":"2024-09-12T18:03:47.343984+0000","last_fullsized":"2024-09-12T18:03:47.343984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.341653+0000","last_change":"2024-09-12T18:03:47.658063+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.341653+0000","last_undegraded":"2024-09-12T18:03:47.341653+0000","last_fullsized":"2024-09-12T18:03:47.341653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337075+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:47.337075+0000","last_peered":"2024-09-12T18:03:47.337075+0000","last_clean":"2024-09-12T18:03:47.337075+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:47.337075+0000","last_undegraded":"2024-09-12T18:03:47.337075+0000","last_fullsized":"2024-09-12T18:03:47.337075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"66'72","reported_seq":183,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344740+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:47.344740+0000","last_peered":"2024-09-12T18:03:47.344740+0000","last_clean":"2024-09-12T18:03:47.344740+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:47.344740+0000","last_undegraded":"2024-09-12T18:03:47.344740+0000","last_fullsized":"2024-09-12T18:03:47.344740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"66'412","reported_seq":606,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348900+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:47.348900+0000","last_peered":"2024-09-12T18:03:47.348900+0000","last_clean":"2024-09-12T18:03:47.348900+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:47.348900+0000","last_undegraded":"2024-09-12T18:03:47.348900+0000","last_fullsized":"2024-09-12T18:03:47.348900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":376,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"66'299","reported_seq":410,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342685+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:47.342685+0000","last_peered":"2024-09-12T18:03:47.342685+0000","last_clean":"2024-09-12T18:03:47.342685+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:47.342685+0000","last_undegraded":"2024-09-12T18:03:47.342685+0000","last_fullsized":"2024-09-12T18:03:47.342685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348948+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:47.348948+0000","last_peered":"2024-09-12T18:03:47.348948+0000","last_clean":"2024-09-12T18:03:47.348948+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:47.348948+0000","last_undegraded":"2024-09-12T18:03:47.348948+0000","last_fullsized":"2024-09-12T18:03:47.348948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"66'356","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340096+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:47.340096+0000","last_peered":"2024-09-12T18:03:47.340096+0000","last_clean":"2024-09-12T18:03:47.340096+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:47.340096+0000","last_undegraded":"2024-09-12T18:03:47.340096+0000","last_fullsized":"2024-09-12T18:03:47.340096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":322,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.962047+0000","last_change":"2024-09-12T18:03:39.949422+0000","last_active":"2024-09-12T18:01:53.672138+0000","last_peered":"2024-09-12T18:01:53.672138+0000","last_clean":"2024-09-12T18:01:53.672138+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:40.962047+0000","last_undegraded":"2024-09-12T18:03:40.962047+0000","last_fullsized":"2024-09-12T18:03:40.962047+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.332114+0000","last_change":"2024-09-12T18:03:47.343843+0000","last_active":"2024-09-12T18:03:47.343843+0000","last_peered":"2024-09-12T18:03:46.332114+0000","last_clean":"2024-09-12T18:03:46.332114+0000","last_became_active":"2024-09-12T18:03:40.975455+0000","last_became_peered":"2024-09-12T18:03:40.975455+0000","last_unstale":"2024-09-12T18:03:46.332114+0000","last_undegraded":"2024-09-12T18:03:46.332114+0000","last_fullsized":"2024-09-12T18:03:46.332114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"66'375","reported_seq":516,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345295+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:47.345295+0000","last_peered":"2024-09-12T18:03:47.345295+0000","last_clean":"2024-09-12T18:03:47.345295+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:47.345295+0000","last_undegraded":"2024-09-12T18:03:47.345295+0000","last_fullsized":"2024-09-12T18:03:47.345295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":342,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'55","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.967391+0000","last_change":"2024-09-12T18:03:39.951414+0000","last_active":"2024-09-12T18:03:39.951414+0000","last_peered":"2024-09-12T18:01:55.589453+0000","last_clean":"2024-09-12T18:01:55.589453+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:03:40.967391+0000","last_undegraded":"2024-09-12T18:03:40.967391+0000","last_fullsized":"2024-09-12T18:03:40.967391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.977229+0000","last_change":"2024-09-12T18:03:39.954023+0000","last_active":"2024-09-12T18:01:49.503848+0000","last_peered":"2024-09-12T18:01:49.503848+0000","last_clean":"2024-09-12T18:01:49.503848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:40.977229+0000","last_undegraded":"2024-09-12T18:03:40.977229+0000","last_fullsized":"2024-09-12T18:03:40.977229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"58'339","reported_seq":437,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.347326+0000","last_change":"2024-09-12T18:03:47.345346+0000","last_active":"2024-09-12T18:03:47.345346+0000","last_peered":"2024-09-12T18:03:39.923074+0000","last_clean":"2024-09-12T18:03:39.923074+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:03:47.347326+0000","last_undegraded":"2024-09-12T18:03:47.347326+0000","last_fullsized":"2024-09-12T18:03:47.347326+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222083,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":317,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.354291+0000","last_change":"2024-09-12T18:03:47.658042+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.354291+0000","last_undegraded":"2024-09-12T18:03:47.354291+0000","last_fullsized":"2024-09-12T18:03:47.354291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341703+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:47.341703+0000","last_peered":"2024-09-12T18:03:47.341703+0000","last_clean":"2024-09-12T18:03:47.341703+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:47.341703+0000","last_undegraded":"2024-09-12T18:03:47.341703+0000","last_fullsized":"2024-09-12T18:03:47.341703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"66'386","reported_seq":544,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340768+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:47.340768+0000","last_peered":"2024-09-12T18:03:47.340768+0000","last_clean":"2024-09-12T18:03:47.340768+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:47.340768+0000","last_undegraded":"2024-09-12T18:03:47.340768+0000","last_fullsized":"2024-09-12T18:03:47.340768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34066,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":349,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'399","reported_seq":549,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339372+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:47.339372+0000","last_peered":"2024-09-12T18:03:47.339372+0000","last_clean":"2024-09-12T18:03:47.339372+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:47.339372+0000","last_undegraded":"2024-09-12T18:03:47.339372+0000","last_fullsized":"2024-09-12T18:03:47.339372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8779,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":362,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":338,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341682+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:47.341682+0000","last_peered":"2024-09-12T18:03:47.341682+0000","last_clean":"2024-09-12T18:03:47.341682+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:47.341682+0000","last_undegraded":"2024-09-12T18:03:47.341682+0000","last_fullsized":"2024-09-12T18:03:47.341682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"66'434","reported_seq":583,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345289+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:47.345289+0000","last_peered":"2024-09-12T18:03:47.345289+0000","last_clean":"2024-09-12T18:03:47.345289+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:47.345289+0000","last_undegraded":"2024-09-12T18:03:47.345289+0000","last_fullsized":"2024-09-12T18:03:47.345289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257690,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":398,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"66'94","reported_seq":204,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342593+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:47.342593+0000","last_peered":"2024-09-12T18:03:47.342593+0000","last_clean":"2024-09-12T18:03:47.342593+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:47.342593+0000","last_undegraded":"2024-09-12T18:03:47.342593+0000","last_fullsized":"2024-09-12T18:03:47.342593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"66'185","reported_seq":307,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.919068+0000","last_change":"2024-09-12T18:03:47.348832+0000","last_active":"2024-09-12T18:03:47.348832+0000","last_peered":"2024-09-12T18:03:46.919068+0000","last_clean":"2024-09-12T18:03:46.919068+0000","last_became_active":"2024-09-12T18:03:43.331938+0000","last_became_peered":"2024-09-12T18:03:43.331938+0000","last_unstale":"2024-09-12T18:03:46.919068+0000","last_undegraded":"2024-09-12T18:03:46.919068+0000","last_fullsized":"2024-09-12T18:03:46.919068+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3329809,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"66'480","reported_seq":678,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344138+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:47.344138+0000","last_peered":"2024-09-12T18:03:47.344138+0000","last_clean":"2024-09-12T18:03:47.344138+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:47.344138+0000","last_undegraded":"2024-09-12T18:03:47.344138+0000","last_fullsized":"2024-09-12T18:03:47.344138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79412,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":446,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"65'54","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:46.331190+0000","last_change":"2024-09-12T18:03:47.658078+0000","last_active":"2024-09-12T18:03:47.658078+0000","last_peered":"2024-09-12T18:03:46.331190+0000","last_clean":"2024-09-12T18:03:46.331190+0000","last_became_active":"2024-09-12T18:03:40.982653+0000","last_became_peered":"2024-09-12T18:03:40.982653+0000","last_unstale":"2024-09-12T18:03:46.331190+0000","last_undegraded":"2024-09-12T18:03:46.331190+0000","last_fullsized":"2024-09-12T18:03:46.331190+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"58'399","reported_seq":542,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.346217+0000","last_change":"2024-09-12T18:03:47.341121+0000","last_active":"2024-09-12T18:03:47.341121+0000","last_peered":"2024-09-12T18:03:39.939093+0000","last_clean":"2024-09-12T18:03:39.939093+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:03:47.346217+0000","last_undegraded":"2024-09-12T18:03:47.346217+0000","last_fullsized":"2024-09-12T18:03:47.346217+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270119,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":376,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"66'367","reported_seq":512,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342832+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:47.342832+0000","last_peered":"2024-09-12T18:03:47.342832+0000","last_clean":"2024-09-12T18:03:47.342832+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:47.342832+0000","last_undegraded":"2024-09-12T18:03:47.342832+0000","last_fullsized":"2024-09-12T18:03:47.342832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20570,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":342,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"66'652","reported_seq":762,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344056+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:47.344056+0000","last_peered":"2024-09-12T18:03:47.344056+0000","last_clean":"2024-09-12T18:03:47.344056+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:47.344056+0000","last_undegraded":"2024-09-12T18:03:47.344056+0000","last_fullsized":"2024-09-12T18:03:47.344056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"66'428","reported_seq":600,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.312409+0000","last_change":"2024-09-12T18:03:47.347694+0000","last_active":"2024-09-12T18:03:47.347694+0000","last_peered":"2024-09-12T18:03:47.312409+0000","last_clean":"2024-09-12T18:03:39.932171+0000","last_became_active":"2024-09-12T18:03:42.054957+0000","last_became_peered":"2024-09-12T18:03:42.054957+0000","last_unstale":"2024-09-12T18:03:47.312409+0000","last_undegraded":"2024-09-12T18:03:41.977297+0000","last_fullsized":"2024-09-12T18:03:41.964490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447021,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":399,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.345290+0000","last_change":"2024-09-12T18:03:47.657929+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.345290+0000","last_undegraded":"2024-09-12T18:03:47.345290+0000","last_fullsized":"2024-09-12T18:03:47.345290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"66'388","reported_seq":534,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341393+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:47.341393+0000","last_peered":"2024-09-12T18:03:47.341393+0000","last_clean":"2024-09-12T18:03:47.341393+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:47.341393+0000","last_undegraded":"2024-09-12T18:03:47.341393+0000","last_fullsized":"2024-09-12T18:03:47.341393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64033,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":343,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"66'211","reported_seq":321,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340225+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:47.340225+0000","last_peered":"2024-09-12T18:03:47.340225+0000","last_clean":"2024-09-12T18:03:47.340225+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:47.340225+0000","last_undegraded":"2024-09-12T18:03:47.340225+0000","last_fullsized":"2024-09-12T18:03:47.340225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12335716,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":12125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"66'369","reported_seq":827,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.307915+0000","last_change":"2024-09-12T18:03:47.339885+0000","last_active":"2024-09-12T18:03:47.339885+0000","last_peered":"2024-09-12T18:03:47.307915+0000","last_clean":"2024-09-12T18:03:47.307915+0000","last_became_active":"2024-09-12T18:03:44.328158+0000","last_became_peered":"2024-09-12T18:03:44.328158+0000","last_unstale":"2024-09-12T18:03:47.307915+0000","last_undegraded":"2024-09-12T18:03:47.307915+0000","last_fullsized":"2024-09-12T18:03:47.307915+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":339,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":161,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345496+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:47.345496+0000","last_peered":"2024-09-12T18:03:47.345496+0000","last_clean":"2024-09-12T18:03:47.345496+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:47.345496+0000","last_undegraded":"2024-09-12T18:03:47.345496+0000","last_fullsized":"2024-09-12T18:03:47.345496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"66'366","reported_seq":827,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.318081+0000","last_change":"2024-09-12T18:03:47.338487+0000","last_active":"2024-09-12T18:03:47.338487+0000","last_peered":"2024-09-12T18:03:47.318081+0000","last_clean":"2024-09-12T18:03:47.318081+0000","last_became_active":"2024-09-12T18:03:46.338563+0000","last_became_peered":"2024-09-12T18:03:46.338563+0000","last_unstale":"2024-09-12T18:03:47.318081+0000","last_undegraded":"2024-09-12T18:03:47.318081+0000","last_fullsized":"2024-09-12T18:03:47.318081+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67687,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":339,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"66'179","reported_seq":303,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.979087+0000","last_change":"2024-09-12T18:03:47.339862+0000","last_active":"2024-09-12T18:03:47.339862+0000","last_peered":"2024-09-12T18:03:46.979087+0000","last_clean":"2024-09-12T18:03:46.979087+0000","last_became_active":"2024-09-12T18:03:43.332784+0000","last_became_peered":"2024-09-12T18:03:43.332784+0000","last_unstale":"2024-09-12T18:03:46.979087+0000","last_undegraded":"2024-09-12T18:03:46.979087+0000","last_fullsized":"2024-09-12T18:03:46.979087+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"66'393","reported_seq":887,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.316554+0000","last_change":"2024-09-12T18:03:47.337760+0000","last_active":"2024-09-12T18:03:47.337760+0000","last_peered":"2024-09-12T18:03:47.316554+0000","last_clean":"2024-09-12T18:03:47.316554+0000","last_became_active":"2024-09-12T18:03:43.327322+0000","last_became_peered":"2024-09-12T18:03:43.327322+0000","last_unstale":"2024-09-12T18:03:47.316554+0000","last_undegraded":"2024-09-12T18:03:47.316554+0000","last_fullsized":"2024-09-12T18:03:47.316554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28513,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":364,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'274","reported_seq":384,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342487+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:47.342487+0000","last_peered":"2024-09-12T18:03:47.342487+0000","last_clean":"2024-09-12T18:03:47.342487+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:47.342487+0000","last_undegraded":"2024-09-12T18:03:47.342487+0000","last_fullsized":"2024-09-12T18:03:47.342487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"66'388","reported_seq":521,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341152+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:47.341152+0000","last_peered":"2024-09-12T18:03:47.341152+0000","last_clean":"2024-09-12T18:03:47.341152+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:47.341152+0000","last_undegraded":"2024-09-12T18:03:47.341152+0000","last_fullsized":"2024-09-12T18:03:47.341152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":354,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.974472+0000","last_change":"2024-09-12T18:03:39.953369+0000","last_active":"2024-09-12T18:03:39.953369+0000","last_peered":"2024-09-12T18:03:11.472248+0000","last_clean":"2024-09-12T18:03:11.472248+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:03:40.974472+0000","last_undegraded":"2024-09-12T18:03:40.974472+0000","last_fullsized":"2024-09-12T18:03:40.974472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"66'447","reported_seq":625,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342575+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:47.342575+0000","last_peered":"2024-09-12T18:03:47.342575+0000","last_clean":"2024-09-12T18:03:47.342575+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:47.342575+0000","last_undegraded":"2024-09-12T18:03:47.342575+0000","last_fullsized":"2024-09-12T18:03:47.342575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":414,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.344918+0000","last_change":"2024-09-12T18:03:47.658053+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.344918+0000","last_undegraded":"2024-09-12T18:03:47.344918+0000","last_fullsized":"2024-09-12T18:03:47.344918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":5150861,"num_objects":485,"num_object_clones":0,"num_object_copies":970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":485,"num_whiteouts":0,"num_read":2431,"num_read_kb":1208833,"num_write":22517,"num_write_kb":3759279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1851,"num_bytes_recovered":2479618,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11350016,"data_stored":13087022,"data_compressed":3344745,"data_compressed_allocated":3870720,"data_compressed_original":9039872,"omap_allocated":0,"internal_metadata":0},"log_size":24431,"ondisk_log_size":24431,"up":128,"acting":123,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":108805596,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3960,"num_write_kb":108138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11718417,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81002496,"data_stored":254055994,"data_compressed":38530927,"data_compressed_allocated":49352704,"data_compressed_original":222466048,"omap_allocated":0,"internal_metadata":0},"log_size":5490,"ondisk_log_size":5490,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98328,"kb_used_data":22788,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94273512,"statfs":{"total":96636764160,"available":96536076288,"internally_reserved":0,"allocated":23334912,"data_stored":52557698,"data_compressed":8099373,"data_compressed_allocated":10391552,"data_compressed_original":41910272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,18],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738397,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101704,"kb_used_data":38644,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94270136,"statfs":{"total":96636764160,"available":96532619264,"internally_reserved":0,"allocated":39571456,"data_stored":115124319,"data_compressed":17630008,"data_compressed_allocated":22261760,"data_compressed_original":99889152,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118456,"kb_used_data":33192,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94253384,"statfs":{"total":96636764160,"available":96515465216,"internally_reserved":0,"allocated":33988608,"data_stored":102834901,"data_compressed":16332984,"data_compressed_allocated":20811776,"data_compressed_original":90763264,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30388224,"data_stored":97915065,"data_compressed":15106567,"data_compressed_allocated":19410944,"data_compressed_original":86966272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33931264,"data_stored":110250747,"data_compressed":16784133,"data_compressed_allocated":21250048,"data_compressed_original":97595392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16683008,"data_stored":45890182,"data_compressed":6640227,"data_compressed_allocated":8691712,"data_compressed_original":37904384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":4063859,"data_compressed":1191165,"data_compressed_allocated":1355776,"data_compressed_original":3223552,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2322432,"data_stored":2621237,"data_compressed":694434,"data_compressed_allocated":815104,"data_compressed_original":1810432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6074368,"data_stored":6401926,"data_compressed":1459146,"data_compressed_allocated":1699840,"data_compressed_original":4005888,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:48.883 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:48.883 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:48.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:48.950 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:48.946+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:49.051 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:49.048+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:49.060 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:49.061 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:49.075 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:49.152 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:49.150+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:49.240 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:49.240 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:49.253 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:49.250+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:49.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:49.354 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:49.348+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:49.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T18:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:49.440 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:49.455 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:49.454+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:49.557 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:49.556+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:49.564 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:49.564 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:49.581 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:49.658 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:49.654+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:49.714 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:49.762 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:49.762+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:49.859 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:49.858+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:49.861 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:49.960 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:49.956+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:49.982 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:49.982 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:49.996 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:50.061 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:50.058+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:50.117 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:50.117 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:50.131 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:50.175 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:50.172+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:50.262 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:50.262+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:50.264 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:50.264 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:50.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:50.350 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-09-12T18:03:50.368 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:50.362+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:50.451 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:50.451 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:50.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:50.465 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:50.462+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:50.566 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:50.562+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:50.586 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:50.586 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:50.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:50.666 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:50.666+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:50.734 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:50.734 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:50.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:50.767 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:50.764+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:50.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T18:03:50.868 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:50.866+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:50.916 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:50.916 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:50.930 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:50.969 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:50.966+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:51.007 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:51.028 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:51.029 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:51.047 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:51.047 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:51.057 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19283 4.16 4:6a54d456:::1000000001c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.8242069249999999, 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067243629999999999, 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.058 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.059 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231965+0000", 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231968+0000", 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3629999999999998e-06 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231978+0000", 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9990000000000003e-06 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231985+0000", 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0140000000000001e-06 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232114+0000", 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012873600000000001 2024-09-12T18:03:51.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232343+0000", 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022858399999999999 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299208+0000", 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066865220000000003 2024-09-12T18:03:51.062 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18530 4.b 4:d24c6f8e:::10000002a1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7210912440000001, 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0437163759999999, 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.063 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335083+0000", 2024-09-12T18:03:51.064 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3699999999999999e-06 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335114+0000", 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0901000000000001e-05 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335143+0000", 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8932999999999999e-05 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335161+0000", 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8244999999999999e-05 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335271+0000", 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010988 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335279+0000", 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1140000000000006e-06 2024-09-12T18:03:51.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344500+0000", 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092206690000000008 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344528+0000", 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8181999999999999e-05 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.067 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.372191+0000", 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.027662643 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.372511+0000", 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031996900000000003 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.372701+0000", 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189932 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.068 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.376797+0000", 2024-09-12T18:03:51.069 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004096662 2024-09-12T18:03:51.069 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.069 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.069 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.069 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.378392+0000", 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015951769999999999 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.378575+0000", 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000182139 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.378796+0000", 2024-09-12T18:03:51.070 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022156000000000001 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18596 4.b 4:d1ad4296:::100000026be.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7209664789999999, 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0441835989999999, 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.071 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.072 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335206+0000", 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.212e-06 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335212+0000", 2024-09-12T18:03:51.073 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5769999999999999e-06 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335230+0000", 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7955999999999999e-05 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335246+0000", 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5302999999999999e-05 2024-09-12T18:03:51.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335372+0000", 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012597699999999999 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335378+0000", 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720000000000003e-06 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.075 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344616+0000", 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092381770000000002 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344637+0000", 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699e-05 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.076 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.374048+0000", 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.029411101 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.374330+0000", 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028211000000000002 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.077 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.374652+0000", 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032179600000000001 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.377172+0000", 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025199879999999999 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379102+0000", 2024-09-12T18:03:51.078 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001929865 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379185+0000", 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3312999999999993e-05 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379388+0000", 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000203253 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.079 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18598 4.b 4:d3a277cc:::100000026d6.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7208984630000002, 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.044465693, 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.080 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335274+0000", 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0109999999999999e-06 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335279+0000", 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6060000000000002e-06 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.082 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335297+0000", 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7676000000000002e-05 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335310+0000", 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2782999999999999e-05 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.083 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335488+0000", 2024-09-12T18:03:51.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017866599999999999 2024-09-12T18:03:51.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.084 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.084 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.084 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335499+0000", 2024-09-12T18:03:51.084 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1163e-05 2024-09-12T18:03:51.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344720+0000", 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092202329999999996 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344742+0000", 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2048999999999998e-05 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.375576+0000", 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0308340819999999 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.375839+0000", 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026327300000000001 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.086 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.375979+0000", 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014022500000000001 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.378921+0000", 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029412930000000002 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379417+0000", 2024-09-12T18:03:51.087 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00049664499999999999 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379534+0000", 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011686199999999999 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379738+0000", 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000204126 2024-09-12T18:03:51.088 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18607 4.b 4:d0b18bcd:::100000026f1.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.720838445, 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.047144088, 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.089 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335334+0000", 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6299999999999993e-07 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335338+0000", 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6829999999999999e-06 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335356+0000", 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7655999999999998e-05 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335368+0000", 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-05 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.092 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335552+0000", 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018376500000000001 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4410000000000001e-06 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.093 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345030+0000", 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0094724470000000002 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345053+0000", 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3683e-05 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.094 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.377271+0000", 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.032217401 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.377459+0000", 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018783499999999999 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.377650+0000", 2024-09-12T18:03:51.095 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000190998 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379078+0000", 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001428973 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382291+0000", 2024-09-12T18:03:51.096 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032126699999999999 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382352+0000", 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1202000000000001e-05 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382477+0000", 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012433100000000001 2024-09-12T18:03:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18757 4.b 4:d3243d32:::100000028a4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7207798639999998, 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0500087810000001, 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.098 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335392+0000", 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9500000000000001e-07 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335397+0000", 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9219999999999996e-06 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.100 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335413+0000", 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5886e-05 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335425+0000", 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2282e-05 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.101 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335612+0000", 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018647499999999999 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335620+0000", 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2430000000000005e-06 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345191+0000", 2024-09-12T18:03:51.102 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095711770000000002 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345221+0000", 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9666e-05 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379850+0000", 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0346295029999999 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.380172+0000", 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000321954 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.380352+0000", 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000179533 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.104 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.383953+0000", 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003601216 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385161+0000", 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012084960000000001 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.105 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385261+0000", 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9421999999999998e-05 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385400+0000", 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139111 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18814 4.b 4:d16f0e9b:::1000000291e.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7207022030000001, 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.050263653, 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.107 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335470+0000", 2024-09-12T18:03:51.108 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0690000000000001e-06 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335475+0000", 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3020000000000002e-06 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335493+0000", 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7949e-05 2024-09-12T18:03:51.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335506+0000", 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2865e-05 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335663+0000", 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015690100000000001 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.110 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335668+0000", 2024-09-12T18:03:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3469999999999998e-06 2024-09-12T18:03:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345320+0000", 2024-09-12T18:03:51.111 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096513759999999997 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345342+0000", 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2056e-05 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.381105+0000", 2024-09-12T18:03:51.112 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.035763462 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.381382+0000", 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000276373 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.381553+0000", 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017170900000000001 2024-09-12T18:03:51.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.384067+0000", 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025136020000000002 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385422+0000", 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013551940000000001 2024-09-12T18:03:51.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385512+0000", 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0005000000000003e-05 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385732+0000", 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022044299999999999 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.115 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18849 4.b 4:d01aae92:::100000029aa.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7206140990000001, 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0538638819999999, 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.116 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335558+0000", 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0219999999999999e-06 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335563+0000", 2024-09-12T18:03:51.118 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.429e-06 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335581+0000", 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7635999999999999e-05 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335594+0000", 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979999999999999e-05 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.119 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335708+0000", 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114351 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335716+0000", 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9899999999999997e-06 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.120 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347521+0000", 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011804434000000001 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347547+0000", 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6393e-05 2024-09-12T18:03:51.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382585+0000", 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0350375469999999 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382858+0000", 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027304400000000001 2024-09-12T18:03:51.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.383112+0000", 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025417899999999999 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.386903+0000", 2024-09-12T18:03:51.123 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037911020000000002 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389121+0000", 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022178850000000002 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389216+0000", 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4790000000000006e-05 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.124 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389421+0000", 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0002051 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18860 4.b 4:d2667579:::100000029c4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:51.125 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7205573809999999, 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0542451399999999, 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.126 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335615+0000", 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5099999999999998e-07 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.127 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335619+0000", 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6890000000000003e-06 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335636+0000", 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6211000000000001e-05 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.128 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335660+0000", 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4671000000000001e-05 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335742+0000", 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1735000000000003e-05 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.129 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335747+0000", 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3020000000000002e-06 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347645+0000", 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011898089000000001 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347666+0000", 2024-09-12T18:03:51.130 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0712000000000001e-05 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.384157+0000", 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0364911459999999 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.384378+0000", 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000221072 2024-09-12T18:03:51.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.384513+0000", 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013463099999999999 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389451+0000", 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004938039 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.132 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389537+0000", 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6408000000000003e-05 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389640+0000", 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102305 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.133 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389859+0000", 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021917900000000001 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18887 4.b 4:d08ab02f:::10000002a82.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7204850399999998, 2024-09-12T18:03:51.134 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.054842348, 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.135 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335687+0000", 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0669999999999999e-06 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.136 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335721+0000", 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4218999999999999e-05 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335744+0000", 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3116e-05 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.137 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335764+0000", 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9145999999999999e-05 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335820+0000", 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6932000000000003e-05 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335826+0000", 2024-09-12T18:03:51.138 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-06 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348074+0000", 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012248458 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348102+0000", 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7889999999999999e-05 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.139 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385817+0000", 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037714786 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.386041+0000", 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000224143 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.140 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.386192+0000", 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000151347 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389899+0000", 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003706174 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.141 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390061+0000", 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016214499999999999 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390241+0000", 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018020300000000001 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390528+0000", 2024-09-12T18:03:51.142 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028736199999999999 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19179 4.b 4:d27772c6:::10000002c76.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7203794960000001, 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0551001250000001, 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.143 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:51.144 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335793+0000", 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.31e-06 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335798+0000", 2024-09-12T18:03:51.145 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335818+0000", 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9695999999999999e-05 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335832+0000", 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4276e-05 2024-09-12T18:03:51.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335883+0000", 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0751000000000002e-05 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335888+0000", 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5260000000000001e-06 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.147 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348183+0000", 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012294312999999999 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348204+0000", 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1769000000000001e-05 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.148 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.386986+0000", 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.038781532 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.387187+0000", 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020144 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.149 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.387334+0000", 2024-09-12T18:03:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014667400000000001 2024-09-12T18:03:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:51.150 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390645+0000", 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033110320000000002 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390667+0000", 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2272999999999998e-05 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:51.151 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390745+0000", 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7478000000000006e-05 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390892+0000", 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014692500000000001 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.152 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19288 4.b 4:d3d0d483:::10000000021.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7203141510000002, 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.059489788, 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.153 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.154 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335858+0000", 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335863+0000", 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0000000000000004e-06 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.155 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335881+0000", 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8352999999999999e-05 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335895+0000", 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4073000000000001e-05 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.156 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335949+0000", 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3402999999999997e-05 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335954+0000", 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4879999999999998e-06 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.157 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348279+0000", 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012324504 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348301+0000", 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2056e-05 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.388033+0000", 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0397318900000001 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.388315+0000", 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028241900000000001 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.159 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.395347+0000", 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070316889999999998 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19289 4.b 4:d2626379:::10000000022.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.720251266, 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0601435320000001, 2024-09-12T18:03:51.160 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:51.161 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335921+0000", 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335926+0000", 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9230000000000001e-06 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.162 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335944+0000", 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7802999999999999e-05 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335957+0000", 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3883000000000001e-05 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.163 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336008+0000", 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0102999999999998e-05 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336013+0000", 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.164 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348363+0000", 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012350517 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348383+0000", 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9729e-05 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.391169+0000", 2024-09-12T18:03:51.165 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0427862919999999 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.391553+0000", 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000383466 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.396063+0000", 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004510371 2024-09-12T18:03:51.166 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19337 4.b 4:d30f9a54:::10000000052.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7201904140000002, 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0604883190000001, 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.167 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335982+0000", 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335987+0000", 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.006e-06 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.169 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336008+0000", 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1248999999999999e-05 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336022+0000", 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.448e-05 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.170 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336081+0000", 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8526000000000002e-05 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336087+0000", 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6919999999999999e-06 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.171 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348475+0000", 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012388771999999999 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348487+0000", 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.172 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.392703+0000", 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.044216512 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.392864+0000", 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000160576 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.173 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.396469+0000", 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036050560000000001 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19467 4.b 4:d02f84b5:::100000000d4.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7201247200000003, 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0637080590000001, 2024-09-12T18:03:51.174 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.175 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336047+0000", 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.094e-06 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336053+0000", 2024-09-12T18:03:51.176 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.113e-06 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336074+0000", 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1506e-05 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336087+0000", 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3373000000000001e-05 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.177 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336138+0000", 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0217999999999999e-05 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336143+0000", 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4419999999999997e-06 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.178 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348572+0000", 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012429295999999999 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348595+0000", 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2671999999999999e-05 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.179 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.393509+0000", 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.044914004 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.393865+0000", 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000356304 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.399754+0000", 2024-09-12T18:03:51.180 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058890369999999997 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19501 4.b 4:d1f1a6ab:::100000000f6.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7200594950000001, 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0646696760000001, 2024-09-12T18:03:51.181 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.182 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336113+0000", 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-06 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336118+0000", 2024-09-12T18:03:51.183 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0699999999999997e-06 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336136+0000", 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8286000000000001e-05 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336150+0000", 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3842999999999999e-05 2024-09-12T18:03:51.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336200+0000", 2024-09-12T18:03:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0123000000000001e-05 2024-09-12T18:03:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.185 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336205+0000", 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3839999999999996e-06 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348675+0000", 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012470088000000001 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.186 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348695+0000", 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9680000000000001e-05 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.396570+0000", 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.047874832 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.396810+0000", 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000240227 2024-09-12T18:03:51.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.400781+0000", 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039710860000000004 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19539 4.b 4:d200bef4:::1000000011c.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.188 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.719997529, 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.065106361, 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336175+0000", 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.006e-06 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.190 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336180+0000", 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.023e-06 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336199+0000", 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9323000000000001e-05 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.191 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336213+0000", 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4187e-05 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336266+0000", 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2649999999999999e-05 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.192 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336271+0000", 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2700000000000004e-06 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348780+0000", 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012509456 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348805+0000", 2024-09-12T18:03:51.193 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4663000000000001e-05 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.397611+0000", 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0488059830000001 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.397854+0000", 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000242993 2024-09-12T18:03:51.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.401280+0000", 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034258069999999999 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19587 4.b 4:d35c25ee:::1000000014c.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:51.195 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.7199336110000001, 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06542493, 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.196 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336239+0000", 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.13e-06 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.197 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336243+0000", 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8860000000000003e-06 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336263+0000", 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9856000000000001e-05 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336276+0000", 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.293e-05 2024-09-12T18:03:51.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336326+0000", 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9895999999999998e-05 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336332+0000", 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5419999999999996e-06 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.199 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348924+0000", 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012592671999999999 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348948+0000", 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3791e-05 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.398631+0000", 2024-09-12T18:03:51.200 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0496827609999999 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.398839+0000", 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020819999999999999 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.401662+0000", 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028232660000000001 2024-09-12T18:03:51.201 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19753 4.b 4:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.719870856, 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0657822180000001, 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:51.202 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.203 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336301+0000", 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.043e-06 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336306+0000", 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2530000000000004e-06 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.204 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336325+0000", 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8243000000000001e-05 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336338+0000", 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3473e-05 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.205 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336388+0000", 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9381e-05 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336393+0000", 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5480000000000001e-06 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.349033+0000", 2024-09-12T18:03:51.206 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012640175999999999 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.349054+0000", 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1016999999999999e-05 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.399825+0000", 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.05077022 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.399991+0000", 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016663499999999999 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.402082+0000", 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002091229 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19759 3.6 3.4b2c82a6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.741583+0000", 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 3.3145879699999998, 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59937238000000004, 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:51.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741583+0000", 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741583+0000", 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:51.210 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741586+0000", 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4669999999999998e-06 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741598+0000", 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1996e-05 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741630+0000", 2024-09-12T18:03:51.211 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2061999999999999e-05 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741654+0000", 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3992999999999999e-05 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741783+0000", 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012956999999999999 2024-09-12T18:03:51.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741791+0000", 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8429999999999993e-06 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.340923+0000", 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59913189600000005 2024-09-12T18:03:51.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.340955+0000", 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2552999999999998e-05 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:51.214 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:51.217 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:51.217 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:51.214+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:51.317 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:51.312+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:51.349 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:51.349 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:51.349 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:03:51.349 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:51.365 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:51.419 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:51.418+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:51.486 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:51.487 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:51.487 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:51.487 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:51.487 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:51.501 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:51.547 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:51.546+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:51.621 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:51.616+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18530 4.b 4.71f6324b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.842113+0000", 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7837628509999996, 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.50406623900000003, 2024-09-12T18:03:51.627 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842113+0000", 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842113+0000", 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842114+0000", 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842117+0000", 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7060000000000002e-06 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842128+0000", 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0146000000000001e-05 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.842135+0000", 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8569999999999995e-06 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.843146+0000", 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010106500000000001 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.843169+0000", 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3019000000000001e-05 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346142+0000", 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.50297290299999997 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346179+0000", 2024-09-12T18:03:51.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7067999999999998e-05 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18596 4.b 4.6942b58b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.857748+0000", 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7681280319999999, 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48851872800000001, 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.632 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857748+0000", 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857748+0000", 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857750+0000", 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0760000000000001e-06 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857757+0000", 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5599999999999996e-06 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857780+0000", 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2585000000000001e-05 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857799+0000", 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9516000000000001e-05 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857930+0000", 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000130176 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857959+0000", 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8926000000000001e-05 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346248+0000", 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48828901000000002 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346266+0000", 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8879e-05 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18598 4.b 4.33ee45cb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.857897+0000", 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7679785829999997, 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48843313300000002, 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.637 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857897+0000", 2024-09-12T18:03:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857897+0000", 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857899+0000", 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2089999999999999e-06 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857907+0000", 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3730000000000004e-06 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857928+0000", 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1138999999999999e-05 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.857946+0000", 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8139e-05 2024-09-12T18:03:51.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.858082+0000", 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013644300000000001 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.858106+0000", 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3319000000000002e-05 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346312+0000", 2024-09-12T18:03:51.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48820612200000002 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346330+0000", 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8389e-05 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18607 4.b 4.b3d18d0b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.642 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.864653+0000", 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7612227389999999, 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48173963400000003, 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864653+0000", 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864653+0000", 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864655+0000", 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7600000000000001e-06 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864663+0000", 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5150000000000006e-06 2024-09-12T18:03:51.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864683+0000", 2024-09-12T18:03:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9966000000000002e-05 2024-09-12T18:03:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864700+0000", 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6458999999999999e-05 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864831+0000", 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013129 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.864856+0000", 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4782000000000001e-05 2024-09-12T18:03:51.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346376+0000", 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.48152003700000001 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346393+0000", 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6824999999999999e-05 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18757 4.b 4.4cbc24cb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.897357+0000", 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7285186489999997, 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.44911416599999998, 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897357+0000", 2024-09-12T18:03:51.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897357+0000", 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897359+0000", 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.764e-06 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897365+0000", 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0170000000000002e-06 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897381+0000", 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5959000000000001e-05 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897392+0000", 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0922e-05 2024-09-12T18:03:51.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897510+0000", 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011803000000000001 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.897531+0000", 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1165000000000001e-05 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346455+0000", 2024-09-12T18:03:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.44892420599999999 2024-09-12T18:03:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346471+0000", 2024-09-12T18:03:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6103000000000002e-05 2024-09-12T18:03:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.652 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18814 4.b 4.d970f68b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.908234+0000", 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7176415370000004, 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43829602499999998, 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908234+0000", 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908234+0000", 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908235+0000", 2024-09-12T18:03:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8999999999999995e-07 2024-09-12T18:03:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908239+0000", 2024-09-12T18:03:51.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7560000000000001e-06 2024-09-12T18:03:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908250+0000", 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1589e-05 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908259+0000", 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6440000000000006e-06 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908350+0000", 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0532999999999995e-05 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.908360+0000", 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0077e-05 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346515+0000", 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43815544099999998 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346530+0000", 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5095e-05 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18849 4.b 4.4975580b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.913467+0000", 2024-09-12T18:03:51.659 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7124091190000001, 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43313351900000002, 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913467+0000", 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913467+0000", 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913468+0000", 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3540000000000001e-06 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913475+0000", 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8820000000000003e-06 2024-09-12T18:03:51.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913488+0000", 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2853e-05 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913498+0000", 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8830000000000001e-06 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913576+0000", 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8144000000000003e-05 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.913587+0000", 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1005999999999999e-05 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346577+0000", 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43299069299999998 2024-09-12T18:03:51.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346600+0000", 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2704000000000001e-05 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18860 4.b 4.9eae664b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.915875+0000", 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7100010069999998, 2024-09-12T18:03:51.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.43078860200000002, 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915875+0000", 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915875+0000", 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915875+0000", 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4000000000000001e-07 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.666 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915879+0000", 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.343e-06 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915887+0000", 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6119999999999999e-06 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915895+0000", 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5909999999999998e-06 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915951+0000", 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6310000000000001e-05 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.915960+0000", 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1810000000000007e-06 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346643+0000", 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.430682444 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346663+0000", 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0480999999999999e-05 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:18887 4.b 4.f40d510b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:46.921817+0000", 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.7040582610000001, 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.42491394700000001, 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921817+0000", 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921817+0000", 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921818+0000", 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8100000000000001e-07 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921822+0000", 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0500000000000002e-06 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921832+0000", 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8220000000000002e-06 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921838+0000", 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4859999999999997e-06 2024-09-12T18:03:51.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921952+0000", 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114109 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:46.921965+0000", 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3642000000000001e-05 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346705+0000", 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.424739794 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346731+0000", 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6163e-05 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19179 4.b 4.634eee4b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.006872+0000", 2024-09-12T18:03:51.674 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.6190041019999999, 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.33991898999999998, 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006872+0000", 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006872+0000", 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006872+0000", 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2e-07 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006874+0000", 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0020000000000001e-06 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006880+0000", 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4829999999999999e-06 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006883+0000", 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8229999999999997e-06 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006940+0000", 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6446999999999997e-05 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.006960+0000", 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.039e-05 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346775+0000", 2024-09-12T18:03:51.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.33981520599999998 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346791+0000", 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5119e-05 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19288 4.b 4.c12b0bcb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.232901+0000", 2024-09-12T18:03:51.679 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3929746129999998, 2024-09-12T18:03:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.113941142, 2024-09-12T18:03:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232901+0000", 2024-09-12T18:03:51.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232901+0000", 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232902+0000", 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.049e-06 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232906+0000", 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3200000000000001e-06 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232922+0000", 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5563e-05 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.232935+0000", 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3422e-05 2024-09-12T18:03:51.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233063+0000", 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012770699999999999 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233086+0000", 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3249000000000001e-05 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346828+0000", 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.11374205799999999 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346842+0000", 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3774000000000001e-05 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.685 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19289 4.b 4.9ec6464b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.233110+0000", 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3927654980000002, 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.113790321, 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233110+0000", 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233110+0000", 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233112+0000", 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2839999999999999e-06 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233118+0000", 2024-09-12T18:03:51.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3659999999999997e-06 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233135+0000", 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7082e-05 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233148+0000", 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3196e-05 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233256+0000", 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107694 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.233277+0000", 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0832999999999999e-05 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346887+0000", 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.11361038499999999 2024-09-12T18:03:51.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346901+0000", 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3481e-05 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19337 4.b 4.2a59f0cb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.237518+0000", 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3883575930000003, 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.109485293, 2024-09-12T18:03:51.690 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237518+0000", 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237518+0000", 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237520+0000", 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.37e-06 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237525+0000", 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9030000000000001e-06 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237544+0000", 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8306000000000001e-05 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.237558+0000", 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3879e-05 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.238807+0000", 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001249682 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.238829+0000", 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2121999999999999e-05 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.346990+0000", 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.108160591 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347003+0000", 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.344e-05 2024-09-12T18:03:51.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19409 4.0 4:03c4ee74:::1000000009a.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.243686+0000", 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3821896650000003, 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.071428762000000007, 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.695 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243686+0000", 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243686+0000", 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243688+0000", 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.844e-06 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243698+0000", 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9019999999999994e-06 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243767+0000", 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9677000000000004e-05 2024-09-12T18:03:51.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.243788+0000", 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0075e-05 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.258307+0000", 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014519489 2024-09-12T18:03:51.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.258563+0000", 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025558599999999998 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.315115+0000", 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.056552189000000003 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19467 4.b 4.ad21f40b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.247114+0000", 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3787618830000001, 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.099938953999999997, 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247114+0000", 2024-09-12T18:03:51.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247114+0000", 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247115+0000", 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6599999999999994e-07 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247139+0000", 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3760999999999998e-05 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247153+0000", 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4304999999999999e-05 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247164+0000", 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0703999999999999e-05 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.250670+0000", 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035068090000000001 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.250682+0000", 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1144999999999999e-05 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347041+0000", 2024-09-12T18:03:51.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.096359865000000003 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347053+0000", 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1399e-05 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19501 4.b 4.d5658f8b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.247842+0000", 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3780334400000003, 2024-09-12T18:03:51.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.099281220000000003, 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247842+0000", 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247842+0000", 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247843+0000", 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.95e-07 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247847+0000", 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8820000000000003e-06 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247860+0000", 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3015e-05 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.247870+0000", 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8539999999999992e-06 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.254003+0000", 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061333719999999998 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.254028+0000", 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4566000000000002e-05 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347108+0000", 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.09308052 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347124+0000", 2024-09-12T18:03:51.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5016e-05 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19539 4.b 4.2f7d004b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.248400+0000", 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3774752259999996, 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.098770102999999998, 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248400+0000", 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248400+0000", 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248401+0000", 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2200000000000003e-07 2024-09-12T18:03:51.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248405+0000", 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7179999999999998e-06 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248421+0000", 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6191000000000001e-05 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248435+0000", 2024-09-12T18:03:51.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3672000000000001e-05 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.258519+0000", 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010084444 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.258542+0000", 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2524999999999999e-05 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347158+0000", 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.088615894000000001 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347171+0000", 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2836999999999999e-05 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.713 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19550 4.0 4:03f08cc0:::10000000127.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.248612+0000", 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3772637420000002, 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.069045260999999997, 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248612+0000", 2024-09-12T18:03:51.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248612+0000", 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248613+0000", 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.06e-06 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248617+0000", 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0899999999999998e-06 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248630+0000", 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2941e-05 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.248641+0000", 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0509999999999999e-05 2024-09-12T18:03:51.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.276251+0000", 2024-09-12T18:03:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027609977000000001 2024-09-12T18:03:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-12T18:03:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.276550+0000", 2024-09-12T18:03:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029953599999999999 2024-09-12T18:03:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.317657+0000", 2024-09-12T18:03:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.041107146999999997 2024-09-12T18:03:51.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19587 4.b 4.77a43acb (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.251693+0000", 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3741825910000003, 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.095553482999999995, 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.719 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251693+0000", 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251693+0000", 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251694+0000", 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2219999999999999e-06 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251699+0000", 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3749999999999996e-06 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251714+0000", 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4851999999999999e-05 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.251729+0000", 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5356999999999999e-05 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.263152+0000", 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011422773000000001 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.263171+0000", 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8842e-05 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347216+0000", 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.084045864999999997 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347247+0000", 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0196999999999999e-05 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(mds.0.3:19753 4.b 4.6cbd9e0b (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-12T18:03:47.269497+0000", 2024-09-12T18:03:51.725 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.3563785800000003, 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.077792044000000005, 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269497+0000", 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269497+0000", 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269498+0000", 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.203e-06 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-12T18:03:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269503+0000", 2024-09-12T18:03:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3359999999999997e-06 2024-09-12T18:03:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-12T18:03:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269518+0000", 2024-09-12T18:03:51.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5279999999999999e-05 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.269536+0000", 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8209000000000001e-05 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.286497+0000", 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016961266999999999 2024-09-12T18:03:51.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for peered", 2024-09-12T18:03:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.286520+0000", 2024-09-12T18:03:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2266999999999999e-05 2024-09-12T18:03:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347278+0000", 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.060758210999999999 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-12T18:03:47.347289+0000", 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1270999999999999e-05 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.731 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:03:51.732 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-12T18:03:51.732 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:51.734 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:51.734 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:51.730+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:51.835 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:51.832+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:51.865 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:51.866 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:51.866 INFO:teuthology.orchestra.run.smithi121.stdout: "num_ops": 0 2024-09-12T18:03:51.866 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:51.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:51.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:51.935 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:51.934+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:52.036 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:52.032+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:52.038 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:52.039 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [], 2024-09-12T18:03:52.039 INFO:teuthology.orchestra.run.smithi121.stdout: "complaint_time": 30, 2024-09-12T18:03:52.039 INFO:teuthology.orchestra.run.smithi121.stdout: "num_blocked_ops": 0 2024-09-12T18:03:52.039 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:52.052 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:52.137 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:52.134+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:52.190 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:52.192 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:52.210 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-12T18:03:51.355838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114546844,"num_objects":532,"num_object_clones":0,"num_object_copies":1064,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532,"num_whiteouts":0,"num_read":2517,"num_read_kb":1208906,"num_write":26624,"num_write_kb":3870091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1856,"num_bytes_recovered":14198054,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30036,"ondisk_log_size":30036,"up":210,"acting":205,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":318488,"kb_used_data":94624,"kb_used_omap":4,"kb_used_meta":223803,"kb_avail":282797032,"statfs":{"total":289910292480,"available":289584160768,"internally_reserved":0,"allocated":96894976,"data_stored":270516918,"data_compressed":42062365,"data_compressed_allocated":53465088,"data_compressed_original":232562688,"omap_allocated":4785,"internal_metadata":229174607},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,18],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-22443183,"num_objects":-1577,"num_object_clones":0,"num_object_copies":-3154,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":-3333,"num_objects_misplaced":-19,"num_objects_unfound":0,"num_objects_dirty":-1577,"num_whiteouts":0,"num_read":-165,"num_read_kb":-63086,"num_write":-43,"num_write_kb":-284722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1551,"num_bytes_recovered":-19943269,"num_keys_recovered":-576,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.022756"},"pg_stats":[{"pgid":"4.3f","version":"66'431","reported_seq":588,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342618+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:47.342618+0000","last_peered":"2024-09-12T18:03:47.342618+0000","last_clean":"2024-09-12T18:03:47.342618+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:47.342618+0000","last_undegraded":"2024-09-12T18:03:47.342618+0000","last_fullsized":"2024-09-12T18:03:47.342618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":402,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"66'459","reported_seq":732,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.334383+0000","last_change":"2024-09-12T18:03:47.344901+0000","last_active":"2024-09-12T18:03:47.344901+0000","last_peered":"2024-09-12T18:03:47.334383+0000","last_clean":"2024-09-12T18:03:38.936262+0000","last_became_active":"2024-09-12T18:03:42.058566+0000","last_became_peered":"2024-09-12T18:03:42.058566+0000","last_unstale":"2024-09-12T18:03:47.334383+0000","last_undegraded":"2024-09-12T18:03:41.974628+0000","last_fullsized":"2024-09-12T18:03:41.972330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30760,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":427,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"66'368","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339198+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:47.339198+0000","last_peered":"2024-09-12T18:03:47.339198+0000","last_clean":"2024-09-12T18:03:47.339198+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:47.339198+0000","last_undegraded":"2024-09-12T18:03:47.339198+0000","last_fullsized":"2024-09-12T18:03:47.339198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":338,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"66'376","reported_seq":508,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337522+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:47.337522+0000","last_peered":"2024-09-12T18:03:47.337522+0000","last_clean":"2024-09-12T18:03:47.337522+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:47.337522+0000","last_undegraded":"2024-09-12T18:03:47.337522+0000","last_fullsized":"2024-09-12T18:03:47.337522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":337,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"66'448","reported_seq":626,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345430+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:47.345430+0000","last_peered":"2024-09-12T18:03:47.345430+0000","last_clean":"2024-09-12T18:03:47.345430+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:47.345430+0000","last_undegraded":"2024-09-12T18:03:47.345430+0000","last_fullsized":"2024-09-12T18:03:47.345430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16695,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":423,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"66'365","reported_seq":489,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336564+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:47.336564+0000","last_peered":"2024-09-12T18:03:47.336564+0000","last_clean":"2024-09-12T18:03:47.336564+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:47.336564+0000","last_undegraded":"2024-09-12T18:03:47.336564+0000","last_fullsized":"2024-09-12T18:03:47.336564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6570,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":337,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"66'425","reported_seq":600,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346020+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:47.346020+0000","last_peered":"2024-09-12T18:03:47.346020+0000","last_clean":"2024-09-12T18:03:47.346020+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:47.346020+0000","last_undegraded":"2024-09-12T18:03:47.346020+0000","last_fullsized":"2024-09-12T18:03:47.346020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26761,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":398,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"66'404","reported_seq":868,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.331063+0000","last_change":"2024-09-12T18:03:47.344226+0000","last_active":"2024-09-12T18:03:47.344226+0000","last_peered":"2024-09-12T18:03:47.331063+0000","last_clean":"2024-09-12T18:03:39.938070+0000","last_became_active":"2024-09-12T18:03:42.051143+0000","last_became_peered":"2024-09-12T18:03:42.051143+0000","last_unstale":"2024-09-12T18:03:47.331063+0000","last_undegraded":"2024-09-12T18:03:41.968420+0000","last_fullsized":"2024-09-12T18:03:41.961304+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345495,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":366,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"66'393","reported_seq":511,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.349849+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:47.349849+0000","last_peered":"2024-09-12T18:03:47.349849+0000","last_clean":"2024-09-12T18:03:47.349849+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:47.349849+0000","last_undegraded":"2024-09-12T18:03:47.349849+0000","last_fullsized":"2024-09-12T18:03:47.349849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29922,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":355,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"65'372","reported_seq":897,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.345185+0000","last_change":"2024-09-12T18:03:46.332377+0000","last_active":"2024-09-12T18:03:46.332377+0000","last_peered":"2024-09-12T18:03:45.972802+0000","last_clean":"2024-09-12T18:03:39.946744+0000","last_became_active":"2024-09-12T18:03:42.054676+0000","last_became_peered":"2024-09-12T18:03:42.054676+0000","last_unstale":"2024-09-12T18:03:47.345185+0000","last_undegraded":"2024-09-12T18:03:47.345185+0000","last_fullsized":"2024-09-12T18:03:47.345185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56312,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":358,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"66'359","reported_seq":511,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339660+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:47.339660+0000","last_peered":"2024-09-12T18:03:47.339660+0000","last_clean":"2024-09-12T18:03:47.339660+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:47.339660+0000","last_undegraded":"2024-09-12T18:03:47.339660+0000","last_fullsized":"2024-09-12T18:03:47.339660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18793,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":338,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"66'354","reported_seq":493,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341087+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:47.341087+0000","last_peered":"2024-09-12T18:03:47.341087+0000","last_clean":"2024-09-12T18:03:47.341087+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:47.341087+0000","last_undegraded":"2024-09-12T18:03:47.341087+0000","last_fullsized":"2024-09-12T18:03:47.341087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24461,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":329,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"66'382","reported_seq":503,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345188+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:47.345188+0000","last_peered":"2024-09-12T18:03:47.345188+0000","last_clean":"2024-09-12T18:03:47.345188+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:47.345188+0000","last_undegraded":"2024-09-12T18:03:47.345188+0000","last_fullsized":"2024-09-12T18:03:47.345188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":347,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"66'415","reported_seq":572,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336714+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:47.336714+0000","last_peered":"2024-09-12T18:03:47.336714+0000","last_clean":"2024-09-12T18:03:47.336714+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:47.336714+0000","last_undegraded":"2024-09-12T18:03:47.336714+0000","last_fullsized":"2024-09-12T18:03:47.336714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30382,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":388,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"66'430","reported_seq":576,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346330+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:47.346330+0000","last_peered":"2024-09-12T18:03:47.346330+0000","last_clean":"2024-09-12T18:03:47.346330+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:47.346330+0000","last_undegraded":"2024-09-12T18:03:47.346330+0000","last_fullsized":"2024-09-12T18:03:47.346330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1541,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":393,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"66'455","reported_seq":639,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342057+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:47.342057+0000","last_peered":"2024-09-12T18:03:47.342057+0000","last_clean":"2024-09-12T18:03:47.342057+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:47.342057+0000","last_undegraded":"2024-09-12T18:03:47.342057+0000","last_fullsized":"2024-09-12T18:03:47.342057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107438,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":423,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"66'421","reported_seq":566,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351372+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:47.351372+0000","last_peered":"2024-09-12T18:03:47.351372+0000","last_clean":"2024-09-12T18:03:47.351372+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:47.351372+0000","last_undegraded":"2024-09-12T18:03:47.351372+0000","last_fullsized":"2024-09-12T18:03:47.351372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63741,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":390,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"66'398","reported_seq":535,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.309045+0000","last_change":"2024-09-12T18:03:47.346596+0000","last_active":"2024-09-12T18:03:47.346596+0000","last_peered":"2024-09-12T18:03:47.309045+0000","last_clean":"2024-09-12T18:03:39.944065+0000","last_became_active":"2024-09-12T18:03:42.058753+0000","last_became_peered":"2024-09-12T18:03:42.058753+0000","last_unstale":"2024-09-12T18:03:47.309045+0000","last_undegraded":"2024-09-12T18:03:41.974699+0000","last_fullsized":"2024-09-12T18:03:41.972473+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24788,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":363,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"66'453","reported_seq":628,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.310360+0000","last_change":"2024-09-12T18:03:47.342842+0000","last_active":"2024-09-12T18:03:47.342842+0000","last_peered":"2024-09-12T18:03:47.310360+0000","last_clean":"2024-09-12T18:03:39.933624+0000","last_became_active":"2024-09-12T18:03:42.029653+0000","last_became_peered":"2024-09-12T18:03:42.029653+0000","last_unstale":"2024-09-12T18:03:47.310360+0000","last_undegraded":"2024-09-12T18:03:41.966171+0000","last_fullsized":"2024-09-12T18:03:41.962893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":414,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"66'427","reported_seq":556,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337921+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:47.337921+0000","last_peered":"2024-09-12T18:03:47.337921+0000","last_clean":"2024-09-12T18:03:47.337921+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:47.337921+0000","last_undegraded":"2024-09-12T18:03:47.337921+0000","last_fullsized":"2024-09-12T18:03:47.337921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":392,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"66'388","reported_seq":864,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.344348+0000","last_change":"2024-09-12T18:03:47.344348+0000","last_active":"2024-09-12T18:03:47.344348+0000","last_peered":"2024-09-12T18:03:47.317829+0000","last_clean":"2024-09-12T18:03:39.923110+0000","last_became_active":"2024-09-12T18:03:42.049745+0000","last_became_peered":"2024-09-12T18:03:42.049745+0000","last_unstale":"2024-09-12T18:03:47.344348+0000","last_undegraded":"2024-09-12T18:03:47.344348+0000","last_fullsized":"2024-09-12T18:03:47.344348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109013,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":366,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"66'435","reported_seq":596,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340093+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:47.340093+0000","last_peered":"2024-09-12T18:03:47.340093+0000","last_clean":"2024-09-12T18:03:47.340093+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:47.340093+0000","last_undegraded":"2024-09-12T18:03:47.340093+0000","last_fullsized":"2024-09-12T18:03:47.340093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15312,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":404,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.341554+0000","last_change":"2024-09-12T18:03:47.657951+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.341554+0000","last_undegraded":"2024-09-12T18:03:47.341554+0000","last_fullsized":"2024-09-12T18:03:47.341554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"66'455","reported_seq":1016,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.344371+0000","last_change":"2024-09-12T18:03:47.344371+0000","last_active":"2024-09-12T18:03:47.344371+0000","last_peered":"2024-09-12T18:03:47.308489+0000","last_clean":"2024-09-12T18:03:39.936313+0000","last_became_active":"2024-09-12T18:03:42.054140+0000","last_became_peered":"2024-09-12T18:03:42.054140+0000","last_unstale":"2024-09-12T18:03:47.344371+0000","last_undegraded":"2024-09-12T18:03:47.344371+0000","last_fullsized":"2024-09-12T18:03:47.344371+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41757,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":427,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"66'386","reported_seq":510,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342731+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:47.342731+0000","last_peered":"2024-09-12T18:03:47.342731+0000","last_clean":"2024-09-12T18:03:47.342731+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:47.342731+0000","last_undegraded":"2024-09-12T18:03:47.342731+0000","last_fullsized":"2024-09-12T18:03:47.342731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":363,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"66'465","reported_seq":605,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351830+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:47.351830+0000","last_peered":"2024-09-12T18:03:47.351830+0000","last_clean":"2024-09-12T18:03:47.351830+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:47.351830+0000","last_undegraded":"2024-09-12T18:03:47.351830+0000","last_fullsized":"2024-09-12T18:03:47.351830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72515,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":415,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"66'404","reported_seq":556,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342041+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:47.342041+0000","last_peered":"2024-09-12T18:03:47.342041+0000","last_clean":"2024-09-12T18:03:47.342041+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:47.342041+0000","last_undegraded":"2024-09-12T18:03:47.342041+0000","last_fullsized":"2024-09-12T18:03:47.342041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32467,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":371,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"66'407","reported_seq":566,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342230+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:47.342230+0000","last_peered":"2024-09-12T18:03:47.342230+0000","last_clean":"2024-09-12T18:03:47.342230+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:47.342230+0000","last_undegraded":"2024-09-12T18:03:47.342230+0000","last_fullsized":"2024-09-12T18:03:47.342230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":381,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.351543+0000","last_change":"2024-09-12T18:03:47.657983+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.351543+0000","last_undegraded":"2024-09-12T18:03:47.351543+0000","last_fullsized":"2024-09-12T18:03:47.351543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"66'464","reported_seq":589,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336442+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:47.336442+0000","last_peered":"2024-09-12T18:03:47.336442+0000","last_clean":"2024-09-12T18:03:47.336442+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:47.336442+0000","last_undegraded":"2024-09-12T18:03:47.336442+0000","last_fullsized":"2024-09-12T18:03:47.336442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":429,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.347203+0000","last_change":"2024-09-12T18:03:47.657903+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.347203+0000","last_undegraded":"2024-09-12T18:03:47.347203+0000","last_fullsized":"2024-09-12T18:03:47.347203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"66'420","reported_seq":559,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342189+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:47.342189+0000","last_peered":"2024-09-12T18:03:47.342189+0000","last_clean":"2024-09-12T18:03:47.342189+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:47.342189+0000","last_undegraded":"2024-09-12T18:03:47.342189+0000","last_fullsized":"2024-09-12T18:03:47.342189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9279,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":390,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"66'401","reported_seq":585,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341232+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:47.341232+0000","last_peered":"2024-09-12T18:03:47.341232+0000","last_clean":"2024-09-12T18:03:47.341232+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:47.341232+0000","last_undegraded":"2024-09-12T18:03:47.341232+0000","last_fullsized":"2024-09-12T18:03:47.341232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47373,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":364,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":557,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344206+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:47.344206+0000","last_peered":"2024-09-12T18:03:47.344206+0000","last_clean":"2024-09-12T18:03:47.344206+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:47.344206+0000","last_undegraded":"2024-09-12T18:03:47.344206+0000","last_fullsized":"2024-09-12T18:03:47.344206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'375","reported_seq":520,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342433+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:47.342433+0000","last_peered":"2024-09-12T18:03:47.342433+0000","last_clean":"2024-09-12T18:03:47.342433+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:47.342433+0000","last_undegraded":"2024-09-12T18:03:47.342433+0000","last_fullsized":"2024-09-12T18:03:47.342433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21606,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":342,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"66'48","reported_seq":158,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345412+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:47.345412+0000","last_peered":"2024-09-12T18:03:47.345412+0000","last_clean":"2024-09-12T18:03:47.345412+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:47.345412+0000","last_undegraded":"2024-09-12T18:03:47.345412+0000","last_fullsized":"2024-09-12T18:03:47.345412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'413","reported_seq":547,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.353039+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:47.353039+0000","last_peered":"2024-09-12T18:03:47.353039+0000","last_clean":"2024-09-12T18:03:47.353039+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:47.353039+0000","last_undegraded":"2024-09-12T18:03:47.353039+0000","last_fullsized":"2024-09-12T18:03:47.353039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63820,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":377,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":179,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340895+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:47.340895+0000","last_peered":"2024-09-12T18:03:47.340895+0000","last_clean":"2024-09-12T18:03:47.340895+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:47.340895+0000","last_undegraded":"2024-09-12T18:03:47.340895+0000","last_fullsized":"2024-09-12T18:03:47.340895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"66'403","reported_seq":547,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.350154+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:47.350154+0000","last_peered":"2024-09-12T18:03:47.350154+0000","last_clean":"2024-09-12T18:03:47.350154+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:47.350154+0000","last_undegraded":"2024-09-12T18:03:47.350154+0000","last_fullsized":"2024-09-12T18:03:47.350154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":371,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'58","reported_seq":169,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342330+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:47.342330+0000","last_peered":"2024-09-12T18:03:47.342330+0000","last_clean":"2024-09-12T18:03:47.342330+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:47.342330+0000","last_undegraded":"2024-09-12T18:03:47.342330+0000","last_fullsized":"2024-09-12T18:03:47.342330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"66'136","reported_seq":247,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341572+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:47.341572+0000","last_peered":"2024-09-12T18:03:47.341572+0000","last_clean":"2024-09-12T18:03:47.341572+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:47.341572+0000","last_undegraded":"2024-09-12T18:03:47.341572+0000","last_fullsized":"2024-09-12T18:03:47.341572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"66'426","reported_seq":560,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342883+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:47.342883+0000","last_peered":"2024-09-12T18:03:47.342883+0000","last_clean":"2024-09-12T18:03:47.342883+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:47.342883+0000","last_undegraded":"2024-09-12T18:03:47.342883+0000","last_fullsized":"2024-09-12T18:03:47.342883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23187,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":388,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":360,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346393+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:47.346393+0000","last_peered":"2024-09-12T18:03:47.346393+0000","last_clean":"2024-09-12T18:03:47.346393+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:47.346393+0000","last_undegraded":"2024-09-12T18:03:47.346393+0000","last_fullsized":"2024-09-12T18:03:47.346393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"66'450","reported_seq":1004,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.294765+0000","last_change":"2024-09-12T18:03:47.342090+0000","last_active":"2024-09-12T18:03:47.342090+0000","last_peered":"2024-09-12T18:03:47.294765+0000","last_clean":"2024-09-12T18:03:47.294765+0000","last_became_active":"2024-09-12T18:03:45.331702+0000","last_became_peered":"2024-09-12T18:03:45.331702+0000","last_unstale":"2024-09-12T18:03:47.294765+0000","last_undegraded":"2024-09-12T18:03:47.294765+0000","last_fullsized":"2024-09-12T18:03:47.294765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37829,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":418,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343646+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:47.343646+0000","last_peered":"2024-09-12T18:03:47.343646+0000","last_clean":"2024-09-12T18:03:47.343646+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:47.343646+0000","last_undegraded":"2024-09-12T18:03:47.343646+0000","last_fullsized":"2024-09-12T18:03:47.343646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"66'417","reported_seq":567,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336707+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:47.336707+0000","last_peered":"2024-09-12T18:03:47.336707+0000","last_clean":"2024-09-12T18:03:47.336707+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:47.336707+0000","last_undegraded":"2024-09-12T18:03:47.336707+0000","last_fullsized":"2024-09-12T18:03:47.336707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67729,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":377,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"66'52","reported_seq":163,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341954+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:47.341954+0000","last_peered":"2024-09-12T18:03:47.341954+0000","last_clean":"2024-09-12T18:03:47.341954+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:47.341954+0000","last_undegraded":"2024-09-12T18:03:47.341954+0000","last_fullsized":"2024-09-12T18:03:47.341954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"58'380","reported_seq":507,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.343478+0000","last_change":"2024-09-12T18:03:47.343478+0000","last_active":"2024-09-12T18:03:47.343478+0000","last_peered":"2024-09-12T18:03:39.930535+0000","last_clean":"2024-09-12T18:03:39.930535+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:03:47.343478+0000","last_undegraded":"2024-09-12T18:03:47.343478+0000","last_fullsized":"2024-09-12T18:03:47.343478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285729,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":353,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.346480+0000","last_change":"2024-09-12T18:03:47.657992+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.346480+0000","last_undegraded":"2024-09-12T18:03:47.346480+0000","last_fullsized":"2024-09-12T18:03:47.346480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"66'452","reported_seq":1015,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.314910+0000","last_change":"2024-09-12T18:03:47.339339+0000","last_active":"2024-09-12T18:03:47.339339+0000","last_peered":"2024-09-12T18:03:47.314910+0000","last_clean":"2024-09-12T18:03:47.314910+0000","last_became_active":"2024-09-12T18:03:45.332775+0000","last_became_peered":"2024-09-12T18:03:45.332775+0000","last_unstale":"2024-09-12T18:03:47.314910+0000","last_undegraded":"2024-09-12T18:03:47.314910+0000","last_fullsized":"2024-09-12T18:03:47.314910+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207450,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":417,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":228,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336949+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:47.336949+0000","last_peered":"2024-09-12T18:03:47.336949+0000","last_clean":"2024-09-12T18:03:47.336949+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:47.336949+0000","last_undegraded":"2024-09-12T18:03:47.336949+0000","last_fullsized":"2024-09-12T18:03:47.336949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":577,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342278+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:47.342278+0000","last_peered":"2024-09-12T18:03:47.342278+0000","last_clean":"2024-09-12T18:03:47.342278+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:47.342278+0000","last_undegraded":"2024-09-12T18:03:47.342278+0000","last_fullsized":"2024-09-12T18:03:47.342278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":162,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341026+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:47.341026+0000","last_peered":"2024-09-12T18:03:47.341026+0000","last_clean":"2024-09-12T18:03:47.341026+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:47.341026+0000","last_undegraded":"2024-09-12T18:03:47.341026+0000","last_fullsized":"2024-09-12T18:03:47.341026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"66'373","reported_seq":518,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348160+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:47.348160+0000","last_peered":"2024-09-12T18:03:47.348160+0000","last_clean":"2024-09-12T18:03:47.348160+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:47.348160+0000","last_undegraded":"2024-09-12T18:03:47.348160+0000","last_fullsized":"2024-09-12T18:03:47.348160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36721,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":342,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"66'481","reported_seq":602,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.949736+0000","last_change":"2024-09-12T18:03:47.339759+0000","last_active":"2024-09-12T18:03:47.339759+0000","last_peered":"2024-09-12T18:03:46.949736+0000","last_clean":"2024-09-12T18:03:46.949736+0000","last_became_active":"2024-09-12T18:03:43.330781+0000","last_became_peered":"2024-09-12T18:03:43.330781+0000","last_unstale":"2024-09-12T18:03:46.949736+0000","last_undegraded":"2024-09-12T18:03:46.949736+0000","last_fullsized":"2024-09-12T18:03:46.949736+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'379","reported_seq":506,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351079+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:47.351079+0000","last_peered":"2024-09-12T18:03:47.351079+0000","last_clean":"2024-09-12T18:03:47.351079+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:47.351079+0000","last_undegraded":"2024-09-12T18:03:47.351079+0000","last_fullsized":"2024-09-12T18:03:47.351079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32157,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":335,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":262,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343934+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:47.343934+0000","last_peered":"2024-09-12T18:03:47.343934+0000","last_clean":"2024-09-12T18:03:47.343934+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:47.343934+0000","last_undegraded":"2024-09-12T18:03:47.343934+0000","last_fullsized":"2024-09-12T18:03:47.343934+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":125,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346578+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:47.346578+0000","last_peered":"2024-09-12T18:03:47.346578+0000","last_clean":"2024-09-12T18:03:47.346578+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:47.346578+0000","last_undegraded":"2024-09-12T18:03:47.346578+0000","last_fullsized":"2024-09-12T18:03:47.346578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":679,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345859+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:47.345859+0000","last_peered":"2024-09-12T18:03:47.345859+0000","last_clean":"2024-09-12T18:03:47.345859+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:47.345859+0000","last_undegraded":"2024-09-12T18:03:47.345859+0000","last_fullsized":"2024-09-12T18:03:47.345859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"66'431","reported_seq":561,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342452+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:47.342452+0000","last_peered":"2024-09-12T18:03:47.342452+0000","last_clean":"2024-09-12T18:03:47.342452+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:47.342452+0000","last_undegraded":"2024-09-12T18:03:47.342452+0000","last_fullsized":"2024-09-12T18:03:47.342452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19446,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":389,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342703+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:47.342703+0000","last_peered":"2024-09-12T18:03:47.342703+0000","last_clean":"2024-09-12T18:03:47.342703+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:47.342703+0000","last_undegraded":"2024-09-12T18:03:47.342703+0000","last_fullsized":"2024-09-12T18:03:47.342703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.342797+0000","last_change":"2024-09-12T18:03:47.657939+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.342797+0000","last_undegraded":"2024-09-12T18:03:47.342797+0000","last_fullsized":"2024-09-12T18:03:47.342797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"65'433","reported_seq":1013,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.345716+0000","last_change":"2024-09-12T18:03:46.332516+0000","last_active":"2024-09-12T18:03:46.332516+0000","last_peered":"2024-09-12T18:03:45.999807+0000","last_clean":"2024-09-12T18:03:39.941039+0000","last_became_active":"2024-09-12T18:03:42.054484+0000","last_became_peered":"2024-09-12T18:03:42.054484+0000","last_unstale":"2024-09-12T18:03:47.345716+0000","last_undegraded":"2024-09-12T18:03:47.345716+0000","last_fullsized":"2024-09-12T18:03:47.345716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264752,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":415,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344469+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:47.344469+0000","last_peered":"2024-09-12T18:03:47.344469+0000","last_clean":"2024-09-12T18:03:47.344469+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:47.344469+0000","last_undegraded":"2024-09-12T18:03:47.344469+0000","last_fullsized":"2024-09-12T18:03:47.344469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"66'373","reported_seq":483,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343984+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:47.343984+0000","last_peered":"2024-09-12T18:03:47.343984+0000","last_clean":"2024-09-12T18:03:47.343984+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:47.343984+0000","last_undegraded":"2024-09-12T18:03:47.343984+0000","last_fullsized":"2024-09-12T18:03:47.343984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.341653+0000","last_change":"2024-09-12T18:03:47.658063+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.341653+0000","last_undegraded":"2024-09-12T18:03:47.341653+0000","last_fullsized":"2024-09-12T18:03:47.341653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337075+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:47.337075+0000","last_peered":"2024-09-12T18:03:47.337075+0000","last_clean":"2024-09-12T18:03:47.337075+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:47.337075+0000","last_undegraded":"2024-09-12T18:03:47.337075+0000","last_fullsized":"2024-09-12T18:03:47.337075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"66'72","reported_seq":183,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344740+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:47.344740+0000","last_peered":"2024-09-12T18:03:47.344740+0000","last_clean":"2024-09-12T18:03:47.344740+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:47.344740+0000","last_undegraded":"2024-09-12T18:03:47.344740+0000","last_fullsized":"2024-09-12T18:03:47.344740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"66'412","reported_seq":606,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348900+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:47.348900+0000","last_peered":"2024-09-12T18:03:47.348900+0000","last_clean":"2024-09-12T18:03:47.348900+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:47.348900+0000","last_undegraded":"2024-09-12T18:03:47.348900+0000","last_fullsized":"2024-09-12T18:03:47.348900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":376,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"66'299","reported_seq":410,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342685+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:47.342685+0000","last_peered":"2024-09-12T18:03:47.342685+0000","last_clean":"2024-09-12T18:03:47.342685+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:47.342685+0000","last_undegraded":"2024-09-12T18:03:47.342685+0000","last_fullsized":"2024-09-12T18:03:47.342685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348948+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:47.348948+0000","last_peered":"2024-09-12T18:03:47.348948+0000","last_clean":"2024-09-12T18:03:47.348948+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:47.348948+0000","last_undegraded":"2024-09-12T18:03:47.348948+0000","last_fullsized":"2024-09-12T18:03:47.348948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"66'356","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340096+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:47.340096+0000","last_peered":"2024-09-12T18:03:47.340096+0000","last_clean":"2024-09-12T18:03:47.340096+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:47.340096+0000","last_undegraded":"2024-09-12T18:03:47.340096+0000","last_fullsized":"2024-09-12T18:03:47.340096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":322,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.962047+0000","last_change":"2024-09-12T18:03:39.949422+0000","last_active":"2024-09-12T18:01:53.672138+0000","last_peered":"2024-09-12T18:01:53.672138+0000","last_clean":"2024-09-12T18:01:53.672138+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:40.962047+0000","last_undegraded":"2024-09-12T18:03:40.962047+0000","last_fullsized":"2024-09-12T18:03:40.962047+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.332114+0000","last_change":"2024-09-12T18:03:47.343843+0000","last_active":"2024-09-12T18:03:47.343843+0000","last_peered":"2024-09-12T18:03:46.332114+0000","last_clean":"2024-09-12T18:03:46.332114+0000","last_became_active":"2024-09-12T18:03:40.975455+0000","last_became_peered":"2024-09-12T18:03:40.975455+0000","last_unstale":"2024-09-12T18:03:46.332114+0000","last_undegraded":"2024-09-12T18:03:46.332114+0000","last_fullsized":"2024-09-12T18:03:46.332114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"66'375","reported_seq":516,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345295+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:47.345295+0000","last_peered":"2024-09-12T18:03:47.345295+0000","last_clean":"2024-09-12T18:03:47.345295+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:47.345295+0000","last_undegraded":"2024-09-12T18:03:47.345295+0000","last_fullsized":"2024-09-12T18:03:47.345295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":342,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'55","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.967391+0000","last_change":"2024-09-12T18:03:39.951414+0000","last_active":"2024-09-12T18:03:39.951414+0000","last_peered":"2024-09-12T18:01:55.589453+0000","last_clean":"2024-09-12T18:01:55.589453+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:03:40.967391+0000","last_undegraded":"2024-09-12T18:03:40.967391+0000","last_fullsized":"2024-09-12T18:03:40.967391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.977229+0000","last_change":"2024-09-12T18:03:39.954023+0000","last_active":"2024-09-12T18:01:49.503848+0000","last_peered":"2024-09-12T18:01:49.503848+0000","last_clean":"2024-09-12T18:01:49.503848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:40.977229+0000","last_undegraded":"2024-09-12T18:03:40.977229+0000","last_fullsized":"2024-09-12T18:03:40.977229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"58'339","reported_seq":437,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.347326+0000","last_change":"2024-09-12T18:03:47.345346+0000","last_active":"2024-09-12T18:03:47.345346+0000","last_peered":"2024-09-12T18:03:39.923074+0000","last_clean":"2024-09-12T18:03:39.923074+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:03:47.347326+0000","last_undegraded":"2024-09-12T18:03:47.347326+0000","last_fullsized":"2024-09-12T18:03:47.347326+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222083,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":317,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.354291+0000","last_change":"2024-09-12T18:03:47.658042+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.354291+0000","last_undegraded":"2024-09-12T18:03:47.354291+0000","last_fullsized":"2024-09-12T18:03:47.354291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341703+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:47.341703+0000","last_peered":"2024-09-12T18:03:47.341703+0000","last_clean":"2024-09-12T18:03:47.341703+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:47.341703+0000","last_undegraded":"2024-09-12T18:03:47.341703+0000","last_fullsized":"2024-09-12T18:03:47.341703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"66'386","reported_seq":544,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340768+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:47.340768+0000","last_peered":"2024-09-12T18:03:47.340768+0000","last_clean":"2024-09-12T18:03:47.340768+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:47.340768+0000","last_undegraded":"2024-09-12T18:03:47.340768+0000","last_fullsized":"2024-09-12T18:03:47.340768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34066,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":349,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'399","reported_seq":549,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339372+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:47.339372+0000","last_peered":"2024-09-12T18:03:47.339372+0000","last_clean":"2024-09-12T18:03:47.339372+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:47.339372+0000","last_undegraded":"2024-09-12T18:03:47.339372+0000","last_fullsized":"2024-09-12T18:03:47.339372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8779,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":362,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":338,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341682+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:47.341682+0000","last_peered":"2024-09-12T18:03:47.341682+0000","last_clean":"2024-09-12T18:03:47.341682+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:47.341682+0000","last_undegraded":"2024-09-12T18:03:47.341682+0000","last_fullsized":"2024-09-12T18:03:47.341682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"66'434","reported_seq":583,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345289+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:47.345289+0000","last_peered":"2024-09-12T18:03:47.345289+0000","last_clean":"2024-09-12T18:03:47.345289+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:47.345289+0000","last_undegraded":"2024-09-12T18:03:47.345289+0000","last_fullsized":"2024-09-12T18:03:47.345289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257690,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":398,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"66'94","reported_seq":204,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342593+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:47.342593+0000","last_peered":"2024-09-12T18:03:47.342593+0000","last_clean":"2024-09-12T18:03:47.342593+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:47.342593+0000","last_undegraded":"2024-09-12T18:03:47.342593+0000","last_fullsized":"2024-09-12T18:03:47.342593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"66'185","reported_seq":307,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.919068+0000","last_change":"2024-09-12T18:03:47.348832+0000","last_active":"2024-09-12T18:03:47.348832+0000","last_peered":"2024-09-12T18:03:46.919068+0000","last_clean":"2024-09-12T18:03:46.919068+0000","last_became_active":"2024-09-12T18:03:43.331938+0000","last_became_peered":"2024-09-12T18:03:43.331938+0000","last_unstale":"2024-09-12T18:03:46.919068+0000","last_undegraded":"2024-09-12T18:03:46.919068+0000","last_fullsized":"2024-09-12T18:03:46.919068+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3329809,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"66'480","reported_seq":678,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344138+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:47.344138+0000","last_peered":"2024-09-12T18:03:47.344138+0000","last_clean":"2024-09-12T18:03:47.344138+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:47.344138+0000","last_undegraded":"2024-09-12T18:03:47.344138+0000","last_fullsized":"2024-09-12T18:03:47.344138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79412,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":446,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"65'54","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:46.331190+0000","last_change":"2024-09-12T18:03:47.658078+0000","last_active":"2024-09-12T18:03:47.658078+0000","last_peered":"2024-09-12T18:03:46.331190+0000","last_clean":"2024-09-12T18:03:46.331190+0000","last_became_active":"2024-09-12T18:03:40.982653+0000","last_became_peered":"2024-09-12T18:03:40.982653+0000","last_unstale":"2024-09-12T18:03:46.331190+0000","last_undegraded":"2024-09-12T18:03:46.331190+0000","last_fullsized":"2024-09-12T18:03:46.331190+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"58'399","reported_seq":542,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.346217+0000","last_change":"2024-09-12T18:03:47.341121+0000","last_active":"2024-09-12T18:03:47.341121+0000","last_peered":"2024-09-12T18:03:39.939093+0000","last_clean":"2024-09-12T18:03:39.939093+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:03:47.346217+0000","last_undegraded":"2024-09-12T18:03:47.346217+0000","last_fullsized":"2024-09-12T18:03:47.346217+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270119,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":376,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"66'367","reported_seq":512,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342832+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:47.342832+0000","last_peered":"2024-09-12T18:03:47.342832+0000","last_clean":"2024-09-12T18:03:47.342832+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:47.342832+0000","last_undegraded":"2024-09-12T18:03:47.342832+0000","last_fullsized":"2024-09-12T18:03:47.342832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20570,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":342,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"66'652","reported_seq":762,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344056+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:47.344056+0000","last_peered":"2024-09-12T18:03:47.344056+0000","last_clean":"2024-09-12T18:03:47.344056+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:47.344056+0000","last_undegraded":"2024-09-12T18:03:47.344056+0000","last_fullsized":"2024-09-12T18:03:47.344056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"66'428","reported_seq":600,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.312409+0000","last_change":"2024-09-12T18:03:47.347694+0000","last_active":"2024-09-12T18:03:47.347694+0000","last_peered":"2024-09-12T18:03:47.312409+0000","last_clean":"2024-09-12T18:03:39.932171+0000","last_became_active":"2024-09-12T18:03:42.054957+0000","last_became_peered":"2024-09-12T18:03:42.054957+0000","last_unstale":"2024-09-12T18:03:47.312409+0000","last_undegraded":"2024-09-12T18:03:41.977297+0000","last_fullsized":"2024-09-12T18:03:41.964490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447021,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":399,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.345290+0000","last_change":"2024-09-12T18:03:47.657929+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.345290+0000","last_undegraded":"2024-09-12T18:03:47.345290+0000","last_fullsized":"2024-09-12T18:03:47.345290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"66'388","reported_seq":534,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341393+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:47.341393+0000","last_peered":"2024-09-12T18:03:47.341393+0000","last_clean":"2024-09-12T18:03:47.341393+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:47.341393+0000","last_undegraded":"2024-09-12T18:03:47.341393+0000","last_fullsized":"2024-09-12T18:03:47.341393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64033,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":343,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"66'211","reported_seq":321,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340225+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:47.340225+0000","last_peered":"2024-09-12T18:03:47.340225+0000","last_clean":"2024-09-12T18:03:47.340225+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:47.340225+0000","last_undegraded":"2024-09-12T18:03:47.340225+0000","last_fullsized":"2024-09-12T18:03:47.340225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12335716,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":12125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"66'369","reported_seq":827,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.307915+0000","last_change":"2024-09-12T18:03:47.339885+0000","last_active":"2024-09-12T18:03:47.339885+0000","last_peered":"2024-09-12T18:03:47.307915+0000","last_clean":"2024-09-12T18:03:47.307915+0000","last_became_active":"2024-09-12T18:03:44.328158+0000","last_became_peered":"2024-09-12T18:03:44.328158+0000","last_unstale":"2024-09-12T18:03:47.307915+0000","last_undegraded":"2024-09-12T18:03:47.307915+0000","last_fullsized":"2024-09-12T18:03:47.307915+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":339,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":161,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345496+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:47.345496+0000","last_peered":"2024-09-12T18:03:47.345496+0000","last_clean":"2024-09-12T18:03:47.345496+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:47.345496+0000","last_undegraded":"2024-09-12T18:03:47.345496+0000","last_fullsized":"2024-09-12T18:03:47.345496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"66'366","reported_seq":827,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.318081+0000","last_change":"2024-09-12T18:03:47.338487+0000","last_active":"2024-09-12T18:03:47.338487+0000","last_peered":"2024-09-12T18:03:47.318081+0000","last_clean":"2024-09-12T18:03:47.318081+0000","last_became_active":"2024-09-12T18:03:46.338563+0000","last_became_peered":"2024-09-12T18:03:46.338563+0000","last_unstale":"2024-09-12T18:03:47.318081+0000","last_undegraded":"2024-09-12T18:03:47.318081+0000","last_fullsized":"2024-09-12T18:03:47.318081+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67687,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":339,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"66'179","reported_seq":303,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.979087+0000","last_change":"2024-09-12T18:03:47.339862+0000","last_active":"2024-09-12T18:03:47.339862+0000","last_peered":"2024-09-12T18:03:46.979087+0000","last_clean":"2024-09-12T18:03:46.979087+0000","last_became_active":"2024-09-12T18:03:43.332784+0000","last_became_peered":"2024-09-12T18:03:43.332784+0000","last_unstale":"2024-09-12T18:03:46.979087+0000","last_undegraded":"2024-09-12T18:03:46.979087+0000","last_fullsized":"2024-09-12T18:03:46.979087+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"66'393","reported_seq":887,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.316554+0000","last_change":"2024-09-12T18:03:47.337760+0000","last_active":"2024-09-12T18:03:47.337760+0000","last_peered":"2024-09-12T18:03:47.316554+0000","last_clean":"2024-09-12T18:03:47.316554+0000","last_became_active":"2024-09-12T18:03:43.327322+0000","last_became_peered":"2024-09-12T18:03:43.327322+0000","last_unstale":"2024-09-12T18:03:47.316554+0000","last_undegraded":"2024-09-12T18:03:47.316554+0000","last_fullsized":"2024-09-12T18:03:47.316554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28513,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":364,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'274","reported_seq":384,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342487+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:47.342487+0000","last_peered":"2024-09-12T18:03:47.342487+0000","last_clean":"2024-09-12T18:03:47.342487+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:47.342487+0000","last_undegraded":"2024-09-12T18:03:47.342487+0000","last_fullsized":"2024-09-12T18:03:47.342487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"66'388","reported_seq":521,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341152+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:47.341152+0000","last_peered":"2024-09-12T18:03:47.341152+0000","last_clean":"2024-09-12T18:03:47.341152+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:47.341152+0000","last_undegraded":"2024-09-12T18:03:47.341152+0000","last_fullsized":"2024-09-12T18:03:47.341152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":354,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.974472+0000","last_change":"2024-09-12T18:03:39.953369+0000","last_active":"2024-09-12T18:03:39.953369+0000","last_peered":"2024-09-12T18:03:11.472248+0000","last_clean":"2024-09-12T18:03:11.472248+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:03:40.974472+0000","last_undegraded":"2024-09-12T18:03:40.974472+0000","last_fullsized":"2024-09-12T18:03:40.974472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"66'447","reported_seq":625,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342575+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:47.342575+0000","last_peered":"2024-09-12T18:03:47.342575+0000","last_clean":"2024-09-12T18:03:47.342575+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:47.342575+0000","last_undegraded":"2024-09-12T18:03:47.342575+0000","last_fullsized":"2024-09-12T18:03:47.342575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":414,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.344918+0000","last_change":"2024-09-12T18:03:47.658053+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.344918+0000","last_undegraded":"2024-09-12T18:03:47.344918+0000","last_fullsized":"2024-09-12T18:03:47.344918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":5150861,"num_objects":485,"num_object_clones":0,"num_object_copies":970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":485,"num_whiteouts":0,"num_read":2431,"num_read_kb":1208833,"num_write":22517,"num_write_kb":3759279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1851,"num_bytes_recovered":2479618,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11350016,"data_stored":13087022,"data_compressed":3344745,"data_compressed_allocated":3870720,"data_compressed_original":9039872,"omap_allocated":0,"internal_metadata":0},"log_size":24431,"ondisk_log_size":24431,"up":128,"acting":123,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":108805596,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3960,"num_write_kb":108138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11718417,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81002496,"data_stored":254055994,"data_compressed":38530927,"data_compressed_allocated":49352704,"data_compressed_original":222466048,"omap_allocated":0,"internal_metadata":0},"log_size":5490,"ondisk_log_size":5490,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98328,"kb_used_data":22788,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94273512,"statfs":{"total":96636764160,"available":96536076288,"internally_reserved":0,"allocated":23334912,"data_stored":52557698,"data_compressed":8099373,"data_compressed_allocated":10391552,"data_compressed_original":41910272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,18],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738397,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101704,"kb_used_data":38644,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94270136,"statfs":{"total":96636764160,"available":96532619264,"internally_reserved":0,"allocated":39571456,"data_stored":115124319,"data_compressed":17630008,"data_compressed_allocated":22261760,"data_compressed_original":99889152,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118456,"kb_used_data":33192,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94253384,"statfs":{"total":96636764160,"available":96515465216,"internally_reserved":0,"allocated":33988608,"data_stored":102834901,"data_compressed":16332984,"data_compressed_allocated":20811776,"data_compressed_original":90763264,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30388224,"data_stored":97915065,"data_compressed":15106567,"data_compressed_allocated":19410944,"data_compressed_original":86966272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33931264,"data_stored":110250747,"data_compressed":16784133,"data_compressed_allocated":21250048,"data_compressed_original":97595392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16683008,"data_stored":45890182,"data_compressed":6640227,"data_compressed_allocated":8691712,"data_compressed_original":37904384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":4063859,"data_compressed":1191165,"data_compressed_allocated":1355776,"data_compressed_original":3223552,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2322432,"data_stored":2621237,"data_compressed":694434,"data_compressed_allocated":815104,"data_compressed_original":1810432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6074368,"data_stored":6401926,"data_compressed":1459146,"data_compressed_allocated":1699840,"data_compressed_original":4005888,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:52.215 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T18:03:52.220 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-12T18:03:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "size": 20, 2024-09-12T18:03:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 600, 2024-09-12T18:03:52.220 INFO:teuthology.orchestra.run.smithi121.stdout: "ops": [ 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18599 4.36 4:6ddc05b2:::100000026d7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.857306+0000", 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.3589664780000001, 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5383780580000002, 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857306+0000", 2024-09-12T18:03:52.221 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857306+0000", 2024-09-12T18:03:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.222 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857306+0000", 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.54e-07 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857309+0000", 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9560000000000002e-06 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857316+0000", 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.5350000000000001e-06 2024-09-12T18:03:52.223 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857320+0000", 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.4870000000000004e-06 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857372+0000", 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1328000000000001e-05 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.224 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.857388+0000", 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6648000000000001e-05 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347423+0000", 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.49003513199999998 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.225 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347427+0000", 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.6339999999999999e-06 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.386659+0000", 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0392314620000001 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.386993+0000", 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033453999999999998 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.226 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.387291+0000", 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029743700000000001 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.394270+0000", 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0069793499999999996 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.395448+0000", 2024-09-12T18:03:52.227 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001178187 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.395523+0000", 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5056999999999996e-05 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.395684+0000", 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00016055099999999999 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.228 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18608 4.36 4:6f9eaa3f:::100000026f2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.864008+0000", 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.3522645640000004, 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5319244969999999, 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.229 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864008+0000", 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864008+0000", 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864008+0000", 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6700000000000003e-07 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.230 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864012+0000", 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7780000000000001e-06 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864022+0000", 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0056e-05 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864029+0000", 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2540000000000003e-06 2024-09-12T18:03:52.231 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864149+0000", 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000119727 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.864160+0000", 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0953e-05 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.232 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347441+0000", 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.48328107100000001 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347445+0000", 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.455e-06 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.388406+0000", 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.040961453 2024-09-12T18:03:52.233 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.388593+0000", 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018702599999999999 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.388756+0000", 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00016324699999999999 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.394338+0000", 2024-09-12T18:03:52.234 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0055816340000000002 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.395711+0000", 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00137298 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.395803+0000", 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.1922999999999994e-05 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.235 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.395932+0000", 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000129173 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18618 4.6 4:6176255c:::100000026fc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.865202+0000", 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.3510703470000003, 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.497795789, 2024-09-12T18:03:52.236 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865202+0000", 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865202+0000", 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.237 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865203+0000", 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3600000000000003e-07 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865205+0000", 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.886e-06 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.238 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865215+0000", 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5449999999999992e-06 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865222+0000", 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0190000000000001e-06 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865558+0000", 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00033598100000000001 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.239 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865581+0000", 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.3439999999999999e-05 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.346943+0000", 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.48136196399999998 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.346951+0000", 2024-09-12T18:03:52.240 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.9729999999999997e-06 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.357228+0000", 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0102769579999999 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.357459+0000", 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000230492 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.241 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.357615+0000", 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000156164 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.362565+0000", 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.004949925 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.362729+0000", 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000164034 2024-09-12T18:03:52.242 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.362833+0000", 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00010364100000000001 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.362998+0000", 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000165031 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.243 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18621 4.36 4:6e348059:::100000026ff.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.865694+0000", 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.3505781690000003, 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.5306767059999999, 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.244 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865694+0000", 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865694+0000", 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865695+0000", 2024-09-12T18:03:52.245 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.0999999999999997e-07 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865699+0000", 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.8449999999999996e-06 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865709+0000", 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0563e-05 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.246 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865719+0000", 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7799999999999995e-06 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865815+0000", 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.6125000000000005e-05 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.865827+0000", 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2224e-05 2024-09-12T18:03:52.247 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347465+0000", 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.481637386 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347471+0000", 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1340000000000001e-06 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.248 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.389446+0000", 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0419752820000001 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.389740+0000", 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029361699999999998 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.389909+0000", 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00016926699999999999 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.249 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396035+0000", 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0061255260000000001 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396157+0000", 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000122024 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396212+0000", 2024-09-12T18:03:52.250 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5075999999999999e-05 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396371+0000", 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000159047 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18659 4.6 4:639b35e5:::1000000275e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.874735+0000", 2024-09-12T18:03:52.251 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.3415372129999996, 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4888578260000001, 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874735+0000", 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.252 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874735+0000", 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874736+0000", 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1400000000000001e-06 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874741+0000", 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9230000000000001e-06 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.253 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874753+0000", 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.2489e-05 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874761+0000", 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.1520000000000003e-06 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874814+0000", 2024-09-12T18:03:52.254 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3399999999999997e-05 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.874824+0000", 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9219999999999992e-06 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.346980+0000", 2024-09-12T18:03:52.255 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.47215599400000002 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.346984+0000", 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5340000000000001e-06 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.358827+0000", 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.011842616 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.359042+0000", 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00021539500000000001 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.359216+0000", 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017398700000000001 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.363083+0000", 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003866661 2024-09-12T18:03:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.363268+0000", 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018447900000000001 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.363375+0000", 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000107098 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.363593+0000", 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00021803600000000001 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18866 4.6 4:60a045a8:::100000029f9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.916323+0000", 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2999490680000001, 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4478469490000001, 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916323+0000", 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916323+0000", 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916324+0000", 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.68e-07 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916326+0000", 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7580000000000001e-06 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916334+0000", 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5170000000000002e-06 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916339+0000", 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4e-06 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916391+0000", 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1687999999999997e-05 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.916403+0000", 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.1836e-05 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347012+0000", 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.43060936100000002 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347019+0000", 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7830000000000001e-06 2024-09-12T18:03:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.359910+0000", 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0128907389999999 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.360193+0000", 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00028363800000000001 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.360485+0000", 2024-09-12T18:03:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00029192699999999999 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.363100+0000", 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0026148930000000001 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.363918+0000", 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00081764299999999995 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.364012+0000", 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.4128000000000004e-05 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.364170+0000", 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015797000000000001 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18898 4.36 4:6c38fd8c:::10000002a9e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.922221+0000", 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2940507300000004, 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4744615539999999, 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922221+0000", 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922221+0000", 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922222+0000", 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.9100000000000004e-07 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922225+0000", 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.7920000000000001e-06 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922233+0000", 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.7500000000000003e-06 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922239+0000", 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9179999999999997e-06 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922295+0000", 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.5254000000000003e-05 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.922303+0000", 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.7220000000000005e-06 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347496+0000", 2024-09-12T18:03:52.270 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.42519305899999998 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347500+0000", 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.817e-06 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.390634+0000", 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0431335900000001 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.271 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.390937+0000", 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030347000000000002 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.391130+0000", 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000192757 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.272 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396135+0000", 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0050047980000000004 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396390+0000", 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00025504800000000002 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396477+0000", 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.7381999999999998e-05 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.273 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396683+0000", 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000205606 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18903 4.36 4:6c7431ad:::10000002aa3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.923252+0000", 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2930198629999996, 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.47951816, 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.274 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923252+0000", 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923252+0000", 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.275 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923253+0000", 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9500000000000001e-07 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923257+0000", 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4960000000000001e-06 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923264+0000", 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4590000000000001e-06 2024-09-12T18:03:52.276 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923269+0000", 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.403e-06 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923322+0000", 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.3096999999999997e-05 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.277 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.923332+0000", 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0540000000000001e-05 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347531+0000", 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.42419920500000002 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347536+0000", 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.278 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.392102+0000", 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.044565739 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.392328+0000", 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000226822 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.392491+0000", 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00016215000000000001 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.279 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396824+0000", 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0043331079999999996 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.402531+0000", 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0057077940000000004 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.280 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.402627+0000", 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.5925000000000001e-05 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.402770+0000", 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000143017 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18917 4.36 4:6d1b509a:::10000002ab1.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.281 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.928733+0000", 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2875391580000004, 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4742947100000001, 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928733+0000", 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.282 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928733+0000", 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928734+0000", 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.6499999999999998e-07 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928737+0000", 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.7110000000000001e-06 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.283 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928744+0000", 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9689999999999997e-06 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928749+0000", 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8049999999999997e-06 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.284 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928797+0000", 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7555999999999997e-05 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.928821+0000", 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.4207999999999999e-05 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347550+0000", 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.41872882300000003 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.285 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347554+0000", 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3989999999999997e-06 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.393157+0000", 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0456027990000001 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.393369+0000", 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000212375 2024-09-12T18:03:52.286 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.393535+0000", 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00016561700000000001 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.399584+0000", 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0060485540000000003 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.402797+0000", 2024-09-12T18:03:52.287 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.003212983 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.402883+0000", 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6599000000000002e-05 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.403028+0000", 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000144547 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.288 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18928 4.6 4:61fc7998:::10000002abc.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.931859+0000", 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2844132579999998, 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4420557899999999, 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.289 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931859+0000", 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931859+0000", 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931860+0000", 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1999999999999998e-07 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.290 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931863+0000", 2024-09-12T18:03:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.3440000000000001e-06 2024-09-12T18:03:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931871+0000", 2024-09-12T18:03:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1820000000000006e-06 2024-09-12T18:03:52.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931876+0000", 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.9590000000000003e-06 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931928+0000", 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.1768999999999999e-05 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.931934+0000", 2024-09-12T18:03:52.292 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.015e-06 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347044+0000", 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.41511013099999999 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347048+0000", 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9539999999999998e-06 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.293 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.361375+0000", 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0143265969999999 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.361558+0000", 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018335700000000001 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.361711+0000", 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000153187 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.294 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.363748+0000", 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0020372530000000002 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.373600+0000", 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0098517120000000003 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.373673+0000", 2024-09-12T18:03:52.295 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.3032000000000001e-05 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.373915+0000", 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00024147799999999999 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.296 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:18971 4.36 4:6fc8f08e:::10000002ae7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.939818+0000", 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2764537200000001, 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.4634216010000001, 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939818+0000", 2024-09-12T18:03:52.297 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939818+0000", 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939819+0000", 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0299999999999998e-07 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.298 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939822+0000", 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.1889999999999999e-06 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939832+0000", 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.7319999999999993e-06 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939838+0000", 2024-09-12T18:03:52.299 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2650000000000002e-06 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939893+0000", 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.4888e-05 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.939902+0000", 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.2199999999999998e-06 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.300 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347576+0000", 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.40767404299999999 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347581+0000", 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8239999999999999e-06 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.394392+0000", 2024-09-12T18:03:52.301 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.046810958 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.394570+0000", 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017787 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.394725+0000", 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00015527 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.302 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.399720+0000", 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0049946449999999998 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.403043+0000", 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033234480000000001 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.403106+0000", 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2434999999999994e-05 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.303 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.403240+0000", 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013411099999999999 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19005 4.6 4:6246e7b8:::10000002b0c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.952387+0000", 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2638850990000003, 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.421968729, 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.304 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952387+0000", 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952387+0000", 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.305 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952388+0000", 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1900000000000001e-07 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952391+0000", 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.0730000000000001e-06 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952397+0000", 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2169999999999999e-06 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.306 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952401+0000", 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2370000000000003e-06 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952445+0000", 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3560999999999998e-05 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.952453+0000", 2024-09-12T18:03:52.307 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4959999999999996e-06 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347071+0000", 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.394617422 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347074+0000", 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5540000000000002e-06 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.308 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.364354+0000", 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0172800950000001 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.364539+0000", 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018434899999999999 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.364688+0000", 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00014918399999999999 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.309 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.368063+0000", 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033746890000000002 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.374105+0000", 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.006042342 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.374187+0000", 2024-09-12T18:03:52.310 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.1865000000000003e-05 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.374356+0000", 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00016882600000000001 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19012 4.36 4:6c48875b:::10000002b13.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.953564+0000", 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.262708162, 2024-09-12T18:03:52.311 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.450972353, 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953564+0000", 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953564+0000", 2024-09-12T18:03:52.312 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953565+0000", 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1600000000000001e-07 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953567+0000", 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.4430000000000002e-06 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.313 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953574+0000", 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.7159999999999997e-06 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953579+0000", 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7420000000000003e-06 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953627+0000", 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7240000000000002e-05 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.314 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.953635+0000", 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.0129999999999993e-06 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347600+0000", 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.39396537799999998 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347605+0000", 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.7149999999999997e-06 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.315 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.396944+0000", 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.049339397 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.397248+0000", 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000303338 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.397443+0000", 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00019554899999999999 2024-09-12T18:03:52.316 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.404215+0000", 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0067717230000000003 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.404244+0000", 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9186000000000001e-05 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.317 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.404327+0000", 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3385000000000002e-05 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.404536+0000", 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020891200000000001 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19061 4.36 4:6f1ee279:::10000002b58.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.965331+0000", 2024-09-12T18:03:52.318 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2509415349999999, 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.439768961, 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965331+0000", 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.319 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965331+0000", 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965331+0000", 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.6300000000000005e-07 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965334+0000", 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.6340000000000001e-06 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.320 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965341+0000", 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2799999999999998e-06 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965346+0000", 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.8219999999999997e-06 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965446+0000", 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9969000000000005e-05 2024-09-12T18:03:52.321 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.965463+0000", 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.6767999999999999e-05 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347625+0000", 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.38216241299999998 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.322 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347629+0000", 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.585e-06 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.398230+0000", 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.050601634 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.398506+0000", 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00027553499999999998 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.323 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.398694+0000", 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00018851 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.404628+0000", 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0059334310000000003 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.404771+0000", 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000143232 2024-09-12T18:03:52.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.404873+0000", 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000101629 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.405100+0000", 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000226856 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.325 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19080 4.6 4:61aad86c:::10000002b6b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.971838+0000", 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2444343279999996, 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.402845812, 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.971838+0000", 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.971838+0000", 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.971839+0000", 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8100000000000001e-07 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.971843+0000", 2024-09-12T18:03:52.327 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.425e-06 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.971853+0000", 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0288999999999999e-05 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.971861+0000", 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.4019999999999996e-06 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.328 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.971919+0000", 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.8137000000000003e-05 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.971928+0000", 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.9069999999999996e-06 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347097+0000", 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.37516876199999999 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.329 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347100+0000", 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5379999999999998e-06 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.365395+0000", 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.018294791 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.365561+0000", 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00016564300000000001 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.330 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.365707+0000", 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000146157 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.371230+0000", 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0055235409999999999 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.374472+0000", 2024-09-12T18:03:52.331 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0032420859999999999 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.374545+0000", 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2645999999999995e-05 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.374684+0000", 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013850700000000001 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.332 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19109 4.6 4:60ef4a7e:::10000002be3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.979175+0000", 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2370967940000002, 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.395835395, 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.979175+0000", 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.979175+0000", 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.979176+0000", 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.1900000000000002e-07 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.979179+0000", 2024-09-12T18:03:52.334 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.9019999999999999e-06 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.979187+0000", 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.0569999999999993e-06 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.979207+0000", 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0355000000000001e-05 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.335 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.979264+0000", 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7136999999999999e-05 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.979273+0000", 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.4409999999999993e-06 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347122+0000", 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.36784954800000003 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.336 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347126+0000", 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4690000000000002e-06 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.368134+0000", 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0210082090000001 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.368458+0000", 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00032344999999999997 2024-09-12T18:03:52.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.368840+0000", 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00038247599999999997 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.373527+0000", 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0046873180000000002 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.374807+0000", 2024-09-12T18:03:52.338 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.001279648 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.374883+0000", 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5585000000000002e-05 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.375011+0000", 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000128181 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.339 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19123 4.6 4:63dcd428:::10000002c2a.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.983292+0000", 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.232980532, 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.399536165, 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.983292+0000", 2024-09-12T18:03:52.340 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.983292+0000", 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.983293+0000", 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.9300000000000006e-07 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.341 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.983297+0000", 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.0180000000000003e-06 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.983307+0000", 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0108999999999999e-05 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.983315+0000", 2024-09-12T18:03:52.342 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.6440000000000006e-06 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.983380+0000", 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.4454000000000003e-05 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.983400+0000", 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.0194999999999999e-05 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.343 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347149+0000", 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.36374858799999998 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347152+0000", 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.5480000000000002e-06 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.369889+0000", 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0227368080000001 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.344 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.370292+0000", 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000402715 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.370586+0000", 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000294135 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.373943+0000", 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0033572369999999999 2024-09-12T18:03:52.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.382585+0000", 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0086423330000000003 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.382655+0000", 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.9811e-05 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.382828+0000", 2024-09-12T18:03:52.346 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017257700000000001 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19168 4.6 4:618cf173:::10000002c6b.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:46.997768+0000", 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.2185043880000004, 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.385562178, 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.347 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.997768+0000", 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.997768+0000", 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.997768+0000", 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.2399999999999998e-07 2024-09-12T18:03:52.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.997771+0000", 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.931e-06 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.997778+0000", 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3940000000000001e-06 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.997782+0000", 2024-09-12T18:03:52.349 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.1819999999999999e-06 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.997839+0000", 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 5.7003999999999998e-05 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:46.997849+0000", 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 9.8530000000000004e-06 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.350 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347174+0000", 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.34932545999999998 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347178+0000", 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4829999999999999e-06 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.371308+0000", 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.024130684 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.351 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.371517+0000", 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020860900000000001 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.371729+0000", 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00021169900000000001 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.352 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.373964+0000", 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0022355399999999998 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.382939+0000", 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0089751190000000002 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.383076+0000", 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00013703700000000001 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.353 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.383330+0000", 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00025355899999999999 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19209 4.36 4:6fb65e96:::10000002f12.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.021651+0000", 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.1946215420000001, 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.3837507929999999, 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.354 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.021651+0000", 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.021651+0000", 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.355 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.021651+0000", 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0100000000000004e-07 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.021654+0000", 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.892e-06 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.021661+0000", 2024-09-12T18:03:52.356 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.2960000000000001e-06 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.021666+0000", 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.5499999999999996e-06 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.021709+0000", 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.3368000000000002e-05 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.357 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.021716+0000", 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.0500000000000003e-06 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347644+0000", 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.32592751199999997 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347647+0000", 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.4520000000000002e-06 2024-09-12T18:03:52.358 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.399832+0000", 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.052184223 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.400277+0000", 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00044515800000000002 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.400580+0000", 2024-09-12T18:03:52.359 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00030282699999999998 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.404736+0000", 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0041565370000000001 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.405127+0000", 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00039131799999999998 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.360 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.405230+0000", 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000102404 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.405401+0000", 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00017150499999999999 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.361 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "description": "osd_op(mds.0.3:19251 4.36 4:6e636422:::10000002f3c.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "initiated_at": "2024-09-12T18:03:47.053961+0000", 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "age": 5.1623113580000002, 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.356121441, 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "continuous": false, 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "type_data": { 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "events": [ 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "initiated", 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.053961+0000", 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.362 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "header_read", 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.053961+0000", 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "throttled", 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.053961+0000", 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.8199999999999999e-07 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "all_read", 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.053964+0000", 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 2.1940000000000001e-06 2024-09-12T18:03:52.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "dispatched", 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.053972+0000", 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 8.3289999999999994e-06 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.053976+0000", 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.51e-06 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.054016+0000", 2024-09-12T18:03:52.364 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 3.9786000000000002e-05 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.054024+0000", 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 7.5089999999999996e-06 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347669+0000", 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.293645514 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.365 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:47.347674+0000", 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 4.2529999999999998e-06 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "reached_pg", 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.401370+0000", 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 1.0536968360000001 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "started", 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.401575+0000", 2024-09-12T18:03:52.366 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020504599999999999 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "waiting for subops from 2", 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.401782+0000", 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.00020677900000000001 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.405540+0000", 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0037582510000000002 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.367 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "op_commit", 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.409851+0000", 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.0043104079999999999 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "commit_sent", 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.409914+0000", 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 6.3359000000000001e-05 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: "event": "done", 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: "time": "2024-09-12T18:03:48.410082+0000", 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: "duration": 0.000167985 2024-09-12T18:03:52.368 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.369 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.369 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.369 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-12T18:03:52.369 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-12T18:03:52.369 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-12T18:03:52.371 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:52.375 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:52.370+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:52.376 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:03:52.472 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:52.470+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:52.505 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:52.505 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:52.506 INFO:teuthology.orchestra.run.smithi153.stdout: "num_ops": 0 2024-09-12T18:03:52.506 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:52.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:52.573 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:52.570+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:52.673 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-12T18:03:52.670+0000 7ff24fa01640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 22980) UID: 0 2024-09-12T18:03:52.691 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:52.692 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [], 2024-09-12T18:03:52.692 INFO:teuthology.orchestra.run.smithi153.stdout: "complaint_time": 30, 2024-09-12T18:03:52.692 INFO:teuthology.orchestra.run.smithi153.stdout: "num_blocked_ops": 0 2024-09-12T18:03:52.692 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:52.706 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:52.745 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:52.745 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false},"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 2 pgs inactive, 3 pgs peering","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":139,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":72,"num_osds":3,"num_up_osds":3,"osd_up_since":1726164102,"num_in_osds":3,"osd_in_since":1726164094,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":70},{"state_name":"peering","count":21},{"state_name":"unknown","count":9},{"state_name":"remapped+peering","count":5}],"num_pgs":105,"num_pools":4,"num_objects":532,"data_bytes":114546844,"bytes_used":326131712,"bytes_avail":289584160768,"bytes_total":289910292480,"unknown_pgs_ratio":0.085714288055896759,"inactive_pgs_ratio":0.24761904776096344,"recovering_objects_per_sec":387,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1551,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4193}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-12T18:03:00.574702+0000","services":{}},"progress_events":{}} 2024-09-12T18:03:52.764 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-12T18:03:52.764 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:52.774 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:52.772+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:52.876 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:52.872+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:52.885 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "size": 20, 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 600, 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "ops": [ 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19283 4.16 4:6a54d456:::1000000001c.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e66)", 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.6485124290000002, 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.067243629999999999, 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.886 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231964+0000", 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231965+0000", 2024-09-12T18:03:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.1399999999999996e-07 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231968+0000", 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3629999999999998e-06 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231978+0000", 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9990000000000003e-06 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.888 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.231985+0000", 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.0140000000000001e-06 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232114+0000", 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012873600000000001 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.232343+0000", 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022858399999999999 2024-09-12T18:03:52.889 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.299208+0000", 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.066865220000000003 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18530 4.b 4:d24c6f8e:::10000002a1b.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5453967479999999, 2024-09-12T18:03:52.890 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0437163759999999, 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335080+0000", 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.891 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335083+0000", 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.3699999999999999e-06 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335114+0000", 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.0901000000000001e-05 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.892 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335143+0000", 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8932999999999999e-05 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335161+0000", 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8244999999999999e-05 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335271+0000", 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00010988 2024-09-12T18:03:52.893 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op must wait for map", 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335279+0000", 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1140000000000006e-06 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344500+0000", 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092206690000000008 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.894 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344528+0000", 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.8181999999999999e-05 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.372191+0000", 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.027662643 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.372511+0000", 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00031996900000000003 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.372701+0000", 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000189932 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.376797+0000", 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004096662 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.896 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.378392+0000", 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0015951769999999999 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.378575+0000", 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000182139 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.378796+0000", 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022156000000000001 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.897 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18596 4.b 4:d1ad4296:::100000026be.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5452719830000001, 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0441835989999999, 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.898 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335205+0000", 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335206+0000", 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.212e-06 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.899 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335212+0000", 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.5769999999999999e-06 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335230+0000", 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7955999999999999e-05 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.900 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335246+0000", 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5302999999999999e-05 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335372+0000", 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012597699999999999 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335378+0000", 2024-09-12T18:03:52.901 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.2720000000000003e-06 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344616+0000", 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092381770000000002 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344637+0000", 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0699e-05 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.902 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.374048+0000", 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.029411101 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.374330+0000", 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028211000000000002 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.374652+0000", 2024-09-12T18:03:52.903 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00032179600000000001 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.377172+0000", 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025199879999999999 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379102+0000", 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001929865 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.904 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379185+0000", 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.3312999999999993e-05 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379388+0000", 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000203253 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.905 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18598 4.b 4:d3a277cc:::100000026d6.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.545203967, 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.044465693, 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.906 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335273+0000", 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335274+0000", 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0109999999999999e-06 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335279+0000", 2024-09-12T18:03:52.907 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6060000000000002e-06 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335297+0000", 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7676000000000002e-05 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335310+0000", 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2782999999999999e-05 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.908 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335488+0000", 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017866599999999999 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335499+0000", 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1163e-05 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344720+0000", 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0092202329999999996 2024-09-12T18:03:52.909 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.344742+0000", 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2048999999999998e-05 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.375576+0000", 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0308340819999999 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.910 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.375839+0000", 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00026327300000000001 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.375979+0000", 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014022500000000001 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.378921+0000", 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0029412930000000002 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.911 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379417+0000", 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00049664499999999999 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379534+0000", 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00011686199999999999 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379738+0000", 2024-09-12T18:03:52.912 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000204126 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18607 4.b 4:d0b18bcd:::100000026f1.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5451439489999999, 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.047144088, 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.913 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335333+0000", 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.914 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335334+0000", 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.6299999999999993e-07 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335338+0000", 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6829999999999999e-06 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335356+0000", 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7655999999999998e-05 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335368+0000", 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.204e-05 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335552+0000", 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018376500000000001 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.916 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4410000000000001e-06 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345030+0000", 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0094724470000000002 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345053+0000", 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3683e-05 2024-09-12T18:03:52.917 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.377271+0000", 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.032217401 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.377459+0000", 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018783499999999999 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.918 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.377650+0000", 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000190998 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379078+0000", 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.001428973 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382291+0000", 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0032126699999999999 2024-09-12T18:03:52.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382352+0000", 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 6.1202000000000001e-05 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382477+0000", 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012433100000000001 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18757 4.b 4:d3243d32:::100000028a4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5450853679999996, 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0500087810000001, 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:52.921 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335391+0000", 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335392+0000", 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.9500000000000001e-07 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.922 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335397+0000", 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9219999999999996e-06 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335413+0000", 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.5886e-05 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335425+0000", 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2282e-05 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335612+0000", 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018647499999999999 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335620+0000", 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.2430000000000005e-06 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345191+0000", 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0095711770000000002 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345221+0000", 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.9666e-05 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.379850+0000", 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0346295029999999 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.380172+0000", 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000321954 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.380352+0000", 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000179533 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.383953+0000", 2024-09-12T18:03:52.926 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003601216 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385161+0000", 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0012084960000000001 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385261+0000", 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.9421999999999998e-05 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.927 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385400+0000", 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000139111 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18814 4.b 4:d16f0e9b:::1000000291e.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5450077069999999, 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.050263653, 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.928 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335469+0000", 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335470+0000", 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0690000000000001e-06 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335475+0000", 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3020000000000002e-06 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.930 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335493+0000", 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7949e-05 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335506+0000", 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2865e-05 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335663+0000", 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00015690100000000001 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.931 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335668+0000", 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3469999999999998e-06 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345320+0000", 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0096513759999999997 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.345342+0000", 2024-09-12T18:03:52.932 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2056e-05 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.381105+0000", 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.035763462 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.381382+0000", 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000276373 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.933 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.381553+0000", 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00017170900000000001 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.384067+0000", 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0025136020000000002 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385422+0000", 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0013551940000000001 2024-09-12T18:03:52.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385512+0000", 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.0005000000000003e-05 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385732+0000", 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00022044299999999999 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18849 4.b 4:d01aae92:::100000029aa.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5449196030000003, 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0538638819999999, 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:52.936 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335557+0000", 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335558+0000", 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0219999999999999e-06 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.937 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335563+0000", 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.429e-06 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335581+0000", 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7635999999999999e-05 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335594+0000", 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.2979999999999999e-05 2024-09-12T18:03:52.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335708+0000", 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000114351 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335716+0000", 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.9899999999999997e-06 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.939 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347521+0000", 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011804434000000001 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347547+0000", 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.6393e-05 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382585+0000", 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0350375469999999 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.940 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.382858+0000", 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00027304400000000001 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.383112+0000", 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00025417899999999999 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.386903+0000", 2024-09-12T18:03:52.941 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0037911020000000002 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389121+0000", 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0022178850000000002 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389216+0000", 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.4790000000000006e-05 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.942 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389421+0000", 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0002051 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18860 4.b 4:d2667579:::100000029c4.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5448628849999997, 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0542451399999999, 2024-09-12T18:03:52.943 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335614+0000", 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335615+0000", 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.5099999999999998e-07 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335619+0000", 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.6890000000000003e-06 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.945 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335636+0000", 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.6211000000000001e-05 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335660+0000", 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4671000000000001e-05 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335742+0000", 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.1735000000000003e-05 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335747+0000", 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3020000000000002e-06 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347645+0000", 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.011898089000000001 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.347666+0000", 2024-09-12T18:03:52.947 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.0712000000000001e-05 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.384157+0000", 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0364911459999999 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.384378+0000", 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000221072 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.948 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.384513+0000", 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00013463099999999999 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389451+0000", 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004938039 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389537+0000", 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 8.6408000000000003e-05 2024-09-12T18:03:52.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389640+0000", 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000102305 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389859+0000", 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00021917900000000001 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:18887 4.b 4:d08ab02f:::10000002a82.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5447905439999996, 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.054842348, 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:52.951 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335686+0000", 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335687+0000", 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0669999999999999e-06 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335721+0000", 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.4218999999999999e-05 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335744+0000", 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3116e-05 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335764+0000", 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9145999999999999e-05 2024-09-12T18:03:52.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335820+0000", 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6932000000000003e-05 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335826+0000", 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3600000000000004e-06 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.954 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348074+0000", 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012248458 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348102+0000", 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.7889999999999999e-05 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.385817+0000", 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037714786 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.955 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.386041+0000", 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000224143 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.386192+0000", 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000151347 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.389899+0000", 2024-09-12T18:03:52.956 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.003706174 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390061+0000", 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016214499999999999 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390241+0000", 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00018020300000000001 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.957 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390528+0000", 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028736199999999999 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19179 4.b 4:d27772c6:::10000002c76.00000000:head [delete] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5446850000000003, 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0551001250000001, 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.958 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335792+0000", 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.959 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335793+0000", 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.31e-06 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335798+0000", 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.13e-06 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335818+0000", 2024-09-12T18:03:52.960 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9695999999999999e-05 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335832+0000", 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4276e-05 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335883+0000", 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0751000000000002e-05 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335888+0000", 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5260000000000001e-06 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348183+0000", 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012294312999999999 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348204+0000", 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1769000000000001e-05 2024-09-12T18:03:52.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.386986+0000", 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.038781532 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.387187+0000", 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020144 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for subops from 0", 2024-09-12T18:03:52.963 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.387334+0000", 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014667400000000001 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "sub_op_commit_rec", 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390645+0000", 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0033110320000000002 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "op_commit", 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390667+0000", 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2272999999999998e-05 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.964 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "commit_sent", 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390745+0000", 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.7478000000000006e-05 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.390892+0000", 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00014692500000000001 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.965 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19288 4.b 4:d3d0d483:::10000000021.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.544619655, 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.059489788, 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335857+0000", 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335858+0000", 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 9.1299999999999998e-07 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.967 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335863+0000", 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0000000000000004e-06 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335881+0000", 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8352999999999999e-05 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335895+0000", 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4073000000000001e-05 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.968 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335949+0000", 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3402999999999997e-05 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335954+0000", 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4879999999999998e-06 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348279+0000", 2024-09-12T18:03:52.969 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012324504 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348301+0000", 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2056e-05 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.388033+0000", 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0397318900000001 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.970 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.388315+0000", 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00028241900000000001 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.395347+0000", 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0070316889999999998 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.971 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19289 4.b 4:d2626379:::10000000022.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5445567699999998, 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0601435320000001, 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335920+0000", 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335921+0000", 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.037e-06 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335926+0000", 2024-09-12T18:03:52.973 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9230000000000001e-06 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335944+0000", 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.7802999999999999e-05 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335957+0000", 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3883000000000001e-05 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.974 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336008+0000", 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0102999999999998e-05 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336013+0000", 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4079999999999997e-06 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348363+0000", 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012350517 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.975 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348383+0000", 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9729e-05 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.391169+0000", 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0427862919999999 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.391553+0000", 2024-09-12T18:03:52.976 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000383466 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.396063+0000", 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.004510371 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19337 4.b 4:d30f9a54:::10000000052.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:52.977 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.544495918, 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0604883190000001, 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335981+0000", 2024-09-12T18:03:52.978 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335982+0000", 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0100000000000001e-06 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.335987+0000", 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.006e-06 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.979 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336008+0000", 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1248999999999999e-05 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336022+0000", 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.448e-05 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336081+0000", 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.8526000000000002e-05 2024-09-12T18:03:52.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336087+0000", 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.6919999999999999e-06 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348475+0000", 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012388771999999999 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.981 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348487+0000", 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1440000000000001e-05 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.392703+0000", 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.044216512 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.392864+0000", 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000160576 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.982 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.396469+0000", 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0036050560000000001 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19467 4.b 4:d02f84b5:::100000000d4.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5444302240000001, 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0637080590000001, 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.983 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336046+0000", 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.984 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336047+0000", 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.094e-06 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336053+0000", 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.113e-06 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336074+0000", 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1506e-05 2024-09-12T18:03:52.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336087+0000", 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3373000000000001e-05 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336138+0000", 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0217999999999999e-05 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.986 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336143+0000", 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.4419999999999997e-06 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348572+0000", 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012429295999999999 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348595+0000", 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.2671999999999999e-05 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.987 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.393509+0000", 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.044914004 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.393865+0000", 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000356304 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.399754+0000", 2024-09-12T18:03:52.988 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0058890369999999997 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19501 4.b 4:d1f1a6ab:::100000000f6.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5443649989999999, 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0646696760000001, 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:52.989 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336112+0000", 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336113+0000", 2024-09-12T18:03:52.990 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.057e-06 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336118+0000", 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0699999999999997e-06 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336136+0000", 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8286000000000001e-05 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.991 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336150+0000", 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3842999999999999e-05 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336200+0000", 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.0123000000000001e-05 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336205+0000", 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.3839999999999996e-06 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.992 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348675+0000", 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012470088000000001 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348695+0000", 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9680000000000001e-05 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.993 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.396570+0000", 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.047874832 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.396810+0000", 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000240227 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.400781+0000", 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0039710860000000004 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.994 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19539 4.b 4:d200bef4:::1000000011c.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5443030330000003, 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.065106361, 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:52.995 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336174+0000", 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336175+0000", 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.006e-06 2024-09-12T18:03:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336180+0000", 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.023e-06 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336199+0000", 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9323000000000001e-05 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:52.997 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336213+0000", 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.4187e-05 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336266+0000", 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2649999999999999e-05 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336271+0000", 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2700000000000004e-06 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.998 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348780+0000", 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012509456 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348805+0000", 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4663000000000001e-05 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.397611+0000", 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0488059830000001 2024-09-12T18:03:52.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.397854+0000", 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.000242993 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.401280+0000", 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0034258069999999999 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19587 4.b 4:d35c25ee:::1000000014c.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5442391149999999, 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.06542493, 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:53.001 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336237+0000", 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336239+0000", 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.13e-06 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.002 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336243+0000", 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.8860000000000003e-06 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336263+0000", 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.9856000000000001e-05 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336276+0000", 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.293e-05 2024-09-12T18:03:53.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336326+0000", 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9895999999999998e-05 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336332+0000", 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5419999999999996e-06 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:53.004 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348924+0000", 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012592671999999999 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.348948+0000", 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3791e-05 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.398631+0000", 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0496827609999999 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.398839+0000", 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00020819999999999999 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.401662+0000", 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.0028232660000000001 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19753 4.b 4:d079bd36:::100000001f2.00000000:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.5441763599999998, 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.0657822180000001, 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "started", 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:53.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336300+0000", 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336301+0000", 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.043e-06 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336306+0000", 2024-09-12T18:03:53.008 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.2530000000000004e-06 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336325+0000", 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.8243000000000001e-05 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336338+0000", 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.3473e-05 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.009 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336388+0000", 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 4.9381e-05 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting_for_map not empty", 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.336393+0000", 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 5.5480000000000001e-06 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.349033+0000", 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.012640175999999999 2024-09-12T18:03:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.349054+0000", 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.1016999999999999e-05 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.399825+0000", 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.05077022 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "started", 2024-09-12T18:03:53.011 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.399991+0000", 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00016663499999999999 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.402082+0000", 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.002091229 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.012 INFO:teuthology.orchestra.run.smithi153.stdout: "description": "osd_op(mds.0.3:19759 3.6 3.4b2c82a6 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "initiated_at": "2024-09-12T18:03:47.741583+0000", 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "age": 5.1388934739999996, 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59937238000000004, 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "continuous": false, 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "type_data": { 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "flag_point": "reached pg", 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "events": [ 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "initiated", 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741583+0000", 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "header_read", 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741583+0000", 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "throttled", 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741586+0000", 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.4669999999999998e-06 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "all_read", 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741598+0000", 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 1.1996e-05 2024-09-12T18:03:53.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "dispatched", 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741630+0000", 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2061999999999999e-05 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "queued_for_pg", 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741654+0000", 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 2.3992999999999999e-05 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:53.015 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741783+0000", 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.00012956999999999999 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "waiting for peered", 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:47.741791+0000", 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 7.8429999999999993e-06 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "reached_pg", 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.340923+0000", 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 0.59913189600000005 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-12T18:03:53.016 INFO:teuthology.orchestra.run.smithi153.stdout: "event": "done", 2024-09-12T18:03:53.017 INFO:teuthology.orchestra.run.smithi153.stdout: "time": "2024-09-12T18:03:48.340955+0000", 2024-09-12T18:03:53.017 INFO:teuthology.orchestra.run.smithi153.stdout: "duration": 3.2552999999999998e-05 2024-09-12T18:03:53.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.017 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:53.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-12T18:03:53.017 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T18:03:53.017 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T18:03:53.019 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T18:03:53.019 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:03:53.018+0000 7f7a8a086640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 22939) UID: 0 2024-09-12T18:03:53.063 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:53.082 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-12T18:03:52.587100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114546844,"num_objects":532,"num_object_clones":0,"num_object_copies":1064,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532,"num_whiteouts":0,"num_read":2517,"num_read_kb":1208906,"num_write":26624,"num_write_kb":3870091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1856,"num_bytes_recovered":14198054,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30036,"ondisk_log_size":30036,"up":210,"acting":205,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":318488,"kb_used_data":94624,"kb_used_omap":4,"kb_used_meta":223803,"kb_avail":282797032,"statfs":{"total":289910292480,"available":289584160768,"internally_reserved":0,"allocated":96894976,"data_stored":270516918,"data_compressed":42062365,"data_compressed_allocated":53465088,"data_compressed_original":232562688,"omap_allocated":4785,"internal_metadata":229174607},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,18],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001130"},"pg_stats":[{"pgid":"4.3f","version":"66'431","reported_seq":588,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342618+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:47.342618+0000","last_peered":"2024-09-12T18:03:47.342618+0000","last_clean":"2024-09-12T18:03:47.342618+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:47.342618+0000","last_undegraded":"2024-09-12T18:03:47.342618+0000","last_fullsized":"2024-09-12T18:03:47.342618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11854,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":402,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"66'459","reported_seq":732,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.334383+0000","last_change":"2024-09-12T18:03:47.344901+0000","last_active":"2024-09-12T18:03:47.344901+0000","last_peered":"2024-09-12T18:03:47.334383+0000","last_clean":"2024-09-12T18:03:38.936262+0000","last_became_active":"2024-09-12T18:03:42.058566+0000","last_became_peered":"2024-09-12T18:03:42.058566+0000","last_unstale":"2024-09-12T18:03:47.334383+0000","last_undegraded":"2024-09-12T18:03:41.974628+0000","last_fullsized":"2024-09-12T18:03:41.972330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30760,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":427,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"66'368","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339198+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:47.339198+0000","last_peered":"2024-09-12T18:03:47.339198+0000","last_clean":"2024-09-12T18:03:47.339198+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:47.339198+0000","last_undegraded":"2024-09-12T18:03:47.339198+0000","last_fullsized":"2024-09-12T18:03:47.339198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":338,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"66'376","reported_seq":508,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337522+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:47.337522+0000","last_peered":"2024-09-12T18:03:47.337522+0000","last_clean":"2024-09-12T18:03:47.337522+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:47.337522+0000","last_undegraded":"2024-09-12T18:03:47.337522+0000","last_fullsized":"2024-09-12T18:03:47.337522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":337,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"66'448","reported_seq":626,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345430+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:47.345430+0000","last_peered":"2024-09-12T18:03:47.345430+0000","last_clean":"2024-09-12T18:03:47.345430+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:47.345430+0000","last_undegraded":"2024-09-12T18:03:47.345430+0000","last_fullsized":"2024-09-12T18:03:47.345430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16695,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":423,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"66'365","reported_seq":489,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336564+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:47.336564+0000","last_peered":"2024-09-12T18:03:47.336564+0000","last_clean":"2024-09-12T18:03:47.336564+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:47.336564+0000","last_undegraded":"2024-09-12T18:03:47.336564+0000","last_fullsized":"2024-09-12T18:03:47.336564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6570,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":337,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"66'425","reported_seq":600,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346020+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:47.346020+0000","last_peered":"2024-09-12T18:03:47.346020+0000","last_clean":"2024-09-12T18:03:47.346020+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:47.346020+0000","last_undegraded":"2024-09-12T18:03:47.346020+0000","last_fullsized":"2024-09-12T18:03:47.346020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26761,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":398,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"66'404","reported_seq":868,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.331063+0000","last_change":"2024-09-12T18:03:47.344226+0000","last_active":"2024-09-12T18:03:47.344226+0000","last_peered":"2024-09-12T18:03:47.331063+0000","last_clean":"2024-09-12T18:03:39.938070+0000","last_became_active":"2024-09-12T18:03:42.051143+0000","last_became_peered":"2024-09-12T18:03:42.051143+0000","last_unstale":"2024-09-12T18:03:47.331063+0000","last_undegraded":"2024-09-12T18:03:41.968420+0000","last_fullsized":"2024-09-12T18:03:41.961304+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":345495,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":366,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":141,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"66'393","reported_seq":511,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.349849+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:47.349849+0000","last_peered":"2024-09-12T18:03:47.349849+0000","last_clean":"2024-09-12T18:03:47.349849+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:47.349849+0000","last_undegraded":"2024-09-12T18:03:47.349849+0000","last_fullsized":"2024-09-12T18:03:47.349849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29922,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":355,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"65'372","reported_seq":897,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.345185+0000","last_change":"2024-09-12T18:03:46.332377+0000","last_active":"2024-09-12T18:03:46.332377+0000","last_peered":"2024-09-12T18:03:45.972802+0000","last_clean":"2024-09-12T18:03:39.946744+0000","last_became_active":"2024-09-12T18:03:42.054676+0000","last_became_peered":"2024-09-12T18:03:42.054676+0000","last_unstale":"2024-09-12T18:03:47.345185+0000","last_undegraded":"2024-09-12T18:03:47.345185+0000","last_fullsized":"2024-09-12T18:03:47.345185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56312,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":358,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"66'359","reported_seq":511,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339660+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:47.339660+0000","last_peered":"2024-09-12T18:03:47.339660+0000","last_clean":"2024-09-12T18:03:47.339660+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:47.339660+0000","last_undegraded":"2024-09-12T18:03:47.339660+0000","last_fullsized":"2024-09-12T18:03:47.339660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18793,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":338,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"66'354","reported_seq":493,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341087+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:47.341087+0000","last_peered":"2024-09-12T18:03:47.341087+0000","last_clean":"2024-09-12T18:03:47.341087+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:47.341087+0000","last_undegraded":"2024-09-12T18:03:47.341087+0000","last_fullsized":"2024-09-12T18:03:47.341087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24461,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":329,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"66'382","reported_seq":503,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345188+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:47.345188+0000","last_peered":"2024-09-12T18:03:47.345188+0000","last_clean":"2024-09-12T18:03:47.345188+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:47.345188+0000","last_undegraded":"2024-09-12T18:03:47.345188+0000","last_fullsized":"2024-09-12T18:03:47.345188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":347,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"66'415","reported_seq":572,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336714+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:47.336714+0000","last_peered":"2024-09-12T18:03:47.336714+0000","last_clean":"2024-09-12T18:03:47.336714+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:47.336714+0000","last_undegraded":"2024-09-12T18:03:47.336714+0000","last_fullsized":"2024-09-12T18:03:47.336714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30382,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":388,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"66'430","reported_seq":576,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346330+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:47.346330+0000","last_peered":"2024-09-12T18:03:47.346330+0000","last_clean":"2024-09-12T18:03:47.346330+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:47.346330+0000","last_undegraded":"2024-09-12T18:03:47.346330+0000","last_fullsized":"2024-09-12T18:03:47.346330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1541,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":393,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"66'455","reported_seq":639,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342057+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:47.342057+0000","last_peered":"2024-09-12T18:03:47.342057+0000","last_clean":"2024-09-12T18:03:47.342057+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:47.342057+0000","last_undegraded":"2024-09-12T18:03:47.342057+0000","last_fullsized":"2024-09-12T18:03:47.342057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107438,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":423,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"66'421","reported_seq":566,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351372+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:47.351372+0000","last_peered":"2024-09-12T18:03:47.351372+0000","last_clean":"2024-09-12T18:03:47.351372+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:47.351372+0000","last_undegraded":"2024-09-12T18:03:47.351372+0000","last_fullsized":"2024-09-12T18:03:47.351372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63741,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":390,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"66'398","reported_seq":535,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.309045+0000","last_change":"2024-09-12T18:03:47.346596+0000","last_active":"2024-09-12T18:03:47.346596+0000","last_peered":"2024-09-12T18:03:47.309045+0000","last_clean":"2024-09-12T18:03:39.944065+0000","last_became_active":"2024-09-12T18:03:42.058753+0000","last_became_peered":"2024-09-12T18:03:42.058753+0000","last_unstale":"2024-09-12T18:03:47.309045+0000","last_undegraded":"2024-09-12T18:03:41.974699+0000","last_fullsized":"2024-09-12T18:03:41.972473+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24788,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":363,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"66'453","reported_seq":628,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.310360+0000","last_change":"2024-09-12T18:03:47.342842+0000","last_active":"2024-09-12T18:03:47.342842+0000","last_peered":"2024-09-12T18:03:47.310360+0000","last_clean":"2024-09-12T18:03:39.933624+0000","last_became_active":"2024-09-12T18:03:42.029653+0000","last_became_peered":"2024-09-12T18:03:42.029653+0000","last_unstale":"2024-09-12T18:03:47.310360+0000","last_undegraded":"2024-09-12T18:03:41.966171+0000","last_fullsized":"2024-09-12T18:03:41.962893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":414,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"66'427","reported_seq":556,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337921+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:47.337921+0000","last_peered":"2024-09-12T18:03:47.337921+0000","last_clean":"2024-09-12T18:03:47.337921+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:47.337921+0000","last_undegraded":"2024-09-12T18:03:47.337921+0000","last_fullsized":"2024-09-12T18:03:47.337921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":392,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"66'388","reported_seq":864,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.344348+0000","last_change":"2024-09-12T18:03:47.344348+0000","last_active":"2024-09-12T18:03:47.344348+0000","last_peered":"2024-09-12T18:03:47.317829+0000","last_clean":"2024-09-12T18:03:39.923110+0000","last_became_active":"2024-09-12T18:03:42.049745+0000","last_became_peered":"2024-09-12T18:03:42.049745+0000","last_unstale":"2024-09-12T18:03:47.344348+0000","last_undegraded":"2024-09-12T18:03:47.344348+0000","last_fullsized":"2024-09-12T18:03:47.344348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109013,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":366,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"66'435","reported_seq":596,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340093+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:47.340093+0000","last_peered":"2024-09-12T18:03:47.340093+0000","last_clean":"2024-09-12T18:03:47.340093+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:47.340093+0000","last_undegraded":"2024-09-12T18:03:47.340093+0000","last_fullsized":"2024-09-12T18:03:47.340093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15312,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":404,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.341554+0000","last_change":"2024-09-12T18:03:47.657951+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.341554+0000","last_undegraded":"2024-09-12T18:03:47.341554+0000","last_fullsized":"2024-09-12T18:03:47.341554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"66'455","reported_seq":1016,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.344371+0000","last_change":"2024-09-12T18:03:47.344371+0000","last_active":"2024-09-12T18:03:47.344371+0000","last_peered":"2024-09-12T18:03:47.308489+0000","last_clean":"2024-09-12T18:03:39.936313+0000","last_became_active":"2024-09-12T18:03:42.054140+0000","last_became_peered":"2024-09-12T18:03:42.054140+0000","last_unstale":"2024-09-12T18:03:47.344371+0000","last_undegraded":"2024-09-12T18:03:47.344371+0000","last_fullsized":"2024-09-12T18:03:47.344371+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41757,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":427,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"66'386","reported_seq":510,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342731+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:47.342731+0000","last_peered":"2024-09-12T18:03:47.342731+0000","last_clean":"2024-09-12T18:03:47.342731+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:47.342731+0000","last_undegraded":"2024-09-12T18:03:47.342731+0000","last_fullsized":"2024-09-12T18:03:47.342731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":225680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":363,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"66'465","reported_seq":605,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351830+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:47.351830+0000","last_peered":"2024-09-12T18:03:47.351830+0000","last_clean":"2024-09-12T18:03:47.351830+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:47.351830+0000","last_undegraded":"2024-09-12T18:03:47.351830+0000","last_fullsized":"2024-09-12T18:03:47.351830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72515,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":415,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"66'404","reported_seq":556,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342041+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:47.342041+0000","last_peered":"2024-09-12T18:03:47.342041+0000","last_clean":"2024-09-12T18:03:47.342041+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:47.342041+0000","last_undegraded":"2024-09-12T18:03:47.342041+0000","last_fullsized":"2024-09-12T18:03:47.342041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32467,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":371,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"66'407","reported_seq":566,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342230+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:47.342230+0000","last_peered":"2024-09-12T18:03:47.342230+0000","last_clean":"2024-09-12T18:03:47.342230+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:47.342230+0000","last_undegraded":"2024-09-12T18:03:47.342230+0000","last_fullsized":"2024-09-12T18:03:47.342230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":381,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.351543+0000","last_change":"2024-09-12T18:03:47.657983+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.351543+0000","last_undegraded":"2024-09-12T18:03:47.351543+0000","last_fullsized":"2024-09-12T18:03:47.351543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"66'464","reported_seq":589,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336442+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:47.336442+0000","last_peered":"2024-09-12T18:03:47.336442+0000","last_clean":"2024-09-12T18:03:47.336442+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:47.336442+0000","last_undegraded":"2024-09-12T18:03:47.336442+0000","last_fullsized":"2024-09-12T18:03:47.336442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22049,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":429,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.347203+0000","last_change":"2024-09-12T18:03:47.657903+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.347203+0000","last_undegraded":"2024-09-12T18:03:47.347203+0000","last_fullsized":"2024-09-12T18:03:47.347203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"66'420","reported_seq":559,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342189+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:47.342189+0000","last_peered":"2024-09-12T18:03:47.342189+0000","last_clean":"2024-09-12T18:03:47.342189+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:47.342189+0000","last_undegraded":"2024-09-12T18:03:47.342189+0000","last_fullsized":"2024-09-12T18:03:47.342189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9279,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":390,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"66'401","reported_seq":585,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341232+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:47.341232+0000","last_peered":"2024-09-12T18:03:47.341232+0000","last_clean":"2024-09-12T18:03:47.341232+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:47.341232+0000","last_undegraded":"2024-09-12T18:03:47.341232+0000","last_fullsized":"2024-09-12T18:03:47.341232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47373,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":364,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":557,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344206+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:47.344206+0000","last_peered":"2024-09-12T18:03:47.344206+0000","last_clean":"2024-09-12T18:03:47.344206+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:47.344206+0000","last_undegraded":"2024-09-12T18:03:47.344206+0000","last_fullsized":"2024-09-12T18:03:47.344206+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"66'375","reported_seq":520,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342433+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:47.342433+0000","last_peered":"2024-09-12T18:03:47.342433+0000","last_clean":"2024-09-12T18:03:47.342433+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:47.342433+0000","last_undegraded":"2024-09-12T18:03:47.342433+0000","last_fullsized":"2024-09-12T18:03:47.342433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21606,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":342,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"66'48","reported_seq":158,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345412+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:47.345412+0000","last_peered":"2024-09-12T18:03:47.345412+0000","last_clean":"2024-09-12T18:03:47.345412+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:47.345412+0000","last_undegraded":"2024-09-12T18:03:47.345412+0000","last_fullsized":"2024-09-12T18:03:47.345412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"66'413","reported_seq":547,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.353039+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:47.353039+0000","last_peered":"2024-09-12T18:03:47.353039+0000","last_clean":"2024-09-12T18:03:47.353039+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:47.353039+0000","last_undegraded":"2024-09-12T18:03:47.353039+0000","last_fullsized":"2024-09-12T18:03:47.353039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63820,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":377,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":179,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340895+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:47.340895+0000","last_peered":"2024-09-12T18:03:47.340895+0000","last_clean":"2024-09-12T18:03:47.340895+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:47.340895+0000","last_undegraded":"2024-09-12T18:03:47.340895+0000","last_fullsized":"2024-09-12T18:03:47.340895+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"66'403","reported_seq":547,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.350154+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:47.350154+0000","last_peered":"2024-09-12T18:03:47.350154+0000","last_clean":"2024-09-12T18:03:47.350154+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:47.350154+0000","last_undegraded":"2024-09-12T18:03:47.350154+0000","last_fullsized":"2024-09-12T18:03:47.350154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":371,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"66'58","reported_seq":169,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342330+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:47.342330+0000","last_peered":"2024-09-12T18:03:47.342330+0000","last_clean":"2024-09-12T18:03:47.342330+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:47.342330+0000","last_undegraded":"2024-09-12T18:03:47.342330+0000","last_fullsized":"2024-09-12T18:03:47.342330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"66'136","reported_seq":247,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341572+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:47.341572+0000","last_peered":"2024-09-12T18:03:47.341572+0000","last_clean":"2024-09-12T18:03:47.341572+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:47.341572+0000","last_undegraded":"2024-09-12T18:03:47.341572+0000","last_fullsized":"2024-09-12T18:03:47.341572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"66'426","reported_seq":560,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342883+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:47.342883+0000","last_peered":"2024-09-12T18:03:47.342883+0000","last_clean":"2024-09-12T18:03:47.342883+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:47.342883+0000","last_undegraded":"2024-09-12T18:03:47.342883+0000","last_fullsized":"2024-09-12T18:03:47.342883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23187,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":388,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":360,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346393+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:47.346393+0000","last_peered":"2024-09-12T18:03:47.346393+0000","last_clean":"2024-09-12T18:03:47.346393+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:47.346393+0000","last_undegraded":"2024-09-12T18:03:47.346393+0000","last_fullsized":"2024-09-12T18:03:47.346393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"66'450","reported_seq":1004,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.294765+0000","last_change":"2024-09-12T18:03:47.342090+0000","last_active":"2024-09-12T18:03:47.342090+0000","last_peered":"2024-09-12T18:03:47.294765+0000","last_clean":"2024-09-12T18:03:47.294765+0000","last_became_active":"2024-09-12T18:03:45.331702+0000","last_became_peered":"2024-09-12T18:03:45.331702+0000","last_unstale":"2024-09-12T18:03:47.294765+0000","last_undegraded":"2024-09-12T18:03:47.294765+0000","last_fullsized":"2024-09-12T18:03:47.294765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37829,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":418,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343646+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:47.343646+0000","last_peered":"2024-09-12T18:03:47.343646+0000","last_clean":"2024-09-12T18:03:47.343646+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:47.343646+0000","last_undegraded":"2024-09-12T18:03:47.343646+0000","last_fullsized":"2024-09-12T18:03:47.343646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"66'417","reported_seq":567,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336707+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:47.336707+0000","last_peered":"2024-09-12T18:03:47.336707+0000","last_clean":"2024-09-12T18:03:47.336707+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:47.336707+0000","last_undegraded":"2024-09-12T18:03:47.336707+0000","last_fullsized":"2024-09-12T18:03:47.336707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67729,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":377,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"66'52","reported_seq":163,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341954+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:47.341954+0000","last_peered":"2024-09-12T18:03:47.341954+0000","last_clean":"2024-09-12T18:03:47.341954+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:47.341954+0000","last_undegraded":"2024-09-12T18:03:47.341954+0000","last_fullsized":"2024-09-12T18:03:47.341954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"58'380","reported_seq":507,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.343478+0000","last_change":"2024-09-12T18:03:47.343478+0000","last_active":"2024-09-12T18:03:47.343478+0000","last_peered":"2024-09-12T18:03:39.930535+0000","last_clean":"2024-09-12T18:03:39.930535+0000","last_became_active":"2024-09-12T18:01:55.588608+0000","last_became_peered":"2024-09-12T18:01:55.588608+0000","last_unstale":"2024-09-12T18:03:47.343478+0000","last_undegraded":"2024-09-12T18:03:47.343478+0000","last_fullsized":"2024-09-12T18:03:47.343478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285729,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":353,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.346480+0000","last_change":"2024-09-12T18:03:47.657992+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.346480+0000","last_undegraded":"2024-09-12T18:03:47.346480+0000","last_fullsized":"2024-09-12T18:03:47.346480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"66'452","reported_seq":1015,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.314910+0000","last_change":"2024-09-12T18:03:47.339339+0000","last_active":"2024-09-12T18:03:47.339339+0000","last_peered":"2024-09-12T18:03:47.314910+0000","last_clean":"2024-09-12T18:03:47.314910+0000","last_became_active":"2024-09-12T18:03:45.332775+0000","last_became_peered":"2024-09-12T18:03:45.332775+0000","last_unstale":"2024-09-12T18:03:47.314910+0000","last_undegraded":"2024-09-12T18:03:47.314910+0000","last_fullsized":"2024-09-12T18:03:47.314910+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207450,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":417,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":228,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.336949+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:47.336949+0000","last_peered":"2024-09-12T18:03:47.336949+0000","last_clean":"2024-09-12T18:03:47.336949+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:47.336949+0000","last_undegraded":"2024-09-12T18:03:47.336949+0000","last_fullsized":"2024-09-12T18:03:47.336949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":577,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342278+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:47.342278+0000","last_peered":"2024-09-12T18:03:47.342278+0000","last_clean":"2024-09-12T18:03:47.342278+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:47.342278+0000","last_undegraded":"2024-09-12T18:03:47.342278+0000","last_fullsized":"2024-09-12T18:03:47.342278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":162,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341026+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:47.341026+0000","last_peered":"2024-09-12T18:03:47.341026+0000","last_clean":"2024-09-12T18:03:47.341026+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:47.341026+0000","last_undegraded":"2024-09-12T18:03:47.341026+0000","last_fullsized":"2024-09-12T18:03:47.341026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"66'373","reported_seq":518,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348160+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:47.348160+0000","last_peered":"2024-09-12T18:03:47.348160+0000","last_clean":"2024-09-12T18:03:47.348160+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:47.348160+0000","last_undegraded":"2024-09-12T18:03:47.348160+0000","last_fullsized":"2024-09-12T18:03:47.348160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36721,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":342,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"66'481","reported_seq":602,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.949736+0000","last_change":"2024-09-12T18:03:47.339759+0000","last_active":"2024-09-12T18:03:47.339759+0000","last_peered":"2024-09-12T18:03:46.949736+0000","last_clean":"2024-09-12T18:03:46.949736+0000","last_became_active":"2024-09-12T18:03:43.330781+0000","last_became_peered":"2024-09-12T18:03:43.330781+0000","last_unstale":"2024-09-12T18:03:46.949736+0000","last_undegraded":"2024-09-12T18:03:46.949736+0000","last_fullsized":"2024-09-12T18:03:46.949736+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"66'379","reported_seq":506,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.351079+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:47.351079+0000","last_peered":"2024-09-12T18:03:47.351079+0000","last_clean":"2024-09-12T18:03:47.351079+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:47.351079+0000","last_undegraded":"2024-09-12T18:03:47.351079+0000","last_fullsized":"2024-09-12T18:03:47.351079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32157,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":335,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":262,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343934+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:47.343934+0000","last_peered":"2024-09-12T18:03:47.343934+0000","last_clean":"2024-09-12T18:03:47.343934+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:47.343934+0000","last_undegraded":"2024-09-12T18:03:47.343934+0000","last_fullsized":"2024-09-12T18:03:47.343934+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":125,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.346578+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:47.346578+0000","last_peered":"2024-09-12T18:03:47.346578+0000","last_clean":"2024-09-12T18:03:47.346578+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:47.346578+0000","last_undegraded":"2024-09-12T18:03:47.346578+0000","last_fullsized":"2024-09-12T18:03:47.346578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":679,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345859+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:47.345859+0000","last_peered":"2024-09-12T18:03:47.345859+0000","last_clean":"2024-09-12T18:03:47.345859+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:47.345859+0000","last_undegraded":"2024-09-12T18:03:47.345859+0000","last_fullsized":"2024-09-12T18:03:47.345859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"66'431","reported_seq":561,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342452+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:47.342452+0000","last_peered":"2024-09-12T18:03:47.342452+0000","last_clean":"2024-09-12T18:03:47.342452+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:47.342452+0000","last_undegraded":"2024-09-12T18:03:47.342452+0000","last_fullsized":"2024-09-12T18:03:47.342452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19446,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":389,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342703+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:47.342703+0000","last_peered":"2024-09-12T18:03:47.342703+0000","last_clean":"2024-09-12T18:03:47.342703+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:47.342703+0000","last_undegraded":"2024-09-12T18:03:47.342703+0000","last_fullsized":"2024-09-12T18:03:47.342703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.342797+0000","last_change":"2024-09-12T18:03:47.657939+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.342797+0000","last_undegraded":"2024-09-12T18:03:47.342797+0000","last_fullsized":"2024-09-12T18:03:47.342797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"65'433","reported_seq":1013,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.345716+0000","last_change":"2024-09-12T18:03:46.332516+0000","last_active":"2024-09-12T18:03:46.332516+0000","last_peered":"2024-09-12T18:03:45.999807+0000","last_clean":"2024-09-12T18:03:39.941039+0000","last_became_active":"2024-09-12T18:03:42.054484+0000","last_became_peered":"2024-09-12T18:03:42.054484+0000","last_unstale":"2024-09-12T18:03:47.345716+0000","last_undegraded":"2024-09-12T18:03:47.345716+0000","last_fullsized":"2024-09-12T18:03:47.345716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264752,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":415,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344469+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:47.344469+0000","last_peered":"2024-09-12T18:03:47.344469+0000","last_clean":"2024-09-12T18:03:47.344469+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:47.344469+0000","last_undegraded":"2024-09-12T18:03:47.344469+0000","last_fullsized":"2024-09-12T18:03:47.344469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"66'373","reported_seq":483,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.343984+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:47.343984+0000","last_peered":"2024-09-12T18:03:47.343984+0000","last_clean":"2024-09-12T18:03:47.343984+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:47.343984+0000","last_undegraded":"2024-09-12T18:03:47.343984+0000","last_fullsized":"2024-09-12T18:03:47.343984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.341653+0000","last_change":"2024-09-12T18:03:47.658063+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.341653+0000","last_undegraded":"2024-09-12T18:03:47.341653+0000","last_fullsized":"2024-09-12T18:03:47.341653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":136,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.337075+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:47.337075+0000","last_peered":"2024-09-12T18:03:47.337075+0000","last_clean":"2024-09-12T18:03:47.337075+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:47.337075+0000","last_undegraded":"2024-09-12T18:03:47.337075+0000","last_fullsized":"2024-09-12T18:03:47.337075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"66'72","reported_seq":183,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344740+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:47.344740+0000","last_peered":"2024-09-12T18:03:47.344740+0000","last_clean":"2024-09-12T18:03:47.344740+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:47.344740+0000","last_undegraded":"2024-09-12T18:03:47.344740+0000","last_fullsized":"2024-09-12T18:03:47.344740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"66'412","reported_seq":606,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348900+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:47.348900+0000","last_peered":"2024-09-12T18:03:47.348900+0000","last_clean":"2024-09-12T18:03:47.348900+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:47.348900+0000","last_undegraded":"2024-09-12T18:03:47.348900+0000","last_fullsized":"2024-09-12T18:03:47.348900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16453,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":376,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"66'299","reported_seq":410,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342685+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:47.342685+0000","last_peered":"2024-09-12T18:03:47.342685+0000","last_clean":"2024-09-12T18:03:47.342685+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:47.342685+0000","last_undegraded":"2024-09-12T18:03:47.342685+0000","last_fullsized":"2024-09-12T18:03:47.342685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.348948+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:47.348948+0000","last_peered":"2024-09-12T18:03:47.348948+0000","last_clean":"2024-09-12T18:03:47.348948+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:47.348948+0000","last_undegraded":"2024-09-12T18:03:47.348948+0000","last_fullsized":"2024-09-12T18:03:47.348948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"66'356","reported_seq":491,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340096+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:47.340096+0000","last_peered":"2024-09-12T18:03:47.340096+0000","last_clean":"2024-09-12T18:03:47.340096+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:47.340096+0000","last_undegraded":"2024-09-12T18:03:47.340096+0000","last_fullsized":"2024-09-12T18:03:47.340096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":322,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.962047+0000","last_change":"2024-09-12T18:03:39.949422+0000","last_active":"2024-09-12T18:01:53.672138+0000","last_peered":"2024-09-12T18:01:53.672138+0000","last_clean":"2024-09-12T18:01:53.672138+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:40.962047+0000","last_undegraded":"2024-09-12T18:03:40.962047+0000","last_fullsized":"2024-09-12T18:03:40.962047+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.332114+0000","last_change":"2024-09-12T18:03:47.343843+0000","last_active":"2024-09-12T18:03:47.343843+0000","last_peered":"2024-09-12T18:03:46.332114+0000","last_clean":"2024-09-12T18:03:46.332114+0000","last_became_active":"2024-09-12T18:03:40.975455+0000","last_became_peered":"2024-09-12T18:03:40.975455+0000","last_unstale":"2024-09-12T18:03:46.332114+0000","last_undegraded":"2024-09-12T18:03:46.332114+0000","last_fullsized":"2024-09-12T18:03:46.332114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"66'375","reported_seq":516,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345295+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:47.345295+0000","last_peered":"2024-09-12T18:03:47.345295+0000","last_clean":"2024-09-12T18:03:47.345295+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:47.345295+0000","last_undegraded":"2024-09-12T18:03:47.345295+0000","last_fullsized":"2024-09-12T18:03:47.345295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":342,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"66'55","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.967391+0000","last_change":"2024-09-12T18:03:39.951414+0000","last_active":"2024-09-12T18:03:39.951414+0000","last_peered":"2024-09-12T18:01:55.589453+0000","last_clean":"2024-09-12T18:01:55.589453+0000","last_became_active":"2024-09-12T18:01:54.710048+0000","last_became_peered":"2024-09-12T18:01:54.710048+0000","last_unstale":"2024-09-12T18:03:40.967391+0000","last_undegraded":"2024-09-12T18:03:40.967391+0000","last_fullsized":"2024-09-12T18:03:40.967391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.977229+0000","last_change":"2024-09-12T18:03:39.954023+0000","last_active":"2024-09-12T18:01:49.503848+0000","last_peered":"2024-09-12T18:01:49.503848+0000","last_clean":"2024-09-12T18:01:49.503848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:40.977229+0000","last_undegraded":"2024-09-12T18:03:40.977229+0000","last_fullsized":"2024-09-12T18:03:40.977229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"58'339","reported_seq":437,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.347326+0000","last_change":"2024-09-12T18:03:47.345346+0000","last_active":"2024-09-12T18:03:47.345346+0000","last_peered":"2024-09-12T18:03:39.923074+0000","last_clean":"2024-09-12T18:03:39.923074+0000","last_became_active":"2024-09-12T18:01:55.586396+0000","last_became_peered":"2024-09-12T18:01:55.586396+0000","last_unstale":"2024-09-12T18:03:47.347326+0000","last_undegraded":"2024-09-12T18:03:47.347326+0000","last_fullsized":"2024-09-12T18:03:47.347326+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222083,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":317,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.354291+0000","last_change":"2024-09-12T18:03:47.658042+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.354291+0000","last_undegraded":"2024-09-12T18:03:47.354291+0000","last_fullsized":"2024-09-12T18:03:47.354291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341703+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:47.341703+0000","last_peered":"2024-09-12T18:03:47.341703+0000","last_clean":"2024-09-12T18:03:47.341703+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:47.341703+0000","last_undegraded":"2024-09-12T18:03:47.341703+0000","last_fullsized":"2024-09-12T18:03:47.341703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"66'386","reported_seq":544,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340768+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:47.340768+0000","last_peered":"2024-09-12T18:03:47.340768+0000","last_clean":"2024-09-12T18:03:47.340768+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:47.340768+0000","last_undegraded":"2024-09-12T18:03:47.340768+0000","last_fullsized":"2024-09-12T18:03:47.340768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34066,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":349,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"66'399","reported_seq":549,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.339372+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:47.339372+0000","last_peered":"2024-09-12T18:03:47.339372+0000","last_clean":"2024-09-12T18:03:47.339372+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:47.339372+0000","last_undegraded":"2024-09-12T18:03:47.339372+0000","last_fullsized":"2024-09-12T18:03:47.339372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8779,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":362,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":338,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341682+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:47.341682+0000","last_peered":"2024-09-12T18:03:47.341682+0000","last_clean":"2024-09-12T18:03:47.341682+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:47.341682+0000","last_undegraded":"2024-09-12T18:03:47.341682+0000","last_fullsized":"2024-09-12T18:03:47.341682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"66'434","reported_seq":583,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345289+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:47.345289+0000","last_peered":"2024-09-12T18:03:47.345289+0000","last_clean":"2024-09-12T18:03:47.345289+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:47.345289+0000","last_undegraded":"2024-09-12T18:03:47.345289+0000","last_fullsized":"2024-09-12T18:03:47.345289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":257690,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":398,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"66'94","reported_seq":204,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342593+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:47.342593+0000","last_peered":"2024-09-12T18:03:47.342593+0000","last_clean":"2024-09-12T18:03:47.342593+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:47.342593+0000","last_undegraded":"2024-09-12T18:03:47.342593+0000","last_fullsized":"2024-09-12T18:03:47.342593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"66'185","reported_seq":307,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.919068+0000","last_change":"2024-09-12T18:03:47.348832+0000","last_active":"2024-09-12T18:03:47.348832+0000","last_peered":"2024-09-12T18:03:46.919068+0000","last_clean":"2024-09-12T18:03:46.919068+0000","last_became_active":"2024-09-12T18:03:43.331938+0000","last_became_peered":"2024-09-12T18:03:43.331938+0000","last_unstale":"2024-09-12T18:03:46.919068+0000","last_undegraded":"2024-09-12T18:03:46.919068+0000","last_fullsized":"2024-09-12T18:03:46.919068+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3329809,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"66'480","reported_seq":678,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344138+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:47.344138+0000","last_peered":"2024-09-12T18:03:47.344138+0000","last_clean":"2024-09-12T18:03:47.344138+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:47.344138+0000","last_undegraded":"2024-09-12T18:03:47.344138+0000","last_fullsized":"2024-09-12T18:03:47.344138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79412,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":446,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"65'54","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:46.331190+0000","last_change":"2024-09-12T18:03:47.658078+0000","last_active":"2024-09-12T18:03:47.658078+0000","last_peered":"2024-09-12T18:03:46.331190+0000","last_clean":"2024-09-12T18:03:46.331190+0000","last_became_active":"2024-09-12T18:03:40.982653+0000","last_became_peered":"2024-09-12T18:03:40.982653+0000","last_unstale":"2024-09-12T18:03:46.331190+0000","last_undegraded":"2024-09-12T18:03:46.331190+0000","last_fullsized":"2024-09-12T18:03:46.331190+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"58'399","reported_seq":542,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:47.346217+0000","last_change":"2024-09-12T18:03:47.341121+0000","last_active":"2024-09-12T18:03:47.341121+0000","last_peered":"2024-09-12T18:03:39.939093+0000","last_clean":"2024-09-12T18:03:39.939093+0000","last_became_active":"2024-09-12T18:01:55.595687+0000","last_became_peered":"2024-09-12T18:01:55.595687+0000","last_unstale":"2024-09-12T18:03:47.346217+0000","last_undegraded":"2024-09-12T18:03:47.346217+0000","last_fullsized":"2024-09-12T18:03:47.346217+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270119,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":376,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"66'367","reported_seq":512,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342832+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:47.342832+0000","last_peered":"2024-09-12T18:03:47.342832+0000","last_clean":"2024-09-12T18:03:47.342832+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:47.342832+0000","last_undegraded":"2024-09-12T18:03:47.342832+0000","last_fullsized":"2024-09-12T18:03:47.342832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20570,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":342,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"66'652","reported_seq":762,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.344056+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:47.344056+0000","last_peered":"2024-09-12T18:03:47.344056+0000","last_clean":"2024-09-12T18:03:47.344056+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:47.344056+0000","last_undegraded":"2024-09-12T18:03:47.344056+0000","last_fullsized":"2024-09-12T18:03:47.344056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"66'428","reported_seq":600,"reported_epoch":66,"state":"remapped+peering","last_fresh":"2024-09-12T18:03:47.312409+0000","last_change":"2024-09-12T18:03:47.347694+0000","last_active":"2024-09-12T18:03:47.347694+0000","last_peered":"2024-09-12T18:03:47.312409+0000","last_clean":"2024-09-12T18:03:39.932171+0000","last_became_active":"2024-09-12T18:03:42.054957+0000","last_became_peered":"2024-09-12T18:03:42.054957+0000","last_unstale":"2024-09-12T18:03:47.312409+0000","last_undegraded":"2024-09-12T18:03:41.977297+0000","last_fullsized":"2024-09-12T18:03:41.964490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1447021,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":399,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.345290+0000","last_change":"2024-09-12T18:03:47.657929+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.345290+0000","last_undegraded":"2024-09-12T18:03:47.345290+0000","last_fullsized":"2024-09-12T18:03:47.345290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"66'388","reported_seq":534,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341393+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:47.341393+0000","last_peered":"2024-09-12T18:03:47.341393+0000","last_clean":"2024-09-12T18:03:47.341393+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:47.341393+0000","last_undegraded":"2024-09-12T18:03:47.341393+0000","last_fullsized":"2024-09-12T18:03:47.341393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64033,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":343,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"66'211","reported_seq":321,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.340225+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:47.340225+0000","last_peered":"2024-09-12T18:03:47.340225+0000","last_clean":"2024-09-12T18:03:47.340225+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:47.340225+0000","last_undegraded":"2024-09-12T18:03:47.340225+0000","last_fullsized":"2024-09-12T18:03:47.340225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12335716,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":12125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"66'369","reported_seq":827,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.307915+0000","last_change":"2024-09-12T18:03:47.339885+0000","last_active":"2024-09-12T18:03:47.339885+0000","last_peered":"2024-09-12T18:03:47.307915+0000","last_clean":"2024-09-12T18:03:47.307915+0000","last_became_active":"2024-09-12T18:03:44.328158+0000","last_became_peered":"2024-09-12T18:03:44.328158+0000","last_unstale":"2024-09-12T18:03:47.307915+0000","last_undegraded":"2024-09-12T18:03:47.307915+0000","last_fullsized":"2024-09-12T18:03:47.307915+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":339,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":161,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.345496+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:47.345496+0000","last_peered":"2024-09-12T18:03:47.345496+0000","last_clean":"2024-09-12T18:03:47.345496+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:47.345496+0000","last_undegraded":"2024-09-12T18:03:47.345496+0000","last_fullsized":"2024-09-12T18:03:47.345496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"66'366","reported_seq":827,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.318081+0000","last_change":"2024-09-12T18:03:47.338487+0000","last_active":"2024-09-12T18:03:47.338487+0000","last_peered":"2024-09-12T18:03:47.318081+0000","last_clean":"2024-09-12T18:03:47.318081+0000","last_became_active":"2024-09-12T18:03:46.338563+0000","last_became_peered":"2024-09-12T18:03:46.338563+0000","last_unstale":"2024-09-12T18:03:47.318081+0000","last_undegraded":"2024-09-12T18:03:47.318081+0000","last_fullsized":"2024-09-12T18:03:47.318081+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67687,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":339,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"66'179","reported_seq":303,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:46.979087+0000","last_change":"2024-09-12T18:03:47.339862+0000","last_active":"2024-09-12T18:03:47.339862+0000","last_peered":"2024-09-12T18:03:46.979087+0000","last_clean":"2024-09-12T18:03:46.979087+0000","last_became_active":"2024-09-12T18:03:43.332784+0000","last_became_peered":"2024-09-12T18:03:43.332784+0000","last_unstale":"2024-09-12T18:03:46.979087+0000","last_undegraded":"2024-09-12T18:03:46.979087+0000","last_fullsized":"2024-09-12T18:03:46.979087+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"66'393","reported_seq":887,"reported_epoch":66,"state":"peering","last_fresh":"2024-09-12T18:03:47.316554+0000","last_change":"2024-09-12T18:03:47.337760+0000","last_active":"2024-09-12T18:03:47.337760+0000","last_peered":"2024-09-12T18:03:47.316554+0000","last_clean":"2024-09-12T18:03:47.316554+0000","last_became_active":"2024-09-12T18:03:43.327322+0000","last_became_peered":"2024-09-12T18:03:43.327322+0000","last_unstale":"2024-09-12T18:03:47.316554+0000","last_undegraded":"2024-09-12T18:03:47.316554+0000","last_fullsized":"2024-09-12T18:03:47.316554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28513,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":364,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"66'274","reported_seq":384,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342487+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:47.342487+0000","last_peered":"2024-09-12T18:03:47.342487+0000","last_clean":"2024-09-12T18:03:47.342487+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:47.342487+0000","last_undegraded":"2024-09-12T18:03:47.342487+0000","last_fullsized":"2024-09-12T18:03:47.342487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"66'388","reported_seq":521,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.341152+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:47.341152+0000","last_peered":"2024-09-12T18:03:47.341152+0000","last_clean":"2024-09-12T18:03:47.341152+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:47.341152+0000","last_undegraded":"2024-09-12T18:03:47.341152+0000","last_fullsized":"2024-09-12T18:03:47.341152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":354,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":2,"reported_epoch":67,"state":"peering","last_fresh":"2024-09-12T18:03:40.974472+0000","last_change":"2024-09-12T18:03:39.953369+0000","last_active":"2024-09-12T18:03:39.953369+0000","last_peered":"2024-09-12T18:03:11.472248+0000","last_clean":"2024-09-12T18:03:11.472248+0000","last_became_active":"2024-09-12T18:01:54.710823+0000","last_became_peered":"2024-09-12T18:01:54.710823+0000","last_unstale":"2024-09-12T18:03:40.974472+0000","last_undegraded":"2024-09-12T18:03:40.974472+0000","last_fullsized":"2024-09-12T18:03:40.974472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"66'447","reported_seq":625,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-12T18:03:47.342575+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:47.342575+0000","last_peered":"2024-09-12T18:03:47.342575+0000","last_clean":"2024-09-12T18:03:47.342575+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:47.342575+0000","last_undegraded":"2024-09-12T18:03:47.342575+0000","last_fullsized":"2024-09-12T18:03:47.342575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":414,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"unknown","last_fresh":"2024-09-12T18:03:47.344918+0000","last_change":"2024-09-12T18:03:47.658053+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T18:03:47.344918+0000","last_undegraded":"2024-09-12T18:03:47.344918+0000","last_fullsized":"2024-09-12T18:03:47.344918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":5150861,"num_objects":485,"num_object_clones":0,"num_object_copies":970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":485,"num_whiteouts":0,"num_read":2431,"num_read_kb":1208833,"num_write":22517,"num_write_kb":3759279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1851,"num_bytes_recovered":2479618,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11350016,"data_stored":13087022,"data_compressed":3344745,"data_compressed_allocated":3870720,"data_compressed_original":9039872,"omap_allocated":0,"internal_metadata":0},"log_size":24431,"ondisk_log_size":24431,"up":128,"acting":123,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":108805596,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3960,"num_write_kb":108138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11718417,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81002496,"data_stored":254055994,"data_compressed":38530927,"data_compressed_allocated":49352704,"data_compressed_original":222466048,"omap_allocated":0,"internal_metadata":0},"log_size":5490,"ondisk_log_size":5490,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738397,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98328,"kb_used_data":22788,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94273512,"statfs":{"total":96636764160,"available":96536076288,"internally_reserved":0,"allocated":23334912,"data_stored":52557698,"data_compressed":8099373,"data_compressed_allocated":10391552,"data_compressed_original":41910272,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,18],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738397,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101704,"kb_used_data":38644,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94270136,"statfs":{"total":96636764160,"available":96532619264,"internally_reserved":0,"allocated":39571456,"data_stored":115124319,"data_compressed":17630008,"data_compressed_allocated":22261760,"data_compressed_original":99889152,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118456,"kb_used_data":33192,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94253384,"statfs":{"total":96636764160,"available":96515465216,"internally_reserved":0,"allocated":33988608,"data_stored":102834901,"data_compressed":16332984,"data_compressed_allocated":20811776,"data_compressed_original":90763264,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30388224,"data_stored":97915065,"data_compressed":15106567,"data_compressed_allocated":19410944,"data_compressed_original":86966272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33931264,"data_stored":110250747,"data_compressed":16784133,"data_compressed_allocated":21250048,"data_compressed_original":97595392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16683008,"data_stored":45890182,"data_compressed":6640227,"data_compressed_allocated":8691712,"data_compressed_original":37904384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":4063859,"data_compressed":1191165,"data_compressed_allocated":1355776,"data_compressed_original":3223552,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2322432,"data_stored":2621237,"data_compressed":694434,"data_compressed_allocated":815104,"data_compressed_original":1810432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6074368,"data_stored":6401926,"data_compressed":1459146,"data_compressed_allocated":1699840,"data_compressed_original":4005888,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:53.119 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:53.116+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:53.154 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:53.154 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-12T18:03:53.154 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:53.169 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T18:03:53.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T18:03:53.220 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:53.216+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:53.292 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:03:53.293 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-12T18:03:53.293 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-12T18:03:53.293 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-12T18:03:53.293 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:03:53.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-12T18:03:53.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:03:53.298 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T18:03:53.306 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T18:03:53.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:03:53.314 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-12T18:03:53.321 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:53.316+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:53.321 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:03:53.327 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T18:03:53.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:03:53.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T18:03:53.366 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-09-12T18:03:53.366 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T18:03:53.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T18:03:53.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-12T18:03:53.387 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-09-12T18:03:53.387 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T18:03:53.405 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-09-12T18:03:53.405 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T18:03:53.421 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:53.416+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:53.435 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:53.435 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:53.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T18:03:53.522 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-12T18:03:53.516+0000 7f6734230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 22909) UID: 0 2024-09-12T18:03:53.552 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T18:03:53.560 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T18:03:53.581 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:53.582 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:53.595 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T18:03:53.761 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:53.761 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:53.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T18:03:53.892 INFO:teuthology.orchestra.run.smithi121.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:53.893 INFO:teuthology.orchestra.run.smithi121.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:53.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T18:03:54.037 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:54.037 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:54.051 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T18:03:54.169 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:54.169 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:54.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T18:03:54.314 INFO:teuthology.orchestra.run.smithi153.stdout:ERROR: (22) Invalid argument 2024-09-12T18:03:54.314 INFO:teuthology.orchestra.run.smithi153.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T18:03:55.342 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T18:03:56.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:56.328 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-09-12T18:03:56.352 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T18:03:56.421 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:56.425 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:56.439 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-12T18:03:56.326589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":346,"num_objects_misplaced":360,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29126,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4426,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32951,"ondisk_log_size":32951,"up":210,"acting":207,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":224,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334152,"kb_used_data":88072,"kb_used_omap":4,"kb_used_meta":246011,"kb_avail":282781368,"statfs":{"total":289910292480,"available":289568120832,"internally_reserved":0,"allocated":90185728,"data_stored":288000347,"data_compressed":44235806,"data_compressed_allocated":56041472,"data_compressed_original":255242240,"omap_allocated":4785,"internal_metadata":251915599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,13],"upper_bound":2048},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13238803,"num_objects":-476,"num_object_clones":0,"num_object_copies":-952,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":346,"num_objects_misplaced":360,"num_objects_unfound":0,"num_objects_dirty":-476,"num_whiteouts":0,"num_read":175,"num_read_kb":63335,"num_write":2502,"num_write_kb":293563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2570,"num_bytes_recovered":54023258,"num_keys_recovered":582,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.963146"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":601,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374472+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:52.374472+0000","last_peered":"2024-09-12T18:03:52.374472+0000","last_clean":"2024-09-12T18:03:52.374472+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:52.374472+0000","last_undegraded":"2024-09-12T18:03:52.374472+0000","last_fullsized":"2024-09-12T18:03:52.374472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":887,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373930+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:03:52.373930+0000","last_peered":"2024-09-12T18:03:52.373930+0000","last_clean":"2024-09-12T18:03:52.373930+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:03:52.373930+0000","last_undegraded":"2024-09-12T18:03:52.373930+0000","last_fullsized":"2024-09-12T18:03:52.373930+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":504,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369803+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:52.369803+0000","last_peered":"2024-09-12T18:03:52.369803+0000","last_clean":"2024-09-12T18:03:52.369803+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:52.369803+0000","last_undegraded":"2024-09-12T18:03:52.369803+0000","last_fullsized":"2024-09-12T18:03:52.369803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":522,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369900+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:52.369900+0000","last_peered":"2024-09-12T18:03:52.369900+0000","last_clean":"2024-09-12T18:03:52.369900+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:52.369900+0000","last_undegraded":"2024-09-12T18:03:52.369900+0000","last_fullsized":"2024-09-12T18:03:52.369900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":640,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374050+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:52.374050+0000","last_peered":"2024-09-12T18:03:52.374050+0000","last_clean":"2024-09-12T18:03:52.374050+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:52.374050+0000","last_undegraded":"2024-09-12T18:03:52.374050+0000","last_fullsized":"2024-09-12T18:03:52.374050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":503,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368496+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:52.368496+0000","last_peered":"2024-09-12T18:03:52.368496+0000","last_clean":"2024-09-12T18:03:52.368496+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:52.368496+0000","last_undegraded":"2024-09-12T18:03:52.368496+0000","last_fullsized":"2024-09-12T18:03:52.368496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":613,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370537+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:52.370537+0000","last_peered":"2024-09-12T18:03:52.370537+0000","last_clean":"2024-09-12T18:03:52.370537+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:52.370537+0000","last_undegraded":"2024-09-12T18:03:52.370537+0000","last_fullsized":"2024-09-12T18:03:52.370537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":967,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.367846+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:03:52.367846+0000","last_peered":"2024-09-12T18:03:52.367846+0000","last_clean":"2024-09-12T18:03:52.367846+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:03:52.367846+0000","last_undegraded":"2024-09-12T18:03:52.367846+0000","last_fullsized":"2024-09-12T18:03:52.367846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":525,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369586+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:52.369586+0000","last_peered":"2024-09-12T18:03:52.369586+0000","last_clean":"2024-09-12T18:03:52.369586+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:52.369586+0000","last_undegraded":"2024-09-12T18:03:52.369586+0000","last_fullsized":"2024-09-12T18:03:52.369586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1024,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374246+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:03:52.374246+0000","last_peered":"2024-09-12T18:03:52.374246+0000","last_clean":"2024-09-12T18:03:52.374246+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:03:52.374246+0000","last_undegraded":"2024-09-12T18:03:52.374246+0000","last_fullsized":"2024-09-12T18:03:52.374246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":528,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371637+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:52.371637+0000","last_peered":"2024-09-12T18:03:52.371637+0000","last_clean":"2024-09-12T18:03:52.371637+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:52.371637+0000","last_undegraded":"2024-09-12T18:03:52.371637+0000","last_fullsized":"2024-09-12T18:03:52.371637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":509,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373148+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:52.373148+0000","last_peered":"2024-09-12T18:03:52.373148+0000","last_clean":"2024-09-12T18:03:52.373148+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:52.373148+0000","last_undegraded":"2024-09-12T18:03:52.373148+0000","last_fullsized":"2024-09-12T18:03:52.373148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":515,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373011+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:52.373011+0000","last_peered":"2024-09-12T18:03:52.373011+0000","last_clean":"2024-09-12T18:03:52.373011+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:52.373011+0000","last_undegraded":"2024-09-12T18:03:52.373011+0000","last_fullsized":"2024-09-12T18:03:52.373011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":589,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368507+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:52.368507+0000","last_peered":"2024-09-12T18:03:52.368507+0000","last_clean":"2024-09-12T18:03:52.368507+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:52.368507+0000","last_undegraded":"2024-09-12T18:03:52.368507+0000","last_fullsized":"2024-09-12T18:03:52.368507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371214+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:52.371214+0000","last_peered":"2024-09-12T18:03:52.371214+0000","last_clean":"2024-09-12T18:03:52.371214+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:52.371214+0000","last_undegraded":"2024-09-12T18:03:52.371214+0000","last_fullsized":"2024-09-12T18:03:52.371214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":659,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368173+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:52.368173+0000","last_peered":"2024-09-12T18:03:52.368173+0000","last_clean":"2024-09-12T18:03:52.368173+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:52.368173+0000","last_undegraded":"2024-09-12T18:03:52.368173+0000","last_fullsized":"2024-09-12T18:03:52.368173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":582,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370935+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:52.370935+0000","last_peered":"2024-09-12T18:03:52.370935+0000","last_clean":"2024-09-12T18:03:52.370935+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:52.370935+0000","last_undegraded":"2024-09-12T18:03:52.370935+0000","last_fullsized":"2024-09-12T18:03:52.370935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":666,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.537530+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:03:52.537530+0000","last_peered":"2024-09-12T18:03:52.537530+0000","last_clean":"2024-09-12T18:03:52.537530+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:03:52.537530+0000","last_undegraded":"2024-09-12T18:03:52.537530+0000","last_fullsized":"2024-09-12T18:03:52.537530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":665,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370516+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:03:52.370516+0000","last_peered":"2024-09-12T18:03:52.370516+0000","last_clean":"2024-09-12T18:03:52.370516+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:03:52.370516+0000","last_undegraded":"2024-09-12T18:03:52.370516+0000","last_fullsized":"2024-09-12T18:03:52.370516+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":568,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370166+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:52.370166+0000","last_peered":"2024-09-12T18:03:52.370166+0000","last_clean":"2024-09-12T18:03:52.370166+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:52.370166+0000","last_undegraded":"2024-09-12T18:03:52.370166+0000","last_fullsized":"2024-09-12T18:03:52.370166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":973,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370332+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:03:52.370332+0000","last_peered":"2024-09-12T18:03:52.370332+0000","last_clean":"2024-09-12T18:03:52.370332+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:03:52.370332+0000","last_undegraded":"2024-09-12T18:03:52.370332+0000","last_fullsized":"2024-09-12T18:03:52.370332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":609,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372751+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:52.372751+0000","last_peered":"2024-09-12T18:03:52.372751+0000","last_clean":"2024-09-12T18:03:52.372751+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:52.372751+0000","last_undegraded":"2024-09-12T18:03:52.372751+0000","last_fullsized":"2024-09-12T18:03:52.372751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":910,"reported_epoch":72,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:52.368120+0000","last_change":"2024-09-12T18:03:49.392122+0000","last_active":"2024-09-12T18:03:52.368120+0000","last_peered":"2024-09-12T18:03:52.368120+0000","last_clean":"2024-09-12T18:03:47.313477+0000","last_became_active":"2024-09-12T18:03:49.382617+0000","last_became_peered":"2024-09-12T18:03:49.382617+0000","last_unstale":"2024-09-12T18:03:52.368120+0000","last_undegraded":"2024-09-12T18:03:49.341774+0000","last_fullsized":"2024-09-12T18:03:49.335755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0","objects":-3}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1141,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371868+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:03:52.371868+0000","last_peered":"2024-09-12T18:03:52.371868+0000","last_clean":"2024-09-12T18:03:52.371868+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:03:52.371868+0000","last_undegraded":"2024-09-12T18:03:52.371868+0000","last_fullsized":"2024-09-12T18:03:52.371868+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":527,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374785+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:52.374785+0000","last_peered":"2024-09-12T18:03:52.374785+0000","last_clean":"2024-09-12T18:03:52.374785+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:52.374785+0000","last_undegraded":"2024-09-12T18:03:52.374785+0000","last_fullsized":"2024-09-12T18:03:52.374785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":621,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370077+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:52.370077+0000","last_peered":"2024-09-12T18:03:52.370077+0000","last_clean":"2024-09-12T18:03:52.370077+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:52.370077+0000","last_undegraded":"2024-09-12T18:03:52.370077+0000","last_fullsized":"2024-09-12T18:03:52.370077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370119+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:52.370119+0000","last_peered":"2024-09-12T18:03:52.370119+0000","last_clean":"2024-09-12T18:03:52.370119+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:52.370119+0000","last_undegraded":"2024-09-12T18:03:52.370119+0000","last_fullsized":"2024-09-12T18:03:52.370119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":581,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373625+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:52.373625+0000","last_peered":"2024-09-12T18:03:52.373625+0000","last_clean":"2024-09-12T18:03:52.373625+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:52.373625+0000","last_undegraded":"2024-09-12T18:03:52.373625+0000","last_fullsized":"2024-09-12T18:03:52.373625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":933,"reported_epoch":72,"state":"active+recovery_wait+remapped","last_fresh":"2024-09-12T18:03:52.371634+0000","last_change":"2024-09-12T18:03:49.384409+0000","last_active":"2024-09-12T18:03:52.371634+0000","last_peered":"2024-09-12T18:03:52.371634+0000","last_clean":"2024-09-12T18:03:46.980225+0000","last_became_active":"2024-09-12T18:03:49.374767+0000","last_became_peered":"2024-09-12T18:03:49.374767+0000","last_unstale":"2024-09-12T18:03:52.371634+0000","last_undegraded":"2024-09-12T18:03:52.371634+0000","last_fullsized":"2024-09-12T18:03:52.371634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":169,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":608,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368160+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:52.368160+0000","last_peered":"2024-09-12T18:03:52.368160+0000","last_clean":"2024-09-12T18:03:52.368160+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:52.368160+0000","last_undegraded":"2024-09-12T18:03:52.368160+0000","last_fullsized":"2024-09-12T18:03:52.368160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":987,"reported_epoch":72,"state":"active+recovery_wait+remapped","last_fresh":"2024-09-12T18:03:52.368294+0000","last_change":"2024-09-12T18:03:49.392458+0000","last_active":"2024-09-12T18:03:52.368294+0000","last_peered":"2024-09-12T18:03:52.368294+0000","last_clean":"2024-09-12T18:03:46.964567+0000","last_became_active":"2024-09-12T18:03:49.384706+0000","last_became_peered":"2024-09-12T18:03:49.384706+0000","last_unstale":"2024-09-12T18:03:52.368294+0000","last_undegraded":"2024-09-12T18:03:52.368294+0000","last_fullsized":"2024-09-12T18:03:52.368294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":191,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":573,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368199+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:52.368199+0000","last_peered":"2024-09-12T18:03:52.368199+0000","last_clean":"2024-09-12T18:03:52.368199+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:52.368199+0000","last_undegraded":"2024-09-12T18:03:52.368199+0000","last_fullsized":"2024-09-12T18:03:52.368199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":600,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373369+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:52.373369+0000","last_peered":"2024-09-12T18:03:52.373369+0000","last_clean":"2024-09-12T18:03:52.373369+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:52.373369+0000","last_undegraded":"2024-09-12T18:03:52.373369+0000","last_fullsized":"2024-09-12T18:03:52.373369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":567,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370636+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:52.370636+0000","last_peered":"2024-09-12T18:03:52.370636+0000","last_clean":"2024-09-12T18:03:52.370636+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:52.370636+0000","last_undegraded":"2024-09-12T18:03:52.370636+0000","last_fullsized":"2024-09-12T18:03:52.370636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":536,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373408+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:52.373408+0000","last_peered":"2024-09-12T18:03:52.373408+0000","last_clean":"2024-09-12T18:03:52.373408+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:52.373408+0000","last_undegraded":"2024-09-12T18:03:52.373408+0000","last_fullsized":"2024-09-12T18:03:52.373408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":170,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368982+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:52.368982+0000","last_peered":"2024-09-12T18:03:52.368982+0000","last_clean":"2024-09-12T18:03:52.368982+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:52.368982+0000","last_undegraded":"2024-09-12T18:03:52.368982+0000","last_fullsized":"2024-09-12T18:03:52.368982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":560,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370538+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:52.370538+0000","last_peered":"2024-09-12T18:03:52.370538+0000","last_clean":"2024-09-12T18:03:52.370538+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:52.370538+0000","last_undegraded":"2024-09-12T18:03:52.370538+0000","last_fullsized":"2024-09-12T18:03:52.370538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":189,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374454+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:52.374454+0000","last_peered":"2024-09-12T18:03:52.374454+0000","last_clean":"2024-09-12T18:03:52.374454+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:52.374454+0000","last_undegraded":"2024-09-12T18:03:52.374454+0000","last_fullsized":"2024-09-12T18:03:52.374454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":560,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369888+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:52.369888+0000","last_peered":"2024-09-12T18:03:52.369888+0000","last_clean":"2024-09-12T18:03:52.369888+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:52.369888+0000","last_undegraded":"2024-09-12T18:03:52.369888+0000","last_fullsized":"2024-09-12T18:03:52.369888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368871+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:52.368871+0000","last_peered":"2024-09-12T18:03:52.368871+0000","last_clean":"2024-09-12T18:03:52.368871+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:52.368871+0000","last_undegraded":"2024-09-12T18:03:52.368871+0000","last_fullsized":"2024-09-12T18:03:52.368871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372544+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:52.372544+0000","last_peered":"2024-09-12T18:03:52.372544+0000","last_clean":"2024-09-12T18:03:52.372544+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:52.372544+0000","last_undegraded":"2024-09-12T18:03:52.372544+0000","last_fullsized":"2024-09-12T18:03:52.372544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":573,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374729+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:52.374729+0000","last_peered":"2024-09-12T18:03:52.374729+0000","last_clean":"2024-09-12T18:03:52.374729+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:52.374729+0000","last_undegraded":"2024-09-12T18:03:52.374729+0000","last_fullsized":"2024-09-12T18:03:52.374729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":370,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.375168+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:52.375168+0000","last_peered":"2024-09-12T18:03:52.375168+0000","last_clean":"2024-09-12T18:03:52.375168+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:52.375168+0000","last_undegraded":"2024-09-12T18:03:52.375168+0000","last_fullsized":"2024-09-12T18:03:52.375168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1434,"reported_epoch":71,"state":"peering","last_fresh":"2024-09-12T18:03:51.794626+0000","last_change":"2024-09-12T18:03:52.372739+0000","last_active":"2024-09-12T18:03:52.372739+0000","last_peered":"2024-09-12T18:03:51.794626+0000","last_clean":"2024-09-12T18:03:47.294765+0000","last_became_active":"2024-09-12T18:03:49.381464+0000","last_became_peered":"2024-09-12T18:03:49.381464+0000","last_unstale":"2024-09-12T18:03:51.794626+0000","last_undegraded":"2024-09-12T18:03:51.794626+0000","last_fullsized":"2024-09-12T18:03:49.328761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":501,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371159+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:52.371159+0000","last_peered":"2024-09-12T18:03:52.371159+0000","last_clean":"2024-09-12T18:03:52.371159+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:52.371159+0000","last_undegraded":"2024-09-12T18:03:52.371159+0000","last_fullsized":"2024-09-12T18:03:52.371159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":586,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368854+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:52.368854+0000","last_peered":"2024-09-12T18:03:52.368854+0000","last_clean":"2024-09-12T18:03:52.368854+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:52.368854+0000","last_undegraded":"2024-09-12T18:03:52.368854+0000","last_fullsized":"2024-09-12T18:03:52.368854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":175,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372025+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:52.372025+0000","last_peered":"2024-09-12T18:03:52.372025+0000","last_clean":"2024-09-12T18:03:52.372025+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:52.372025+0000","last_undegraded":"2024-09-12T18:03:52.372025+0000","last_fullsized":"2024-09-12T18:03:52.372025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":623,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369107+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:03:52.369107+0000","last_peered":"2024-09-12T18:03:52.369107+0000","last_clean":"2024-09-12T18:03:52.369107+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:03:52.369107+0000","last_undegraded":"2024-09-12T18:03:52.369107+0000","last_fullsized":"2024-09-12T18:03:52.369107+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":284,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369755+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:03:52.369755+0000","last_peered":"2024-09-12T18:03:52.369755+0000","last_clean":"2024-09-12T18:03:52.369755+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:03:52.369755+0000","last_undegraded":"2024-09-12T18:03:52.369755+0000","last_fullsized":"2024-09-12T18:03:52.369755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1120,"reported_epoch":72,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:52.690265+0000","last_change":"2024-09-12T18:03:52.538379+0000","last_active":"2024-09-12T18:03:52.690265+0000","last_peered":"2024-09-12T18:03:52.690265+0000","last_clean":"2024-09-12T18:03:47.314910+0000","last_became_active":"2024-09-12T18:03:49.371661+0000","last_became_peered":"2024-09-12T18:03:49.371661+0000","last_unstale":"2024-09-12T18:03:52.690265+0000","last_undegraded":"2024-09-12T18:03:49.339319+0000","last_fullsized":"2024-09-12T18:03:49.332890+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":238,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369161+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:52.369161+0000","last_peered":"2024-09-12T18:03:52.369161+0000","last_clean":"2024-09-12T18:03:52.369161+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:52.369161+0000","last_undegraded":"2024-09-12T18:03:52.369161+0000","last_fullsized":"2024-09-12T18:03:52.369161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370559+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:52.370559+0000","last_peered":"2024-09-12T18:03:52.370559+0000","last_clean":"2024-09-12T18:03:52.370559+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:52.370559+0000","last_undegraded":"2024-09-12T18:03:52.370559+0000","last_fullsized":"2024-09-12T18:03:52.370559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":172,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374597+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:52.374597+0000","last_peered":"2024-09-12T18:03:52.374597+0000","last_clean":"2024-09-12T18:03:52.374597+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:52.374597+0000","last_undegraded":"2024-09-12T18:03:52.374597+0000","last_fullsized":"2024-09-12T18:03:52.374597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":534,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372217+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:52.372217+0000","last_peered":"2024-09-12T18:03:52.372217+0000","last_clean":"2024-09-12T18:03:52.372217+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:52.372217+0000","last_undegraded":"2024-09-12T18:03:52.372217+0000","last_fullsized":"2024-09-12T18:03:52.372217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372264+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:03:52.372264+0000","last_peered":"2024-09-12T18:03:52.372264+0000","last_clean":"2024-09-12T18:03:52.372264+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:03:52.372264+0000","last_undegraded":"2024-09-12T18:03:52.372264+0000","last_fullsized":"2024-09-12T18:03:52.372264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":525,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370487+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:52.370487+0000","last_peered":"2024-09-12T18:03:52.370487+0000","last_clean":"2024-09-12T18:03:52.370487+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:52.370487+0000","last_undegraded":"2024-09-12T18:03:52.370487+0000","last_fullsized":"2024-09-12T18:03:52.370487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":272,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369072+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:52.369072+0000","last_peered":"2024-09-12T18:03:52.369072+0000","last_clean":"2024-09-12T18:03:52.369072+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:52.369072+0000","last_undegraded":"2024-09-12T18:03:52.369072+0000","last_fullsized":"2024-09-12T18:03:52.369072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":135,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371348+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:52.371348+0000","last_peered":"2024-09-12T18:03:52.371348+0000","last_clean":"2024-09-12T18:03:52.371348+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:52.371348+0000","last_undegraded":"2024-09-12T18:03:52.371348+0000","last_fullsized":"2024-09-12T18:03:52.371348+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":689,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369506+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:52.369506+0000","last_peered":"2024-09-12T18:03:52.369506+0000","last_clean":"2024-09-12T18:03:52.369506+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:52.369506+0000","last_undegraded":"2024-09-12T18:03:52.369506+0000","last_fullsized":"2024-09-12T18:03:52.369506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":582,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370874+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:52.370874+0000","last_peered":"2024-09-12T18:03:52.370874+0000","last_clean":"2024-09-12T18:03:52.370874+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:52.370874+0000","last_undegraded":"2024-09-12T18:03:52.370874+0000","last_fullsized":"2024-09-12T18:03:52.370874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368922+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:52.368922+0000","last_peered":"2024-09-12T18:03:52.368922+0000","last_clean":"2024-09-12T18:03:52.368922+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:52.368922+0000","last_undegraded":"2024-09-12T18:03:52.368922+0000","last_fullsized":"2024-09-12T18:03:52.368922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":319,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368398+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:03:52.368398+0000","last_peered":"2024-09-12T18:03:52.368398+0000","last_clean":"2024-09-12T18:03:52.368398+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:03:52.368398+0000","last_undegraded":"2024-09-12T18:03:52.368398+0000","last_fullsized":"2024-09-12T18:03:52.368398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1140,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374518+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:03:52.374518+0000","last_peered":"2024-09-12T18:03:52.374518+0000","last_clean":"2024-09-12T18:03:52.374518+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:03:52.374518+0000","last_undegraded":"2024-09-12T18:03:52.374518+0000","last_fullsized":"2024-09-12T18:03:52.374518+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369867+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:52.369867+0000","last_peered":"2024-09-12T18:03:52.369867+0000","last_clean":"2024-09-12T18:03:52.369867+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:52.369867+0000","last_undegraded":"2024-09-12T18:03:52.369867+0000","last_fullsized":"2024-09-12T18:03:52.369867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":494,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372584+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:52.372584+0000","last_peered":"2024-09-12T18:03:52.372584+0000","last_clean":"2024-09-12T18:03:52.372584+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:52.372584+0000","last_undegraded":"2024-09-12T18:03:52.372584+0000","last_fullsized":"2024-09-12T18:03:52.372584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":1098,"reported_epoch":72,"state":"active+remapped","last_fresh":"2024-09-12T18:03:52.374116+0000","last_change":"2024-09-12T18:03:52.374116+0000","last_active":"2024-09-12T18:03:52.374116+0000","last_peered":"2024-09-12T18:03:52.374116+0000","last_clean":"2024-09-12T18:03:46.993256+0000","last_became_active":"2024-09-12T18:03:49.369380+0000","last_became_peered":"2024-09-12T18:03:49.369380+0000","last_unstale":"2024-09-12T18:03:52.374116+0000","last_undegraded":"2024-09-12T18:03:52.374116+0000","last_fullsized":"2024-09-12T18:03:52.374116+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":146,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369453+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:52.369453+0000","last_peered":"2024-09-12T18:03:52.369453+0000","last_clean":"2024-09-12T18:03:52.369453+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:52.369453+0000","last_undegraded":"2024-09-12T18:03:52.369453+0000","last_fullsized":"2024-09-12T18:03:52.369453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":195,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370979+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:52.370979+0000","last_peered":"2024-09-12T18:03:52.370979+0000","last_clean":"2024-09-12T18:03:52.370979+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:52.370979+0000","last_undegraded":"2024-09-12T18:03:52.370979+0000","last_fullsized":"2024-09-12T18:03:52.370979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":621,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370555+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:52.370555+0000","last_peered":"2024-09-12T18:03:52.370555+0000","last_clean":"2024-09-12T18:03:52.370555+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:52.370555+0000","last_undegraded":"2024-09-12T18:03:52.370555+0000","last_fullsized":"2024-09-12T18:03:52.370555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":421,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371947+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:52.371947+0000","last_peered":"2024-09-12T18:03:52.371947+0000","last_clean":"2024-09-12T18:03:52.371947+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:52.371947+0000","last_undegraded":"2024-09-12T18:03:52.371947+0000","last_fullsized":"2024-09-12T18:03:52.371947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370849+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:52.370849+0000","last_peered":"2024-09-12T18:03:52.370849+0000","last_clean":"2024-09-12T18:03:52.370849+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:52.370849+0000","last_undegraded":"2024-09-12T18:03:52.370849+0000","last_fullsized":"2024-09-12T18:03:52.370849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":505,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373034+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:52.373034+0000","last_peered":"2024-09-12T18:03:52.373034+0000","last_clean":"2024-09-12T18:03:52.373034+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:52.373034+0000","last_undegraded":"2024-09-12T18:03:52.373034+0000","last_fullsized":"2024-09-12T18:03:52.373034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368980+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:03:52.368980+0000","last_peered":"2024-09-12T18:03:52.368980+0000","last_clean":"2024-09-12T18:03:52.368980+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:03:52.368980+0000","last_undegraded":"2024-09-12T18:03:52.368980+0000","last_fullsized":"2024-09-12T18:03:52.368980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374468+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:03:52.374468+0000","last_peered":"2024-09-12T18:03:52.374468+0000","last_clean":"2024-09-12T18:03:52.374468+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:03:52.374468+0000","last_undegraded":"2024-09-12T18:03:52.374468+0000","last_fullsized":"2024-09-12T18:03:52.374468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":531,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373591+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:52.373591+0000","last_peered":"2024-09-12T18:03:52.373591+0000","last_clean":"2024-09-12T18:03:52.373591+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:52.373591+0000","last_undegraded":"2024-09-12T18:03:52.373591+0000","last_fullsized":"2024-09-12T18:03:52.373591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370884+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:03:52.370884+0000","last_peered":"2024-09-12T18:03:52.370884+0000","last_clean":"2024-09-12T18:03:52.370884+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:03:52.370884+0000","last_undegraded":"2024-09-12T18:03:52.370884+0000","last_fullsized":"2024-09-12T18:03:52.370884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369112+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:03:52.369112+0000","last_peered":"2024-09-12T18:03:52.369112+0000","last_clean":"2024-09-12T18:03:52.369112+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:03:52.369112+0000","last_undegraded":"2024-09-12T18:03:52.369112+0000","last_fullsized":"2024-09-12T18:03:52.369112+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":549,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368227+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:03:52.368227+0000","last_peered":"2024-09-12T18:03:52.368227+0000","last_clean":"2024-09-12T18:03:52.368227+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:03:52.368227+0000","last_undegraded":"2024-09-12T18:03:52.368227+0000","last_fullsized":"2024-09-12T18:03:52.368227+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"69'113","reported_seq":242,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370427+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:03:52.370427+0000","last_peered":"2024-09-12T18:03:52.370427+0000","last_clean":"2024-09-12T18:03:52.370427+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:03:52.370427+0000","last_undegraded":"2024-09-12T18:03:52.370427+0000","last_fullsized":"2024-09-12T18:03:52.370427+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372620+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:52.372620+0000","last_peered":"2024-09-12T18:03:52.372620+0000","last_clean":"2024-09-12T18:03:52.372620+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:52.372620+0000","last_undegraded":"2024-09-12T18:03:52.372620+0000","last_fullsized":"2024-09-12T18:03:52.372620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":559,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374297+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:52.374297+0000","last_peered":"2024-09-12T18:03:52.374297+0000","last_clean":"2024-09-12T18:03:52.374297+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:52.374297+0000","last_undegraded":"2024-09-12T18:03:52.374297+0000","last_fullsized":"2024-09-12T18:03:52.374297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369239+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:52.369239+0000","last_peered":"2024-09-12T18:03:52.369239+0000","last_clean":"2024-09-12T18:03:52.369239+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:52.369239+0000","last_undegraded":"2024-09-12T18:03:52.369239+0000","last_fullsized":"2024-09-12T18:03:52.369239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":348,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371668+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:52.371668+0000","last_peered":"2024-09-12T18:03:52.371668+0000","last_clean":"2024-09-12T18:03:52.371668+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:52.371668+0000","last_undegraded":"2024-09-12T18:03:52.371668+0000","last_fullsized":"2024-09-12T18:03:52.371668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":602,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368720+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:52.368720+0000","last_peered":"2024-09-12T18:03:52.368720+0000","last_clean":"2024-09-12T18:03:52.368720+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:52.368720+0000","last_undegraded":"2024-09-12T18:03:52.368720+0000","last_fullsized":"2024-09-12T18:03:52.368720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374026+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:52.374026+0000","last_peered":"2024-09-12T18:03:52.374026+0000","last_clean":"2024-09-12T18:03:52.374026+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:52.374026+0000","last_undegraded":"2024-09-12T18:03:52.374026+0000","last_fullsized":"2024-09-12T18:03:52.374026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":332,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372484+0000","last_change":"2024-09-12T18:03:51.372214+0000","last_active":"2024-09-12T18:03:52.372484+0000","last_peered":"2024-09-12T18:03:52.372484+0000","last_clean":"2024-09-12T18:03:52.372484+0000","last_became_active":"2024-09-12T18:03:51.371525+0000","last_became_peered":"2024-09-12T18:03:51.371525+0000","last_unstale":"2024-09-12T18:03:52.372484+0000","last_undegraded":"2024-09-12T18:03:52.372484+0000","last_fullsized":"2024-09-12T18:03:52.372484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:05.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":695,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369348+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:52.369348+0000","last_peered":"2024-09-12T18:03:52.369348+0000","last_clean":"2024-09-12T18:03:52.369348+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:52.369348+0000","last_undegraded":"2024-09-12T18:03:52.369348+0000","last_fullsized":"2024-09-12T18:03:52.369348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370558+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:03:52.370558+0000","last_peered":"2024-09-12T18:03:52.370558+0000","last_clean":"2024-09-12T18:03:52.370558+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:03:52.370558+0000","last_undegraded":"2024-09-12T18:03:52.370558+0000","last_fullsized":"2024-09-12T18:03:52.370558+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":671,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368173+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:03:52.368173+0000","last_peered":"2024-09-12T18:03:52.368173+0000","last_clean":"2024-09-12T18:03:52.368173+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:03:52.368173+0000","last_undegraded":"2024-09-12T18:03:52.368173+0000","last_fullsized":"2024-09-12T18:03:52.368173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":526,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374940+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:52.374940+0000","last_peered":"2024-09-12T18:03:52.374940+0000","last_clean":"2024-09-12T18:03:52.374940+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:52.374940+0000","last_undegraded":"2024-09-12T18:03:52.374940+0000","last_fullsized":"2024-09-12T18:03:52.374940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":773,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368491+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:52.368491+0000","last_peered":"2024-09-12T18:03:52.368491+0000","last_clean":"2024-09-12T18:03:52.368491+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:52.368491+0000","last_undegraded":"2024-09-12T18:03:52.368491+0000","last_fullsized":"2024-09-12T18:03:52.368491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":644,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369809+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:03:52.369809+0000","last_peered":"2024-09-12T18:03:52.369809+0000","last_clean":"2024-09-12T18:03:52.369809+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:03:52.369809+0000","last_undegraded":"2024-09-12T18:03:52.369809+0000","last_fullsized":"2024-09-12T18:03:52.369809+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":346,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368029+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:03:52.368029+0000","last_peered":"2024-09-12T18:03:52.368029+0000","last_clean":"2024-09-12T18:03:52.368029+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:03:52.368029+0000","last_undegraded":"2024-09-12T18:03:52.368029+0000","last_fullsized":"2024-09-12T18:03:52.368029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":551,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373081+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:52.373081+0000","last_peered":"2024-09-12T18:03:52.373081+0000","last_clean":"2024-09-12T18:03:52.373081+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:52.373081+0000","last_undegraded":"2024-09-12T18:03:52.373081+0000","last_fullsized":"2024-09-12T18:03:52.373081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":334,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.662378+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:52.662378+0000","last_peered":"2024-09-12T18:03:52.662378+0000","last_clean":"2024-09-12T18:03:52.662378+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:52.662378+0000","last_undegraded":"2024-09-12T18:03:52.662378+0000","last_fullsized":"2024-09-12T18:03:52.662378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.379269+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:03:52.379269+0000","last_peered":"2024-09-12T18:03:52.379269+0000","last_clean":"2024-09-12T18:03:52.379269+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:03:52.379269+0000","last_undegraded":"2024-09-12T18:03:52.379269+0000","last_fullsized":"2024-09-12T18:03:52.379269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":171,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374319+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:52.374319+0000","last_peered":"2024-09-12T18:03:52.374319+0000","last_clean":"2024-09-12T18:03:52.374319+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:52.374319+0000","last_undegraded":"2024-09-12T18:03:52.374319+0000","last_fullsized":"2024-09-12T18:03:52.374319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":847,"reported_epoch":72,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:52.370103+0000","last_change":"2024-09-12T18:03:49.384396+0000","last_active":"2024-09-12T18:03:52.370103+0000","last_peered":"2024-09-12T18:03:52.370103+0000","last_clean":"2024-09-12T18:03:47.318081+0000","last_became_active":"2024-09-12T18:03:49.379398+0000","last_became_peered":"2024-09-12T18:03:49.379398+0000","last_unstale":"2024-09-12T18:03:52.370103+0000","last_undegraded":"2024-09-12T18:03:49.347989+0000","last_fullsized":"2024-09-12T18:03:49.339526+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0","objects":-7}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":330,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370830+0000","last_change":"2024-09-12T18:03:51.371985+0000","last_active":"2024-09-12T18:03:52.370830+0000","last_peered":"2024-09-12T18:03:52.370830+0000","last_clean":"2024-09-12T18:03:52.370830+0000","last_became_active":"2024-09-12T18:03:51.371031+0000","last_became_peered":"2024-09-12T18:03:51.371031+0000","last_unstale":"2024-09-12T18:03:52.370830+0000","last_undegraded":"2024-09-12T18:03:52.370830+0000","last_fullsized":"2024-09-12T18:03:52.370830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:47.783150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1266,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.378943+0000","last_change":"2024-09-12T18:03:52.378736+0000","last_active":"2024-09-12T18:03:52.378943+0000","last_peered":"2024-09-12T18:03:52.378943+0000","last_clean":"2024-09-12T18:03:52.378943+0000","last_became_active":"2024-09-12T18:03:52.374218+0000","last_became_peered":"2024-09-12T18:03:52.374218+0000","last_unstale":"2024-09-12T18:03:52.378943+0000","last_undegraded":"2024-09-12T18:03:52.378943+0000","last_fullsized":"2024-09-12T18:03:52.378943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:24.098596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":397,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373524+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:52.373524+0000","last_peered":"2024-09-12T18:03:52.373524+0000","last_clean":"2024-09-12T18:03:52.373524+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:52.373524+0000","last_undegraded":"2024-09-12T18:03:52.373524+0000","last_fullsized":"2024-09-12T18:03:52.373524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":537,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374736+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:52.374736+0000","last_peered":"2024-09-12T18:03:52.374736+0000","last_clean":"2024-09-12T18:03:52.374736+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:52.374736+0000","last_undegraded":"2024-09-12T18:03:52.374736+0000","last_fullsized":"2024-09-12T18:03:52.374736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370136+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:03:52.370136+0000","last_peered":"2024-09-12T18:03:52.370136+0000","last_clean":"2024-09-12T18:03:52.370136+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:03:52.370136+0000","last_undegraded":"2024-09-12T18:03:52.370136+0000","last_fullsized":"2024-09-12T18:03:52.370136+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":639,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368516+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:52.368516+0000","last_peered":"2024-09-12T18:03:52.368516+0000","last_clean":"2024-09-12T18:03:52.368516+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:52.368516+0000","last_undegraded":"2024-09-12T18:03:52.368516+0000","last_fullsized":"2024-09-12T18:03:52.368516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":195,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369092+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:03:52.369092+0000","last_peered":"2024-09-12T18:03:52.369092+0000","last_clean":"2024-09-12T18:03:52.369092+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:03:52.369092+0000","last_undegraded":"2024-09-12T18:03:52.369092+0000","last_fullsized":"2024-09-12T18:03:52.369092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":346,"num_objects_misplaced":360,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4397,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":404172,"data_compressed":100626,"data_compressed_allocated":118784,"data_compressed_original":303104,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":125,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4485,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81813504,"data_stored":258441473,"data_compressed":39400911,"data_compressed_allocated":50376704,"data_compressed_original":227065856,"omap_allocated":0,"internal_metadata":0},"log_size":6247,"ondisk_log_size":6247,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738398,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113540,"kb_used_data":24116,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94258300,"statfs":{"total":96636764160,"available":96520499200,"internally_reserved":0,"allocated":24694784,"data_stored":81465849,"data_compressed":12673336,"data_compressed_allocated":15798272,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,3],"upper_bound":2048},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738398,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101436,"kb_used_data":34212,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94270404,"statfs":{"total":96636764160,"available":96532893696,"internally_reserved":0,"allocated":35033088,"data_stored":111798722,"data_compressed":17027829,"data_compressed_allocated":21532672,"data_compressed_original":98754560,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,10],"upper_bound":2048},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738398,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119176,"kb_used_data":29744,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94252664,"statfs":{"total":96636764160,"available":96514727936,"internally_reserved":0,"allocated":30457856,"data_stored":94735776,"data_compressed":14534641,"data_compressed_allocated":18710528,"data_compressed_original":83423232,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29614080,"data_stored":93744597,"data_compressed":14472179,"data_compressed_allocated":18632704,"data_compressed_original":82792448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23736320,"data_stored":80913711,"data_compressed":12623268,"data_compressed_allocated":15736832,"data_compressed_original":72925184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":110730,"data_compressed":27210,"data_compressed_allocated":32768,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":293442,"data_compressed":73416,"data_compressed_allocated":86016,"data_compressed_original":245760,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:56.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T18:03:56.839 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:56.839 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"nodeep-scrub flag(s) set","count":12},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 346/112 objects degraded (308.929%), 3 pgs degraded","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":143,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":76,"num_osds":3,"num_up_osds":3,"osd_up_since":1726164102,"num_in_osds":3,"osd_in_since":1726164094,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":98},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovery_wait+remapped","count":2},{"state_name":"peering","count":1},{"state_name":"active+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":56,"data_bytes":127785647,"bytes_used":342171648,"bytes_avail":289568120832,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":346,"degraded_total":112,"degraded_ratio":3.0892857142857144,"misplaced_objects":360,"misplaced_total":112,"misplaced_ratio":3.2142857142857144,"recovering_objects_per_sec":642,"recovering_bytes_per_sec":13501536,"recovering_keys_per_sec":145,"num_objects_recovered":2570,"num_bytes_recovered":54023258,"num_keys_recovered":582,"read_bytes_sec":16208623,"write_bytes_sec":75128321,"read_op_per_sec":43,"write_op_per_sec":625},"fsmap":{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4193}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-12T18:03:00.574702+0000","services":{}},"progress_events":{}} 2024-09-12T18:03:56.858 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-12T18:03:56.859 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:03:57.171 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:03:57.174 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:03:57.189 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-12T18:03:56.588306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":346,"num_objects_misplaced":360,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29126,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4426,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32951,"ondisk_log_size":32951,"up":210,"acting":207,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":224,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334152,"kb_used_data":88072,"kb_used_omap":4,"kb_used_meta":246011,"kb_avail":282781368,"statfs":{"total":289910292480,"available":289568120832,"internally_reserved":0,"allocated":90185728,"data_stored":288000347,"data_compressed":44235806,"data_compressed_allocated":56041472,"data_compressed_original":255242240,"omap_allocated":4785,"internal_metadata":251915599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,13],"upper_bound":2048},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13238803,"num_objects":-476,"num_object_clones":0,"num_object_copies":-952,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":346,"num_objects_misplaced":360,"num_objects_unfound":0,"num_objects_dirty":-476,"num_whiteouts":0,"num_read":175,"num_read_kb":63335,"num_write":2502,"num_write_kb":293563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2570,"num_bytes_recovered":54023258,"num_keys_recovered":582,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001206"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":601,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374472+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:52.374472+0000","last_peered":"2024-09-12T18:03:52.374472+0000","last_clean":"2024-09-12T18:03:52.374472+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:52.374472+0000","last_undegraded":"2024-09-12T18:03:52.374472+0000","last_fullsized":"2024-09-12T18:03:52.374472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":887,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373930+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:03:52.373930+0000","last_peered":"2024-09-12T18:03:52.373930+0000","last_clean":"2024-09-12T18:03:52.373930+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:03:52.373930+0000","last_undegraded":"2024-09-12T18:03:52.373930+0000","last_fullsized":"2024-09-12T18:03:52.373930+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":504,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369803+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:52.369803+0000","last_peered":"2024-09-12T18:03:52.369803+0000","last_clean":"2024-09-12T18:03:52.369803+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:52.369803+0000","last_undegraded":"2024-09-12T18:03:52.369803+0000","last_fullsized":"2024-09-12T18:03:52.369803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":522,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369900+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:52.369900+0000","last_peered":"2024-09-12T18:03:52.369900+0000","last_clean":"2024-09-12T18:03:52.369900+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:52.369900+0000","last_undegraded":"2024-09-12T18:03:52.369900+0000","last_fullsized":"2024-09-12T18:03:52.369900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":640,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374050+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:52.374050+0000","last_peered":"2024-09-12T18:03:52.374050+0000","last_clean":"2024-09-12T18:03:52.374050+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:52.374050+0000","last_undegraded":"2024-09-12T18:03:52.374050+0000","last_fullsized":"2024-09-12T18:03:52.374050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":503,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368496+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:52.368496+0000","last_peered":"2024-09-12T18:03:52.368496+0000","last_clean":"2024-09-12T18:03:52.368496+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:52.368496+0000","last_undegraded":"2024-09-12T18:03:52.368496+0000","last_fullsized":"2024-09-12T18:03:52.368496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":613,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370537+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:52.370537+0000","last_peered":"2024-09-12T18:03:52.370537+0000","last_clean":"2024-09-12T18:03:52.370537+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:52.370537+0000","last_undegraded":"2024-09-12T18:03:52.370537+0000","last_fullsized":"2024-09-12T18:03:52.370537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":967,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.367846+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:03:52.367846+0000","last_peered":"2024-09-12T18:03:52.367846+0000","last_clean":"2024-09-12T18:03:52.367846+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:03:52.367846+0000","last_undegraded":"2024-09-12T18:03:52.367846+0000","last_fullsized":"2024-09-12T18:03:52.367846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":525,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369586+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:52.369586+0000","last_peered":"2024-09-12T18:03:52.369586+0000","last_clean":"2024-09-12T18:03:52.369586+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:52.369586+0000","last_undegraded":"2024-09-12T18:03:52.369586+0000","last_fullsized":"2024-09-12T18:03:52.369586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1024,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374246+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:03:52.374246+0000","last_peered":"2024-09-12T18:03:52.374246+0000","last_clean":"2024-09-12T18:03:52.374246+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:03:52.374246+0000","last_undegraded":"2024-09-12T18:03:52.374246+0000","last_fullsized":"2024-09-12T18:03:52.374246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":528,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371637+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:52.371637+0000","last_peered":"2024-09-12T18:03:52.371637+0000","last_clean":"2024-09-12T18:03:52.371637+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:52.371637+0000","last_undegraded":"2024-09-12T18:03:52.371637+0000","last_fullsized":"2024-09-12T18:03:52.371637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":509,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373148+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:52.373148+0000","last_peered":"2024-09-12T18:03:52.373148+0000","last_clean":"2024-09-12T18:03:52.373148+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:52.373148+0000","last_undegraded":"2024-09-12T18:03:52.373148+0000","last_fullsized":"2024-09-12T18:03:52.373148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":515,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373011+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:52.373011+0000","last_peered":"2024-09-12T18:03:52.373011+0000","last_clean":"2024-09-12T18:03:52.373011+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:52.373011+0000","last_undegraded":"2024-09-12T18:03:52.373011+0000","last_fullsized":"2024-09-12T18:03:52.373011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":589,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368507+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:52.368507+0000","last_peered":"2024-09-12T18:03:52.368507+0000","last_clean":"2024-09-12T18:03:52.368507+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:52.368507+0000","last_undegraded":"2024-09-12T18:03:52.368507+0000","last_fullsized":"2024-09-12T18:03:52.368507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371214+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:52.371214+0000","last_peered":"2024-09-12T18:03:52.371214+0000","last_clean":"2024-09-12T18:03:52.371214+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:52.371214+0000","last_undegraded":"2024-09-12T18:03:52.371214+0000","last_fullsized":"2024-09-12T18:03:52.371214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":659,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368173+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:52.368173+0000","last_peered":"2024-09-12T18:03:52.368173+0000","last_clean":"2024-09-12T18:03:52.368173+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:52.368173+0000","last_undegraded":"2024-09-12T18:03:52.368173+0000","last_fullsized":"2024-09-12T18:03:52.368173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":582,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370935+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:52.370935+0000","last_peered":"2024-09-12T18:03:52.370935+0000","last_clean":"2024-09-12T18:03:52.370935+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:52.370935+0000","last_undegraded":"2024-09-12T18:03:52.370935+0000","last_fullsized":"2024-09-12T18:03:52.370935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":666,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.537530+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:03:52.537530+0000","last_peered":"2024-09-12T18:03:52.537530+0000","last_clean":"2024-09-12T18:03:52.537530+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:03:52.537530+0000","last_undegraded":"2024-09-12T18:03:52.537530+0000","last_fullsized":"2024-09-12T18:03:52.537530+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":665,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370516+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:03:52.370516+0000","last_peered":"2024-09-12T18:03:52.370516+0000","last_clean":"2024-09-12T18:03:52.370516+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:03:52.370516+0000","last_undegraded":"2024-09-12T18:03:52.370516+0000","last_fullsized":"2024-09-12T18:03:52.370516+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":568,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370166+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:52.370166+0000","last_peered":"2024-09-12T18:03:52.370166+0000","last_clean":"2024-09-12T18:03:52.370166+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:52.370166+0000","last_undegraded":"2024-09-12T18:03:52.370166+0000","last_fullsized":"2024-09-12T18:03:52.370166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":973,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370332+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:03:52.370332+0000","last_peered":"2024-09-12T18:03:52.370332+0000","last_clean":"2024-09-12T18:03:52.370332+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:03:52.370332+0000","last_undegraded":"2024-09-12T18:03:52.370332+0000","last_fullsized":"2024-09-12T18:03:52.370332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":609,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372751+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:52.372751+0000","last_peered":"2024-09-12T18:03:52.372751+0000","last_clean":"2024-09-12T18:03:52.372751+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:52.372751+0000","last_undegraded":"2024-09-12T18:03:52.372751+0000","last_fullsized":"2024-09-12T18:03:52.372751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":910,"reported_epoch":72,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:52.368120+0000","last_change":"2024-09-12T18:03:49.392122+0000","last_active":"2024-09-12T18:03:52.368120+0000","last_peered":"2024-09-12T18:03:52.368120+0000","last_clean":"2024-09-12T18:03:47.313477+0000","last_became_active":"2024-09-12T18:03:49.382617+0000","last_became_peered":"2024-09-12T18:03:49.382617+0000","last_unstale":"2024-09-12T18:03:52.368120+0000","last_undegraded":"2024-09-12T18:03:49.341774+0000","last_fullsized":"2024-09-12T18:03:49.335755+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":176,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0","objects":-3}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1141,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371868+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:03:52.371868+0000","last_peered":"2024-09-12T18:03:52.371868+0000","last_clean":"2024-09-12T18:03:52.371868+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:03:52.371868+0000","last_undegraded":"2024-09-12T18:03:52.371868+0000","last_fullsized":"2024-09-12T18:03:52.371868+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":527,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374785+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:52.374785+0000","last_peered":"2024-09-12T18:03:52.374785+0000","last_clean":"2024-09-12T18:03:52.374785+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:52.374785+0000","last_undegraded":"2024-09-12T18:03:52.374785+0000","last_fullsized":"2024-09-12T18:03:52.374785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":621,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370077+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:52.370077+0000","last_peered":"2024-09-12T18:03:52.370077+0000","last_clean":"2024-09-12T18:03:52.370077+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:52.370077+0000","last_undegraded":"2024-09-12T18:03:52.370077+0000","last_fullsized":"2024-09-12T18:03:52.370077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":572,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370119+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:52.370119+0000","last_peered":"2024-09-12T18:03:52.370119+0000","last_clean":"2024-09-12T18:03:52.370119+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:52.370119+0000","last_undegraded":"2024-09-12T18:03:52.370119+0000","last_fullsized":"2024-09-12T18:03:52.370119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":581,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373625+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:52.373625+0000","last_peered":"2024-09-12T18:03:52.373625+0000","last_clean":"2024-09-12T18:03:52.373625+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:52.373625+0000","last_undegraded":"2024-09-12T18:03:52.373625+0000","last_fullsized":"2024-09-12T18:03:52.373625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":933,"reported_epoch":72,"state":"active+recovery_wait+remapped","last_fresh":"2024-09-12T18:03:52.371634+0000","last_change":"2024-09-12T18:03:49.384409+0000","last_active":"2024-09-12T18:03:52.371634+0000","last_peered":"2024-09-12T18:03:52.371634+0000","last_clean":"2024-09-12T18:03:46.980225+0000","last_became_active":"2024-09-12T18:03:49.374767+0000","last_became_peered":"2024-09-12T18:03:49.374767+0000","last_unstale":"2024-09-12T18:03:52.371634+0000","last_undegraded":"2024-09-12T18:03:52.371634+0000","last_fullsized":"2024-09-12T18:03:52.371634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":169,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":-4}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":608,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368160+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:52.368160+0000","last_peered":"2024-09-12T18:03:52.368160+0000","last_clean":"2024-09-12T18:03:52.368160+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:52.368160+0000","last_undegraded":"2024-09-12T18:03:52.368160+0000","last_fullsized":"2024-09-12T18:03:52.368160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":987,"reported_epoch":72,"state":"active+recovery_wait+remapped","last_fresh":"2024-09-12T18:03:52.368294+0000","last_change":"2024-09-12T18:03:49.392458+0000","last_active":"2024-09-12T18:03:52.368294+0000","last_peered":"2024-09-12T18:03:52.368294+0000","last_clean":"2024-09-12T18:03:46.964567+0000","last_became_active":"2024-09-12T18:03:49.384706+0000","last_became_peered":"2024-09-12T18:03:49.384706+0000","last_unstale":"2024-09-12T18:03:52.368294+0000","last_undegraded":"2024-09-12T18:03:52.368294+0000","last_fullsized":"2024-09-12T18:03:52.368294+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":191,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":-8}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":573,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368199+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:52.368199+0000","last_peered":"2024-09-12T18:03:52.368199+0000","last_clean":"2024-09-12T18:03:52.368199+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:52.368199+0000","last_undegraded":"2024-09-12T18:03:52.368199+0000","last_fullsized":"2024-09-12T18:03:52.368199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":600,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373369+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:52.373369+0000","last_peered":"2024-09-12T18:03:52.373369+0000","last_clean":"2024-09-12T18:03:52.373369+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:52.373369+0000","last_undegraded":"2024-09-12T18:03:52.373369+0000","last_fullsized":"2024-09-12T18:03:52.373369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":567,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370636+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:52.370636+0000","last_peered":"2024-09-12T18:03:52.370636+0000","last_clean":"2024-09-12T18:03:52.370636+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:52.370636+0000","last_undegraded":"2024-09-12T18:03:52.370636+0000","last_fullsized":"2024-09-12T18:03:52.370636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":536,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373408+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:52.373408+0000","last_peered":"2024-09-12T18:03:52.373408+0000","last_clean":"2024-09-12T18:03:52.373408+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:52.373408+0000","last_undegraded":"2024-09-12T18:03:52.373408+0000","last_fullsized":"2024-09-12T18:03:52.373408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":170,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368982+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:52.368982+0000","last_peered":"2024-09-12T18:03:52.368982+0000","last_clean":"2024-09-12T18:03:52.368982+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:52.368982+0000","last_undegraded":"2024-09-12T18:03:52.368982+0000","last_fullsized":"2024-09-12T18:03:52.368982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":560,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370538+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:52.370538+0000","last_peered":"2024-09-12T18:03:52.370538+0000","last_clean":"2024-09-12T18:03:52.370538+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:52.370538+0000","last_undegraded":"2024-09-12T18:03:52.370538+0000","last_fullsized":"2024-09-12T18:03:52.370538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":189,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374454+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:52.374454+0000","last_peered":"2024-09-12T18:03:52.374454+0000","last_clean":"2024-09-12T18:03:52.374454+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:52.374454+0000","last_undegraded":"2024-09-12T18:03:52.374454+0000","last_fullsized":"2024-09-12T18:03:52.374454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":560,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369888+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:52.369888+0000","last_peered":"2024-09-12T18:03:52.369888+0000","last_clean":"2024-09-12T18:03:52.369888+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:52.369888+0000","last_undegraded":"2024-09-12T18:03:52.369888+0000","last_fullsized":"2024-09-12T18:03:52.369888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368871+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:52.368871+0000","last_peered":"2024-09-12T18:03:52.368871+0000","last_clean":"2024-09-12T18:03:52.368871+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:52.368871+0000","last_undegraded":"2024-09-12T18:03:52.368871+0000","last_fullsized":"2024-09-12T18:03:52.368871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372544+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:52.372544+0000","last_peered":"2024-09-12T18:03:52.372544+0000","last_clean":"2024-09-12T18:03:52.372544+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:52.372544+0000","last_undegraded":"2024-09-12T18:03:52.372544+0000","last_fullsized":"2024-09-12T18:03:52.372544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":573,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374729+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:52.374729+0000","last_peered":"2024-09-12T18:03:52.374729+0000","last_clean":"2024-09-12T18:03:52.374729+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:52.374729+0000","last_undegraded":"2024-09-12T18:03:52.374729+0000","last_fullsized":"2024-09-12T18:03:52.374729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":370,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.375168+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:52.375168+0000","last_peered":"2024-09-12T18:03:52.375168+0000","last_clean":"2024-09-12T18:03:52.375168+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:52.375168+0000","last_undegraded":"2024-09-12T18:03:52.375168+0000","last_fullsized":"2024-09-12T18:03:52.375168+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1434,"reported_epoch":71,"state":"peering","last_fresh":"2024-09-12T18:03:51.794626+0000","last_change":"2024-09-12T18:03:52.372739+0000","last_active":"2024-09-12T18:03:52.372739+0000","last_peered":"2024-09-12T18:03:51.794626+0000","last_clean":"2024-09-12T18:03:47.294765+0000","last_became_active":"2024-09-12T18:03:49.381464+0000","last_became_peered":"2024-09-12T18:03:49.381464+0000","last_unstale":"2024-09-12T18:03:51.794626+0000","last_undegraded":"2024-09-12T18:03:51.794626+0000","last_fullsized":"2024-09-12T18:03:49.328761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":501,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371159+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:52.371159+0000","last_peered":"2024-09-12T18:03:52.371159+0000","last_clean":"2024-09-12T18:03:52.371159+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:52.371159+0000","last_undegraded":"2024-09-12T18:03:52.371159+0000","last_fullsized":"2024-09-12T18:03:52.371159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":586,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368854+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:52.368854+0000","last_peered":"2024-09-12T18:03:52.368854+0000","last_clean":"2024-09-12T18:03:52.368854+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:52.368854+0000","last_undegraded":"2024-09-12T18:03:52.368854+0000","last_fullsized":"2024-09-12T18:03:52.368854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":175,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372025+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:52.372025+0000","last_peered":"2024-09-12T18:03:52.372025+0000","last_clean":"2024-09-12T18:03:52.372025+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:52.372025+0000","last_undegraded":"2024-09-12T18:03:52.372025+0000","last_fullsized":"2024-09-12T18:03:52.372025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":623,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369107+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:03:52.369107+0000","last_peered":"2024-09-12T18:03:52.369107+0000","last_clean":"2024-09-12T18:03:52.369107+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:03:52.369107+0000","last_undegraded":"2024-09-12T18:03:52.369107+0000","last_fullsized":"2024-09-12T18:03:52.369107+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":284,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369755+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:03:52.369755+0000","last_peered":"2024-09-12T18:03:52.369755+0000","last_clean":"2024-09-12T18:03:52.369755+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:03:52.369755+0000","last_undegraded":"2024-09-12T18:03:52.369755+0000","last_fullsized":"2024-09-12T18:03:52.369755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1120,"reported_epoch":72,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:52.690265+0000","last_change":"2024-09-12T18:03:52.538379+0000","last_active":"2024-09-12T18:03:52.690265+0000","last_peered":"2024-09-12T18:03:52.690265+0000","last_clean":"2024-09-12T18:03:47.314910+0000","last_became_active":"2024-09-12T18:03:49.371661+0000","last_became_peered":"2024-09-12T18:03:49.371661+0000","last_unstale":"2024-09-12T18:03:52.690265+0000","last_undegraded":"2024-09-12T18:03:49.339319+0000","last_fullsized":"2024-09-12T18:03:49.332890+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0","objects":-5}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":238,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369161+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:52.369161+0000","last_peered":"2024-09-12T18:03:52.369161+0000","last_clean":"2024-09-12T18:03:52.369161+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:52.369161+0000","last_undegraded":"2024-09-12T18:03:52.369161+0000","last_fullsized":"2024-09-12T18:03:52.369161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370559+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:52.370559+0000","last_peered":"2024-09-12T18:03:52.370559+0000","last_clean":"2024-09-12T18:03:52.370559+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:52.370559+0000","last_undegraded":"2024-09-12T18:03:52.370559+0000","last_fullsized":"2024-09-12T18:03:52.370559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":172,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374597+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:52.374597+0000","last_peered":"2024-09-12T18:03:52.374597+0000","last_clean":"2024-09-12T18:03:52.374597+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:52.374597+0000","last_undegraded":"2024-09-12T18:03:52.374597+0000","last_fullsized":"2024-09-12T18:03:52.374597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":534,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372217+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:52.372217+0000","last_peered":"2024-09-12T18:03:52.372217+0000","last_clean":"2024-09-12T18:03:52.372217+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:52.372217+0000","last_undegraded":"2024-09-12T18:03:52.372217+0000","last_fullsized":"2024-09-12T18:03:52.372217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372264+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:03:52.372264+0000","last_peered":"2024-09-12T18:03:52.372264+0000","last_clean":"2024-09-12T18:03:52.372264+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:03:52.372264+0000","last_undegraded":"2024-09-12T18:03:52.372264+0000","last_fullsized":"2024-09-12T18:03:52.372264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":525,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370487+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:52.370487+0000","last_peered":"2024-09-12T18:03:52.370487+0000","last_clean":"2024-09-12T18:03:52.370487+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:52.370487+0000","last_undegraded":"2024-09-12T18:03:52.370487+0000","last_fullsized":"2024-09-12T18:03:52.370487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":272,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369072+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:52.369072+0000","last_peered":"2024-09-12T18:03:52.369072+0000","last_clean":"2024-09-12T18:03:52.369072+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:52.369072+0000","last_undegraded":"2024-09-12T18:03:52.369072+0000","last_fullsized":"2024-09-12T18:03:52.369072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":135,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371348+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:52.371348+0000","last_peered":"2024-09-12T18:03:52.371348+0000","last_clean":"2024-09-12T18:03:52.371348+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:52.371348+0000","last_undegraded":"2024-09-12T18:03:52.371348+0000","last_fullsized":"2024-09-12T18:03:52.371348+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":689,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369506+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:52.369506+0000","last_peered":"2024-09-12T18:03:52.369506+0000","last_clean":"2024-09-12T18:03:52.369506+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:52.369506+0000","last_undegraded":"2024-09-12T18:03:52.369506+0000","last_fullsized":"2024-09-12T18:03:52.369506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":582,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370874+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:52.370874+0000","last_peered":"2024-09-12T18:03:52.370874+0000","last_clean":"2024-09-12T18:03:52.370874+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:52.370874+0000","last_undegraded":"2024-09-12T18:03:52.370874+0000","last_fullsized":"2024-09-12T18:03:52.370874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368922+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:52.368922+0000","last_peered":"2024-09-12T18:03:52.368922+0000","last_clean":"2024-09-12T18:03:52.368922+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:52.368922+0000","last_undegraded":"2024-09-12T18:03:52.368922+0000","last_fullsized":"2024-09-12T18:03:52.368922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":319,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368398+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:03:52.368398+0000","last_peered":"2024-09-12T18:03:52.368398+0000","last_clean":"2024-09-12T18:03:52.368398+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:03:52.368398+0000","last_undegraded":"2024-09-12T18:03:52.368398+0000","last_fullsized":"2024-09-12T18:03:52.368398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1140,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374518+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:03:52.374518+0000","last_peered":"2024-09-12T18:03:52.374518+0000","last_clean":"2024-09-12T18:03:52.374518+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:03:52.374518+0000","last_undegraded":"2024-09-12T18:03:52.374518+0000","last_fullsized":"2024-09-12T18:03:52.374518+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369867+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:52.369867+0000","last_peered":"2024-09-12T18:03:52.369867+0000","last_clean":"2024-09-12T18:03:52.369867+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:52.369867+0000","last_undegraded":"2024-09-12T18:03:52.369867+0000","last_fullsized":"2024-09-12T18:03:52.369867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":494,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372584+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:52.372584+0000","last_peered":"2024-09-12T18:03:52.372584+0000","last_clean":"2024-09-12T18:03:52.372584+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:52.372584+0000","last_undegraded":"2024-09-12T18:03:52.372584+0000","last_fullsized":"2024-09-12T18:03:52.372584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":1098,"reported_epoch":72,"state":"active+remapped","last_fresh":"2024-09-12T18:03:52.374116+0000","last_change":"2024-09-12T18:03:52.374116+0000","last_active":"2024-09-12T18:03:52.374116+0000","last_peered":"2024-09-12T18:03:52.374116+0000","last_clean":"2024-09-12T18:03:46.993256+0000","last_became_active":"2024-09-12T18:03:49.369380+0000","last_became_peered":"2024-09-12T18:03:49.369380+0000","last_unstale":"2024-09-12T18:03:52.374116+0000","last_undegraded":"2024-09-12T18:03:52.374116+0000","last_fullsized":"2024-09-12T18:03:52.374116+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":146,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369453+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:52.369453+0000","last_peered":"2024-09-12T18:03:52.369453+0000","last_clean":"2024-09-12T18:03:52.369453+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:52.369453+0000","last_undegraded":"2024-09-12T18:03:52.369453+0000","last_fullsized":"2024-09-12T18:03:52.369453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":195,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370979+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:52.370979+0000","last_peered":"2024-09-12T18:03:52.370979+0000","last_clean":"2024-09-12T18:03:52.370979+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:52.370979+0000","last_undegraded":"2024-09-12T18:03:52.370979+0000","last_fullsized":"2024-09-12T18:03:52.370979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":621,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370555+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:52.370555+0000","last_peered":"2024-09-12T18:03:52.370555+0000","last_clean":"2024-09-12T18:03:52.370555+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:52.370555+0000","last_undegraded":"2024-09-12T18:03:52.370555+0000","last_fullsized":"2024-09-12T18:03:52.370555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":421,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371947+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:52.371947+0000","last_peered":"2024-09-12T18:03:52.371947+0000","last_clean":"2024-09-12T18:03:52.371947+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:52.371947+0000","last_undegraded":"2024-09-12T18:03:52.371947+0000","last_fullsized":"2024-09-12T18:03:52.371947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370849+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:52.370849+0000","last_peered":"2024-09-12T18:03:52.370849+0000","last_clean":"2024-09-12T18:03:52.370849+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:52.370849+0000","last_undegraded":"2024-09-12T18:03:52.370849+0000","last_fullsized":"2024-09-12T18:03:52.370849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":505,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373034+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:52.373034+0000","last_peered":"2024-09-12T18:03:52.373034+0000","last_clean":"2024-09-12T18:03:52.373034+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:52.373034+0000","last_undegraded":"2024-09-12T18:03:52.373034+0000","last_fullsized":"2024-09-12T18:03:52.373034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368980+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:03:52.368980+0000","last_peered":"2024-09-12T18:03:52.368980+0000","last_clean":"2024-09-12T18:03:52.368980+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:03:52.368980+0000","last_undegraded":"2024-09-12T18:03:52.368980+0000","last_fullsized":"2024-09-12T18:03:52.368980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374468+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:03:52.374468+0000","last_peered":"2024-09-12T18:03:52.374468+0000","last_clean":"2024-09-12T18:03:52.374468+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:03:52.374468+0000","last_undegraded":"2024-09-12T18:03:52.374468+0000","last_fullsized":"2024-09-12T18:03:52.374468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":531,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373591+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:52.373591+0000","last_peered":"2024-09-12T18:03:52.373591+0000","last_clean":"2024-09-12T18:03:52.373591+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:52.373591+0000","last_undegraded":"2024-09-12T18:03:52.373591+0000","last_fullsized":"2024-09-12T18:03:52.373591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370884+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:03:52.370884+0000","last_peered":"2024-09-12T18:03:52.370884+0000","last_clean":"2024-09-12T18:03:52.370884+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:03:52.370884+0000","last_undegraded":"2024-09-12T18:03:52.370884+0000","last_fullsized":"2024-09-12T18:03:52.370884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369112+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:03:52.369112+0000","last_peered":"2024-09-12T18:03:52.369112+0000","last_clean":"2024-09-12T18:03:52.369112+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:03:52.369112+0000","last_undegraded":"2024-09-12T18:03:52.369112+0000","last_fullsized":"2024-09-12T18:03:52.369112+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":549,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368227+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:03:52.368227+0000","last_peered":"2024-09-12T18:03:52.368227+0000","last_clean":"2024-09-12T18:03:52.368227+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:03:52.368227+0000","last_undegraded":"2024-09-12T18:03:52.368227+0000","last_fullsized":"2024-09-12T18:03:52.368227+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"69'113","reported_seq":242,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370427+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:03:52.370427+0000","last_peered":"2024-09-12T18:03:52.370427+0000","last_clean":"2024-09-12T18:03:52.370427+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:03:52.370427+0000","last_undegraded":"2024-09-12T18:03:52.370427+0000","last_fullsized":"2024-09-12T18:03:52.370427+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372620+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:52.372620+0000","last_peered":"2024-09-12T18:03:52.372620+0000","last_clean":"2024-09-12T18:03:52.372620+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:52.372620+0000","last_undegraded":"2024-09-12T18:03:52.372620+0000","last_fullsized":"2024-09-12T18:03:52.372620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":559,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374297+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:52.374297+0000","last_peered":"2024-09-12T18:03:52.374297+0000","last_clean":"2024-09-12T18:03:52.374297+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:52.374297+0000","last_undegraded":"2024-09-12T18:03:52.374297+0000","last_fullsized":"2024-09-12T18:03:52.374297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369239+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:52.369239+0000","last_peered":"2024-09-12T18:03:52.369239+0000","last_clean":"2024-09-12T18:03:52.369239+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:52.369239+0000","last_undegraded":"2024-09-12T18:03:52.369239+0000","last_fullsized":"2024-09-12T18:03:52.369239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":348,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.371668+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:52.371668+0000","last_peered":"2024-09-12T18:03:52.371668+0000","last_clean":"2024-09-12T18:03:52.371668+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:52.371668+0000","last_undegraded":"2024-09-12T18:03:52.371668+0000","last_fullsized":"2024-09-12T18:03:52.371668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":602,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368720+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:52.368720+0000","last_peered":"2024-09-12T18:03:52.368720+0000","last_clean":"2024-09-12T18:03:52.368720+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:52.368720+0000","last_undegraded":"2024-09-12T18:03:52.368720+0000","last_fullsized":"2024-09-12T18:03:52.368720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374026+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:52.374026+0000","last_peered":"2024-09-12T18:03:52.374026+0000","last_clean":"2024-09-12T18:03:52.374026+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:52.374026+0000","last_undegraded":"2024-09-12T18:03:52.374026+0000","last_fullsized":"2024-09-12T18:03:52.374026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":332,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.372484+0000","last_change":"2024-09-12T18:03:51.372214+0000","last_active":"2024-09-12T18:03:52.372484+0000","last_peered":"2024-09-12T18:03:52.372484+0000","last_clean":"2024-09-12T18:03:52.372484+0000","last_became_active":"2024-09-12T18:03:51.371525+0000","last_became_peered":"2024-09-12T18:03:51.371525+0000","last_unstale":"2024-09-12T18:03:52.372484+0000","last_undegraded":"2024-09-12T18:03:52.372484+0000","last_fullsized":"2024-09-12T18:03:52.372484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:05.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":695,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369348+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:52.369348+0000","last_peered":"2024-09-12T18:03:52.369348+0000","last_clean":"2024-09-12T18:03:52.369348+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:52.369348+0000","last_undegraded":"2024-09-12T18:03:52.369348+0000","last_fullsized":"2024-09-12T18:03:52.369348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370558+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:03:52.370558+0000","last_peered":"2024-09-12T18:03:52.370558+0000","last_clean":"2024-09-12T18:03:52.370558+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:03:52.370558+0000","last_undegraded":"2024-09-12T18:03:52.370558+0000","last_fullsized":"2024-09-12T18:03:52.370558+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":671,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368173+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:03:52.368173+0000","last_peered":"2024-09-12T18:03:52.368173+0000","last_clean":"2024-09-12T18:03:52.368173+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:03:52.368173+0000","last_undegraded":"2024-09-12T18:03:52.368173+0000","last_fullsized":"2024-09-12T18:03:52.368173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":526,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374940+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:52.374940+0000","last_peered":"2024-09-12T18:03:52.374940+0000","last_clean":"2024-09-12T18:03:52.374940+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:52.374940+0000","last_undegraded":"2024-09-12T18:03:52.374940+0000","last_fullsized":"2024-09-12T18:03:52.374940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":773,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368491+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:52.368491+0000","last_peered":"2024-09-12T18:03:52.368491+0000","last_clean":"2024-09-12T18:03:52.368491+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:52.368491+0000","last_undegraded":"2024-09-12T18:03:52.368491+0000","last_fullsized":"2024-09-12T18:03:52.368491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":644,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369809+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:03:52.369809+0000","last_peered":"2024-09-12T18:03:52.369809+0000","last_clean":"2024-09-12T18:03:52.369809+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:03:52.369809+0000","last_undegraded":"2024-09-12T18:03:52.369809+0000","last_fullsized":"2024-09-12T18:03:52.369809+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":346,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368029+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:03:52.368029+0000","last_peered":"2024-09-12T18:03:52.368029+0000","last_clean":"2024-09-12T18:03:52.368029+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:03:52.368029+0000","last_undegraded":"2024-09-12T18:03:52.368029+0000","last_fullsized":"2024-09-12T18:03:52.368029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":551,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373081+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:52.373081+0000","last_peered":"2024-09-12T18:03:52.373081+0000","last_clean":"2024-09-12T18:03:52.373081+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:52.373081+0000","last_undegraded":"2024-09-12T18:03:52.373081+0000","last_fullsized":"2024-09-12T18:03:52.373081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":334,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.662378+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:52.662378+0000","last_peered":"2024-09-12T18:03:52.662378+0000","last_clean":"2024-09-12T18:03:52.662378+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:52.662378+0000","last_undegraded":"2024-09-12T18:03:52.662378+0000","last_fullsized":"2024-09-12T18:03:52.662378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.379269+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:03:52.379269+0000","last_peered":"2024-09-12T18:03:52.379269+0000","last_clean":"2024-09-12T18:03:52.379269+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:03:52.379269+0000","last_undegraded":"2024-09-12T18:03:52.379269+0000","last_fullsized":"2024-09-12T18:03:52.379269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":171,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374319+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:52.374319+0000","last_peered":"2024-09-12T18:03:52.374319+0000","last_clean":"2024-09-12T18:03:52.374319+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:52.374319+0000","last_undegraded":"2024-09-12T18:03:52.374319+0000","last_fullsized":"2024-09-12T18:03:52.374319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":847,"reported_epoch":72,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-12T18:03:52.370103+0000","last_change":"2024-09-12T18:03:49.384396+0000","last_active":"2024-09-12T18:03:52.370103+0000","last_peered":"2024-09-12T18:03:52.370103+0000","last_clean":"2024-09-12T18:03:47.318081+0000","last_became_active":"2024-09-12T18:03:49.379398+0000","last_became_peered":"2024-09-12T18:03:49.379398+0000","last_unstale":"2024-09-12T18:03:52.370103+0000","last_undegraded":"2024-09-12T18:03:49.347989+0000","last_fullsized":"2024-09-12T18:03:49.339526+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":165,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0","objects":-7}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":330,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370830+0000","last_change":"2024-09-12T18:03:51.371985+0000","last_active":"2024-09-12T18:03:52.370830+0000","last_peered":"2024-09-12T18:03:52.370830+0000","last_clean":"2024-09-12T18:03:52.370830+0000","last_became_active":"2024-09-12T18:03:51.371031+0000","last_became_peered":"2024-09-12T18:03:51.371031+0000","last_unstale":"2024-09-12T18:03:52.370830+0000","last_undegraded":"2024-09-12T18:03:52.370830+0000","last_fullsized":"2024-09-12T18:03:52.370830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:47.783150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1266,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.378943+0000","last_change":"2024-09-12T18:03:52.378736+0000","last_active":"2024-09-12T18:03:52.378943+0000","last_peered":"2024-09-12T18:03:52.378943+0000","last_clean":"2024-09-12T18:03:52.378943+0000","last_became_active":"2024-09-12T18:03:52.374218+0000","last_became_peered":"2024-09-12T18:03:52.374218+0000","last_unstale":"2024-09-12T18:03:52.378943+0000","last_undegraded":"2024-09-12T18:03:52.378943+0000","last_fullsized":"2024-09-12T18:03:52.378943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:24.098596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":397,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.373524+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:52.373524+0000","last_peered":"2024-09-12T18:03:52.373524+0000","last_clean":"2024-09-12T18:03:52.373524+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:52.373524+0000","last_undegraded":"2024-09-12T18:03:52.373524+0000","last_fullsized":"2024-09-12T18:03:52.373524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":537,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.374736+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:52.374736+0000","last_peered":"2024-09-12T18:03:52.374736+0000","last_clean":"2024-09-12T18:03:52.374736+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:52.374736+0000","last_undegraded":"2024-09-12T18:03:52.374736+0000","last_fullsized":"2024-09-12T18:03:52.374736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.370136+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:03:52.370136+0000","last_peered":"2024-09-12T18:03:52.370136+0000","last_clean":"2024-09-12T18:03:52.370136+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:03:52.370136+0000","last_undegraded":"2024-09-12T18:03:52.370136+0000","last_fullsized":"2024-09-12T18:03:52.370136+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":639,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.368516+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:52.368516+0000","last_peered":"2024-09-12T18:03:52.368516+0000","last_clean":"2024-09-12T18:03:52.368516+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:52.368516+0000","last_undegraded":"2024-09-12T18:03:52.368516+0000","last_fullsized":"2024-09-12T18:03:52.368516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":195,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-12T18:03:52.369092+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:03:52.369092+0000","last_peered":"2024-09-12T18:03:52.369092+0000","last_clean":"2024-09-12T18:03:52.369092+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:03:52.369092+0000","last_undegraded":"2024-09-12T18:03:52.369092+0000","last_fullsized":"2024-09-12T18:03:52.369092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":346,"num_objects_misplaced":360,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4397,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":404172,"data_compressed":100626,"data_compressed_allocated":118784,"data_compressed_original":303104,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":125,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4485,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":81813504,"data_stored":258441473,"data_compressed":39400911,"data_compressed_allocated":50376704,"data_compressed_original":227065856,"omap_allocated":0,"internal_metadata":0},"log_size":6247,"ondisk_log_size":6247,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738398,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113540,"kb_used_data":24116,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94258300,"statfs":{"total":96636764160,"available":96520499200,"internally_reserved":0,"allocated":24694784,"data_stored":81465849,"data_compressed":12673336,"data_compressed_allocated":15798272,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,3],"upper_bound":2048},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738398,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101436,"kb_used_data":34212,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94270404,"statfs":{"total":96636764160,"available":96532893696,"internally_reserved":0,"allocated":35033088,"data_stored":111798722,"data_compressed":17027829,"data_compressed_allocated":21532672,"data_compressed_original":98754560,"omap_allocated":1595,"internal_metadata":68811205},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,10],"upper_bound":2048},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738398,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119176,"kb_used_data":29744,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94252664,"statfs":{"total":96636764160,"available":96514727936,"internally_reserved":0,"allocated":30457856,"data_stored":94735776,"data_compressed":14534641,"data_compressed_allocated":18710528,"data_compressed_original":83423232,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29614080,"data_stored":93744597,"data_compressed":14472179,"data_compressed_allocated":18632704,"data_compressed_original":82792448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23736320,"data_stored":80913711,"data_compressed":12623268,"data_compressed_allocated":15736832,"data_compressed_original":72925184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":110730,"data_compressed":27210,"data_compressed_allocated":32768,"data_compressed_original":57344,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":293442,"data_compressed":73416,"data_compressed_allocated":86016,"data_compressed_original":245760,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:03:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-09-12T18:04:00.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:04:00.526 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:00.528 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:04:00.544 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-12T18:03:58.588725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32952,"ondisk_log_size":32952,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":221,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":353592,"kb_used_data":81140,"kb_used_omap":4,"kb_used_meta":272379,"kb_avail":282761928,"statfs":{"total":289910292480,"available":289548214272,"internally_reserved":0,"allocated":83087360,"data_stored":256512267,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":278916431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-346,"num_objects_misplaced":-360,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":861,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.267315"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":611,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333664+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:03:57.333664+0000","last_peered":"2024-09-12T18:03:57.333664+0000","last_clean":"2024-09-12T18:03:57.333664+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:03:57.333664+0000","last_undegraded":"2024-09-12T18:03:57.333664+0000","last_fullsized":"2024-09-12T18:03:57.333664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":897,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333054+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:03:57.333054+0000","last_peered":"2024-09-12T18:03:57.333054+0000","last_clean":"2024-09-12T18:03:57.333054+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:03:57.333054+0000","last_undegraded":"2024-09-12T18:03:57.333054+0000","last_fullsized":"2024-09-12T18:03:57.333054+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":514,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342809+0000","last_change":"2024-09-12T18:01:55.596575+0000","last_active":"2024-09-12T18:03:57.342809+0000","last_peered":"2024-09-12T18:03:57.342809+0000","last_clean":"2024-09-12T18:03:57.342809+0000","last_became_active":"2024-09-12T18:01:55.595821+0000","last_became_peered":"2024-09-12T18:01:55.595821+0000","last_unstale":"2024-09-12T18:03:57.342809+0000","last_undegraded":"2024-09-12T18:03:57.342809+0000","last_fullsized":"2024-09-12T18:03:57.342809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:28.635060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":533,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342647+0000","last_change":"2024-09-12T18:01:55.585710+0000","last_active":"2024-09-12T18:03:57.342647+0000","last_peered":"2024-09-12T18:03:57.342647+0000","last_clean":"2024-09-12T18:03:57.342647+0000","last_became_active":"2024-09-12T18:01:55.584979+0000","last_became_peered":"2024-09-12T18:01:55.584979+0000","last_unstale":"2024-09-12T18:03:57.342647+0000","last_undegraded":"2024-09-12T18:03:57.342647+0000","last_fullsized":"2024-09-12T18:03:57.342647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:12.121468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":650,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332614+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:03:57.332614+0000","last_peered":"2024-09-12T18:03:57.332614+0000","last_clean":"2024-09-12T18:03:57.332614+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:03:57.332614+0000","last_undegraded":"2024-09-12T18:03:57.332614+0000","last_fullsized":"2024-09-12T18:03:57.332614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":513,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335920+0000","last_change":"2024-09-12T18:01:55.591393+0000","last_active":"2024-09-12T18:03:57.335920+0000","last_peered":"2024-09-12T18:03:57.335920+0000","last_clean":"2024-09-12T18:03:57.335920+0000","last_became_active":"2024-09-12T18:01:55.590689+0000","last_became_peered":"2024-09-12T18:01:55.590689+0000","last_unstale":"2024-09-12T18:03:57.335920+0000","last_undegraded":"2024-09-12T18:03:57.335920+0000","last_fullsized":"2024-09-12T18:03:57.335920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:30.636937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":623,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336031+0000","last_change":"2024-09-12T18:01:55.583082+0000","last_active":"2024-09-12T18:03:57.336031+0000","last_peered":"2024-09-12T18:03:57.336031+0000","last_clean":"2024-09-12T18:03:57.336031+0000","last_became_active":"2024-09-12T18:01:55.581676+0000","last_became_peered":"2024-09-12T18:01:55.581676+0000","last_unstale":"2024-09-12T18:03:57.336031+0000","last_undegraded":"2024-09-12T18:03:57.336031+0000","last_fullsized":"2024-09-12T18:03:57.336031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:02.583205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":977,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335232+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:03:57.335232+0000","last_peered":"2024-09-12T18:03:57.335232+0000","last_clean":"2024-09-12T18:03:57.335232+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:03:57.335232+0000","last_undegraded":"2024-09-12T18:03:57.335232+0000","last_fullsized":"2024-09-12T18:03:57.335232+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":535,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337485+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:03:57.337485+0000","last_peered":"2024-09-12T18:03:57.337485+0000","last_clean":"2024-09-12T18:03:57.337485+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:03:57.337485+0000","last_undegraded":"2024-09-12T18:03:57.337485+0000","last_fullsized":"2024-09-12T18:03:57.337485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1034,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333153+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:03:57.333153+0000","last_peered":"2024-09-12T18:03:57.333153+0000","last_clean":"2024-09-12T18:03:57.333153+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:03:57.333153+0000","last_undegraded":"2024-09-12T18:03:57.333153+0000","last_fullsized":"2024-09-12T18:03:57.333153+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":538,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.343140+0000","last_change":"2024-09-12T18:01:55.578358+0000","last_active":"2024-09-12T18:03:57.343140+0000","last_peered":"2024-09-12T18:03:57.343140+0000","last_clean":"2024-09-12T18:03:57.343140+0000","last_became_active":"2024-09-12T18:01:55.577296+0000","last_became_peered":"2024-09-12T18:01:55.577296+0000","last_unstale":"2024-09-12T18:03:57.343140+0000","last_undegraded":"2024-09-12T18:03:57.343140+0000","last_fullsized":"2024-09-12T18:03:57.343140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":519,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332772+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:03:57.332772+0000","last_peered":"2024-09-12T18:03:57.332772+0000","last_clean":"2024-09-12T18:03:57.332772+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:03:57.332772+0000","last_undegraded":"2024-09-12T18:03:57.332772+0000","last_fullsized":"2024-09-12T18:03:57.332772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":525,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332324+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:03:57.332324+0000","last_peered":"2024-09-12T18:03:57.332324+0000","last_clean":"2024-09-12T18:03:57.332324+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:03:57.332324+0000","last_undegraded":"2024-09-12T18:03:57.332324+0000","last_fullsized":"2024-09-12T18:03:57.332324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":599,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.341752+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:03:57.341752+0000","last_peered":"2024-09-12T18:03:57.341752+0000","last_clean":"2024-09-12T18:03:57.341752+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:03:57.341752+0000","last_undegraded":"2024-09-12T18:03:57.341752+0000","last_fullsized":"2024-09-12T18:03:57.341752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":597,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.341943+0000","last_change":"2024-09-12T18:02:21.655330+0000","last_active":"2024-09-12T18:03:57.341943+0000","last_peered":"2024-09-12T18:03:57.341943+0000","last_clean":"2024-09-12T18:03:57.341943+0000","last_became_active":"2024-09-12T18:02:21.655122+0000","last_became_peered":"2024-09-12T18:02:21.655122+0000","last_unstale":"2024-09-12T18:03:57.341943+0000","last_undegraded":"2024-09-12T18:03:57.341943+0000","last_fullsized":"2024-09-12T18:03:57.341943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:08.948815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":669,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335417+0000","last_change":"2024-09-12T18:01:55.578901+0000","last_active":"2024-09-12T18:03:57.335417+0000","last_peered":"2024-09-12T18:03:57.335417+0000","last_clean":"2024-09-12T18:03:57.335417+0000","last_became_active":"2024-09-12T18:01:55.577859+0000","last_became_peered":"2024-09-12T18:01:55.577859+0000","last_unstale":"2024-09-12T18:03:57.335417+0000","last_undegraded":"2024-09-12T18:03:57.335417+0000","last_fullsized":"2024-09-12T18:03:57.335417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:10.016462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":592,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.338832+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:03:57.338832+0000","last_peered":"2024-09-12T18:03:57.338832+0000","last_clean":"2024-09-12T18:03:57.338832+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:03:57.338832+0000","last_undegraded":"2024-09-12T18:03:57.338832+0000","last_fullsized":"2024-09-12T18:03:57.338832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":676,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333612+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:03:57.333612+0000","last_peered":"2024-09-12T18:03:57.333612+0000","last_clean":"2024-09-12T18:03:57.333612+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:03:57.333612+0000","last_undegraded":"2024-09-12T18:03:57.333612+0000","last_fullsized":"2024-09-12T18:03:57.333612+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":675,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335225+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:03:57.335225+0000","last_peered":"2024-09-12T18:03:57.335225+0000","last_clean":"2024-09-12T18:03:57.335225+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:03:57.335225+0000","last_undegraded":"2024-09-12T18:03:57.335225+0000","last_fullsized":"2024-09-12T18:03:57.335225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":578,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342584+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:03:57.342584+0000","last_peered":"2024-09-12T18:03:57.342584+0000","last_clean":"2024-09-12T18:03:57.342584+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:03:57.342584+0000","last_undegraded":"2024-09-12T18:03:57.342584+0000","last_fullsized":"2024-09-12T18:03:57.342584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":983,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342544+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:03:57.342544+0000","last_peered":"2024-09-12T18:03:57.342544+0000","last_clean":"2024-09-12T18:03:57.342544+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:03:57.342544+0000","last_undegraded":"2024-09-12T18:03:57.342544+0000","last_fullsized":"2024-09-12T18:03:57.342544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":619,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331840+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:03:57.331840+0000","last_peered":"2024-09-12T18:03:57.331840+0000","last_clean":"2024-09-12T18:03:57.331840+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:03:57.331840+0000","last_undegraded":"2024-09-12T18:03:57.331840+0000","last_fullsized":"2024-09-12T18:03:57.331840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":918,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337416+0000","last_change":"2024-09-12T18:03:56.341786+0000","last_active":"2024-09-12T18:03:57.337416+0000","last_peered":"2024-09-12T18:03:57.337416+0000","last_clean":"2024-09-12T18:03:57.337416+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:03:57.337416+0000","last_undegraded":"2024-09-12T18:03:57.337416+0000","last_fullsized":"2024-09-12T18:03:57.337416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1151,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331305+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:03:57.331305+0000","last_peered":"2024-09-12T18:03:57.331305+0000","last_clean":"2024-09-12T18:03:57.331305+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:03:57.331305+0000","last_undegraded":"2024-09-12T18:03:57.331305+0000","last_fullsized":"2024-09-12T18:03:57.331305+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":537,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333788+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:03:57.333788+0000","last_peered":"2024-09-12T18:03:57.333788+0000","last_clean":"2024-09-12T18:03:57.333788+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:03:57.333788+0000","last_undegraded":"2024-09-12T18:03:57.333788+0000","last_fullsized":"2024-09-12T18:03:57.333788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":631,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337690+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:03:57.337690+0000","last_peered":"2024-09-12T18:03:57.337690+0000","last_clean":"2024-09-12T18:03:57.337690+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:03:57.337690+0000","last_undegraded":"2024-09-12T18:03:57.337690+0000","last_fullsized":"2024-09-12T18:03:57.337690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":582,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.343245+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:03:57.343245+0000","last_peered":"2024-09-12T18:03:57.343245+0000","last_clean":"2024-09-12T18:03:57.343245+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:03:57.343245+0000","last_undegraded":"2024-09-12T18:03:57.343245+0000","last_fullsized":"2024-09-12T18:03:57.343245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333305+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:03:57.333305+0000","last_peered":"2024-09-12T18:03:57.333305+0000","last_clean":"2024-09-12T18:03:57.333305+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:03:57.333305+0000","last_undegraded":"2024-09-12T18:03:57.333305+0000","last_fullsized":"2024-09-12T18:03:57.333305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":938,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337020+0000","last_change":"2024-09-12T18:03:56.344116+0000","last_active":"2024-09-12T18:03:57.337020+0000","last_peered":"2024-09-12T18:03:57.337020+0000","last_clean":"2024-09-12T18:03:57.337020+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:03:57.337020+0000","last_undegraded":"2024-09-12T18:03:57.337020+0000","last_fullsized":"2024-09-12T18:03:57.337020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":618,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335614+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:03:57.335614+0000","last_peered":"2024-09-12T18:03:57.335614+0000","last_clean":"2024-09-12T18:03:57.335614+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:03:57.335614+0000","last_undegraded":"2024-09-12T18:03:57.335614+0000","last_fullsized":"2024-09-12T18:03:57.335614+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":991,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.344961+0000","last_change":"2024-09-12T18:03:57.344789+0000","last_active":"2024-09-12T18:03:57.344961+0000","last_peered":"2024-09-12T18:03:57.344961+0000","last_clean":"2024-09-12T18:03:57.344961+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:03:57.344961+0000","last_undegraded":"2024-09-12T18:03:57.344961+0000","last_fullsized":"2024-09-12T18:03:57.344961+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":583,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335558+0000","last_change":"2024-09-12T18:01:55.578462+0000","last_active":"2024-09-12T18:03:57.335558+0000","last_peered":"2024-09-12T18:03:57.335558+0000","last_clean":"2024-09-12T18:03:57.335558+0000","last_became_active":"2024-09-12T18:01:55.577721+0000","last_became_peered":"2024-09-12T18:01:55.577721+0000","last_unstale":"2024-09-12T18:03:57.335558+0000","last_undegraded":"2024-09-12T18:03:57.335558+0000","last_fullsized":"2024-09-12T18:03:57.335558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":610,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333098+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:03:57.333098+0000","last_peered":"2024-09-12T18:03:57.333098+0000","last_clean":"2024-09-12T18:03:57.333098+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:03:57.333098+0000","last_undegraded":"2024-09-12T18:03:57.333098+0000","last_fullsized":"2024-09-12T18:03:57.333098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":577,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342682+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:03:57.342682+0000","last_peered":"2024-09-12T18:03:57.342682+0000","last_clean":"2024-09-12T18:03:57.342682+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:03:57.342682+0000","last_undegraded":"2024-09-12T18:03:57.342682+0000","last_fullsized":"2024-09-12T18:03:57.342682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":546,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333217+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:03:57.333217+0000","last_peered":"2024-09-12T18:03:57.333217+0000","last_clean":"2024-09-12T18:03:57.333217+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:03:57.333217+0000","last_undegraded":"2024-09-12T18:03:57.333217+0000","last_fullsized":"2024-09-12T18:03:57.333217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":180,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336433+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:03:57.336433+0000","last_peered":"2024-09-12T18:03:57.336433+0000","last_clean":"2024-09-12T18:03:57.336433+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:03:57.336433+0000","last_undegraded":"2024-09-12T18:03:57.336433+0000","last_fullsized":"2024-09-12T18:03:57.336433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":570,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.338541+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:03:57.338541+0000","last_peered":"2024-09-12T18:03:57.338541+0000","last_clean":"2024-09-12T18:03:57.338541+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:03:57.338541+0000","last_undegraded":"2024-09-12T18:03:57.338541+0000","last_fullsized":"2024-09-12T18:03:57.338541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":199,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331746+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:03:57.331746+0000","last_peered":"2024-09-12T18:03:57.331746+0000","last_clean":"2024-09-12T18:03:57.331746+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:03:57.331746+0000","last_undegraded":"2024-09-12T18:03:57.331746+0000","last_fullsized":"2024-09-12T18:03:57.331746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":570,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.338393+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:03:57.338393+0000","last_peered":"2024-09-12T18:03:57.338393+0000","last_clean":"2024-09-12T18:03:57.338393+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:03:57.338393+0000","last_undegraded":"2024-09-12T18:03:57.338393+0000","last_fullsized":"2024-09-12T18:03:57.338393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":192,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335684+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:03:57.335684+0000","last_peered":"2024-09-12T18:03:57.335684+0000","last_clean":"2024-09-12T18:03:57.335684+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:03:57.335684+0000","last_undegraded":"2024-09-12T18:03:57.335684+0000","last_fullsized":"2024-09-12T18:03:57.335684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":269,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.343508+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:03:57.343508+0000","last_peered":"2024-09-12T18:03:57.343508+0000","last_clean":"2024-09-12T18:03:57.343508+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:03:57.343508+0000","last_undegraded":"2024-09-12T18:03:57.343508+0000","last_fullsized":"2024-09-12T18:03:57.343508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":583,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331295+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:03:57.331295+0000","last_peered":"2024-09-12T18:03:57.331295+0000","last_clean":"2024-09-12T18:03:57.331295+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:03:57.331295+0000","last_undegraded":"2024-09-12T18:03:57.331295+0000","last_fullsized":"2024-09-12T18:03:57.331295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":380,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333669+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:03:57.333669+0000","last_peered":"2024-09-12T18:03:57.333669+0000","last_clean":"2024-09-12T18:03:57.333669+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:03:57.333669+0000","last_undegraded":"2024-09-12T18:03:57.333669+0000","last_fullsized":"2024-09-12T18:03:57.333669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1451,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331254+0000","last_change":"2024-09-12T18:03:53.336888+0000","last_active":"2024-09-12T18:03:57.331254+0000","last_peered":"2024-09-12T18:03:57.331254+0000","last_clean":"2024-09-12T18:03:57.331254+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:03:57.331254+0000","last_undegraded":"2024-09-12T18:03:57.331254+0000","last_fullsized":"2024-09-12T18:03:57.331254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":511,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.344820+0000","last_change":"2024-09-12T18:01:54.705264+0000","last_active":"2024-09-12T18:03:57.344820+0000","last_peered":"2024-09-12T18:03:57.344820+0000","last_clean":"2024-09-12T18:03:57.344820+0000","last_became_active":"2024-09-12T18:01:54.704444+0000","last_became_peered":"2024-09-12T18:01:54.704444+0000","last_unstale":"2024-09-12T18:03:57.344820+0000","last_undegraded":"2024-09-12T18:03:57.344820+0000","last_fullsized":"2024-09-12T18:03:57.344820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:32.507074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":596,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.341943+0000","last_change":"2024-09-12T18:01:55.590929+0000","last_active":"2024-09-12T18:03:57.341943+0000","last_peered":"2024-09-12T18:03:57.341943+0000","last_clean":"2024-09-12T18:03:57.341943+0000","last_became_active":"2024-09-12T18:01:55.590029+0000","last_became_peered":"2024-09-12T18:01:55.590029+0000","last_unstale":"2024-09-12T18:03:57.341943+0000","last_undegraded":"2024-09-12T18:03:57.341943+0000","last_fullsized":"2024-09-12T18:03:57.341943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":185,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.343159+0000","last_change":"2024-09-12T18:01:54.714732+0000","last_active":"2024-09-12T18:03:57.343159+0000","last_peered":"2024-09-12T18:03:57.343159+0000","last_clean":"2024-09-12T18:03:57.343159+0000","last_became_active":"2024-09-12T18:01:54.713465+0000","last_became_peered":"2024-09-12T18:01:54.713465+0000","last_unstale":"2024-09-12T18:03:57.343159+0000","last_undegraded":"2024-09-12T18:03:57.343159+0000","last_fullsized":"2024-09-12T18:03:57.343159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:00.230453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":633,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336696+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:03:57.336696+0000","last_peered":"2024-09-12T18:03:57.336696+0000","last_clean":"2024-09-12T18:03:57.336696+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:03:57.336696+0000","last_undegraded":"2024-09-12T18:03:57.336696+0000","last_fullsized":"2024-09-12T18:03:57.336696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":294,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337450+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:03:57.337450+0000","last_peered":"2024-09-12T18:03:57.337450+0000","last_clean":"2024-09-12T18:03:57.337450+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:03:57.337450+0000","last_undegraded":"2024-09-12T18:03:57.337450+0000","last_fullsized":"2024-09-12T18:03:57.337450+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1457,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342797+0000","last_change":"2024-09-12T18:03:54.335232+0000","last_active":"2024-09-12T18:03:57.342797+0000","last_peered":"2024-09-12T18:03:57.342797+0000","last_clean":"2024-09-12T18:03:57.342797+0000","last_became_active":"2024-09-12T18:03:54.332330+0000","last_became_peered":"2024-09-12T18:03:54.332330+0000","last_unstale":"2024-09-12T18:03:57.342797+0000","last_undegraded":"2024-09-12T18:03:57.342797+0000","last_fullsized":"2024-09-12T18:03:57.342797+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:05.723311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":248,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342277+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:03:57.342277+0000","last_peered":"2024-09-12T18:03:57.342277+0000","last_clean":"2024-09-12T18:03:57.342277+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:03:57.342277+0000","last_undegraded":"2024-09-12T18:03:57.342277+0000","last_fullsized":"2024-09-12T18:03:57.342277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":597,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.343520+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:03:57.343520+0000","last_peered":"2024-09-12T18:03:57.343520+0000","last_clean":"2024-09-12T18:03:57.343520+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:03:57.343520+0000","last_undegraded":"2024-09-12T18:03:57.343520+0000","last_fullsized":"2024-09-12T18:03:57.343520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":182,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331965+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:03:57.331965+0000","last_peered":"2024-09-12T18:03:57.331965+0000","last_clean":"2024-09-12T18:03:57.331965+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:03:57.331965+0000","last_undegraded":"2024-09-12T18:03:57.331965+0000","last_fullsized":"2024-09-12T18:03:57.331965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":544,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.344626+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:03:57.344626+0000","last_peered":"2024-09-12T18:03:57.344626+0000","last_clean":"2024-09-12T18:03:57.344626+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:03:57.344626+0000","last_undegraded":"2024-09-12T18:03:57.344626+0000","last_fullsized":"2024-09-12T18:03:57.344626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":636,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331658+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:03:57.331658+0000","last_peered":"2024-09-12T18:03:57.331658+0000","last_clean":"2024-09-12T18:03:57.331658+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:03:57.331658+0000","last_undegraded":"2024-09-12T18:03:57.331658+0000","last_fullsized":"2024-09-12T18:03:57.331658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":535,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337992+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:03:57.337992+0000","last_peered":"2024-09-12T18:03:57.337992+0000","last_clean":"2024-09-12T18:03:57.337992+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:03:57.337992+0000","last_undegraded":"2024-09-12T18:03:57.337992+0000","last_fullsized":"2024-09-12T18:03:57.337992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":282,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.341864+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:03:57.341864+0000","last_peered":"2024-09-12T18:03:57.341864+0000","last_clean":"2024-09-12T18:03:57.341864+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:03:57.341864+0000","last_undegraded":"2024-09-12T18:03:57.341864+0000","last_fullsized":"2024-09-12T18:03:57.341864+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":146,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.344783+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:03:57.344783+0000","last_peered":"2024-09-12T18:03:57.344783+0000","last_clean":"2024-09-12T18:03:57.344783+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:03:57.344783+0000","last_undegraded":"2024-09-12T18:03:57.344783+0000","last_fullsized":"2024-09-12T18:03:57.344783+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":699,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337070+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:03:57.337070+0000","last_peered":"2024-09-12T18:03:57.337070+0000","last_clean":"2024-09-12T18:03:57.337070+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:03:57.337070+0000","last_undegraded":"2024-09-12T18:03:57.337070+0000","last_fullsized":"2024-09-12T18:03:57.337070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":592,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.343520+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:03:57.343520+0000","last_peered":"2024-09-12T18:03:57.343520+0000","last_clean":"2024-09-12T18:03:57.343520+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:03:57.343520+0000","last_undegraded":"2024-09-12T18:03:57.343520+0000","last_fullsized":"2024-09-12T18:03:57.343520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335875+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:03:57.335875+0000","last_peered":"2024-09-12T18:03:57.335875+0000","last_clean":"2024-09-12T18:03:57.335875+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:03:57.335875+0000","last_undegraded":"2024-09-12T18:03:57.335875+0000","last_fullsized":"2024-09-12T18:03:57.335875+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":329,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337128+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:03:57.337128+0000","last_peered":"2024-09-12T18:03:57.337128+0000","last_clean":"2024-09-12T18:03:57.337128+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:03:57.337128+0000","last_undegraded":"2024-09-12T18:03:57.337128+0000","last_fullsized":"2024-09-12T18:03:57.337128+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1150,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333363+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:03:57.333363+0000","last_peered":"2024-09-12T18:03:57.333363+0000","last_clean":"2024-09-12T18:03:57.333363+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:03:57.333363+0000","last_undegraded":"2024-09-12T18:03:57.333363+0000","last_fullsized":"2024-09-12T18:03:57.333363+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.338897+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:03:57.338897+0000","last_peered":"2024-09-12T18:03:57.338897+0000","last_clean":"2024-09-12T18:03:57.338897+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:03:57.338897+0000","last_undegraded":"2024-09-12T18:03:57.338897+0000","last_fullsized":"2024-09-12T18:03:57.338897+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":505,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332215+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:03:57.332215+0000","last_peered":"2024-09-12T18:03:57.332215+0000","last_clean":"2024-09-12T18:03:57.332215+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:03:57.332215+0000","last_undegraded":"2024-09-12T18:03:57.332215+0000","last_fullsized":"2024-09-12T18:03:57.332215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":798,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337361+0000","last_change":"2024-09-12T18:03:54.334607+0000","last_active":"2024-09-12T18:03:57.337361+0000","last_peered":"2024-09-12T18:03:57.337361+0000","last_clean":"2024-09-12T18:03:57.337361+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:03:57.337361+0000","last_undegraded":"2024-09-12T18:03:57.337361+0000","last_fullsized":"2024-09-12T18:03:57.337361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:27.565973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":157,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342629+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:03:57.342629+0000","last_peered":"2024-09-12T18:03:57.342629+0000","last_clean":"2024-09-12T18:03:57.342629+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:03:57.342629+0000","last_undegraded":"2024-09-12T18:03:57.342629+0000","last_fullsized":"2024-09-12T18:03:57.342629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":205,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342822+0000","last_change":"2024-09-12T18:01:54.716454+0000","last_active":"2024-09-12T18:03:57.342822+0000","last_peered":"2024-09-12T18:03:57.342822+0000","last_clean":"2024-09-12T18:03:57.342822+0000","last_became_active":"2024-09-12T18:01:54.715001+0000","last_became_peered":"2024-09-12T18:01:54.715001+0000","last_unstale":"2024-09-12T18:03:57.342822+0000","last_undegraded":"2024-09-12T18:03:57.342822+0000","last_fullsized":"2024-09-12T18:03:57.342822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:17.288237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":631,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336918+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:03:57.336918+0000","last_peered":"2024-09-12T18:03:57.336918+0000","last_clean":"2024-09-12T18:03:57.336918+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:03:57.336918+0000","last_undegraded":"2024-09-12T18:03:57.336918+0000","last_fullsized":"2024-09-12T18:03:57.336918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":431,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.344872+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:03:57.344872+0000","last_peered":"2024-09-12T18:03:57.344872+0000","last_clean":"2024-09-12T18:03:57.344872+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:03:57.344872+0000","last_undegraded":"2024-09-12T18:03:57.344872+0000","last_fullsized":"2024-09-12T18:03:57.344872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337166+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:03:57.337166+0000","last_peered":"2024-09-12T18:03:57.337166+0000","last_clean":"2024-09-12T18:03:57.337166+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:03:57.337166+0000","last_undegraded":"2024-09-12T18:03:57.337166+0000","last_fullsized":"2024-09-12T18:03:57.337166+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":515,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331921+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:03:57.331921+0000","last_peered":"2024-09-12T18:03:57.331921+0000","last_clean":"2024-09-12T18:03:57.331921+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:03:57.331921+0000","last_undegraded":"2024-09-12T18:03:57.331921+0000","last_fullsized":"2024-09-12T18:03:57.331921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336326+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:03:57.336326+0000","last_peered":"2024-09-12T18:03:57.336326+0000","last_clean":"2024-09-12T18:03:57.336326+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:03:57.336326+0000","last_undegraded":"2024-09-12T18:03:57.336326+0000","last_fullsized":"2024-09-12T18:03:57.336326+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":156,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333918+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:03:57.333918+0000","last_peered":"2024-09-12T18:03:57.333918+0000","last_clean":"2024-09-12T18:03:57.333918+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:03:57.333918+0000","last_undegraded":"2024-09-12T18:03:57.333918+0000","last_fullsized":"2024-09-12T18:03:57.333918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":541,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332403+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:03:57.332403+0000","last_peered":"2024-09-12T18:03:57.332403+0000","last_clean":"2024-09-12T18:03:57.332403+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:03:57.332403+0000","last_undegraded":"2024-09-12T18:03:57.332403+0000","last_fullsized":"2024-09-12T18:03:57.332403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":35,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.338737+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:03:57.338737+0000","last_peered":"2024-09-12T18:03:57.338737+0000","last_clean":"2024-09-12T18:03:57.338737+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:03:57.338737+0000","last_undegraded":"2024-09-12T18:03:57.338737+0000","last_fullsized":"2024-09-12T18:03:57.338737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336831+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:03:57.336831+0000","last_peered":"2024-09-12T18:03:57.336831+0000","last_clean":"2024-09-12T18:03:57.336831+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:03:57.336831+0000","last_undegraded":"2024-09-12T18:03:57.336831+0000","last_fullsized":"2024-09-12T18:03:57.336831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":560,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337014+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:03:57.337014+0000","last_peered":"2024-09-12T18:03:57.337014+0000","last_clean":"2024-09-12T18:03:57.337014+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:03:57.337014+0000","last_undegraded":"2024-09-12T18:03:57.337014+0000","last_fullsized":"2024-09-12T18:03:57.337014+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"72'114","reported_seq":253,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.338467+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:03:57.338467+0000","last_peered":"2024-09-12T18:03:57.338467+0000","last_clean":"2024-09-12T18:03:57.338467+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:03:57.338467+0000","last_undegraded":"2024-09-12T18:03:57.338467+0000","last_fullsized":"2024-09-12T18:03:57.338467+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.343499+0000","last_change":"2024-09-12T18:01:52.539597+0000","last_active":"2024-09-12T18:03:57.343499+0000","last_peered":"2024-09-12T18:03:57.343499+0000","last_clean":"2024-09-12T18:03:57.343499+0000","last_became_active":"2024-09-12T18:01:50.534559+0000","last_became_peered":"2024-09-12T18:01:50.534559+0000","last_unstale":"2024-09-12T18:03:57.343499+0000","last_undegraded":"2024-09-12T18:03:57.343499+0000","last_fullsized":"2024-09-12T18:03:57.343499+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:25.810333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097042299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":569,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.331687+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:03:57.331687+0000","last_peered":"2024-09-12T18:03:57.331687+0000","last_clean":"2024-09-12T18:03:57.331687+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:03:57.331687+0000","last_undegraded":"2024-09-12T18:03:57.331687+0000","last_fullsized":"2024-09-12T18:03:57.331687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":572,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342219+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:03:57.342219+0000","last_peered":"2024-09-12T18:03:57.342219+0000","last_clean":"2024-09-12T18:03:57.342219+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:03:57.342219+0000","last_undegraded":"2024-09-12T18:03:57.342219+0000","last_fullsized":"2024-09-12T18:03:57.342219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":358,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.343094+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:03:57.343094+0000","last_peered":"2024-09-12T18:03:57.343094+0000","last_clean":"2024-09-12T18:03:57.343094+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:03:57.343094+0000","last_undegraded":"2024-09-12T18:03:57.343094+0000","last_fullsized":"2024-09-12T18:03:57.343094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":612,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336279+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:03:57.336279+0000","last_peered":"2024-09-12T18:03:57.336279+0000","last_clean":"2024-09-12T18:03:57.336279+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:03:57.336279+0000","last_undegraded":"2024-09-12T18:03:57.336279+0000","last_fullsized":"2024-09-12T18:03:57.336279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":225,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333605+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:03:57.333605+0000","last_peered":"2024-09-12T18:03:57.333605+0000","last_clean":"2024-09-12T18:03:57.333605+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:03:57.333605+0000","last_undegraded":"2024-09-12T18:03:57.333605+0000","last_fullsized":"2024-09-12T18:03:57.333605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":342,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.344779+0000","last_change":"2024-09-12T18:03:51.372214+0000","last_active":"2024-09-12T18:03:57.344779+0000","last_peered":"2024-09-12T18:03:57.344779+0000","last_clean":"2024-09-12T18:03:57.344779+0000","last_became_active":"2024-09-12T18:03:51.371525+0000","last_became_peered":"2024-09-12T18:03:51.371525+0000","last_unstale":"2024-09-12T18:03:57.344779+0000","last_undegraded":"2024-09-12T18:03:57.344779+0000","last_fullsized":"2024-09-12T18:03:57.344779+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:05.078563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":705,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.338581+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:03:57.338581+0000","last_peered":"2024-09-12T18:03:57.338581+0000","last_clean":"2024-09-12T18:03:57.338581+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:03:57.338581+0000","last_undegraded":"2024-09-12T18:03:57.338581+0000","last_fullsized":"2024-09-12T18:03:57.338581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.338474+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:03:57.338474+0000","last_peered":"2024-09-12T18:03:57.338474+0000","last_clean":"2024-09-12T18:03:57.338474+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:03:57.338474+0000","last_undegraded":"2024-09-12T18:03:57.338474+0000","last_fullsized":"2024-09-12T18:03:57.338474+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":681,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335900+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:03:57.335900+0000","last_peered":"2024-09-12T18:03:57.335900+0000","last_clean":"2024-09-12T18:03:57.335900+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:03:57.335900+0000","last_undegraded":"2024-09-12T18:03:57.335900+0000","last_fullsized":"2024-09-12T18:03:57.335900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":536,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333942+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:03:57.333942+0000","last_peered":"2024-09-12T18:03:57.333942+0000","last_clean":"2024-09-12T18:03:57.333942+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:03:57.333942+0000","last_undegraded":"2024-09-12T18:03:57.333942+0000","last_fullsized":"2024-09-12T18:03:57.333942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":783,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336236+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:03:57.336236+0000","last_peered":"2024-09-12T18:03:57.336236+0000","last_clean":"2024-09-12T18:03:57.336236+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:03:57.336236+0000","last_undegraded":"2024-09-12T18:03:57.336236+0000","last_fullsized":"2024-09-12T18:03:57.336236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":655,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337544+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:03:57.337544+0000","last_peered":"2024-09-12T18:03:57.337544+0000","last_clean":"2024-09-12T18:03:57.337544+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:03:57.337544+0000","last_undegraded":"2024-09-12T18:03:57.337544+0000","last_fullsized":"2024-09-12T18:03:57.337544+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":356,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337076+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:03:57.337076+0000","last_peered":"2024-09-12T18:03:57.337076+0000","last_clean":"2024-09-12T18:03:57.337076+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:03:57.337076+0000","last_undegraded":"2024-09-12T18:03:57.337076+0000","last_fullsized":"2024-09-12T18:03:57.337076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":561,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332821+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:03:57.332821+0000","last_peered":"2024-09-12T18:03:57.332821+0000","last_clean":"2024-09-12T18:03:57.332821+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:03:57.332821+0000","last_undegraded":"2024-09-12T18:03:57.332821+0000","last_fullsized":"2024-09-12T18:03:57.332821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":344,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332117+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:03:57.332117+0000","last_peered":"2024-09-12T18:03:57.332117+0000","last_clean":"2024-09-12T18:03:57.332117+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:03:57.332117+0000","last_undegraded":"2024-09-12T18:03:57.332117+0000","last_fullsized":"2024-09-12T18:03:57.332117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1194,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332793+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:03:57.332793+0000","last_peered":"2024-09-12T18:03:57.332793+0000","last_clean":"2024-09-12T18:03:57.332793+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:03:57.332793+0000","last_undegraded":"2024-09-12T18:03:57.332793+0000","last_fullsized":"2024-09-12T18:03:57.332793+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":181,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332652+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:03:57.332652+0000","last_peered":"2024-09-12T18:03:57.332652+0000","last_clean":"2024-09-12T18:03:57.332652+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:03:57.332652+0000","last_undegraded":"2024-09-12T18:03:57.332652+0000","last_fullsized":"2024-09-12T18:03:57.332652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1195,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342235+0000","last_change":"2024-09-12T18:03:55.341147+0000","last_active":"2024-09-12T18:03:57.342235+0000","last_peered":"2024-09-12T18:03:57.342235+0000","last_clean":"2024-09-12T18:03:57.342235+0000","last_became_active":"2024-09-12T18:03:55.338222+0000","last_became_peered":"2024-09-12T18:03:55.338222+0000","last_unstale":"2024-09-12T18:03:57.342235+0000","last_undegraded":"2024-09-12T18:03:57.342235+0000","last_fullsized":"2024-09-12T18:03:57.342235+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:31.003898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":340,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342860+0000","last_change":"2024-09-12T18:03:51.371985+0000","last_active":"2024-09-12T18:03:57.342860+0000","last_peered":"2024-09-12T18:03:57.342860+0000","last_clean":"2024-09-12T18:03:57.342860+0000","last_became_active":"2024-09-12T18:03:51.371031+0000","last_became_peered":"2024-09-12T18:03:51.371031+0000","last_unstale":"2024-09-12T18:03:57.342860+0000","last_undegraded":"2024-09-12T18:03:57.342860+0000","last_fullsized":"2024-09-12T18:03:57.342860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:47.783150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1276,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.342206+0000","last_change":"2024-09-12T18:03:52.378736+0000","last_active":"2024-09-12T18:03:57.342206+0000","last_peered":"2024-09-12T18:03:57.342206+0000","last_clean":"2024-09-12T18:03:57.342206+0000","last_became_active":"2024-09-12T18:03:52.374218+0000","last_became_peered":"2024-09-12T18:03:52.374218+0000","last_unstale":"2024-09-12T18:03:57.342206+0000","last_undegraded":"2024-09-12T18:03:57.342206+0000","last_fullsized":"2024-09-12T18:03:57.342206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:24.098596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":407,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.333310+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:03:57.333310+0000","last_peered":"2024-09-12T18:03:57.333310+0000","last_clean":"2024-09-12T18:03:57.333310+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:03:57.333310+0000","last_undegraded":"2024-09-12T18:03:57.333310+0000","last_fullsized":"2024-09-12T18:03:57.333310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":547,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.332065+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:03:57.332065+0000","last_peered":"2024-09-12T18:03:57.332065+0000","last_clean":"2024-09-12T18:03:57.332065+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:03:57.332065+0000","last_undegraded":"2024-09-12T18:03:57.332065+0000","last_fullsized":"2024-09-12T18:03:57.332065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.337779+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:03:57.337779+0000","last_peered":"2024-09-12T18:03:57.337779+0000","last_clean":"2024-09-12T18:03:57.337779+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:03:57.337779+0000","last_undegraded":"2024-09-12T18:03:57.337779+0000","last_fullsized":"2024-09-12T18:03:57.337779+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":649,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.335826+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:03:57.335826+0000","last_peered":"2024-09-12T18:03:57.335826+0000","last_clean":"2024-09-12T18:03:57.335826+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:03:57.335826+0000","last_undegraded":"2024-09-12T18:03:57.335826+0000","last_fullsized":"2024-09-12T18:03:57.335826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":205,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-12T18:03:57.336915+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:03:57.336915+0000","last_peered":"2024-09-12T18:03:57.336915+0000","last_clean":"2024-09-12T18:03:57.336915+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:03:57.336915+0000","last_undegraded":"2024-09-12T18:03:57.336915+0000","last_fullsized":"2024-09-12T18:03:57.336915+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6248,"ondisk_log_size":6248,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738399,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121640,"kb_used_data":23888,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94250200,"statfs":{"total":96636764160,"available":96512204800,"internally_reserved":0,"allocated":24461312,"data_stored":81369280,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738399,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113820,"kb_used_data":28548,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94258020,"statfs":{"total":96636764160,"available":96520212480,"internally_reserved":0,"allocated":29233152,"data_stored":84690089,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118132,"kb_used_data":28704,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253708,"statfs":{"total":96636764160,"available":96515796992,"internally_reserved":0,"allocated":29392896,"data_stored":90452898,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:04:00.548 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:04:00.549 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T18:04:00.549 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T18:04:00.549 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.446657 2024-09-12T18:04:00.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.44665677092446243 2024-09-12T18:04:01.403 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.0 primary-affinity to 0.446657 (8292722) 2024-09-12T18:04:06.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T18:04:06.582 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a: {} 2024-09-12T18:04:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:04:06.591 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b: {} 2024-09-12T18:04:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:04:06.601 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c: {} 2024-09-12T18:04:06.602 INFO:teuthology.orchestra.run.smithi052.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T18:04:06.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T18:04:07.653 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T18:04:07.679 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T18:04:08.655 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T18:04:08.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T18:04:09.670 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T18:04:09.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T18:04:10.681 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T18:04:10.707 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T18:04:11.690 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T18:04:11.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T18:04:12.700 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T18:04:12.725 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T18:04:12.725 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T18:04:12.726 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T18:04:12.726 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T18:04:12.726 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T18:04:12.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:04:13.040 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:13.040 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":85,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:04:12.691343+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.2","osds":[0,1]},{"pgid":"4.22","osds":[0,2]},{"pgid":"4.31","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:04:13.060 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T18:04:13.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:04:13.373 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:13.374 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":85,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:04:12.691343+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.2","osds":[0,1]},{"pgid":"4.22","osds":[0,2]},{"pgid":"4.31","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:04:13.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T18:04:13.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T18:04:13.393 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T18:04:13.550 INFO:teuthology.orchestra.run.smithi052.stdout:34359738403 2024-09-12T18:04:13.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:04:13.554 INFO:teuthology.orchestra.run.smithi052.stdout:34359738403 2024-09-12T18:04:13.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:04:13.556 INFO:teuthology.orchestra.run.smithi052.stdout:34359738403 2024-09-12T18:04:13.557 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:04:13.850 INFO:teuthology.orchestra.run.smithi052.stdout:34359738401 2024-09-12T18:04:13.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738403 got 34359738401 for osd.0 2024-09-12T18:04:13.888 INFO:teuthology.orchestra.run.smithi052.stdout:34359738401 2024-09-12T18:04:13.901 INFO:teuthology.orchestra.run.smithi052.stdout:34359738401 2024-09-12T18:04:13.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738403 got 34359738401 for osd.1 2024-09-12T18:04:13.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738403 got 34359738401 for osd.2 2024-09-12T18:04:14.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:04:14.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:04:14.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:04:15.197 INFO:teuthology.orchestra.run.smithi052.stdout:34359738403 2024-09-12T18:04:15.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738403 got 34359738403 for osd.0 2024-09-12T18:04:15.215 DEBUG:teuthology.parallel:result is None 2024-09-12T18:04:15.218 INFO:teuthology.orchestra.run.smithi052.stdout:34359738403 2024-09-12T18:04:15.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738403 got 34359738403 for osd.2 2024-09-12T18:04:15.235 INFO:teuthology.orchestra.run.smithi052.stdout:34359738403 2024-09-12T18:04:15.236 DEBUG:teuthology.parallel:result is None 2024-09-12T18:04:15.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738403 got 34359738403 for osd.1 2024-09-12T18:04:15.253 DEBUG:teuthology.parallel:result is None 2024-09-12T18:04:15.253 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T18:04:15.253 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:04:15.596 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:15.597 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:04:15.615 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-12T18:04:14.593870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32952,"ondisk_log_size":32952,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":353800,"kb_used_data":81340,"kb_used_omap":4,"kb_used_meta":272379,"kb_avail":282761720,"statfs":{"total":289910292480,"available":289548001280,"internally_reserved":0,"allocated":83292160,"data_stored":256620290,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":278916431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":548,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.928142"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706444+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:04:12.706444+0000","last_peered":"2024-09-12T18:04:12.706444+0000","last_clean":"2024-09-12T18:04:12.706444+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:04:12.706444+0000","last_undegraded":"2024-09-12T18:04:12.706444+0000","last_fullsized":"2024-09-12T18:04:12.706444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705980+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:04:12.705980+0000","last_peered":"2024-09-12T18:04:12.705980+0000","last_clean":"2024-09-12T18:04:12.705980+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:04:12.705980+0000","last_undegraded":"2024-09-12T18:04:12.705980+0000","last_fullsized":"2024-09-12T18:04:12.705980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705200+0000","last_change":"2024-09-12T18:04:09.681163+0000","last_active":"2024-09-12T18:04:12.705200+0000","last_peered":"2024-09-12T18:04:12.705200+0000","last_clean":"2024-09-12T18:04:12.705200+0000","last_became_active":"2024-09-12T18:04:09.677098+0000","last_became_peered":"2024-09-12T18:04:09.677098+0000","last_unstale":"2024-09-12T18:04:12.705200+0000","last_undegraded":"2024-09-12T18:04:12.705200+0000","last_fullsized":"2024-09-12T18:04:12.705200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:22.899798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705006+0000","last_change":"2024-09-12T18:04:09.694526+0000","last_active":"2024-09-12T18:04:12.705006+0000","last_peered":"2024-09-12T18:04:12.705006+0000","last_clean":"2024-09-12T18:04:12.705006+0000","last_became_active":"2024-09-12T18:04:09.685115+0000","last_became_peered":"2024-09-12T18:04:09.685115+0000","last_unstale":"2024-09-12T18:04:12.705006+0000","last_undegraded":"2024-09-12T18:04:12.705006+0000","last_fullsized":"2024-09-12T18:04:12.705006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.108507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705679+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:04:12.705679+0000","last_peered":"2024-09-12T18:04:12.705679+0000","last_clean":"2024-09-12T18:04:12.705679+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:04:12.705679+0000","last_undegraded":"2024-09-12T18:04:12.705679+0000","last_fullsized":"2024-09-12T18:04:12.705679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704814+0000","last_change":"2024-09-12T18:04:09.697456+0000","last_active":"2024-09-12T18:04:12.704814+0000","last_peered":"2024-09-12T18:04:12.704814+0000","last_clean":"2024-09-12T18:04:12.704814+0000","last_became_active":"2024-09-12T18:04:09.691370+0000","last_became_peered":"2024-09-12T18:04:09.691370+0000","last_unstale":"2024-09-12T18:04:12.704814+0000","last_undegraded":"2024-09-12T18:04:12.704814+0000","last_fullsized":"2024-09-12T18:04:12.704814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705623+0000","last_change":"2024-09-12T18:04:09.694180+0000","last_active":"2024-09-12T18:04:12.705623+0000","last_peered":"2024-09-12T18:04:12.705623+0000","last_clean":"2024-09-12T18:04:12.705623+0000","last_became_active":"2024-09-12T18:04:09.686122+0000","last_became_peered":"2024-09-12T18:04:09.686122+0000","last_unstale":"2024-09-12T18:04:12.705623+0000","last_undegraded":"2024-09-12T18:04:12.705623+0000","last_fullsized":"2024-09-12T18:04:12.705623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:39.304422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":993,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704310+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:04:12.704310+0000","last_peered":"2024-09-12T18:04:12.704310+0000","last_clean":"2024-09-12T18:04:12.704310+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:04:12.704310+0000","last_undegraded":"2024-09-12T18:04:12.704310+0000","last_fullsized":"2024-09-12T18:04:12.704310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691592+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:04:11.691592+0000","last_peered":"2024-09-12T18:04:11.691592+0000","last_clean":"2024-09-12T18:04:11.691592+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:04:11.691592+0000","last_undegraded":"2024-09-12T18:04:11.691592+0000","last_fullsized":"2024-09-12T18:04:11.691592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1050,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706158+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:04:12.706158+0000","last_peered":"2024-09-12T18:04:12.706158+0000","last_clean":"2024-09-12T18:04:12.706158+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:04:12.706158+0000","last_undegraded":"2024-09-12T18:04:12.706158+0000","last_fullsized":"2024-09-12T18:04:12.706158+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705486+0000","last_change":"2024-09-12T18:04:09.685941+0000","last_active":"2024-09-12T18:04:12.705486+0000","last_peered":"2024-09-12T18:04:12.705486+0000","last_clean":"2024-09-12T18:04:12.705486+0000","last_became_active":"2024-09-12T18:04:09.681305+0000","last_became_peered":"2024-09-12T18:04:09.681305+0000","last_unstale":"2024-09-12T18:04:12.705486+0000","last_undegraded":"2024-09-12T18:04:12.705486+0000","last_fullsized":"2024-09-12T18:04:12.705486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:29.147388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":535,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705577+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:04:12.705577+0000","last_peered":"2024-09-12T18:04:12.705577+0000","last_clean":"2024-09-12T18:04:12.705577+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:04:12.705577+0000","last_undegraded":"2024-09-12T18:04:12.705577+0000","last_fullsized":"2024-09-12T18:04:12.705577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705397+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:04:12.705397+0000","last_peered":"2024-09-12T18:04:12.705397+0000","last_clean":"2024-09-12T18:04:12.705397+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:04:12.705397+0000","last_undegraded":"2024-09-12T18:04:12.705397+0000","last_fullsized":"2024-09-12T18:04:12.705397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":615,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704904+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:04:12.704904+0000","last_peered":"2024-09-12T18:04:12.704904+0000","last_clean":"2024-09-12T18:04:12.704904+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:04:12.704904+0000","last_undegraded":"2024-09-12T18:04:12.704904+0000","last_fullsized":"2024-09-12T18:04:12.704904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706583+0000","last_change":"2024-09-12T18:04:09.695076+0000","last_active":"2024-09-12T18:04:12.706583+0000","last_peered":"2024-09-12T18:04:12.706583+0000","last_clean":"2024-09-12T18:04:12.706583+0000","last_became_active":"2024-09-12T18:04:09.684858+0000","last_became_peered":"2024-09-12T18:04:09.684858+0000","last_unstale":"2024-09-12T18:04:12.706583+0000","last_undegraded":"2024-09-12T18:04:12.706583+0000","last_fullsized":"2024-09-12T18:04:12.706583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:14.097506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":685,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704492+0000","last_change":"2024-09-12T18:04:09.687477+0000","last_active":"2024-09-12T18:04:12.704492+0000","last_peered":"2024-09-12T18:04:12.704492+0000","last_clean":"2024-09-12T18:04:12.704492+0000","last_became_active":"2024-09-12T18:04:09.680510+0000","last_became_peered":"2024-09-12T18:04:09.680510+0000","last_unstale":"2024-09-12T18:04:12.704492+0000","last_undegraded":"2024-09-12T18:04:12.704492+0000","last_fullsized":"2024-09-12T18:04:12.704492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:53.703464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":605,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691939+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:04:11.691939+0000","last_peered":"2024-09-12T18:04:11.691939+0000","last_clean":"2024-09-12T18:04:11.691939+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:04:11.691939+0000","last_undegraded":"2024-09-12T18:04:11.691939+0000","last_fullsized":"2024-09-12T18:04:11.691939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":692,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706585+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:04:12.706585+0000","last_peered":"2024-09-12T18:04:12.706585+0000","last_clean":"2024-09-12T18:04:12.706585+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:04:12.706585+0000","last_undegraded":"2024-09-12T18:04:12.706585+0000","last_fullsized":"2024-09-12T18:04:12.706585+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":689,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690818+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:04:11.690818+0000","last_peered":"2024-09-12T18:04:11.690818+0000","last_clean":"2024-09-12T18:04:11.690818+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:04:11.690818+0000","last_undegraded":"2024-09-12T18:04:11.690818+0000","last_fullsized":"2024-09-12T18:04:11.690818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705083+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:04:12.705083+0000","last_peered":"2024-09-12T18:04:12.705083+0000","last_clean":"2024-09-12T18:04:12.705083+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:04:12.705083+0000","last_undegraded":"2024-09-12T18:04:12.705083+0000","last_fullsized":"2024-09-12T18:04:12.705083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":1000,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706891+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:04:12.706891+0000","last_peered":"2024-09-12T18:04:12.706891+0000","last_clean":"2024-09-12T18:04:12.706891+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:04:12.706891+0000","last_undegraded":"2024-09-12T18:04:12.706891+0000","last_fullsized":"2024-09-12T18:04:12.706891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704901+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:04:12.704901+0000","last_peered":"2024-09-12T18:04:12.704901+0000","last_clean":"2024-09-12T18:04:12.704901+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:04:12.704901+0000","last_undegraded":"2024-09-12T18:04:12.704901+0000","last_fullsized":"2024-09-12T18:04:12.704901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":931,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689822+0000","last_change":"2024-09-12T18:03:56.341786+0000","last_active":"2024-09-12T18:04:11.689822+0000","last_peered":"2024-09-12T18:04:11.689822+0000","last_clean":"2024-09-12T18:04:11.689822+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:04:11.689822+0000","last_undegraded":"2024-09-12T18:04:11.689822+0000","last_fullsized":"2024-09-12T18:04:11.689822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704364+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:04:12.704364+0000","last_peered":"2024-09-12T18:04:12.704364+0000","last_clean":"2024-09-12T18:04:12.704364+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:04:12.704364+0000","last_undegraded":"2024-09-12T18:04:12.704364+0000","last_fullsized":"2024-09-12T18:04:12.704364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706563+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:04:12.706563+0000","last_peered":"2024-09-12T18:04:12.706563+0000","last_clean":"2024-09-12T18:04:12.706563+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:04:12.706563+0000","last_undegraded":"2024-09-12T18:04:12.706563+0000","last_fullsized":"2024-09-12T18:04:12.706563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691216+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:04:11.691216+0000","last_peered":"2024-09-12T18:04:11.691216+0000","last_clean":"2024-09-12T18:04:11.691216+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:04:11.691216+0000","last_undegraded":"2024-09-12T18:04:11.691216+0000","last_fullsized":"2024-09-12T18:04:11.691216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705566+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:04:12.705566+0000","last_peered":"2024-09-12T18:04:12.705566+0000","last_clean":"2024-09-12T18:04:12.705566+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:04:12.705566+0000","last_undegraded":"2024-09-12T18:04:12.705566+0000","last_fullsized":"2024-09-12T18:04:12.705566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706212+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:04:12.706212+0000","last_peered":"2024-09-12T18:04:12.706212+0000","last_clean":"2024-09-12T18:04:12.706212+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:04:12.706212+0000","last_undegraded":"2024-09-12T18:04:12.706212+0000","last_fullsized":"2024-09-12T18:04:12.706212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":951,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690328+0000","last_change":"2024-09-12T18:03:56.344116+0000","last_active":"2024-09-12T18:04:11.690328+0000","last_peered":"2024-09-12T18:04:11.690328+0000","last_clean":"2024-09-12T18:04:11.690328+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:04:11.690328+0000","last_undegraded":"2024-09-12T18:04:11.690328+0000","last_fullsized":"2024-09-12T18:04:11.690328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704483+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:04:12.704483+0000","last_peered":"2024-09-12T18:04:12.704483+0000","last_clean":"2024-09-12T18:04:12.704483+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:04:12.704483+0000","last_undegraded":"2024-09-12T18:04:12.704483+0000","last_fullsized":"2024-09-12T18:04:12.704483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":1004,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689361+0000","last_change":"2024-09-12T18:03:57.344789+0000","last_active":"2024-09-12T18:04:11.689361+0000","last_peered":"2024-09-12T18:04:11.689361+0000","last_clean":"2024-09-12T18:04:11.689361+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:04:11.689361+0000","last_undegraded":"2024-09-12T18:04:11.689361+0000","last_fullsized":"2024-09-12T18:04:11.689361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704604+0000","last_change":"2024-09-12T18:04:09.687125+0000","last_active":"2024-09-12T18:04:12.704604+0000","last_peered":"2024-09-12T18:04:12.704604+0000","last_clean":"2024-09-12T18:04:12.704604+0000","last_became_active":"2024-09-12T18:04:09.680177+0000","last_became_peered":"2024-09-12T18:04:09.680177+0000","last_unstale":"2024-09-12T18:04:12.704604+0000","last_undegraded":"2024-09-12T18:04:12.704604+0000","last_fullsized":"2024-09-12T18:04:12.704604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705931+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:04:12.705931+0000","last_peered":"2024-09-12T18:04:12.705931+0000","last_clean":"2024-09-12T18:04:12.705931+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:04:12.705931+0000","last_undegraded":"2024-09-12T18:04:12.705931+0000","last_fullsized":"2024-09-12T18:04:12.705931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707039+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:04:12.707039+0000","last_peered":"2024-09-12T18:04:12.707039+0000","last_clean":"2024-09-12T18:04:12.707039+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:04:12.707039+0000","last_undegraded":"2024-09-12T18:04:12.707039+0000","last_fullsized":"2024-09-12T18:04:12.707039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":562,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706416+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:04:12.706416+0000","last_peered":"2024-09-12T18:04:12.706416+0000","last_clean":"2024-09-12T18:04:12.706416+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:04:12.706416+0000","last_undegraded":"2024-09-12T18:04:12.706416+0000","last_fullsized":"2024-09-12T18:04:12.706416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":193,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690488+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:04:11.690488+0000","last_peered":"2024-09-12T18:04:11.690488+0000","last_clean":"2024-09-12T18:04:11.690488+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:04:11.690488+0000","last_undegraded":"2024-09-12T18:04:11.690488+0000","last_fullsized":"2024-09-12T18:04:11.690488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691699+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:04:11.691699+0000","last_peered":"2024-09-12T18:04:11.691699+0000","last_clean":"2024-09-12T18:04:11.691699+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:04:11.691699+0000","last_undegraded":"2024-09-12T18:04:11.691699+0000","last_fullsized":"2024-09-12T18:04:11.691699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704763+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:04:12.704763+0000","last_peered":"2024-09-12T18:04:12.704763+0000","last_clean":"2024-09-12T18:04:12.704763+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:04:12.704763+0000","last_undegraded":"2024-09-12T18:04:12.704763+0000","last_fullsized":"2024-09-12T18:04:12.704763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690883+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:04:11.690883+0000","last_peered":"2024-09-12T18:04:11.690883+0000","last_clean":"2024-09-12T18:04:11.690883+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:04:11.690883+0000","last_undegraded":"2024-09-12T18:04:11.690883+0000","last_fullsized":"2024-09-12T18:04:11.690883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":208,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704780+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:04:12.704780+0000","last_peered":"2024-09-12T18:04:12.704780+0000","last_clean":"2024-09-12T18:04:12.704780+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:04:12.704780+0000","last_undegraded":"2024-09-12T18:04:12.704780+0000","last_fullsized":"2024-09-12T18:04:12.704780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":286,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706247+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:04:12.706247+0000","last_peered":"2024-09-12T18:04:12.706247+0000","last_clean":"2024-09-12T18:04:12.706247+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:04:12.706247+0000","last_undegraded":"2024-09-12T18:04:12.706247+0000","last_fullsized":"2024-09-12T18:04:12.706247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704427+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:04:12.704427+0000","last_peered":"2024-09-12T18:04:12.704427+0000","last_clean":"2024-09-12T18:04:12.704427+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:04:12.704427+0000","last_undegraded":"2024-09-12T18:04:12.704427+0000","last_fullsized":"2024-09-12T18:04:12.704427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":397,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706623+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:04:12.706623+0000","last_peered":"2024-09-12T18:04:12.706623+0000","last_clean":"2024-09-12T18:04:12.706623+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:04:12.706623+0000","last_undegraded":"2024-09-12T18:04:12.706623+0000","last_fullsized":"2024-09-12T18:04:12.706623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1468,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704401+0000","last_change":"2024-09-12T18:03:53.336888+0000","last_active":"2024-09-12T18:04:12.704401+0000","last_peered":"2024-09-12T18:04:12.704401+0000","last_clean":"2024-09-12T18:04:12.704401+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:04:12.704401+0000","last_undegraded":"2024-09-12T18:04:12.704401+0000","last_fullsized":"2024-09-12T18:04:12.704401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706190+0000","last_change":"2024-09-12T18:04:09.686572+0000","last_active":"2024-09-12T18:04:12.706190+0000","last_peered":"2024-09-12T18:04:12.706190+0000","last_clean":"2024-09-12T18:04:12.706190+0000","last_became_active":"2024-09-12T18:04:09.682207+0000","last_became_peered":"2024-09-12T18:04:09.682207+0000","last_unstale":"2024-09-12T18:04:12.706190+0000","last_undegraded":"2024-09-12T18:04:12.706190+0000","last_fullsized":"2024-09-12T18:04:12.706190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:19.750113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705239+0000","last_change":"2024-09-12T18:04:09.694336+0000","last_active":"2024-09-12T18:04:12.705239+0000","last_peered":"2024-09-12T18:04:12.705239+0000","last_clean":"2024-09-12T18:04:12.705239+0000","last_became_active":"2024-09-12T18:04:09.681881+0000","last_became_peered":"2024-09-12T18:04:09.681881+0000","last_unstale":"2024-09-12T18:04:12.705239+0000","last_undegraded":"2024-09-12T18:04:12.705239+0000","last_fullsized":"2024-09-12T18:04:12.705239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:08.728289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":202,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706249+0000","last_change":"2024-09-12T18:04:09.695023+0000","last_active":"2024-09-12T18:04:12.706249+0000","last_peered":"2024-09-12T18:04:12.706249+0000","last_clean":"2024-09-12T18:04:12.706249+0000","last_became_active":"2024-09-12T18:04:09.692860+0000","last_became_peered":"2024-09-12T18:04:09.692860+0000","last_unstale":"2024-09-12T18:04:12.706249+0000","last_undegraded":"2024-09-12T18:04:12.706249+0000","last_fullsized":"2024-09-12T18:04:12.706249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:22.990905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":647,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690399+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:04:11.690399+0000","last_peered":"2024-09-12T18:04:11.690399+0000","last_clean":"2024-09-12T18:04:11.690399+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:04:11.690399+0000","last_undegraded":"2024-09-12T18:04:11.690399+0000","last_fullsized":"2024-09-12T18:04:11.690399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691540+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:04:11.691540+0000","last_peered":"2024-09-12T18:04:11.691540+0000","last_clean":"2024-09-12T18:04:11.691540+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:04:11.691540+0000","last_undegraded":"2024-09-12T18:04:11.691540+0000","last_fullsized":"2024-09-12T18:04:11.691540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705390+0000","last_change":"2024-09-12T18:04:09.694162+0000","last_active":"2024-09-12T18:04:12.705390+0000","last_peered":"2024-09-12T18:04:12.705390+0000","last_clean":"2024-09-12T18:04:12.705390+0000","last_became_active":"2024-09-12T18:04:09.686387+0000","last_became_peered":"2024-09-12T18:04:09.686387+0000","last_unstale":"2024-09-12T18:04:12.705390+0000","last_undegraded":"2024-09-12T18:04:12.705390+0000","last_fullsized":"2024-09-12T18:04:12.705390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:22.543587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706189+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:04:12.706189+0000","last_peered":"2024-09-12T18:04:12.706189+0000","last_clean":"2024-09-12T18:04:12.706189+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:04:12.706189+0000","last_undegraded":"2024-09-12T18:04:12.706189+0000","last_fullsized":"2024-09-12T18:04:12.706189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705919+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:04:12.705919+0000","last_peered":"2024-09-12T18:04:12.705919+0000","last_clean":"2024-09-12T18:04:12.705919+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:04:12.705919+0000","last_undegraded":"2024-09-12T18:04:12.705919+0000","last_fullsized":"2024-09-12T18:04:12.705919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":199,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704923+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:04:12.704923+0000","last_peered":"2024-09-12T18:04:12.704923+0000","last_clean":"2024-09-12T18:04:12.704923+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:04:12.704923+0000","last_undegraded":"2024-09-12T18:04:12.704923+0000","last_fullsized":"2024-09-12T18:04:12.704923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705970+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:04:12.705970+0000","last_peered":"2024-09-12T18:04:12.705970+0000","last_clean":"2024-09-12T18:04:12.705970+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:04:12.705970+0000","last_undegraded":"2024-09-12T18:04:12.705970+0000","last_fullsized":"2024-09-12T18:04:12.705970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704648+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:04:12.704648+0000","last_peered":"2024-09-12T18:04:12.704648+0000","last_clean":"2024-09-12T18:04:12.704648+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:04:12.704648+0000","last_undegraded":"2024-09-12T18:04:12.704648+0000","last_fullsized":"2024-09-12T18:04:12.704648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691197+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:04:11.691197+0000","last_peered":"2024-09-12T18:04:11.691197+0000","last_clean":"2024-09-12T18:04:11.691197+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:04:11.691197+0000","last_undegraded":"2024-09-12T18:04:11.691197+0000","last_fullsized":"2024-09-12T18:04:11.691197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705995+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:04:12.705995+0000","last_peered":"2024-09-12T18:04:12.705995+0000","last_clean":"2024-09-12T18:04:12.705995+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:04:12.705995+0000","last_undegraded":"2024-09-12T18:04:12.705995+0000","last_fullsized":"2024-09-12T18:04:12.705995+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707193+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:04:12.707193+0000","last_peered":"2024-09-12T18:04:12.707193+0000","last_clean":"2024-09-12T18:04:12.707193+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:04:12.707193+0000","last_undegraded":"2024-09-12T18:04:12.707193+0000","last_fullsized":"2024-09-12T18:04:12.707193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":713,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690829+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:04:11.690829+0000","last_peered":"2024-09-12T18:04:11.690829+0000","last_clean":"2024-09-12T18:04:11.690829+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:04:11.690829+0000","last_undegraded":"2024-09-12T18:04:11.690829+0000","last_fullsized":"2024-09-12T18:04:11.690829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":609,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706016+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:04:12.706016+0000","last_peered":"2024-09-12T18:04:12.706016+0000","last_clean":"2024-09-12T18:04:12.706016+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:04:12.706016+0000","last_undegraded":"2024-09-12T18:04:12.706016+0000","last_fullsized":"2024-09-12T18:04:12.706016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705822+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:04:12.705822+0000","last_peered":"2024-09-12T18:04:12.705822+0000","last_clean":"2024-09-12T18:04:12.705822+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:04:12.705822+0000","last_undegraded":"2024-09-12T18:04:12.705822+0000","last_fullsized":"2024-09-12T18:04:12.705822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":342,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689704+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:04:11.689704+0000","last_peered":"2024-09-12T18:04:11.689704+0000","last_clean":"2024-09-12T18:04:11.689704+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:04:11.689704+0000","last_undegraded":"2024-09-12T18:04:11.689704+0000","last_fullsized":"2024-09-12T18:04:11.689704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706251+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:04:12.706251+0000","last_peered":"2024-09-12T18:04:12.706251+0000","last_clean":"2024-09-12T18:04:12.706251+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:04:12.706251+0000","last_undegraded":"2024-09-12T18:04:12.706251+0000","last_fullsized":"2024-09-12T18:04:12.706251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691575+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:04:11.691575+0000","last_peered":"2024-09-12T18:04:11.691575+0000","last_clean":"2024-09-12T18:04:11.691575+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:04:11.691575+0000","last_undegraded":"2024-09-12T18:04:11.691575+0000","last_fullsized":"2024-09-12T18:04:11.691575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704735+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:04:12.704735+0000","last_peered":"2024-09-12T18:04:12.704735+0000","last_clean":"2024-09-12T18:04:12.704735+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:04:12.704735+0000","last_undegraded":"2024-09-12T18:04:12.704735+0000","last_fullsized":"2024-09-12T18:04:12.704735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":811,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690607+0000","last_change":"2024-09-12T18:03:54.334607+0000","last_active":"2024-09-12T18:04:11.690607+0000","last_peered":"2024-09-12T18:04:11.690607+0000","last_clean":"2024-09-12T18:04:11.690607+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:04:11.690607+0000","last_undegraded":"2024-09-12T18:04:11.690607+0000","last_fullsized":"2024-09-12T18:04:11.690607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:27.565973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706554+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:04:12.706554+0000","last_peered":"2024-09-12T18:04:12.706554+0000","last_clean":"2024-09-12T18:04:12.706554+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:04:12.706554+0000","last_undegraded":"2024-09-12T18:04:12.706554+0000","last_fullsized":"2024-09-12T18:04:12.706554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":222,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707067+0000","last_change":"2024-09-12T18:04:09.697006+0000","last_active":"2024-09-12T18:04:12.707067+0000","last_peered":"2024-09-12T18:04:12.707067+0000","last_clean":"2024-09-12T18:04:12.707067+0000","last_became_active":"2024-09-12T18:04:09.686200+0000","last_became_peered":"2024-09-12T18:04:09.686200+0000","last_unstale":"2024-09-12T18:04:12.707067+0000","last_undegraded":"2024-09-12T18:04:12.707067+0000","last_fullsized":"2024-09-12T18:04:12.707067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:17.012774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691405+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:04:11.691405+0000","last_peered":"2024-09-12T18:04:11.691405+0000","last_clean":"2024-09-12T18:04:11.691405+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:04:11.691405+0000","last_undegraded":"2024-09-12T18:04:11.691405+0000","last_fullsized":"2024-09-12T18:04:11.691405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":448,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706291+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:04:12.706291+0000","last_peered":"2024-09-12T18:04:12.706291+0000","last_clean":"2024-09-12T18:04:12.706291+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:04:12.706291+0000","last_undegraded":"2024-09-12T18:04:12.706291+0000","last_fullsized":"2024-09-12T18:04:12.706291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691578+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:04:11.691578+0000","last_peered":"2024-09-12T18:04:11.691578+0000","last_clean":"2024-09-12T18:04:11.691578+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:04:11.691578+0000","last_undegraded":"2024-09-12T18:04:11.691578+0000","last_fullsized":"2024-09-12T18:04:11.691578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704996+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:04:12.704996+0000","last_peered":"2024-09-12T18:04:12.704996+0000","last_clean":"2024-09-12T18:04:12.704996+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:04:12.704996+0000","last_undegraded":"2024-09-12T18:04:12.704996+0000","last_fullsized":"2024-09-12T18:04:12.704996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690358+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:04:11.690358+0000","last_peered":"2024-09-12T18:04:11.690358+0000","last_clean":"2024-09-12T18:04:11.690358+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:04:11.690358+0000","last_undegraded":"2024-09-12T18:04:11.690358+0000","last_fullsized":"2024-09-12T18:04:11.690358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707020+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:04:12.707020+0000","last_peered":"2024-09-12T18:04:12.707020+0000","last_clean":"2024-09-12T18:04:12.707020+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:04:12.707020+0000","last_undegraded":"2024-09-12T18:04:12.707020+0000","last_fullsized":"2024-09-12T18:04:12.707020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":558,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705573+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:04:12.705573+0000","last_peered":"2024-09-12T18:04:12.705573+0000","last_clean":"2024-09-12T18:04:12.705573+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:04:12.705573+0000","last_undegraded":"2024-09-12T18:04:12.705573+0000","last_fullsized":"2024-09-12T18:04:12.705573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691531+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:04:11.691531+0000","last_peered":"2024-09-12T18:04:11.691531+0000","last_clean":"2024-09-12T18:04:11.691531+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:04:11.691531+0000","last_undegraded":"2024-09-12T18:04:11.691531+0000","last_fullsized":"2024-09-12T18:04:11.691531+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690336+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:04:11.690336+0000","last_peered":"2024-09-12T18:04:11.690336+0000","last_clean":"2024-09-12T18:04:11.690336+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:04:11.690336+0000","last_undegraded":"2024-09-12T18:04:11.690336+0000","last_fullsized":"2024-09-12T18:04:11.690336+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":573,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689659+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:04:11.689659+0000","last_peered":"2024-09-12T18:04:11.689659+0000","last_clean":"2024-09-12T18:04:11.689659+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:04:11.689659+0000","last_undegraded":"2024-09-12T18:04:11.689659+0000","last_fullsized":"2024-09-12T18:04:11.689659+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"72'114","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691584+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:04:11.691584+0000","last_peered":"2024-09-12T18:04:11.691584+0000","last_clean":"2024-09-12T18:04:11.691584+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:04:11.691584+0000","last_undegraded":"2024-09-12T18:04:11.691584+0000","last_fullsized":"2024-09-12T18:04:11.691584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706764+0000","last_change":"2024-09-12T18:04:09.677962+0000","last_active":"2024-09-12T18:04:12.706764+0000","last_peered":"2024-09-12T18:04:12.706764+0000","last_clean":"2024-09-12T18:04:12.706764+0000","last_became_active":"2024-09-12T18:04:09.677062+0000","last_became_peered":"2024-09-12T18:04:09.677062+0000","last_unstale":"2024-09-12T18:04:12.706764+0000","last_undegraded":"2024-09-12T18:04:12.706764+0000","last_fullsized":"2024-09-12T18:04:12.706764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:17.652687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704592+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:04:12.704592+0000","last_peered":"2024-09-12T18:04:12.704592+0000","last_clean":"2024-09-12T18:04:12.704592+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:04:12.704592+0000","last_undegraded":"2024-09-12T18:04:12.704592+0000","last_fullsized":"2024-09-12T18:04:12.704592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":588,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706604+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:04:12.706604+0000","last_peered":"2024-09-12T18:04:12.706604+0000","last_clean":"2024-09-12T18:04:12.706604+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:04:12.706604+0000","last_undegraded":"2024-09-12T18:04:12.706604+0000","last_fullsized":"2024-09-12T18:04:12.706604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705957+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:04:12.705957+0000","last_peered":"2024-09-12T18:04:12.705957+0000","last_clean":"2024-09-12T18:04:12.705957+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:04:12.705957+0000","last_undegraded":"2024-09-12T18:04:12.705957+0000","last_fullsized":"2024-09-12T18:04:12.705957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":625,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690149+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:04:11.690149+0000","last_peered":"2024-09-12T18:04:11.690149+0000","last_clean":"2024-09-12T18:04:11.690149+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:04:11.690149+0000","last_undegraded":"2024-09-12T18:04:11.690149+0000","last_fullsized":"2024-09-12T18:04:11.690149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":241,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706935+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:04:12.706935+0000","last_peered":"2024-09-12T18:04:12.706935+0000","last_clean":"2024-09-12T18:04:12.706935+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:04:12.706935+0000","last_undegraded":"2024-09-12T18:04:12.706935+0000","last_fullsized":"2024-09-12T18:04:12.706935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":358,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706436+0000","last_change":"2024-09-12T18:04:09.685980+0000","last_active":"2024-09-12T18:04:12.706436+0000","last_peered":"2024-09-12T18:04:12.706436+0000","last_clean":"2024-09-12T18:04:12.706436+0000","last_became_active":"2024-09-12T18:04:09.682878+0000","last_became_peered":"2024-09-12T18:04:09.682878+0000","last_unstale":"2024-09-12T18:04:12.706436+0000","last_undegraded":"2024-09-12T18:04:12.706436+0000","last_fullsized":"2024-09-12T18:04:12.706436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":718,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691128+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:04:11.691128+0000","last_peered":"2024-09-12T18:04:11.691128+0000","last_clean":"2024-09-12T18:04:11.691128+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:04:11.691128+0000","last_undegraded":"2024-09-12T18:04:11.691128+0000","last_fullsized":"2024-09-12T18:04:11.691128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691277+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:04:11.691277+0000","last_peered":"2024-09-12T18:04:11.691277+0000","last_clean":"2024-09-12T18:04:11.691277+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:04:11.691277+0000","last_undegraded":"2024-09-12T18:04:11.691277+0000","last_fullsized":"2024-09-12T18:04:11.691277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":694,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689505+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:04:11.689505+0000","last_peered":"2024-09-12T18:04:11.689505+0000","last_clean":"2024-09-12T18:04:11.689505+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:04:11.689505+0000","last_undegraded":"2024-09-12T18:04:11.689505+0000","last_fullsized":"2024-09-12T18:04:11.689505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706629+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:04:12.706629+0000","last_peered":"2024-09-12T18:04:12.706629+0000","last_clean":"2024-09-12T18:04:12.706629+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:04:12.706629+0000","last_undegraded":"2024-09-12T18:04:12.706629+0000","last_fullsized":"2024-09-12T18:04:12.706629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":796,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689874+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:04:11.689874+0000","last_peered":"2024-09-12T18:04:11.689874+0000","last_clean":"2024-09-12T18:04:11.689874+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:04:11.689874+0000","last_undegraded":"2024-09-12T18:04:11.689874+0000","last_fullsized":"2024-09-12T18:04:11.689874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":668,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691035+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:04:11.691035+0000","last_peered":"2024-09-12T18:04:11.691035+0000","last_clean":"2024-09-12T18:04:11.691035+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:04:11.691035+0000","last_undegraded":"2024-09-12T18:04:11.691035+0000","last_fullsized":"2024-09-12T18:04:11.691035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":369,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689515+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:04:11.689515+0000","last_peered":"2024-09-12T18:04:11.689515+0000","last_clean":"2024-09-12T18:04:11.689515+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:04:11.689515+0000","last_undegraded":"2024-09-12T18:04:11.689515+0000","last_fullsized":"2024-09-12T18:04:11.689515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705907+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:04:12.705907+0000","last_peered":"2024-09-12T18:04:12.705907+0000","last_clean":"2024-09-12T18:04:12.705907+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:04:12.705907+0000","last_undegraded":"2024-09-12T18:04:12.705907+0000","last_fullsized":"2024-09-12T18:04:12.705907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":360,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705227+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:04:12.705227+0000","last_peered":"2024-09-12T18:04:12.705227+0000","last_clean":"2024-09-12T18:04:12.705227+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:04:12.705227+0000","last_undegraded":"2024-09-12T18:04:12.705227+0000","last_fullsized":"2024-09-12T18:04:12.705227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705628+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:04:12.705628+0000","last_peered":"2024-09-12T18:04:12.705628+0000","last_clean":"2024-09-12T18:04:12.705628+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:04:12.705628+0000","last_undegraded":"2024-09-12T18:04:12.705628+0000","last_fullsized":"2024-09-12T18:04:12.705628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":197,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705941+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:04:12.705941+0000","last_peered":"2024-09-12T18:04:12.705941+0000","last_clean":"2024-09-12T18:04:12.705941+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:04:12.705941+0000","last_undegraded":"2024-09-12T18:04:12.705941+0000","last_fullsized":"2024-09-12T18:04:12.705941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706584+0000","last_change":"2024-09-12T18:04:09.697861+0000","last_active":"2024-09-12T18:04:12.706584+0000","last_peered":"2024-09-12T18:04:12.706584+0000","last_clean":"2024-09-12T18:04:12.706584+0000","last_became_active":"2024-09-12T18:04:09.688026+0000","last_became_peered":"2024-09-12T18:04:09.688026+0000","last_unstale":"2024-09-12T18:04:12.706584+0000","last_undegraded":"2024-09-12T18:04:12.706584+0000","last_fullsized":"2024-09-12T18:04:12.706584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.825721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705675+0000","last_change":"2024-09-12T18:04:09.695422+0000","last_active":"2024-09-12T18:04:12.705675+0000","last_peered":"2024-09-12T18:04:12.705675+0000","last_clean":"2024-09-12T18:04:12.705675+0000","last_became_active":"2024-09-12T18:04:09.692975+0000","last_became_peered":"2024-09-12T18:04:09.692975+0000","last_unstale":"2024-09-12T18:04:12.705675+0000","last_undegraded":"2024-09-12T18:04:12.705675+0000","last_fullsized":"2024-09-12T18:04:12.705675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.708997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1292,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705908+0000","last_change":"2024-09-12T18:04:09.693020+0000","last_active":"2024-09-12T18:04:12.705908+0000","last_peered":"2024-09-12T18:04:12.705908+0000","last_clean":"2024-09-12T18:04:12.705908+0000","last_became_active":"2024-09-12T18:04:09.684915+0000","last_became_peered":"2024-09-12T18:04:09.684915+0000","last_unstale":"2024-09-12T18:04:12.705908+0000","last_undegraded":"2024-09-12T18:04:12.705908+0000","last_fullsized":"2024-09-12T18:04:12.705908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:27.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":423,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706634+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:04:12.706634+0000","last_peered":"2024-09-12T18:04:12.706634+0000","last_clean":"2024-09-12T18:04:12.706634+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:04:12.706634+0000","last_undegraded":"2024-09-12T18:04:12.706634+0000","last_fullsized":"2024-09-12T18:04:12.706634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":563,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704948+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:04:12.704948+0000","last_peered":"2024-09-12T18:04:12.704948+0000","last_clean":"2024-09-12T18:04:12.704948+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:04:12.704948+0000","last_undegraded":"2024-09-12T18:04:12.704948+0000","last_fullsized":"2024-09-12T18:04:12.704948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691316+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:04:11.691316+0000","last_peered":"2024-09-12T18:04:11.691316+0000","last_clean":"2024-09-12T18:04:11.691316+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:04:11.691316+0000","last_undegraded":"2024-09-12T18:04:11.691316+0000","last_fullsized":"2024-09-12T18:04:11.691316+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704907+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:04:12.704907+0000","last_peered":"2024-09-12T18:04:12.704907+0000","last_clean":"2024-09-12T18:04:12.704907+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:04:12.704907+0000","last_undegraded":"2024-09-12T18:04:12.704907+0000","last_fullsized":"2024-09-12T18:04:12.704907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690565+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:04:11.690565+0000","last_peered":"2024-09-12T18:04:11.690565+0000","last_clean":"2024-09-12T18:04:11.690565+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:04:11.690565+0000","last_undegraded":"2024-09-12T18:04:11.690565+0000","last_fullsized":"2024-09-12T18:04:11.690565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6248,"ondisk_log_size":6248,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121704,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":24526848,"data_stored":81403848,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738403,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113888,"kb_used_data":28612,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94257952,"statfs":{"total":96636764160,"available":96520142848,"internally_reserved":0,"allocated":29298688,"data_stored":84724657,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738403,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118208,"kb_used_data":28776,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253632,"statfs":{"total":96636764160,"available":96515719168,"internally_reserved":0,"allocated":29466624,"data_stored":90491785,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:04:15.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:04:15.980 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:15.982 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:04:15.999 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-12T18:04:14.593870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32952,"ondisk_log_size":32952,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":353800,"kb_used_data":81340,"kb_used_omap":4,"kb_used_meta":272379,"kb_avail":282761720,"statfs":{"total":289910292480,"available":289548001280,"internally_reserved":0,"allocated":83292160,"data_stored":256620290,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":278916431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":548,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.928142"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706444+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:04:12.706444+0000","last_peered":"2024-09-12T18:04:12.706444+0000","last_clean":"2024-09-12T18:04:12.706444+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:04:12.706444+0000","last_undegraded":"2024-09-12T18:04:12.706444+0000","last_fullsized":"2024-09-12T18:04:12.706444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705980+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:04:12.705980+0000","last_peered":"2024-09-12T18:04:12.705980+0000","last_clean":"2024-09-12T18:04:12.705980+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:04:12.705980+0000","last_undegraded":"2024-09-12T18:04:12.705980+0000","last_fullsized":"2024-09-12T18:04:12.705980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705200+0000","last_change":"2024-09-12T18:04:09.681163+0000","last_active":"2024-09-12T18:04:12.705200+0000","last_peered":"2024-09-12T18:04:12.705200+0000","last_clean":"2024-09-12T18:04:12.705200+0000","last_became_active":"2024-09-12T18:04:09.677098+0000","last_became_peered":"2024-09-12T18:04:09.677098+0000","last_unstale":"2024-09-12T18:04:12.705200+0000","last_undegraded":"2024-09-12T18:04:12.705200+0000","last_fullsized":"2024-09-12T18:04:12.705200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:22.899798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705006+0000","last_change":"2024-09-12T18:04:09.694526+0000","last_active":"2024-09-12T18:04:12.705006+0000","last_peered":"2024-09-12T18:04:12.705006+0000","last_clean":"2024-09-12T18:04:12.705006+0000","last_became_active":"2024-09-12T18:04:09.685115+0000","last_became_peered":"2024-09-12T18:04:09.685115+0000","last_unstale":"2024-09-12T18:04:12.705006+0000","last_undegraded":"2024-09-12T18:04:12.705006+0000","last_fullsized":"2024-09-12T18:04:12.705006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.108507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705679+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:04:12.705679+0000","last_peered":"2024-09-12T18:04:12.705679+0000","last_clean":"2024-09-12T18:04:12.705679+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:04:12.705679+0000","last_undegraded":"2024-09-12T18:04:12.705679+0000","last_fullsized":"2024-09-12T18:04:12.705679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704814+0000","last_change":"2024-09-12T18:04:09.697456+0000","last_active":"2024-09-12T18:04:12.704814+0000","last_peered":"2024-09-12T18:04:12.704814+0000","last_clean":"2024-09-12T18:04:12.704814+0000","last_became_active":"2024-09-12T18:04:09.691370+0000","last_became_peered":"2024-09-12T18:04:09.691370+0000","last_unstale":"2024-09-12T18:04:12.704814+0000","last_undegraded":"2024-09-12T18:04:12.704814+0000","last_fullsized":"2024-09-12T18:04:12.704814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705623+0000","last_change":"2024-09-12T18:04:09.694180+0000","last_active":"2024-09-12T18:04:12.705623+0000","last_peered":"2024-09-12T18:04:12.705623+0000","last_clean":"2024-09-12T18:04:12.705623+0000","last_became_active":"2024-09-12T18:04:09.686122+0000","last_became_peered":"2024-09-12T18:04:09.686122+0000","last_unstale":"2024-09-12T18:04:12.705623+0000","last_undegraded":"2024-09-12T18:04:12.705623+0000","last_fullsized":"2024-09-12T18:04:12.705623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:39.304422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":993,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704310+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:04:12.704310+0000","last_peered":"2024-09-12T18:04:12.704310+0000","last_clean":"2024-09-12T18:04:12.704310+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:04:12.704310+0000","last_undegraded":"2024-09-12T18:04:12.704310+0000","last_fullsized":"2024-09-12T18:04:12.704310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691592+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:04:11.691592+0000","last_peered":"2024-09-12T18:04:11.691592+0000","last_clean":"2024-09-12T18:04:11.691592+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:04:11.691592+0000","last_undegraded":"2024-09-12T18:04:11.691592+0000","last_fullsized":"2024-09-12T18:04:11.691592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1050,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706158+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:04:12.706158+0000","last_peered":"2024-09-12T18:04:12.706158+0000","last_clean":"2024-09-12T18:04:12.706158+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:04:12.706158+0000","last_undegraded":"2024-09-12T18:04:12.706158+0000","last_fullsized":"2024-09-12T18:04:12.706158+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705486+0000","last_change":"2024-09-12T18:04:09.685941+0000","last_active":"2024-09-12T18:04:12.705486+0000","last_peered":"2024-09-12T18:04:12.705486+0000","last_clean":"2024-09-12T18:04:12.705486+0000","last_became_active":"2024-09-12T18:04:09.681305+0000","last_became_peered":"2024-09-12T18:04:09.681305+0000","last_unstale":"2024-09-12T18:04:12.705486+0000","last_undegraded":"2024-09-12T18:04:12.705486+0000","last_fullsized":"2024-09-12T18:04:12.705486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:29.147388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":535,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705577+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:04:12.705577+0000","last_peered":"2024-09-12T18:04:12.705577+0000","last_clean":"2024-09-12T18:04:12.705577+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:04:12.705577+0000","last_undegraded":"2024-09-12T18:04:12.705577+0000","last_fullsized":"2024-09-12T18:04:12.705577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705397+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:04:12.705397+0000","last_peered":"2024-09-12T18:04:12.705397+0000","last_clean":"2024-09-12T18:04:12.705397+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:04:12.705397+0000","last_undegraded":"2024-09-12T18:04:12.705397+0000","last_fullsized":"2024-09-12T18:04:12.705397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":615,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704904+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:04:12.704904+0000","last_peered":"2024-09-12T18:04:12.704904+0000","last_clean":"2024-09-12T18:04:12.704904+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:04:12.704904+0000","last_undegraded":"2024-09-12T18:04:12.704904+0000","last_fullsized":"2024-09-12T18:04:12.704904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706583+0000","last_change":"2024-09-12T18:04:09.695076+0000","last_active":"2024-09-12T18:04:12.706583+0000","last_peered":"2024-09-12T18:04:12.706583+0000","last_clean":"2024-09-12T18:04:12.706583+0000","last_became_active":"2024-09-12T18:04:09.684858+0000","last_became_peered":"2024-09-12T18:04:09.684858+0000","last_unstale":"2024-09-12T18:04:12.706583+0000","last_undegraded":"2024-09-12T18:04:12.706583+0000","last_fullsized":"2024-09-12T18:04:12.706583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:14.097506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":685,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704492+0000","last_change":"2024-09-12T18:04:09.687477+0000","last_active":"2024-09-12T18:04:12.704492+0000","last_peered":"2024-09-12T18:04:12.704492+0000","last_clean":"2024-09-12T18:04:12.704492+0000","last_became_active":"2024-09-12T18:04:09.680510+0000","last_became_peered":"2024-09-12T18:04:09.680510+0000","last_unstale":"2024-09-12T18:04:12.704492+0000","last_undegraded":"2024-09-12T18:04:12.704492+0000","last_fullsized":"2024-09-12T18:04:12.704492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:53.703464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":605,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691939+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:04:11.691939+0000","last_peered":"2024-09-12T18:04:11.691939+0000","last_clean":"2024-09-12T18:04:11.691939+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:04:11.691939+0000","last_undegraded":"2024-09-12T18:04:11.691939+0000","last_fullsized":"2024-09-12T18:04:11.691939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":692,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706585+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:04:12.706585+0000","last_peered":"2024-09-12T18:04:12.706585+0000","last_clean":"2024-09-12T18:04:12.706585+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:04:12.706585+0000","last_undegraded":"2024-09-12T18:04:12.706585+0000","last_fullsized":"2024-09-12T18:04:12.706585+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":689,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690818+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:04:11.690818+0000","last_peered":"2024-09-12T18:04:11.690818+0000","last_clean":"2024-09-12T18:04:11.690818+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:04:11.690818+0000","last_undegraded":"2024-09-12T18:04:11.690818+0000","last_fullsized":"2024-09-12T18:04:11.690818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705083+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:04:12.705083+0000","last_peered":"2024-09-12T18:04:12.705083+0000","last_clean":"2024-09-12T18:04:12.705083+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:04:12.705083+0000","last_undegraded":"2024-09-12T18:04:12.705083+0000","last_fullsized":"2024-09-12T18:04:12.705083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":1000,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706891+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:04:12.706891+0000","last_peered":"2024-09-12T18:04:12.706891+0000","last_clean":"2024-09-12T18:04:12.706891+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:04:12.706891+0000","last_undegraded":"2024-09-12T18:04:12.706891+0000","last_fullsized":"2024-09-12T18:04:12.706891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704901+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:04:12.704901+0000","last_peered":"2024-09-12T18:04:12.704901+0000","last_clean":"2024-09-12T18:04:12.704901+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:04:12.704901+0000","last_undegraded":"2024-09-12T18:04:12.704901+0000","last_fullsized":"2024-09-12T18:04:12.704901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":931,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689822+0000","last_change":"2024-09-12T18:03:56.341786+0000","last_active":"2024-09-12T18:04:11.689822+0000","last_peered":"2024-09-12T18:04:11.689822+0000","last_clean":"2024-09-12T18:04:11.689822+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:04:11.689822+0000","last_undegraded":"2024-09-12T18:04:11.689822+0000","last_fullsized":"2024-09-12T18:04:11.689822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704364+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:04:12.704364+0000","last_peered":"2024-09-12T18:04:12.704364+0000","last_clean":"2024-09-12T18:04:12.704364+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:04:12.704364+0000","last_undegraded":"2024-09-12T18:04:12.704364+0000","last_fullsized":"2024-09-12T18:04:12.704364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706563+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:04:12.706563+0000","last_peered":"2024-09-12T18:04:12.706563+0000","last_clean":"2024-09-12T18:04:12.706563+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:04:12.706563+0000","last_undegraded":"2024-09-12T18:04:12.706563+0000","last_fullsized":"2024-09-12T18:04:12.706563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691216+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:04:11.691216+0000","last_peered":"2024-09-12T18:04:11.691216+0000","last_clean":"2024-09-12T18:04:11.691216+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:04:11.691216+0000","last_undegraded":"2024-09-12T18:04:11.691216+0000","last_fullsized":"2024-09-12T18:04:11.691216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705566+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:04:12.705566+0000","last_peered":"2024-09-12T18:04:12.705566+0000","last_clean":"2024-09-12T18:04:12.705566+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:04:12.705566+0000","last_undegraded":"2024-09-12T18:04:12.705566+0000","last_fullsized":"2024-09-12T18:04:12.705566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706212+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:04:12.706212+0000","last_peered":"2024-09-12T18:04:12.706212+0000","last_clean":"2024-09-12T18:04:12.706212+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:04:12.706212+0000","last_undegraded":"2024-09-12T18:04:12.706212+0000","last_fullsized":"2024-09-12T18:04:12.706212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":951,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690328+0000","last_change":"2024-09-12T18:03:56.344116+0000","last_active":"2024-09-12T18:04:11.690328+0000","last_peered":"2024-09-12T18:04:11.690328+0000","last_clean":"2024-09-12T18:04:11.690328+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:04:11.690328+0000","last_undegraded":"2024-09-12T18:04:11.690328+0000","last_fullsized":"2024-09-12T18:04:11.690328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704483+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:04:12.704483+0000","last_peered":"2024-09-12T18:04:12.704483+0000","last_clean":"2024-09-12T18:04:12.704483+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:04:12.704483+0000","last_undegraded":"2024-09-12T18:04:12.704483+0000","last_fullsized":"2024-09-12T18:04:12.704483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":1004,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689361+0000","last_change":"2024-09-12T18:03:57.344789+0000","last_active":"2024-09-12T18:04:11.689361+0000","last_peered":"2024-09-12T18:04:11.689361+0000","last_clean":"2024-09-12T18:04:11.689361+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:04:11.689361+0000","last_undegraded":"2024-09-12T18:04:11.689361+0000","last_fullsized":"2024-09-12T18:04:11.689361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704604+0000","last_change":"2024-09-12T18:04:09.687125+0000","last_active":"2024-09-12T18:04:12.704604+0000","last_peered":"2024-09-12T18:04:12.704604+0000","last_clean":"2024-09-12T18:04:12.704604+0000","last_became_active":"2024-09-12T18:04:09.680177+0000","last_became_peered":"2024-09-12T18:04:09.680177+0000","last_unstale":"2024-09-12T18:04:12.704604+0000","last_undegraded":"2024-09-12T18:04:12.704604+0000","last_fullsized":"2024-09-12T18:04:12.704604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705931+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:04:12.705931+0000","last_peered":"2024-09-12T18:04:12.705931+0000","last_clean":"2024-09-12T18:04:12.705931+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:04:12.705931+0000","last_undegraded":"2024-09-12T18:04:12.705931+0000","last_fullsized":"2024-09-12T18:04:12.705931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707039+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:04:12.707039+0000","last_peered":"2024-09-12T18:04:12.707039+0000","last_clean":"2024-09-12T18:04:12.707039+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:04:12.707039+0000","last_undegraded":"2024-09-12T18:04:12.707039+0000","last_fullsized":"2024-09-12T18:04:12.707039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":562,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706416+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:04:12.706416+0000","last_peered":"2024-09-12T18:04:12.706416+0000","last_clean":"2024-09-12T18:04:12.706416+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:04:12.706416+0000","last_undegraded":"2024-09-12T18:04:12.706416+0000","last_fullsized":"2024-09-12T18:04:12.706416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":193,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690488+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:04:11.690488+0000","last_peered":"2024-09-12T18:04:11.690488+0000","last_clean":"2024-09-12T18:04:11.690488+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:04:11.690488+0000","last_undegraded":"2024-09-12T18:04:11.690488+0000","last_fullsized":"2024-09-12T18:04:11.690488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691699+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:04:11.691699+0000","last_peered":"2024-09-12T18:04:11.691699+0000","last_clean":"2024-09-12T18:04:11.691699+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:04:11.691699+0000","last_undegraded":"2024-09-12T18:04:11.691699+0000","last_fullsized":"2024-09-12T18:04:11.691699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704763+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:04:12.704763+0000","last_peered":"2024-09-12T18:04:12.704763+0000","last_clean":"2024-09-12T18:04:12.704763+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:04:12.704763+0000","last_undegraded":"2024-09-12T18:04:12.704763+0000","last_fullsized":"2024-09-12T18:04:12.704763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690883+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:04:11.690883+0000","last_peered":"2024-09-12T18:04:11.690883+0000","last_clean":"2024-09-12T18:04:11.690883+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:04:11.690883+0000","last_undegraded":"2024-09-12T18:04:11.690883+0000","last_fullsized":"2024-09-12T18:04:11.690883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":208,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704780+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:04:12.704780+0000","last_peered":"2024-09-12T18:04:12.704780+0000","last_clean":"2024-09-12T18:04:12.704780+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:04:12.704780+0000","last_undegraded":"2024-09-12T18:04:12.704780+0000","last_fullsized":"2024-09-12T18:04:12.704780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":286,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706247+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:04:12.706247+0000","last_peered":"2024-09-12T18:04:12.706247+0000","last_clean":"2024-09-12T18:04:12.706247+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:04:12.706247+0000","last_undegraded":"2024-09-12T18:04:12.706247+0000","last_fullsized":"2024-09-12T18:04:12.706247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704427+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:04:12.704427+0000","last_peered":"2024-09-12T18:04:12.704427+0000","last_clean":"2024-09-12T18:04:12.704427+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:04:12.704427+0000","last_undegraded":"2024-09-12T18:04:12.704427+0000","last_fullsized":"2024-09-12T18:04:12.704427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":397,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706623+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:04:12.706623+0000","last_peered":"2024-09-12T18:04:12.706623+0000","last_clean":"2024-09-12T18:04:12.706623+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:04:12.706623+0000","last_undegraded":"2024-09-12T18:04:12.706623+0000","last_fullsized":"2024-09-12T18:04:12.706623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1468,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704401+0000","last_change":"2024-09-12T18:03:53.336888+0000","last_active":"2024-09-12T18:04:12.704401+0000","last_peered":"2024-09-12T18:04:12.704401+0000","last_clean":"2024-09-12T18:04:12.704401+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:04:12.704401+0000","last_undegraded":"2024-09-12T18:04:12.704401+0000","last_fullsized":"2024-09-12T18:04:12.704401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706190+0000","last_change":"2024-09-12T18:04:09.686572+0000","last_active":"2024-09-12T18:04:12.706190+0000","last_peered":"2024-09-12T18:04:12.706190+0000","last_clean":"2024-09-12T18:04:12.706190+0000","last_became_active":"2024-09-12T18:04:09.682207+0000","last_became_peered":"2024-09-12T18:04:09.682207+0000","last_unstale":"2024-09-12T18:04:12.706190+0000","last_undegraded":"2024-09-12T18:04:12.706190+0000","last_fullsized":"2024-09-12T18:04:12.706190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:19.750113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705239+0000","last_change":"2024-09-12T18:04:09.694336+0000","last_active":"2024-09-12T18:04:12.705239+0000","last_peered":"2024-09-12T18:04:12.705239+0000","last_clean":"2024-09-12T18:04:12.705239+0000","last_became_active":"2024-09-12T18:04:09.681881+0000","last_became_peered":"2024-09-12T18:04:09.681881+0000","last_unstale":"2024-09-12T18:04:12.705239+0000","last_undegraded":"2024-09-12T18:04:12.705239+0000","last_fullsized":"2024-09-12T18:04:12.705239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:08.728289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":202,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706249+0000","last_change":"2024-09-12T18:04:09.695023+0000","last_active":"2024-09-12T18:04:12.706249+0000","last_peered":"2024-09-12T18:04:12.706249+0000","last_clean":"2024-09-12T18:04:12.706249+0000","last_became_active":"2024-09-12T18:04:09.692860+0000","last_became_peered":"2024-09-12T18:04:09.692860+0000","last_unstale":"2024-09-12T18:04:12.706249+0000","last_undegraded":"2024-09-12T18:04:12.706249+0000","last_fullsized":"2024-09-12T18:04:12.706249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:22.990905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":647,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690399+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:04:11.690399+0000","last_peered":"2024-09-12T18:04:11.690399+0000","last_clean":"2024-09-12T18:04:11.690399+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:04:11.690399+0000","last_undegraded":"2024-09-12T18:04:11.690399+0000","last_fullsized":"2024-09-12T18:04:11.690399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691540+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:04:11.691540+0000","last_peered":"2024-09-12T18:04:11.691540+0000","last_clean":"2024-09-12T18:04:11.691540+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:04:11.691540+0000","last_undegraded":"2024-09-12T18:04:11.691540+0000","last_fullsized":"2024-09-12T18:04:11.691540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705390+0000","last_change":"2024-09-12T18:04:09.694162+0000","last_active":"2024-09-12T18:04:12.705390+0000","last_peered":"2024-09-12T18:04:12.705390+0000","last_clean":"2024-09-12T18:04:12.705390+0000","last_became_active":"2024-09-12T18:04:09.686387+0000","last_became_peered":"2024-09-12T18:04:09.686387+0000","last_unstale":"2024-09-12T18:04:12.705390+0000","last_undegraded":"2024-09-12T18:04:12.705390+0000","last_fullsized":"2024-09-12T18:04:12.705390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:22.543587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706189+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:04:12.706189+0000","last_peered":"2024-09-12T18:04:12.706189+0000","last_clean":"2024-09-12T18:04:12.706189+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:04:12.706189+0000","last_undegraded":"2024-09-12T18:04:12.706189+0000","last_fullsized":"2024-09-12T18:04:12.706189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705919+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:04:12.705919+0000","last_peered":"2024-09-12T18:04:12.705919+0000","last_clean":"2024-09-12T18:04:12.705919+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:04:12.705919+0000","last_undegraded":"2024-09-12T18:04:12.705919+0000","last_fullsized":"2024-09-12T18:04:12.705919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":199,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704923+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:04:12.704923+0000","last_peered":"2024-09-12T18:04:12.704923+0000","last_clean":"2024-09-12T18:04:12.704923+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:04:12.704923+0000","last_undegraded":"2024-09-12T18:04:12.704923+0000","last_fullsized":"2024-09-12T18:04:12.704923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705970+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:04:12.705970+0000","last_peered":"2024-09-12T18:04:12.705970+0000","last_clean":"2024-09-12T18:04:12.705970+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:04:12.705970+0000","last_undegraded":"2024-09-12T18:04:12.705970+0000","last_fullsized":"2024-09-12T18:04:12.705970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704648+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:04:12.704648+0000","last_peered":"2024-09-12T18:04:12.704648+0000","last_clean":"2024-09-12T18:04:12.704648+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:04:12.704648+0000","last_undegraded":"2024-09-12T18:04:12.704648+0000","last_fullsized":"2024-09-12T18:04:12.704648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691197+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:04:11.691197+0000","last_peered":"2024-09-12T18:04:11.691197+0000","last_clean":"2024-09-12T18:04:11.691197+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:04:11.691197+0000","last_undegraded":"2024-09-12T18:04:11.691197+0000","last_fullsized":"2024-09-12T18:04:11.691197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705995+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:04:12.705995+0000","last_peered":"2024-09-12T18:04:12.705995+0000","last_clean":"2024-09-12T18:04:12.705995+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:04:12.705995+0000","last_undegraded":"2024-09-12T18:04:12.705995+0000","last_fullsized":"2024-09-12T18:04:12.705995+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707193+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:04:12.707193+0000","last_peered":"2024-09-12T18:04:12.707193+0000","last_clean":"2024-09-12T18:04:12.707193+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:04:12.707193+0000","last_undegraded":"2024-09-12T18:04:12.707193+0000","last_fullsized":"2024-09-12T18:04:12.707193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":713,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690829+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:04:11.690829+0000","last_peered":"2024-09-12T18:04:11.690829+0000","last_clean":"2024-09-12T18:04:11.690829+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:04:11.690829+0000","last_undegraded":"2024-09-12T18:04:11.690829+0000","last_fullsized":"2024-09-12T18:04:11.690829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":609,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706016+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:04:12.706016+0000","last_peered":"2024-09-12T18:04:12.706016+0000","last_clean":"2024-09-12T18:04:12.706016+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:04:12.706016+0000","last_undegraded":"2024-09-12T18:04:12.706016+0000","last_fullsized":"2024-09-12T18:04:12.706016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705822+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:04:12.705822+0000","last_peered":"2024-09-12T18:04:12.705822+0000","last_clean":"2024-09-12T18:04:12.705822+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:04:12.705822+0000","last_undegraded":"2024-09-12T18:04:12.705822+0000","last_fullsized":"2024-09-12T18:04:12.705822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":342,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689704+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:04:11.689704+0000","last_peered":"2024-09-12T18:04:11.689704+0000","last_clean":"2024-09-12T18:04:11.689704+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:04:11.689704+0000","last_undegraded":"2024-09-12T18:04:11.689704+0000","last_fullsized":"2024-09-12T18:04:11.689704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706251+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:04:12.706251+0000","last_peered":"2024-09-12T18:04:12.706251+0000","last_clean":"2024-09-12T18:04:12.706251+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:04:12.706251+0000","last_undegraded":"2024-09-12T18:04:12.706251+0000","last_fullsized":"2024-09-12T18:04:12.706251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691575+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:04:11.691575+0000","last_peered":"2024-09-12T18:04:11.691575+0000","last_clean":"2024-09-12T18:04:11.691575+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:04:11.691575+0000","last_undegraded":"2024-09-12T18:04:11.691575+0000","last_fullsized":"2024-09-12T18:04:11.691575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704735+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:04:12.704735+0000","last_peered":"2024-09-12T18:04:12.704735+0000","last_clean":"2024-09-12T18:04:12.704735+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:04:12.704735+0000","last_undegraded":"2024-09-12T18:04:12.704735+0000","last_fullsized":"2024-09-12T18:04:12.704735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":811,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690607+0000","last_change":"2024-09-12T18:03:54.334607+0000","last_active":"2024-09-12T18:04:11.690607+0000","last_peered":"2024-09-12T18:04:11.690607+0000","last_clean":"2024-09-12T18:04:11.690607+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:04:11.690607+0000","last_undegraded":"2024-09-12T18:04:11.690607+0000","last_fullsized":"2024-09-12T18:04:11.690607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:27.565973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706554+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:04:12.706554+0000","last_peered":"2024-09-12T18:04:12.706554+0000","last_clean":"2024-09-12T18:04:12.706554+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:04:12.706554+0000","last_undegraded":"2024-09-12T18:04:12.706554+0000","last_fullsized":"2024-09-12T18:04:12.706554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":222,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707067+0000","last_change":"2024-09-12T18:04:09.697006+0000","last_active":"2024-09-12T18:04:12.707067+0000","last_peered":"2024-09-12T18:04:12.707067+0000","last_clean":"2024-09-12T18:04:12.707067+0000","last_became_active":"2024-09-12T18:04:09.686200+0000","last_became_peered":"2024-09-12T18:04:09.686200+0000","last_unstale":"2024-09-12T18:04:12.707067+0000","last_undegraded":"2024-09-12T18:04:12.707067+0000","last_fullsized":"2024-09-12T18:04:12.707067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:17.012774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691405+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:04:11.691405+0000","last_peered":"2024-09-12T18:04:11.691405+0000","last_clean":"2024-09-12T18:04:11.691405+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:04:11.691405+0000","last_undegraded":"2024-09-12T18:04:11.691405+0000","last_fullsized":"2024-09-12T18:04:11.691405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":448,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706291+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:04:12.706291+0000","last_peered":"2024-09-12T18:04:12.706291+0000","last_clean":"2024-09-12T18:04:12.706291+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:04:12.706291+0000","last_undegraded":"2024-09-12T18:04:12.706291+0000","last_fullsized":"2024-09-12T18:04:12.706291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691578+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:04:11.691578+0000","last_peered":"2024-09-12T18:04:11.691578+0000","last_clean":"2024-09-12T18:04:11.691578+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:04:11.691578+0000","last_undegraded":"2024-09-12T18:04:11.691578+0000","last_fullsized":"2024-09-12T18:04:11.691578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704996+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:04:12.704996+0000","last_peered":"2024-09-12T18:04:12.704996+0000","last_clean":"2024-09-12T18:04:12.704996+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:04:12.704996+0000","last_undegraded":"2024-09-12T18:04:12.704996+0000","last_fullsized":"2024-09-12T18:04:12.704996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690358+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:04:11.690358+0000","last_peered":"2024-09-12T18:04:11.690358+0000","last_clean":"2024-09-12T18:04:11.690358+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:04:11.690358+0000","last_undegraded":"2024-09-12T18:04:11.690358+0000","last_fullsized":"2024-09-12T18:04:11.690358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707020+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:04:12.707020+0000","last_peered":"2024-09-12T18:04:12.707020+0000","last_clean":"2024-09-12T18:04:12.707020+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:04:12.707020+0000","last_undegraded":"2024-09-12T18:04:12.707020+0000","last_fullsized":"2024-09-12T18:04:12.707020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":558,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705573+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:04:12.705573+0000","last_peered":"2024-09-12T18:04:12.705573+0000","last_clean":"2024-09-12T18:04:12.705573+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:04:12.705573+0000","last_undegraded":"2024-09-12T18:04:12.705573+0000","last_fullsized":"2024-09-12T18:04:12.705573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691531+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:04:11.691531+0000","last_peered":"2024-09-12T18:04:11.691531+0000","last_clean":"2024-09-12T18:04:11.691531+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:04:11.691531+0000","last_undegraded":"2024-09-12T18:04:11.691531+0000","last_fullsized":"2024-09-12T18:04:11.691531+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690336+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:04:11.690336+0000","last_peered":"2024-09-12T18:04:11.690336+0000","last_clean":"2024-09-12T18:04:11.690336+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:04:11.690336+0000","last_undegraded":"2024-09-12T18:04:11.690336+0000","last_fullsized":"2024-09-12T18:04:11.690336+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":573,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689659+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:04:11.689659+0000","last_peered":"2024-09-12T18:04:11.689659+0000","last_clean":"2024-09-12T18:04:11.689659+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:04:11.689659+0000","last_undegraded":"2024-09-12T18:04:11.689659+0000","last_fullsized":"2024-09-12T18:04:11.689659+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"72'114","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691584+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:04:11.691584+0000","last_peered":"2024-09-12T18:04:11.691584+0000","last_clean":"2024-09-12T18:04:11.691584+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:04:11.691584+0000","last_undegraded":"2024-09-12T18:04:11.691584+0000","last_fullsized":"2024-09-12T18:04:11.691584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706764+0000","last_change":"2024-09-12T18:04:09.677962+0000","last_active":"2024-09-12T18:04:12.706764+0000","last_peered":"2024-09-12T18:04:12.706764+0000","last_clean":"2024-09-12T18:04:12.706764+0000","last_became_active":"2024-09-12T18:04:09.677062+0000","last_became_peered":"2024-09-12T18:04:09.677062+0000","last_unstale":"2024-09-12T18:04:12.706764+0000","last_undegraded":"2024-09-12T18:04:12.706764+0000","last_fullsized":"2024-09-12T18:04:12.706764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:17.652687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704592+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:04:12.704592+0000","last_peered":"2024-09-12T18:04:12.704592+0000","last_clean":"2024-09-12T18:04:12.704592+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:04:12.704592+0000","last_undegraded":"2024-09-12T18:04:12.704592+0000","last_fullsized":"2024-09-12T18:04:12.704592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":588,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706604+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:04:12.706604+0000","last_peered":"2024-09-12T18:04:12.706604+0000","last_clean":"2024-09-12T18:04:12.706604+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:04:12.706604+0000","last_undegraded":"2024-09-12T18:04:12.706604+0000","last_fullsized":"2024-09-12T18:04:12.706604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705957+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:04:12.705957+0000","last_peered":"2024-09-12T18:04:12.705957+0000","last_clean":"2024-09-12T18:04:12.705957+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:04:12.705957+0000","last_undegraded":"2024-09-12T18:04:12.705957+0000","last_fullsized":"2024-09-12T18:04:12.705957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":625,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690149+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:04:11.690149+0000","last_peered":"2024-09-12T18:04:11.690149+0000","last_clean":"2024-09-12T18:04:11.690149+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:04:11.690149+0000","last_undegraded":"2024-09-12T18:04:11.690149+0000","last_fullsized":"2024-09-12T18:04:11.690149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":241,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706935+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:04:12.706935+0000","last_peered":"2024-09-12T18:04:12.706935+0000","last_clean":"2024-09-12T18:04:12.706935+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:04:12.706935+0000","last_undegraded":"2024-09-12T18:04:12.706935+0000","last_fullsized":"2024-09-12T18:04:12.706935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":358,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706436+0000","last_change":"2024-09-12T18:04:09.685980+0000","last_active":"2024-09-12T18:04:12.706436+0000","last_peered":"2024-09-12T18:04:12.706436+0000","last_clean":"2024-09-12T18:04:12.706436+0000","last_became_active":"2024-09-12T18:04:09.682878+0000","last_became_peered":"2024-09-12T18:04:09.682878+0000","last_unstale":"2024-09-12T18:04:12.706436+0000","last_undegraded":"2024-09-12T18:04:12.706436+0000","last_fullsized":"2024-09-12T18:04:12.706436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":718,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691128+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:04:11.691128+0000","last_peered":"2024-09-12T18:04:11.691128+0000","last_clean":"2024-09-12T18:04:11.691128+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:04:11.691128+0000","last_undegraded":"2024-09-12T18:04:11.691128+0000","last_fullsized":"2024-09-12T18:04:11.691128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691277+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:04:11.691277+0000","last_peered":"2024-09-12T18:04:11.691277+0000","last_clean":"2024-09-12T18:04:11.691277+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:04:11.691277+0000","last_undegraded":"2024-09-12T18:04:11.691277+0000","last_fullsized":"2024-09-12T18:04:11.691277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":694,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689505+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:04:11.689505+0000","last_peered":"2024-09-12T18:04:11.689505+0000","last_clean":"2024-09-12T18:04:11.689505+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:04:11.689505+0000","last_undegraded":"2024-09-12T18:04:11.689505+0000","last_fullsized":"2024-09-12T18:04:11.689505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706629+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:04:12.706629+0000","last_peered":"2024-09-12T18:04:12.706629+0000","last_clean":"2024-09-12T18:04:12.706629+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:04:12.706629+0000","last_undegraded":"2024-09-12T18:04:12.706629+0000","last_fullsized":"2024-09-12T18:04:12.706629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":796,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689874+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:04:11.689874+0000","last_peered":"2024-09-12T18:04:11.689874+0000","last_clean":"2024-09-12T18:04:11.689874+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:04:11.689874+0000","last_undegraded":"2024-09-12T18:04:11.689874+0000","last_fullsized":"2024-09-12T18:04:11.689874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":668,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691035+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:04:11.691035+0000","last_peered":"2024-09-12T18:04:11.691035+0000","last_clean":"2024-09-12T18:04:11.691035+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:04:11.691035+0000","last_undegraded":"2024-09-12T18:04:11.691035+0000","last_fullsized":"2024-09-12T18:04:11.691035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":369,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689515+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:04:11.689515+0000","last_peered":"2024-09-12T18:04:11.689515+0000","last_clean":"2024-09-12T18:04:11.689515+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:04:11.689515+0000","last_undegraded":"2024-09-12T18:04:11.689515+0000","last_fullsized":"2024-09-12T18:04:11.689515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705907+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:04:12.705907+0000","last_peered":"2024-09-12T18:04:12.705907+0000","last_clean":"2024-09-12T18:04:12.705907+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:04:12.705907+0000","last_undegraded":"2024-09-12T18:04:12.705907+0000","last_fullsized":"2024-09-12T18:04:12.705907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":360,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705227+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:04:12.705227+0000","last_peered":"2024-09-12T18:04:12.705227+0000","last_clean":"2024-09-12T18:04:12.705227+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:04:12.705227+0000","last_undegraded":"2024-09-12T18:04:12.705227+0000","last_fullsized":"2024-09-12T18:04:12.705227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705628+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:04:12.705628+0000","last_peered":"2024-09-12T18:04:12.705628+0000","last_clean":"2024-09-12T18:04:12.705628+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:04:12.705628+0000","last_undegraded":"2024-09-12T18:04:12.705628+0000","last_fullsized":"2024-09-12T18:04:12.705628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":197,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705941+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:04:12.705941+0000","last_peered":"2024-09-12T18:04:12.705941+0000","last_clean":"2024-09-12T18:04:12.705941+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:04:12.705941+0000","last_undegraded":"2024-09-12T18:04:12.705941+0000","last_fullsized":"2024-09-12T18:04:12.705941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706584+0000","last_change":"2024-09-12T18:04:09.697861+0000","last_active":"2024-09-12T18:04:12.706584+0000","last_peered":"2024-09-12T18:04:12.706584+0000","last_clean":"2024-09-12T18:04:12.706584+0000","last_became_active":"2024-09-12T18:04:09.688026+0000","last_became_peered":"2024-09-12T18:04:09.688026+0000","last_unstale":"2024-09-12T18:04:12.706584+0000","last_undegraded":"2024-09-12T18:04:12.706584+0000","last_fullsized":"2024-09-12T18:04:12.706584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.825721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705675+0000","last_change":"2024-09-12T18:04:09.695422+0000","last_active":"2024-09-12T18:04:12.705675+0000","last_peered":"2024-09-12T18:04:12.705675+0000","last_clean":"2024-09-12T18:04:12.705675+0000","last_became_active":"2024-09-12T18:04:09.692975+0000","last_became_peered":"2024-09-12T18:04:09.692975+0000","last_unstale":"2024-09-12T18:04:12.705675+0000","last_undegraded":"2024-09-12T18:04:12.705675+0000","last_fullsized":"2024-09-12T18:04:12.705675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.708997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1292,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705908+0000","last_change":"2024-09-12T18:04:09.693020+0000","last_active":"2024-09-12T18:04:12.705908+0000","last_peered":"2024-09-12T18:04:12.705908+0000","last_clean":"2024-09-12T18:04:12.705908+0000","last_became_active":"2024-09-12T18:04:09.684915+0000","last_became_peered":"2024-09-12T18:04:09.684915+0000","last_unstale":"2024-09-12T18:04:12.705908+0000","last_undegraded":"2024-09-12T18:04:12.705908+0000","last_fullsized":"2024-09-12T18:04:12.705908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:27.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":423,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706634+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:04:12.706634+0000","last_peered":"2024-09-12T18:04:12.706634+0000","last_clean":"2024-09-12T18:04:12.706634+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:04:12.706634+0000","last_undegraded":"2024-09-12T18:04:12.706634+0000","last_fullsized":"2024-09-12T18:04:12.706634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":563,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704948+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:04:12.704948+0000","last_peered":"2024-09-12T18:04:12.704948+0000","last_clean":"2024-09-12T18:04:12.704948+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:04:12.704948+0000","last_undegraded":"2024-09-12T18:04:12.704948+0000","last_fullsized":"2024-09-12T18:04:12.704948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691316+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:04:11.691316+0000","last_peered":"2024-09-12T18:04:11.691316+0000","last_clean":"2024-09-12T18:04:11.691316+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:04:11.691316+0000","last_undegraded":"2024-09-12T18:04:11.691316+0000","last_fullsized":"2024-09-12T18:04:11.691316+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704907+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:04:12.704907+0000","last_peered":"2024-09-12T18:04:12.704907+0000","last_clean":"2024-09-12T18:04:12.704907+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:04:12.704907+0000","last_undegraded":"2024-09-12T18:04:12.704907+0000","last_fullsized":"2024-09-12T18:04:12.704907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690565+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:04:11.690565+0000","last_peered":"2024-09-12T18:04:11.690565+0000","last_clean":"2024-09-12T18:04:11.690565+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:04:11.690565+0000","last_undegraded":"2024-09-12T18:04:11.690565+0000","last_fullsized":"2024-09-12T18:04:11.690565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6248,"ondisk_log_size":6248,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121704,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":24526848,"data_stored":81403848,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738403,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113888,"kb_used_data":28612,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94257952,"statfs":{"total":96636764160,"available":96520142848,"internally_reserved":0,"allocated":29298688,"data_stored":84724657,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738403,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118208,"kb_used_data":28776,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253632,"statfs":{"total":96636764160,"available":96515719168,"internally_reserved":0,"allocated":29466624,"data_stored":90491785,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:04:16.003 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T18:04:16.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T18:04:16.372 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T18:04:16.382 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:04:16.382 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:04:16.691 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:16.693 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:04:16.709 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-12T18:04:16.594787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32952,"ondisk_log_size":32952,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":353800,"kb_used_data":81340,"kb_used_omap":4,"kb_used_meta":272379,"kb_avail":282761720,"statfs":{"total":289910292480,"available":289548001280,"internally_reserved":0,"allocated":83292160,"data_stored":256620290,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":278916431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":548,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002040"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706444+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:04:12.706444+0000","last_peered":"2024-09-12T18:04:12.706444+0000","last_clean":"2024-09-12T18:04:12.706444+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:04:12.706444+0000","last_undegraded":"2024-09-12T18:04:12.706444+0000","last_fullsized":"2024-09-12T18:04:12.706444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705980+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:04:12.705980+0000","last_peered":"2024-09-12T18:04:12.705980+0000","last_clean":"2024-09-12T18:04:12.705980+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:04:12.705980+0000","last_undegraded":"2024-09-12T18:04:12.705980+0000","last_fullsized":"2024-09-12T18:04:12.705980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705200+0000","last_change":"2024-09-12T18:04:09.681163+0000","last_active":"2024-09-12T18:04:12.705200+0000","last_peered":"2024-09-12T18:04:12.705200+0000","last_clean":"2024-09-12T18:04:12.705200+0000","last_became_active":"2024-09-12T18:04:09.677098+0000","last_became_peered":"2024-09-12T18:04:09.677098+0000","last_unstale":"2024-09-12T18:04:12.705200+0000","last_undegraded":"2024-09-12T18:04:12.705200+0000","last_fullsized":"2024-09-12T18:04:12.705200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:22.899798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705006+0000","last_change":"2024-09-12T18:04:09.694526+0000","last_active":"2024-09-12T18:04:12.705006+0000","last_peered":"2024-09-12T18:04:12.705006+0000","last_clean":"2024-09-12T18:04:12.705006+0000","last_became_active":"2024-09-12T18:04:09.685115+0000","last_became_peered":"2024-09-12T18:04:09.685115+0000","last_unstale":"2024-09-12T18:04:12.705006+0000","last_undegraded":"2024-09-12T18:04:12.705006+0000","last_fullsized":"2024-09-12T18:04:12.705006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.108507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705679+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:04:12.705679+0000","last_peered":"2024-09-12T18:04:12.705679+0000","last_clean":"2024-09-12T18:04:12.705679+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:04:12.705679+0000","last_undegraded":"2024-09-12T18:04:12.705679+0000","last_fullsized":"2024-09-12T18:04:12.705679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704814+0000","last_change":"2024-09-12T18:04:09.697456+0000","last_active":"2024-09-12T18:04:12.704814+0000","last_peered":"2024-09-12T18:04:12.704814+0000","last_clean":"2024-09-12T18:04:12.704814+0000","last_became_active":"2024-09-12T18:04:09.691370+0000","last_became_peered":"2024-09-12T18:04:09.691370+0000","last_unstale":"2024-09-12T18:04:12.704814+0000","last_undegraded":"2024-09-12T18:04:12.704814+0000","last_fullsized":"2024-09-12T18:04:12.704814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705623+0000","last_change":"2024-09-12T18:04:09.694180+0000","last_active":"2024-09-12T18:04:12.705623+0000","last_peered":"2024-09-12T18:04:12.705623+0000","last_clean":"2024-09-12T18:04:12.705623+0000","last_became_active":"2024-09-12T18:04:09.686122+0000","last_became_peered":"2024-09-12T18:04:09.686122+0000","last_unstale":"2024-09-12T18:04:12.705623+0000","last_undegraded":"2024-09-12T18:04:12.705623+0000","last_fullsized":"2024-09-12T18:04:12.705623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:39.304422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":993,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704310+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:04:12.704310+0000","last_peered":"2024-09-12T18:04:12.704310+0000","last_clean":"2024-09-12T18:04:12.704310+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:04:12.704310+0000","last_undegraded":"2024-09-12T18:04:12.704310+0000","last_fullsized":"2024-09-12T18:04:12.704310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691592+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:04:11.691592+0000","last_peered":"2024-09-12T18:04:11.691592+0000","last_clean":"2024-09-12T18:04:11.691592+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:04:11.691592+0000","last_undegraded":"2024-09-12T18:04:11.691592+0000","last_fullsized":"2024-09-12T18:04:11.691592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1050,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706158+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:04:12.706158+0000","last_peered":"2024-09-12T18:04:12.706158+0000","last_clean":"2024-09-12T18:04:12.706158+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:04:12.706158+0000","last_undegraded":"2024-09-12T18:04:12.706158+0000","last_fullsized":"2024-09-12T18:04:12.706158+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705486+0000","last_change":"2024-09-12T18:04:09.685941+0000","last_active":"2024-09-12T18:04:12.705486+0000","last_peered":"2024-09-12T18:04:12.705486+0000","last_clean":"2024-09-12T18:04:12.705486+0000","last_became_active":"2024-09-12T18:04:09.681305+0000","last_became_peered":"2024-09-12T18:04:09.681305+0000","last_unstale":"2024-09-12T18:04:12.705486+0000","last_undegraded":"2024-09-12T18:04:12.705486+0000","last_fullsized":"2024-09-12T18:04:12.705486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:29.147388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":535,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705577+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:04:12.705577+0000","last_peered":"2024-09-12T18:04:12.705577+0000","last_clean":"2024-09-12T18:04:12.705577+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:04:12.705577+0000","last_undegraded":"2024-09-12T18:04:12.705577+0000","last_fullsized":"2024-09-12T18:04:12.705577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705397+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:04:12.705397+0000","last_peered":"2024-09-12T18:04:12.705397+0000","last_clean":"2024-09-12T18:04:12.705397+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:04:12.705397+0000","last_undegraded":"2024-09-12T18:04:12.705397+0000","last_fullsized":"2024-09-12T18:04:12.705397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":615,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704904+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:04:12.704904+0000","last_peered":"2024-09-12T18:04:12.704904+0000","last_clean":"2024-09-12T18:04:12.704904+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:04:12.704904+0000","last_undegraded":"2024-09-12T18:04:12.704904+0000","last_fullsized":"2024-09-12T18:04:12.704904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706583+0000","last_change":"2024-09-12T18:04:09.695076+0000","last_active":"2024-09-12T18:04:12.706583+0000","last_peered":"2024-09-12T18:04:12.706583+0000","last_clean":"2024-09-12T18:04:12.706583+0000","last_became_active":"2024-09-12T18:04:09.684858+0000","last_became_peered":"2024-09-12T18:04:09.684858+0000","last_unstale":"2024-09-12T18:04:12.706583+0000","last_undegraded":"2024-09-12T18:04:12.706583+0000","last_fullsized":"2024-09-12T18:04:12.706583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:14.097506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":685,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704492+0000","last_change":"2024-09-12T18:04:09.687477+0000","last_active":"2024-09-12T18:04:12.704492+0000","last_peered":"2024-09-12T18:04:12.704492+0000","last_clean":"2024-09-12T18:04:12.704492+0000","last_became_active":"2024-09-12T18:04:09.680510+0000","last_became_peered":"2024-09-12T18:04:09.680510+0000","last_unstale":"2024-09-12T18:04:12.704492+0000","last_undegraded":"2024-09-12T18:04:12.704492+0000","last_fullsized":"2024-09-12T18:04:12.704492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:53.703464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":605,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691939+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:04:11.691939+0000","last_peered":"2024-09-12T18:04:11.691939+0000","last_clean":"2024-09-12T18:04:11.691939+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:04:11.691939+0000","last_undegraded":"2024-09-12T18:04:11.691939+0000","last_fullsized":"2024-09-12T18:04:11.691939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":692,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706585+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:04:12.706585+0000","last_peered":"2024-09-12T18:04:12.706585+0000","last_clean":"2024-09-12T18:04:12.706585+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:04:12.706585+0000","last_undegraded":"2024-09-12T18:04:12.706585+0000","last_fullsized":"2024-09-12T18:04:12.706585+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":689,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690818+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:04:11.690818+0000","last_peered":"2024-09-12T18:04:11.690818+0000","last_clean":"2024-09-12T18:04:11.690818+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:04:11.690818+0000","last_undegraded":"2024-09-12T18:04:11.690818+0000","last_fullsized":"2024-09-12T18:04:11.690818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705083+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:04:12.705083+0000","last_peered":"2024-09-12T18:04:12.705083+0000","last_clean":"2024-09-12T18:04:12.705083+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:04:12.705083+0000","last_undegraded":"2024-09-12T18:04:12.705083+0000","last_fullsized":"2024-09-12T18:04:12.705083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":1000,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706891+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:04:12.706891+0000","last_peered":"2024-09-12T18:04:12.706891+0000","last_clean":"2024-09-12T18:04:12.706891+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:04:12.706891+0000","last_undegraded":"2024-09-12T18:04:12.706891+0000","last_fullsized":"2024-09-12T18:04:12.706891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704901+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:04:12.704901+0000","last_peered":"2024-09-12T18:04:12.704901+0000","last_clean":"2024-09-12T18:04:12.704901+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:04:12.704901+0000","last_undegraded":"2024-09-12T18:04:12.704901+0000","last_fullsized":"2024-09-12T18:04:12.704901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":931,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689822+0000","last_change":"2024-09-12T18:03:56.341786+0000","last_active":"2024-09-12T18:04:11.689822+0000","last_peered":"2024-09-12T18:04:11.689822+0000","last_clean":"2024-09-12T18:04:11.689822+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:04:11.689822+0000","last_undegraded":"2024-09-12T18:04:11.689822+0000","last_fullsized":"2024-09-12T18:04:11.689822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704364+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:04:12.704364+0000","last_peered":"2024-09-12T18:04:12.704364+0000","last_clean":"2024-09-12T18:04:12.704364+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:04:12.704364+0000","last_undegraded":"2024-09-12T18:04:12.704364+0000","last_fullsized":"2024-09-12T18:04:12.704364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706563+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:04:12.706563+0000","last_peered":"2024-09-12T18:04:12.706563+0000","last_clean":"2024-09-12T18:04:12.706563+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:04:12.706563+0000","last_undegraded":"2024-09-12T18:04:12.706563+0000","last_fullsized":"2024-09-12T18:04:12.706563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691216+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:04:11.691216+0000","last_peered":"2024-09-12T18:04:11.691216+0000","last_clean":"2024-09-12T18:04:11.691216+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:04:11.691216+0000","last_undegraded":"2024-09-12T18:04:11.691216+0000","last_fullsized":"2024-09-12T18:04:11.691216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705566+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:04:12.705566+0000","last_peered":"2024-09-12T18:04:12.705566+0000","last_clean":"2024-09-12T18:04:12.705566+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:04:12.705566+0000","last_undegraded":"2024-09-12T18:04:12.705566+0000","last_fullsized":"2024-09-12T18:04:12.705566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706212+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:04:12.706212+0000","last_peered":"2024-09-12T18:04:12.706212+0000","last_clean":"2024-09-12T18:04:12.706212+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:04:12.706212+0000","last_undegraded":"2024-09-12T18:04:12.706212+0000","last_fullsized":"2024-09-12T18:04:12.706212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":951,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690328+0000","last_change":"2024-09-12T18:03:56.344116+0000","last_active":"2024-09-12T18:04:11.690328+0000","last_peered":"2024-09-12T18:04:11.690328+0000","last_clean":"2024-09-12T18:04:11.690328+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:04:11.690328+0000","last_undegraded":"2024-09-12T18:04:11.690328+0000","last_fullsized":"2024-09-12T18:04:11.690328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704483+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:04:12.704483+0000","last_peered":"2024-09-12T18:04:12.704483+0000","last_clean":"2024-09-12T18:04:12.704483+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:04:12.704483+0000","last_undegraded":"2024-09-12T18:04:12.704483+0000","last_fullsized":"2024-09-12T18:04:12.704483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":1004,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689361+0000","last_change":"2024-09-12T18:03:57.344789+0000","last_active":"2024-09-12T18:04:11.689361+0000","last_peered":"2024-09-12T18:04:11.689361+0000","last_clean":"2024-09-12T18:04:11.689361+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:04:11.689361+0000","last_undegraded":"2024-09-12T18:04:11.689361+0000","last_fullsized":"2024-09-12T18:04:11.689361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704604+0000","last_change":"2024-09-12T18:04:09.687125+0000","last_active":"2024-09-12T18:04:12.704604+0000","last_peered":"2024-09-12T18:04:12.704604+0000","last_clean":"2024-09-12T18:04:12.704604+0000","last_became_active":"2024-09-12T18:04:09.680177+0000","last_became_peered":"2024-09-12T18:04:09.680177+0000","last_unstale":"2024-09-12T18:04:12.704604+0000","last_undegraded":"2024-09-12T18:04:12.704604+0000","last_fullsized":"2024-09-12T18:04:12.704604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705931+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:04:12.705931+0000","last_peered":"2024-09-12T18:04:12.705931+0000","last_clean":"2024-09-12T18:04:12.705931+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:04:12.705931+0000","last_undegraded":"2024-09-12T18:04:12.705931+0000","last_fullsized":"2024-09-12T18:04:12.705931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707039+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:04:12.707039+0000","last_peered":"2024-09-12T18:04:12.707039+0000","last_clean":"2024-09-12T18:04:12.707039+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:04:12.707039+0000","last_undegraded":"2024-09-12T18:04:12.707039+0000","last_fullsized":"2024-09-12T18:04:12.707039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":562,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706416+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:04:12.706416+0000","last_peered":"2024-09-12T18:04:12.706416+0000","last_clean":"2024-09-12T18:04:12.706416+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:04:12.706416+0000","last_undegraded":"2024-09-12T18:04:12.706416+0000","last_fullsized":"2024-09-12T18:04:12.706416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":193,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690488+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:04:11.690488+0000","last_peered":"2024-09-12T18:04:11.690488+0000","last_clean":"2024-09-12T18:04:11.690488+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:04:11.690488+0000","last_undegraded":"2024-09-12T18:04:11.690488+0000","last_fullsized":"2024-09-12T18:04:11.690488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691699+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:04:11.691699+0000","last_peered":"2024-09-12T18:04:11.691699+0000","last_clean":"2024-09-12T18:04:11.691699+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:04:11.691699+0000","last_undegraded":"2024-09-12T18:04:11.691699+0000","last_fullsized":"2024-09-12T18:04:11.691699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704763+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:04:12.704763+0000","last_peered":"2024-09-12T18:04:12.704763+0000","last_clean":"2024-09-12T18:04:12.704763+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:04:12.704763+0000","last_undegraded":"2024-09-12T18:04:12.704763+0000","last_fullsized":"2024-09-12T18:04:12.704763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690883+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:04:11.690883+0000","last_peered":"2024-09-12T18:04:11.690883+0000","last_clean":"2024-09-12T18:04:11.690883+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:04:11.690883+0000","last_undegraded":"2024-09-12T18:04:11.690883+0000","last_fullsized":"2024-09-12T18:04:11.690883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":208,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704780+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:04:12.704780+0000","last_peered":"2024-09-12T18:04:12.704780+0000","last_clean":"2024-09-12T18:04:12.704780+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:04:12.704780+0000","last_undegraded":"2024-09-12T18:04:12.704780+0000","last_fullsized":"2024-09-12T18:04:12.704780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":286,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706247+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:04:12.706247+0000","last_peered":"2024-09-12T18:04:12.706247+0000","last_clean":"2024-09-12T18:04:12.706247+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:04:12.706247+0000","last_undegraded":"2024-09-12T18:04:12.706247+0000","last_fullsized":"2024-09-12T18:04:12.706247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704427+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:04:12.704427+0000","last_peered":"2024-09-12T18:04:12.704427+0000","last_clean":"2024-09-12T18:04:12.704427+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:04:12.704427+0000","last_undegraded":"2024-09-12T18:04:12.704427+0000","last_fullsized":"2024-09-12T18:04:12.704427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":397,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706623+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:04:12.706623+0000","last_peered":"2024-09-12T18:04:12.706623+0000","last_clean":"2024-09-12T18:04:12.706623+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:04:12.706623+0000","last_undegraded":"2024-09-12T18:04:12.706623+0000","last_fullsized":"2024-09-12T18:04:12.706623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1468,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704401+0000","last_change":"2024-09-12T18:03:53.336888+0000","last_active":"2024-09-12T18:04:12.704401+0000","last_peered":"2024-09-12T18:04:12.704401+0000","last_clean":"2024-09-12T18:04:12.704401+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:04:12.704401+0000","last_undegraded":"2024-09-12T18:04:12.704401+0000","last_fullsized":"2024-09-12T18:04:12.704401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706190+0000","last_change":"2024-09-12T18:04:09.686572+0000","last_active":"2024-09-12T18:04:12.706190+0000","last_peered":"2024-09-12T18:04:12.706190+0000","last_clean":"2024-09-12T18:04:12.706190+0000","last_became_active":"2024-09-12T18:04:09.682207+0000","last_became_peered":"2024-09-12T18:04:09.682207+0000","last_unstale":"2024-09-12T18:04:12.706190+0000","last_undegraded":"2024-09-12T18:04:12.706190+0000","last_fullsized":"2024-09-12T18:04:12.706190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:19.750113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705239+0000","last_change":"2024-09-12T18:04:09.694336+0000","last_active":"2024-09-12T18:04:12.705239+0000","last_peered":"2024-09-12T18:04:12.705239+0000","last_clean":"2024-09-12T18:04:12.705239+0000","last_became_active":"2024-09-12T18:04:09.681881+0000","last_became_peered":"2024-09-12T18:04:09.681881+0000","last_unstale":"2024-09-12T18:04:12.705239+0000","last_undegraded":"2024-09-12T18:04:12.705239+0000","last_fullsized":"2024-09-12T18:04:12.705239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:08.728289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":202,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706249+0000","last_change":"2024-09-12T18:04:09.695023+0000","last_active":"2024-09-12T18:04:12.706249+0000","last_peered":"2024-09-12T18:04:12.706249+0000","last_clean":"2024-09-12T18:04:12.706249+0000","last_became_active":"2024-09-12T18:04:09.692860+0000","last_became_peered":"2024-09-12T18:04:09.692860+0000","last_unstale":"2024-09-12T18:04:12.706249+0000","last_undegraded":"2024-09-12T18:04:12.706249+0000","last_fullsized":"2024-09-12T18:04:12.706249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:22.990905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":647,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690399+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:04:11.690399+0000","last_peered":"2024-09-12T18:04:11.690399+0000","last_clean":"2024-09-12T18:04:11.690399+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:04:11.690399+0000","last_undegraded":"2024-09-12T18:04:11.690399+0000","last_fullsized":"2024-09-12T18:04:11.690399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691540+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:04:11.691540+0000","last_peered":"2024-09-12T18:04:11.691540+0000","last_clean":"2024-09-12T18:04:11.691540+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:04:11.691540+0000","last_undegraded":"2024-09-12T18:04:11.691540+0000","last_fullsized":"2024-09-12T18:04:11.691540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705390+0000","last_change":"2024-09-12T18:04:09.694162+0000","last_active":"2024-09-12T18:04:12.705390+0000","last_peered":"2024-09-12T18:04:12.705390+0000","last_clean":"2024-09-12T18:04:12.705390+0000","last_became_active":"2024-09-12T18:04:09.686387+0000","last_became_peered":"2024-09-12T18:04:09.686387+0000","last_unstale":"2024-09-12T18:04:12.705390+0000","last_undegraded":"2024-09-12T18:04:12.705390+0000","last_fullsized":"2024-09-12T18:04:12.705390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:22.543587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706189+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:04:12.706189+0000","last_peered":"2024-09-12T18:04:12.706189+0000","last_clean":"2024-09-12T18:04:12.706189+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:04:12.706189+0000","last_undegraded":"2024-09-12T18:04:12.706189+0000","last_fullsized":"2024-09-12T18:04:12.706189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705919+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:04:12.705919+0000","last_peered":"2024-09-12T18:04:12.705919+0000","last_clean":"2024-09-12T18:04:12.705919+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:04:12.705919+0000","last_undegraded":"2024-09-12T18:04:12.705919+0000","last_fullsized":"2024-09-12T18:04:12.705919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":199,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704923+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:04:12.704923+0000","last_peered":"2024-09-12T18:04:12.704923+0000","last_clean":"2024-09-12T18:04:12.704923+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:04:12.704923+0000","last_undegraded":"2024-09-12T18:04:12.704923+0000","last_fullsized":"2024-09-12T18:04:12.704923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705970+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:04:12.705970+0000","last_peered":"2024-09-12T18:04:12.705970+0000","last_clean":"2024-09-12T18:04:12.705970+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:04:12.705970+0000","last_undegraded":"2024-09-12T18:04:12.705970+0000","last_fullsized":"2024-09-12T18:04:12.705970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704648+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:04:12.704648+0000","last_peered":"2024-09-12T18:04:12.704648+0000","last_clean":"2024-09-12T18:04:12.704648+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:04:12.704648+0000","last_undegraded":"2024-09-12T18:04:12.704648+0000","last_fullsized":"2024-09-12T18:04:12.704648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691197+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:04:11.691197+0000","last_peered":"2024-09-12T18:04:11.691197+0000","last_clean":"2024-09-12T18:04:11.691197+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:04:11.691197+0000","last_undegraded":"2024-09-12T18:04:11.691197+0000","last_fullsized":"2024-09-12T18:04:11.691197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705995+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:04:12.705995+0000","last_peered":"2024-09-12T18:04:12.705995+0000","last_clean":"2024-09-12T18:04:12.705995+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:04:12.705995+0000","last_undegraded":"2024-09-12T18:04:12.705995+0000","last_fullsized":"2024-09-12T18:04:12.705995+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707193+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:04:12.707193+0000","last_peered":"2024-09-12T18:04:12.707193+0000","last_clean":"2024-09-12T18:04:12.707193+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:04:12.707193+0000","last_undegraded":"2024-09-12T18:04:12.707193+0000","last_fullsized":"2024-09-12T18:04:12.707193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":713,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690829+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:04:11.690829+0000","last_peered":"2024-09-12T18:04:11.690829+0000","last_clean":"2024-09-12T18:04:11.690829+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:04:11.690829+0000","last_undegraded":"2024-09-12T18:04:11.690829+0000","last_fullsized":"2024-09-12T18:04:11.690829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":609,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706016+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:04:12.706016+0000","last_peered":"2024-09-12T18:04:12.706016+0000","last_clean":"2024-09-12T18:04:12.706016+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:04:12.706016+0000","last_undegraded":"2024-09-12T18:04:12.706016+0000","last_fullsized":"2024-09-12T18:04:12.706016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705822+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:04:12.705822+0000","last_peered":"2024-09-12T18:04:12.705822+0000","last_clean":"2024-09-12T18:04:12.705822+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:04:12.705822+0000","last_undegraded":"2024-09-12T18:04:12.705822+0000","last_fullsized":"2024-09-12T18:04:12.705822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":342,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689704+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:04:11.689704+0000","last_peered":"2024-09-12T18:04:11.689704+0000","last_clean":"2024-09-12T18:04:11.689704+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:04:11.689704+0000","last_undegraded":"2024-09-12T18:04:11.689704+0000","last_fullsized":"2024-09-12T18:04:11.689704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706251+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:04:12.706251+0000","last_peered":"2024-09-12T18:04:12.706251+0000","last_clean":"2024-09-12T18:04:12.706251+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:04:12.706251+0000","last_undegraded":"2024-09-12T18:04:12.706251+0000","last_fullsized":"2024-09-12T18:04:12.706251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691575+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:04:11.691575+0000","last_peered":"2024-09-12T18:04:11.691575+0000","last_clean":"2024-09-12T18:04:11.691575+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:04:11.691575+0000","last_undegraded":"2024-09-12T18:04:11.691575+0000","last_fullsized":"2024-09-12T18:04:11.691575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704735+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:04:12.704735+0000","last_peered":"2024-09-12T18:04:12.704735+0000","last_clean":"2024-09-12T18:04:12.704735+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:04:12.704735+0000","last_undegraded":"2024-09-12T18:04:12.704735+0000","last_fullsized":"2024-09-12T18:04:12.704735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":811,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690607+0000","last_change":"2024-09-12T18:03:54.334607+0000","last_active":"2024-09-12T18:04:11.690607+0000","last_peered":"2024-09-12T18:04:11.690607+0000","last_clean":"2024-09-12T18:04:11.690607+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:04:11.690607+0000","last_undegraded":"2024-09-12T18:04:11.690607+0000","last_fullsized":"2024-09-12T18:04:11.690607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:27.565973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706554+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:04:12.706554+0000","last_peered":"2024-09-12T18:04:12.706554+0000","last_clean":"2024-09-12T18:04:12.706554+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:04:12.706554+0000","last_undegraded":"2024-09-12T18:04:12.706554+0000","last_fullsized":"2024-09-12T18:04:12.706554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":222,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707067+0000","last_change":"2024-09-12T18:04:09.697006+0000","last_active":"2024-09-12T18:04:12.707067+0000","last_peered":"2024-09-12T18:04:12.707067+0000","last_clean":"2024-09-12T18:04:12.707067+0000","last_became_active":"2024-09-12T18:04:09.686200+0000","last_became_peered":"2024-09-12T18:04:09.686200+0000","last_unstale":"2024-09-12T18:04:12.707067+0000","last_undegraded":"2024-09-12T18:04:12.707067+0000","last_fullsized":"2024-09-12T18:04:12.707067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:17.012774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691405+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:04:11.691405+0000","last_peered":"2024-09-12T18:04:11.691405+0000","last_clean":"2024-09-12T18:04:11.691405+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:04:11.691405+0000","last_undegraded":"2024-09-12T18:04:11.691405+0000","last_fullsized":"2024-09-12T18:04:11.691405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":448,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706291+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:04:12.706291+0000","last_peered":"2024-09-12T18:04:12.706291+0000","last_clean":"2024-09-12T18:04:12.706291+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:04:12.706291+0000","last_undegraded":"2024-09-12T18:04:12.706291+0000","last_fullsized":"2024-09-12T18:04:12.706291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691578+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:04:11.691578+0000","last_peered":"2024-09-12T18:04:11.691578+0000","last_clean":"2024-09-12T18:04:11.691578+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:04:11.691578+0000","last_undegraded":"2024-09-12T18:04:11.691578+0000","last_fullsized":"2024-09-12T18:04:11.691578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704996+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:04:12.704996+0000","last_peered":"2024-09-12T18:04:12.704996+0000","last_clean":"2024-09-12T18:04:12.704996+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:04:12.704996+0000","last_undegraded":"2024-09-12T18:04:12.704996+0000","last_fullsized":"2024-09-12T18:04:12.704996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690358+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:04:11.690358+0000","last_peered":"2024-09-12T18:04:11.690358+0000","last_clean":"2024-09-12T18:04:11.690358+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:04:11.690358+0000","last_undegraded":"2024-09-12T18:04:11.690358+0000","last_fullsized":"2024-09-12T18:04:11.690358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707020+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:04:12.707020+0000","last_peered":"2024-09-12T18:04:12.707020+0000","last_clean":"2024-09-12T18:04:12.707020+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:04:12.707020+0000","last_undegraded":"2024-09-12T18:04:12.707020+0000","last_fullsized":"2024-09-12T18:04:12.707020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":558,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705573+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:04:12.705573+0000","last_peered":"2024-09-12T18:04:12.705573+0000","last_clean":"2024-09-12T18:04:12.705573+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:04:12.705573+0000","last_undegraded":"2024-09-12T18:04:12.705573+0000","last_fullsized":"2024-09-12T18:04:12.705573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691531+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:04:11.691531+0000","last_peered":"2024-09-12T18:04:11.691531+0000","last_clean":"2024-09-12T18:04:11.691531+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:04:11.691531+0000","last_undegraded":"2024-09-12T18:04:11.691531+0000","last_fullsized":"2024-09-12T18:04:11.691531+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690336+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:04:11.690336+0000","last_peered":"2024-09-12T18:04:11.690336+0000","last_clean":"2024-09-12T18:04:11.690336+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:04:11.690336+0000","last_undegraded":"2024-09-12T18:04:11.690336+0000","last_fullsized":"2024-09-12T18:04:11.690336+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":573,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689659+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:04:11.689659+0000","last_peered":"2024-09-12T18:04:11.689659+0000","last_clean":"2024-09-12T18:04:11.689659+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:04:11.689659+0000","last_undegraded":"2024-09-12T18:04:11.689659+0000","last_fullsized":"2024-09-12T18:04:11.689659+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"72'114","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691584+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:04:11.691584+0000","last_peered":"2024-09-12T18:04:11.691584+0000","last_clean":"2024-09-12T18:04:11.691584+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:04:11.691584+0000","last_undegraded":"2024-09-12T18:04:11.691584+0000","last_fullsized":"2024-09-12T18:04:11.691584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706764+0000","last_change":"2024-09-12T18:04:09.677962+0000","last_active":"2024-09-12T18:04:12.706764+0000","last_peered":"2024-09-12T18:04:12.706764+0000","last_clean":"2024-09-12T18:04:12.706764+0000","last_became_active":"2024-09-12T18:04:09.677062+0000","last_became_peered":"2024-09-12T18:04:09.677062+0000","last_unstale":"2024-09-12T18:04:12.706764+0000","last_undegraded":"2024-09-12T18:04:12.706764+0000","last_fullsized":"2024-09-12T18:04:12.706764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:17.652687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704592+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:04:12.704592+0000","last_peered":"2024-09-12T18:04:12.704592+0000","last_clean":"2024-09-12T18:04:12.704592+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:04:12.704592+0000","last_undegraded":"2024-09-12T18:04:12.704592+0000","last_fullsized":"2024-09-12T18:04:12.704592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":588,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706604+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:04:12.706604+0000","last_peered":"2024-09-12T18:04:12.706604+0000","last_clean":"2024-09-12T18:04:12.706604+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:04:12.706604+0000","last_undegraded":"2024-09-12T18:04:12.706604+0000","last_fullsized":"2024-09-12T18:04:12.706604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705957+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:04:12.705957+0000","last_peered":"2024-09-12T18:04:12.705957+0000","last_clean":"2024-09-12T18:04:12.705957+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:04:12.705957+0000","last_undegraded":"2024-09-12T18:04:12.705957+0000","last_fullsized":"2024-09-12T18:04:12.705957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":625,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690149+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:04:11.690149+0000","last_peered":"2024-09-12T18:04:11.690149+0000","last_clean":"2024-09-12T18:04:11.690149+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:04:11.690149+0000","last_undegraded":"2024-09-12T18:04:11.690149+0000","last_fullsized":"2024-09-12T18:04:11.690149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":241,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706935+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:04:12.706935+0000","last_peered":"2024-09-12T18:04:12.706935+0000","last_clean":"2024-09-12T18:04:12.706935+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:04:12.706935+0000","last_undegraded":"2024-09-12T18:04:12.706935+0000","last_fullsized":"2024-09-12T18:04:12.706935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":358,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706436+0000","last_change":"2024-09-12T18:04:09.685980+0000","last_active":"2024-09-12T18:04:12.706436+0000","last_peered":"2024-09-12T18:04:12.706436+0000","last_clean":"2024-09-12T18:04:12.706436+0000","last_became_active":"2024-09-12T18:04:09.682878+0000","last_became_peered":"2024-09-12T18:04:09.682878+0000","last_unstale":"2024-09-12T18:04:12.706436+0000","last_undegraded":"2024-09-12T18:04:12.706436+0000","last_fullsized":"2024-09-12T18:04:12.706436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":718,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691128+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:04:11.691128+0000","last_peered":"2024-09-12T18:04:11.691128+0000","last_clean":"2024-09-12T18:04:11.691128+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:04:11.691128+0000","last_undegraded":"2024-09-12T18:04:11.691128+0000","last_fullsized":"2024-09-12T18:04:11.691128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691277+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:04:11.691277+0000","last_peered":"2024-09-12T18:04:11.691277+0000","last_clean":"2024-09-12T18:04:11.691277+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:04:11.691277+0000","last_undegraded":"2024-09-12T18:04:11.691277+0000","last_fullsized":"2024-09-12T18:04:11.691277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":694,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689505+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:04:11.689505+0000","last_peered":"2024-09-12T18:04:11.689505+0000","last_clean":"2024-09-12T18:04:11.689505+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:04:11.689505+0000","last_undegraded":"2024-09-12T18:04:11.689505+0000","last_fullsized":"2024-09-12T18:04:11.689505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706629+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:04:12.706629+0000","last_peered":"2024-09-12T18:04:12.706629+0000","last_clean":"2024-09-12T18:04:12.706629+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:04:12.706629+0000","last_undegraded":"2024-09-12T18:04:12.706629+0000","last_fullsized":"2024-09-12T18:04:12.706629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":796,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689874+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:04:11.689874+0000","last_peered":"2024-09-12T18:04:11.689874+0000","last_clean":"2024-09-12T18:04:11.689874+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:04:11.689874+0000","last_undegraded":"2024-09-12T18:04:11.689874+0000","last_fullsized":"2024-09-12T18:04:11.689874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":668,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691035+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:04:11.691035+0000","last_peered":"2024-09-12T18:04:11.691035+0000","last_clean":"2024-09-12T18:04:11.691035+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:04:11.691035+0000","last_undegraded":"2024-09-12T18:04:11.691035+0000","last_fullsized":"2024-09-12T18:04:11.691035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":369,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689515+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:04:11.689515+0000","last_peered":"2024-09-12T18:04:11.689515+0000","last_clean":"2024-09-12T18:04:11.689515+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:04:11.689515+0000","last_undegraded":"2024-09-12T18:04:11.689515+0000","last_fullsized":"2024-09-12T18:04:11.689515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705907+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:04:12.705907+0000","last_peered":"2024-09-12T18:04:12.705907+0000","last_clean":"2024-09-12T18:04:12.705907+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:04:12.705907+0000","last_undegraded":"2024-09-12T18:04:12.705907+0000","last_fullsized":"2024-09-12T18:04:12.705907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":360,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705227+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:04:12.705227+0000","last_peered":"2024-09-12T18:04:12.705227+0000","last_clean":"2024-09-12T18:04:12.705227+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:04:12.705227+0000","last_undegraded":"2024-09-12T18:04:12.705227+0000","last_fullsized":"2024-09-12T18:04:12.705227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705628+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:04:12.705628+0000","last_peered":"2024-09-12T18:04:12.705628+0000","last_clean":"2024-09-12T18:04:12.705628+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:04:12.705628+0000","last_undegraded":"2024-09-12T18:04:12.705628+0000","last_fullsized":"2024-09-12T18:04:12.705628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":197,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705941+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:04:12.705941+0000","last_peered":"2024-09-12T18:04:12.705941+0000","last_clean":"2024-09-12T18:04:12.705941+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:04:12.705941+0000","last_undegraded":"2024-09-12T18:04:12.705941+0000","last_fullsized":"2024-09-12T18:04:12.705941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706584+0000","last_change":"2024-09-12T18:04:09.697861+0000","last_active":"2024-09-12T18:04:12.706584+0000","last_peered":"2024-09-12T18:04:12.706584+0000","last_clean":"2024-09-12T18:04:12.706584+0000","last_became_active":"2024-09-12T18:04:09.688026+0000","last_became_peered":"2024-09-12T18:04:09.688026+0000","last_unstale":"2024-09-12T18:04:12.706584+0000","last_undegraded":"2024-09-12T18:04:12.706584+0000","last_fullsized":"2024-09-12T18:04:12.706584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.825721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705675+0000","last_change":"2024-09-12T18:04:09.695422+0000","last_active":"2024-09-12T18:04:12.705675+0000","last_peered":"2024-09-12T18:04:12.705675+0000","last_clean":"2024-09-12T18:04:12.705675+0000","last_became_active":"2024-09-12T18:04:09.692975+0000","last_became_peered":"2024-09-12T18:04:09.692975+0000","last_unstale":"2024-09-12T18:04:12.705675+0000","last_undegraded":"2024-09-12T18:04:12.705675+0000","last_fullsized":"2024-09-12T18:04:12.705675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.708997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1292,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705908+0000","last_change":"2024-09-12T18:04:09.693020+0000","last_active":"2024-09-12T18:04:12.705908+0000","last_peered":"2024-09-12T18:04:12.705908+0000","last_clean":"2024-09-12T18:04:12.705908+0000","last_became_active":"2024-09-12T18:04:09.684915+0000","last_became_peered":"2024-09-12T18:04:09.684915+0000","last_unstale":"2024-09-12T18:04:12.705908+0000","last_undegraded":"2024-09-12T18:04:12.705908+0000","last_fullsized":"2024-09-12T18:04:12.705908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:27.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":423,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706634+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:04:12.706634+0000","last_peered":"2024-09-12T18:04:12.706634+0000","last_clean":"2024-09-12T18:04:12.706634+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:04:12.706634+0000","last_undegraded":"2024-09-12T18:04:12.706634+0000","last_fullsized":"2024-09-12T18:04:12.706634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":563,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704948+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:04:12.704948+0000","last_peered":"2024-09-12T18:04:12.704948+0000","last_clean":"2024-09-12T18:04:12.704948+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:04:12.704948+0000","last_undegraded":"2024-09-12T18:04:12.704948+0000","last_fullsized":"2024-09-12T18:04:12.704948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691316+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:04:11.691316+0000","last_peered":"2024-09-12T18:04:11.691316+0000","last_clean":"2024-09-12T18:04:11.691316+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:04:11.691316+0000","last_undegraded":"2024-09-12T18:04:11.691316+0000","last_fullsized":"2024-09-12T18:04:11.691316+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704907+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:04:12.704907+0000","last_peered":"2024-09-12T18:04:12.704907+0000","last_clean":"2024-09-12T18:04:12.704907+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:04:12.704907+0000","last_undegraded":"2024-09-12T18:04:12.704907+0000","last_fullsized":"2024-09-12T18:04:12.704907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690565+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:04:11.690565+0000","last_peered":"2024-09-12T18:04:11.690565+0000","last_clean":"2024-09-12T18:04:11.690565+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:04:11.690565+0000","last_undegraded":"2024-09-12T18:04:11.690565+0000","last_fullsized":"2024-09-12T18:04:11.690565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6248,"ondisk_log_size":6248,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121704,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":24526848,"data_stored":81403848,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738403,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113888,"kb_used_data":28612,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94257952,"statfs":{"total":96636764160,"available":96520142848,"internally_reserved":0,"allocated":29298688,"data_stored":84724657,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738403,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118208,"kb_used_data":28776,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253632,"statfs":{"total":96636764160,"available":96515719168,"internally_reserved":0,"allocated":29466624,"data_stored":90491785,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:04:16.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:04:17.079 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:17.081 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:04:17.098 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-12T18:04:16.594787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32952,"ondisk_log_size":32952,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":353800,"kb_used_data":81340,"kb_used_omap":4,"kb_used_meta":272379,"kb_avail":282761720,"statfs":{"total":289910292480,"available":289548001280,"internally_reserved":0,"allocated":83292160,"data_stored":256620290,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":278916431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":548,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002040"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706444+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:04:12.706444+0000","last_peered":"2024-09-12T18:04:12.706444+0000","last_clean":"2024-09-12T18:04:12.706444+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:04:12.706444+0000","last_undegraded":"2024-09-12T18:04:12.706444+0000","last_fullsized":"2024-09-12T18:04:12.706444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705980+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:04:12.705980+0000","last_peered":"2024-09-12T18:04:12.705980+0000","last_clean":"2024-09-12T18:04:12.705980+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:04:12.705980+0000","last_undegraded":"2024-09-12T18:04:12.705980+0000","last_fullsized":"2024-09-12T18:04:12.705980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705200+0000","last_change":"2024-09-12T18:04:09.681163+0000","last_active":"2024-09-12T18:04:12.705200+0000","last_peered":"2024-09-12T18:04:12.705200+0000","last_clean":"2024-09-12T18:04:12.705200+0000","last_became_active":"2024-09-12T18:04:09.677098+0000","last_became_peered":"2024-09-12T18:04:09.677098+0000","last_unstale":"2024-09-12T18:04:12.705200+0000","last_undegraded":"2024-09-12T18:04:12.705200+0000","last_fullsized":"2024-09-12T18:04:12.705200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:22.899798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705006+0000","last_change":"2024-09-12T18:04:09.694526+0000","last_active":"2024-09-12T18:04:12.705006+0000","last_peered":"2024-09-12T18:04:12.705006+0000","last_clean":"2024-09-12T18:04:12.705006+0000","last_became_active":"2024-09-12T18:04:09.685115+0000","last_became_peered":"2024-09-12T18:04:09.685115+0000","last_unstale":"2024-09-12T18:04:12.705006+0000","last_undegraded":"2024-09-12T18:04:12.705006+0000","last_fullsized":"2024-09-12T18:04:12.705006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.108507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705679+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:04:12.705679+0000","last_peered":"2024-09-12T18:04:12.705679+0000","last_clean":"2024-09-12T18:04:12.705679+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:04:12.705679+0000","last_undegraded":"2024-09-12T18:04:12.705679+0000","last_fullsized":"2024-09-12T18:04:12.705679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704814+0000","last_change":"2024-09-12T18:04:09.697456+0000","last_active":"2024-09-12T18:04:12.704814+0000","last_peered":"2024-09-12T18:04:12.704814+0000","last_clean":"2024-09-12T18:04:12.704814+0000","last_became_active":"2024-09-12T18:04:09.691370+0000","last_became_peered":"2024-09-12T18:04:09.691370+0000","last_unstale":"2024-09-12T18:04:12.704814+0000","last_undegraded":"2024-09-12T18:04:12.704814+0000","last_fullsized":"2024-09-12T18:04:12.704814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705623+0000","last_change":"2024-09-12T18:04:09.694180+0000","last_active":"2024-09-12T18:04:12.705623+0000","last_peered":"2024-09-12T18:04:12.705623+0000","last_clean":"2024-09-12T18:04:12.705623+0000","last_became_active":"2024-09-12T18:04:09.686122+0000","last_became_peered":"2024-09-12T18:04:09.686122+0000","last_unstale":"2024-09-12T18:04:12.705623+0000","last_undegraded":"2024-09-12T18:04:12.705623+0000","last_fullsized":"2024-09-12T18:04:12.705623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:39.304422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":993,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704310+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:04:12.704310+0000","last_peered":"2024-09-12T18:04:12.704310+0000","last_clean":"2024-09-12T18:04:12.704310+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:04:12.704310+0000","last_undegraded":"2024-09-12T18:04:12.704310+0000","last_fullsized":"2024-09-12T18:04:12.704310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691592+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:04:11.691592+0000","last_peered":"2024-09-12T18:04:11.691592+0000","last_clean":"2024-09-12T18:04:11.691592+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:04:11.691592+0000","last_undegraded":"2024-09-12T18:04:11.691592+0000","last_fullsized":"2024-09-12T18:04:11.691592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1050,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706158+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:04:12.706158+0000","last_peered":"2024-09-12T18:04:12.706158+0000","last_clean":"2024-09-12T18:04:12.706158+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:04:12.706158+0000","last_undegraded":"2024-09-12T18:04:12.706158+0000","last_fullsized":"2024-09-12T18:04:12.706158+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705486+0000","last_change":"2024-09-12T18:04:09.685941+0000","last_active":"2024-09-12T18:04:12.705486+0000","last_peered":"2024-09-12T18:04:12.705486+0000","last_clean":"2024-09-12T18:04:12.705486+0000","last_became_active":"2024-09-12T18:04:09.681305+0000","last_became_peered":"2024-09-12T18:04:09.681305+0000","last_unstale":"2024-09-12T18:04:12.705486+0000","last_undegraded":"2024-09-12T18:04:12.705486+0000","last_fullsized":"2024-09-12T18:04:12.705486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:29.147388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":535,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705577+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:04:12.705577+0000","last_peered":"2024-09-12T18:04:12.705577+0000","last_clean":"2024-09-12T18:04:12.705577+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:04:12.705577+0000","last_undegraded":"2024-09-12T18:04:12.705577+0000","last_fullsized":"2024-09-12T18:04:12.705577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705397+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:04:12.705397+0000","last_peered":"2024-09-12T18:04:12.705397+0000","last_clean":"2024-09-12T18:04:12.705397+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:04:12.705397+0000","last_undegraded":"2024-09-12T18:04:12.705397+0000","last_fullsized":"2024-09-12T18:04:12.705397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":615,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704904+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:04:12.704904+0000","last_peered":"2024-09-12T18:04:12.704904+0000","last_clean":"2024-09-12T18:04:12.704904+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:04:12.704904+0000","last_undegraded":"2024-09-12T18:04:12.704904+0000","last_fullsized":"2024-09-12T18:04:12.704904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706583+0000","last_change":"2024-09-12T18:04:09.695076+0000","last_active":"2024-09-12T18:04:12.706583+0000","last_peered":"2024-09-12T18:04:12.706583+0000","last_clean":"2024-09-12T18:04:12.706583+0000","last_became_active":"2024-09-12T18:04:09.684858+0000","last_became_peered":"2024-09-12T18:04:09.684858+0000","last_unstale":"2024-09-12T18:04:12.706583+0000","last_undegraded":"2024-09-12T18:04:12.706583+0000","last_fullsized":"2024-09-12T18:04:12.706583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:14.097506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":685,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704492+0000","last_change":"2024-09-12T18:04:09.687477+0000","last_active":"2024-09-12T18:04:12.704492+0000","last_peered":"2024-09-12T18:04:12.704492+0000","last_clean":"2024-09-12T18:04:12.704492+0000","last_became_active":"2024-09-12T18:04:09.680510+0000","last_became_peered":"2024-09-12T18:04:09.680510+0000","last_unstale":"2024-09-12T18:04:12.704492+0000","last_undegraded":"2024-09-12T18:04:12.704492+0000","last_fullsized":"2024-09-12T18:04:12.704492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:53.703464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":605,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691939+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:04:11.691939+0000","last_peered":"2024-09-12T18:04:11.691939+0000","last_clean":"2024-09-12T18:04:11.691939+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:04:11.691939+0000","last_undegraded":"2024-09-12T18:04:11.691939+0000","last_fullsized":"2024-09-12T18:04:11.691939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":692,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706585+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:04:12.706585+0000","last_peered":"2024-09-12T18:04:12.706585+0000","last_clean":"2024-09-12T18:04:12.706585+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:04:12.706585+0000","last_undegraded":"2024-09-12T18:04:12.706585+0000","last_fullsized":"2024-09-12T18:04:12.706585+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":689,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690818+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:04:11.690818+0000","last_peered":"2024-09-12T18:04:11.690818+0000","last_clean":"2024-09-12T18:04:11.690818+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:04:11.690818+0000","last_undegraded":"2024-09-12T18:04:11.690818+0000","last_fullsized":"2024-09-12T18:04:11.690818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705083+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:04:12.705083+0000","last_peered":"2024-09-12T18:04:12.705083+0000","last_clean":"2024-09-12T18:04:12.705083+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:04:12.705083+0000","last_undegraded":"2024-09-12T18:04:12.705083+0000","last_fullsized":"2024-09-12T18:04:12.705083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":1000,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706891+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:04:12.706891+0000","last_peered":"2024-09-12T18:04:12.706891+0000","last_clean":"2024-09-12T18:04:12.706891+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:04:12.706891+0000","last_undegraded":"2024-09-12T18:04:12.706891+0000","last_fullsized":"2024-09-12T18:04:12.706891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704901+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:04:12.704901+0000","last_peered":"2024-09-12T18:04:12.704901+0000","last_clean":"2024-09-12T18:04:12.704901+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:04:12.704901+0000","last_undegraded":"2024-09-12T18:04:12.704901+0000","last_fullsized":"2024-09-12T18:04:12.704901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":931,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689822+0000","last_change":"2024-09-12T18:03:56.341786+0000","last_active":"2024-09-12T18:04:11.689822+0000","last_peered":"2024-09-12T18:04:11.689822+0000","last_clean":"2024-09-12T18:04:11.689822+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:04:11.689822+0000","last_undegraded":"2024-09-12T18:04:11.689822+0000","last_fullsized":"2024-09-12T18:04:11.689822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704364+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:04:12.704364+0000","last_peered":"2024-09-12T18:04:12.704364+0000","last_clean":"2024-09-12T18:04:12.704364+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:04:12.704364+0000","last_undegraded":"2024-09-12T18:04:12.704364+0000","last_fullsized":"2024-09-12T18:04:12.704364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706563+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:04:12.706563+0000","last_peered":"2024-09-12T18:04:12.706563+0000","last_clean":"2024-09-12T18:04:12.706563+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:04:12.706563+0000","last_undegraded":"2024-09-12T18:04:12.706563+0000","last_fullsized":"2024-09-12T18:04:12.706563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691216+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:04:11.691216+0000","last_peered":"2024-09-12T18:04:11.691216+0000","last_clean":"2024-09-12T18:04:11.691216+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:04:11.691216+0000","last_undegraded":"2024-09-12T18:04:11.691216+0000","last_fullsized":"2024-09-12T18:04:11.691216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705566+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:04:12.705566+0000","last_peered":"2024-09-12T18:04:12.705566+0000","last_clean":"2024-09-12T18:04:12.705566+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:04:12.705566+0000","last_undegraded":"2024-09-12T18:04:12.705566+0000","last_fullsized":"2024-09-12T18:04:12.705566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706212+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:04:12.706212+0000","last_peered":"2024-09-12T18:04:12.706212+0000","last_clean":"2024-09-12T18:04:12.706212+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:04:12.706212+0000","last_undegraded":"2024-09-12T18:04:12.706212+0000","last_fullsized":"2024-09-12T18:04:12.706212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":951,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690328+0000","last_change":"2024-09-12T18:03:56.344116+0000","last_active":"2024-09-12T18:04:11.690328+0000","last_peered":"2024-09-12T18:04:11.690328+0000","last_clean":"2024-09-12T18:04:11.690328+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:04:11.690328+0000","last_undegraded":"2024-09-12T18:04:11.690328+0000","last_fullsized":"2024-09-12T18:04:11.690328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704483+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:04:12.704483+0000","last_peered":"2024-09-12T18:04:12.704483+0000","last_clean":"2024-09-12T18:04:12.704483+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:04:12.704483+0000","last_undegraded":"2024-09-12T18:04:12.704483+0000","last_fullsized":"2024-09-12T18:04:12.704483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":1004,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689361+0000","last_change":"2024-09-12T18:03:57.344789+0000","last_active":"2024-09-12T18:04:11.689361+0000","last_peered":"2024-09-12T18:04:11.689361+0000","last_clean":"2024-09-12T18:04:11.689361+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:04:11.689361+0000","last_undegraded":"2024-09-12T18:04:11.689361+0000","last_fullsized":"2024-09-12T18:04:11.689361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704604+0000","last_change":"2024-09-12T18:04:09.687125+0000","last_active":"2024-09-12T18:04:12.704604+0000","last_peered":"2024-09-12T18:04:12.704604+0000","last_clean":"2024-09-12T18:04:12.704604+0000","last_became_active":"2024-09-12T18:04:09.680177+0000","last_became_peered":"2024-09-12T18:04:09.680177+0000","last_unstale":"2024-09-12T18:04:12.704604+0000","last_undegraded":"2024-09-12T18:04:12.704604+0000","last_fullsized":"2024-09-12T18:04:12.704604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705931+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:04:12.705931+0000","last_peered":"2024-09-12T18:04:12.705931+0000","last_clean":"2024-09-12T18:04:12.705931+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:04:12.705931+0000","last_undegraded":"2024-09-12T18:04:12.705931+0000","last_fullsized":"2024-09-12T18:04:12.705931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707039+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:04:12.707039+0000","last_peered":"2024-09-12T18:04:12.707039+0000","last_clean":"2024-09-12T18:04:12.707039+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:04:12.707039+0000","last_undegraded":"2024-09-12T18:04:12.707039+0000","last_fullsized":"2024-09-12T18:04:12.707039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":562,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706416+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:04:12.706416+0000","last_peered":"2024-09-12T18:04:12.706416+0000","last_clean":"2024-09-12T18:04:12.706416+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:04:12.706416+0000","last_undegraded":"2024-09-12T18:04:12.706416+0000","last_fullsized":"2024-09-12T18:04:12.706416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":193,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690488+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:04:11.690488+0000","last_peered":"2024-09-12T18:04:11.690488+0000","last_clean":"2024-09-12T18:04:11.690488+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:04:11.690488+0000","last_undegraded":"2024-09-12T18:04:11.690488+0000","last_fullsized":"2024-09-12T18:04:11.690488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691699+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:04:11.691699+0000","last_peered":"2024-09-12T18:04:11.691699+0000","last_clean":"2024-09-12T18:04:11.691699+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:04:11.691699+0000","last_undegraded":"2024-09-12T18:04:11.691699+0000","last_fullsized":"2024-09-12T18:04:11.691699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704763+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:04:12.704763+0000","last_peered":"2024-09-12T18:04:12.704763+0000","last_clean":"2024-09-12T18:04:12.704763+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:04:12.704763+0000","last_undegraded":"2024-09-12T18:04:12.704763+0000","last_fullsized":"2024-09-12T18:04:12.704763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690883+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:04:11.690883+0000","last_peered":"2024-09-12T18:04:11.690883+0000","last_clean":"2024-09-12T18:04:11.690883+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:04:11.690883+0000","last_undegraded":"2024-09-12T18:04:11.690883+0000","last_fullsized":"2024-09-12T18:04:11.690883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":208,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704780+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:04:12.704780+0000","last_peered":"2024-09-12T18:04:12.704780+0000","last_clean":"2024-09-12T18:04:12.704780+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:04:12.704780+0000","last_undegraded":"2024-09-12T18:04:12.704780+0000","last_fullsized":"2024-09-12T18:04:12.704780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":286,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706247+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:04:12.706247+0000","last_peered":"2024-09-12T18:04:12.706247+0000","last_clean":"2024-09-12T18:04:12.706247+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:04:12.706247+0000","last_undegraded":"2024-09-12T18:04:12.706247+0000","last_fullsized":"2024-09-12T18:04:12.706247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704427+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:04:12.704427+0000","last_peered":"2024-09-12T18:04:12.704427+0000","last_clean":"2024-09-12T18:04:12.704427+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:04:12.704427+0000","last_undegraded":"2024-09-12T18:04:12.704427+0000","last_fullsized":"2024-09-12T18:04:12.704427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":397,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706623+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:04:12.706623+0000","last_peered":"2024-09-12T18:04:12.706623+0000","last_clean":"2024-09-12T18:04:12.706623+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:04:12.706623+0000","last_undegraded":"2024-09-12T18:04:12.706623+0000","last_fullsized":"2024-09-12T18:04:12.706623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1468,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704401+0000","last_change":"2024-09-12T18:03:53.336888+0000","last_active":"2024-09-12T18:04:12.704401+0000","last_peered":"2024-09-12T18:04:12.704401+0000","last_clean":"2024-09-12T18:04:12.704401+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:04:12.704401+0000","last_undegraded":"2024-09-12T18:04:12.704401+0000","last_fullsized":"2024-09-12T18:04:12.704401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706190+0000","last_change":"2024-09-12T18:04:09.686572+0000","last_active":"2024-09-12T18:04:12.706190+0000","last_peered":"2024-09-12T18:04:12.706190+0000","last_clean":"2024-09-12T18:04:12.706190+0000","last_became_active":"2024-09-12T18:04:09.682207+0000","last_became_peered":"2024-09-12T18:04:09.682207+0000","last_unstale":"2024-09-12T18:04:12.706190+0000","last_undegraded":"2024-09-12T18:04:12.706190+0000","last_fullsized":"2024-09-12T18:04:12.706190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:19.750113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705239+0000","last_change":"2024-09-12T18:04:09.694336+0000","last_active":"2024-09-12T18:04:12.705239+0000","last_peered":"2024-09-12T18:04:12.705239+0000","last_clean":"2024-09-12T18:04:12.705239+0000","last_became_active":"2024-09-12T18:04:09.681881+0000","last_became_peered":"2024-09-12T18:04:09.681881+0000","last_unstale":"2024-09-12T18:04:12.705239+0000","last_undegraded":"2024-09-12T18:04:12.705239+0000","last_fullsized":"2024-09-12T18:04:12.705239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:08.728289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":202,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706249+0000","last_change":"2024-09-12T18:04:09.695023+0000","last_active":"2024-09-12T18:04:12.706249+0000","last_peered":"2024-09-12T18:04:12.706249+0000","last_clean":"2024-09-12T18:04:12.706249+0000","last_became_active":"2024-09-12T18:04:09.692860+0000","last_became_peered":"2024-09-12T18:04:09.692860+0000","last_unstale":"2024-09-12T18:04:12.706249+0000","last_undegraded":"2024-09-12T18:04:12.706249+0000","last_fullsized":"2024-09-12T18:04:12.706249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:22.990905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":647,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690399+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:04:11.690399+0000","last_peered":"2024-09-12T18:04:11.690399+0000","last_clean":"2024-09-12T18:04:11.690399+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:04:11.690399+0000","last_undegraded":"2024-09-12T18:04:11.690399+0000","last_fullsized":"2024-09-12T18:04:11.690399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691540+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:04:11.691540+0000","last_peered":"2024-09-12T18:04:11.691540+0000","last_clean":"2024-09-12T18:04:11.691540+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:04:11.691540+0000","last_undegraded":"2024-09-12T18:04:11.691540+0000","last_fullsized":"2024-09-12T18:04:11.691540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705390+0000","last_change":"2024-09-12T18:04:09.694162+0000","last_active":"2024-09-12T18:04:12.705390+0000","last_peered":"2024-09-12T18:04:12.705390+0000","last_clean":"2024-09-12T18:04:12.705390+0000","last_became_active":"2024-09-12T18:04:09.686387+0000","last_became_peered":"2024-09-12T18:04:09.686387+0000","last_unstale":"2024-09-12T18:04:12.705390+0000","last_undegraded":"2024-09-12T18:04:12.705390+0000","last_fullsized":"2024-09-12T18:04:12.705390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:22.543587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706189+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:04:12.706189+0000","last_peered":"2024-09-12T18:04:12.706189+0000","last_clean":"2024-09-12T18:04:12.706189+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:04:12.706189+0000","last_undegraded":"2024-09-12T18:04:12.706189+0000","last_fullsized":"2024-09-12T18:04:12.706189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705919+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:04:12.705919+0000","last_peered":"2024-09-12T18:04:12.705919+0000","last_clean":"2024-09-12T18:04:12.705919+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:04:12.705919+0000","last_undegraded":"2024-09-12T18:04:12.705919+0000","last_fullsized":"2024-09-12T18:04:12.705919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":199,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704923+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:04:12.704923+0000","last_peered":"2024-09-12T18:04:12.704923+0000","last_clean":"2024-09-12T18:04:12.704923+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:04:12.704923+0000","last_undegraded":"2024-09-12T18:04:12.704923+0000","last_fullsized":"2024-09-12T18:04:12.704923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705970+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:04:12.705970+0000","last_peered":"2024-09-12T18:04:12.705970+0000","last_clean":"2024-09-12T18:04:12.705970+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:04:12.705970+0000","last_undegraded":"2024-09-12T18:04:12.705970+0000","last_fullsized":"2024-09-12T18:04:12.705970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704648+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:04:12.704648+0000","last_peered":"2024-09-12T18:04:12.704648+0000","last_clean":"2024-09-12T18:04:12.704648+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:04:12.704648+0000","last_undegraded":"2024-09-12T18:04:12.704648+0000","last_fullsized":"2024-09-12T18:04:12.704648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691197+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:04:11.691197+0000","last_peered":"2024-09-12T18:04:11.691197+0000","last_clean":"2024-09-12T18:04:11.691197+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:04:11.691197+0000","last_undegraded":"2024-09-12T18:04:11.691197+0000","last_fullsized":"2024-09-12T18:04:11.691197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705995+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:04:12.705995+0000","last_peered":"2024-09-12T18:04:12.705995+0000","last_clean":"2024-09-12T18:04:12.705995+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:04:12.705995+0000","last_undegraded":"2024-09-12T18:04:12.705995+0000","last_fullsized":"2024-09-12T18:04:12.705995+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707193+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:04:12.707193+0000","last_peered":"2024-09-12T18:04:12.707193+0000","last_clean":"2024-09-12T18:04:12.707193+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:04:12.707193+0000","last_undegraded":"2024-09-12T18:04:12.707193+0000","last_fullsized":"2024-09-12T18:04:12.707193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":713,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690829+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:04:11.690829+0000","last_peered":"2024-09-12T18:04:11.690829+0000","last_clean":"2024-09-12T18:04:11.690829+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:04:11.690829+0000","last_undegraded":"2024-09-12T18:04:11.690829+0000","last_fullsized":"2024-09-12T18:04:11.690829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":609,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706016+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:04:12.706016+0000","last_peered":"2024-09-12T18:04:12.706016+0000","last_clean":"2024-09-12T18:04:12.706016+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:04:12.706016+0000","last_undegraded":"2024-09-12T18:04:12.706016+0000","last_fullsized":"2024-09-12T18:04:12.706016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705822+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:04:12.705822+0000","last_peered":"2024-09-12T18:04:12.705822+0000","last_clean":"2024-09-12T18:04:12.705822+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:04:12.705822+0000","last_undegraded":"2024-09-12T18:04:12.705822+0000","last_fullsized":"2024-09-12T18:04:12.705822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":342,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689704+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:04:11.689704+0000","last_peered":"2024-09-12T18:04:11.689704+0000","last_clean":"2024-09-12T18:04:11.689704+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:04:11.689704+0000","last_undegraded":"2024-09-12T18:04:11.689704+0000","last_fullsized":"2024-09-12T18:04:11.689704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706251+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:04:12.706251+0000","last_peered":"2024-09-12T18:04:12.706251+0000","last_clean":"2024-09-12T18:04:12.706251+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:04:12.706251+0000","last_undegraded":"2024-09-12T18:04:12.706251+0000","last_fullsized":"2024-09-12T18:04:12.706251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691575+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:04:11.691575+0000","last_peered":"2024-09-12T18:04:11.691575+0000","last_clean":"2024-09-12T18:04:11.691575+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:04:11.691575+0000","last_undegraded":"2024-09-12T18:04:11.691575+0000","last_fullsized":"2024-09-12T18:04:11.691575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704735+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:04:12.704735+0000","last_peered":"2024-09-12T18:04:12.704735+0000","last_clean":"2024-09-12T18:04:12.704735+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:04:12.704735+0000","last_undegraded":"2024-09-12T18:04:12.704735+0000","last_fullsized":"2024-09-12T18:04:12.704735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":811,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690607+0000","last_change":"2024-09-12T18:03:54.334607+0000","last_active":"2024-09-12T18:04:11.690607+0000","last_peered":"2024-09-12T18:04:11.690607+0000","last_clean":"2024-09-12T18:04:11.690607+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:04:11.690607+0000","last_undegraded":"2024-09-12T18:04:11.690607+0000","last_fullsized":"2024-09-12T18:04:11.690607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:27.565973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706554+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:04:12.706554+0000","last_peered":"2024-09-12T18:04:12.706554+0000","last_clean":"2024-09-12T18:04:12.706554+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:04:12.706554+0000","last_undegraded":"2024-09-12T18:04:12.706554+0000","last_fullsized":"2024-09-12T18:04:12.706554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":222,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707067+0000","last_change":"2024-09-12T18:04:09.697006+0000","last_active":"2024-09-12T18:04:12.707067+0000","last_peered":"2024-09-12T18:04:12.707067+0000","last_clean":"2024-09-12T18:04:12.707067+0000","last_became_active":"2024-09-12T18:04:09.686200+0000","last_became_peered":"2024-09-12T18:04:09.686200+0000","last_unstale":"2024-09-12T18:04:12.707067+0000","last_undegraded":"2024-09-12T18:04:12.707067+0000","last_fullsized":"2024-09-12T18:04:12.707067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:17.012774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691405+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:04:11.691405+0000","last_peered":"2024-09-12T18:04:11.691405+0000","last_clean":"2024-09-12T18:04:11.691405+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:04:11.691405+0000","last_undegraded":"2024-09-12T18:04:11.691405+0000","last_fullsized":"2024-09-12T18:04:11.691405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":448,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706291+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:04:12.706291+0000","last_peered":"2024-09-12T18:04:12.706291+0000","last_clean":"2024-09-12T18:04:12.706291+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:04:12.706291+0000","last_undegraded":"2024-09-12T18:04:12.706291+0000","last_fullsized":"2024-09-12T18:04:12.706291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691578+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:04:11.691578+0000","last_peered":"2024-09-12T18:04:11.691578+0000","last_clean":"2024-09-12T18:04:11.691578+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:04:11.691578+0000","last_undegraded":"2024-09-12T18:04:11.691578+0000","last_fullsized":"2024-09-12T18:04:11.691578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704996+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:04:12.704996+0000","last_peered":"2024-09-12T18:04:12.704996+0000","last_clean":"2024-09-12T18:04:12.704996+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:04:12.704996+0000","last_undegraded":"2024-09-12T18:04:12.704996+0000","last_fullsized":"2024-09-12T18:04:12.704996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690358+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:04:11.690358+0000","last_peered":"2024-09-12T18:04:11.690358+0000","last_clean":"2024-09-12T18:04:11.690358+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:04:11.690358+0000","last_undegraded":"2024-09-12T18:04:11.690358+0000","last_fullsized":"2024-09-12T18:04:11.690358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707020+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:04:12.707020+0000","last_peered":"2024-09-12T18:04:12.707020+0000","last_clean":"2024-09-12T18:04:12.707020+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:04:12.707020+0000","last_undegraded":"2024-09-12T18:04:12.707020+0000","last_fullsized":"2024-09-12T18:04:12.707020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":558,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705573+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:04:12.705573+0000","last_peered":"2024-09-12T18:04:12.705573+0000","last_clean":"2024-09-12T18:04:12.705573+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:04:12.705573+0000","last_undegraded":"2024-09-12T18:04:12.705573+0000","last_fullsized":"2024-09-12T18:04:12.705573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691531+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:04:11.691531+0000","last_peered":"2024-09-12T18:04:11.691531+0000","last_clean":"2024-09-12T18:04:11.691531+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:04:11.691531+0000","last_undegraded":"2024-09-12T18:04:11.691531+0000","last_fullsized":"2024-09-12T18:04:11.691531+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690336+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:04:11.690336+0000","last_peered":"2024-09-12T18:04:11.690336+0000","last_clean":"2024-09-12T18:04:11.690336+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:04:11.690336+0000","last_undegraded":"2024-09-12T18:04:11.690336+0000","last_fullsized":"2024-09-12T18:04:11.690336+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":573,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689659+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:04:11.689659+0000","last_peered":"2024-09-12T18:04:11.689659+0000","last_clean":"2024-09-12T18:04:11.689659+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:04:11.689659+0000","last_undegraded":"2024-09-12T18:04:11.689659+0000","last_fullsized":"2024-09-12T18:04:11.689659+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"72'114","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691584+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:04:11.691584+0000","last_peered":"2024-09-12T18:04:11.691584+0000","last_clean":"2024-09-12T18:04:11.691584+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:04:11.691584+0000","last_undegraded":"2024-09-12T18:04:11.691584+0000","last_fullsized":"2024-09-12T18:04:11.691584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706764+0000","last_change":"2024-09-12T18:04:09.677962+0000","last_active":"2024-09-12T18:04:12.706764+0000","last_peered":"2024-09-12T18:04:12.706764+0000","last_clean":"2024-09-12T18:04:12.706764+0000","last_became_active":"2024-09-12T18:04:09.677062+0000","last_became_peered":"2024-09-12T18:04:09.677062+0000","last_unstale":"2024-09-12T18:04:12.706764+0000","last_undegraded":"2024-09-12T18:04:12.706764+0000","last_fullsized":"2024-09-12T18:04:12.706764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:17.652687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704592+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:04:12.704592+0000","last_peered":"2024-09-12T18:04:12.704592+0000","last_clean":"2024-09-12T18:04:12.704592+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:04:12.704592+0000","last_undegraded":"2024-09-12T18:04:12.704592+0000","last_fullsized":"2024-09-12T18:04:12.704592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":588,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706604+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:04:12.706604+0000","last_peered":"2024-09-12T18:04:12.706604+0000","last_clean":"2024-09-12T18:04:12.706604+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:04:12.706604+0000","last_undegraded":"2024-09-12T18:04:12.706604+0000","last_fullsized":"2024-09-12T18:04:12.706604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705957+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:04:12.705957+0000","last_peered":"2024-09-12T18:04:12.705957+0000","last_clean":"2024-09-12T18:04:12.705957+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:04:12.705957+0000","last_undegraded":"2024-09-12T18:04:12.705957+0000","last_fullsized":"2024-09-12T18:04:12.705957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":625,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690149+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:04:11.690149+0000","last_peered":"2024-09-12T18:04:11.690149+0000","last_clean":"2024-09-12T18:04:11.690149+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:04:11.690149+0000","last_undegraded":"2024-09-12T18:04:11.690149+0000","last_fullsized":"2024-09-12T18:04:11.690149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":241,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706935+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:04:12.706935+0000","last_peered":"2024-09-12T18:04:12.706935+0000","last_clean":"2024-09-12T18:04:12.706935+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:04:12.706935+0000","last_undegraded":"2024-09-12T18:04:12.706935+0000","last_fullsized":"2024-09-12T18:04:12.706935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":358,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706436+0000","last_change":"2024-09-12T18:04:09.685980+0000","last_active":"2024-09-12T18:04:12.706436+0000","last_peered":"2024-09-12T18:04:12.706436+0000","last_clean":"2024-09-12T18:04:12.706436+0000","last_became_active":"2024-09-12T18:04:09.682878+0000","last_became_peered":"2024-09-12T18:04:09.682878+0000","last_unstale":"2024-09-12T18:04:12.706436+0000","last_undegraded":"2024-09-12T18:04:12.706436+0000","last_fullsized":"2024-09-12T18:04:12.706436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":718,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691128+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:04:11.691128+0000","last_peered":"2024-09-12T18:04:11.691128+0000","last_clean":"2024-09-12T18:04:11.691128+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:04:11.691128+0000","last_undegraded":"2024-09-12T18:04:11.691128+0000","last_fullsized":"2024-09-12T18:04:11.691128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691277+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:04:11.691277+0000","last_peered":"2024-09-12T18:04:11.691277+0000","last_clean":"2024-09-12T18:04:11.691277+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:04:11.691277+0000","last_undegraded":"2024-09-12T18:04:11.691277+0000","last_fullsized":"2024-09-12T18:04:11.691277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":694,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689505+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:04:11.689505+0000","last_peered":"2024-09-12T18:04:11.689505+0000","last_clean":"2024-09-12T18:04:11.689505+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:04:11.689505+0000","last_undegraded":"2024-09-12T18:04:11.689505+0000","last_fullsized":"2024-09-12T18:04:11.689505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706629+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:04:12.706629+0000","last_peered":"2024-09-12T18:04:12.706629+0000","last_clean":"2024-09-12T18:04:12.706629+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:04:12.706629+0000","last_undegraded":"2024-09-12T18:04:12.706629+0000","last_fullsized":"2024-09-12T18:04:12.706629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":796,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689874+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:04:11.689874+0000","last_peered":"2024-09-12T18:04:11.689874+0000","last_clean":"2024-09-12T18:04:11.689874+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:04:11.689874+0000","last_undegraded":"2024-09-12T18:04:11.689874+0000","last_fullsized":"2024-09-12T18:04:11.689874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":668,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691035+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:04:11.691035+0000","last_peered":"2024-09-12T18:04:11.691035+0000","last_clean":"2024-09-12T18:04:11.691035+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:04:11.691035+0000","last_undegraded":"2024-09-12T18:04:11.691035+0000","last_fullsized":"2024-09-12T18:04:11.691035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":369,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689515+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:04:11.689515+0000","last_peered":"2024-09-12T18:04:11.689515+0000","last_clean":"2024-09-12T18:04:11.689515+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:04:11.689515+0000","last_undegraded":"2024-09-12T18:04:11.689515+0000","last_fullsized":"2024-09-12T18:04:11.689515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705907+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:04:12.705907+0000","last_peered":"2024-09-12T18:04:12.705907+0000","last_clean":"2024-09-12T18:04:12.705907+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:04:12.705907+0000","last_undegraded":"2024-09-12T18:04:12.705907+0000","last_fullsized":"2024-09-12T18:04:12.705907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":360,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705227+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:04:12.705227+0000","last_peered":"2024-09-12T18:04:12.705227+0000","last_clean":"2024-09-12T18:04:12.705227+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:04:12.705227+0000","last_undegraded":"2024-09-12T18:04:12.705227+0000","last_fullsized":"2024-09-12T18:04:12.705227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705628+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:04:12.705628+0000","last_peered":"2024-09-12T18:04:12.705628+0000","last_clean":"2024-09-12T18:04:12.705628+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:04:12.705628+0000","last_undegraded":"2024-09-12T18:04:12.705628+0000","last_fullsized":"2024-09-12T18:04:12.705628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":197,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705941+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:04:12.705941+0000","last_peered":"2024-09-12T18:04:12.705941+0000","last_clean":"2024-09-12T18:04:12.705941+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:04:12.705941+0000","last_undegraded":"2024-09-12T18:04:12.705941+0000","last_fullsized":"2024-09-12T18:04:12.705941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706584+0000","last_change":"2024-09-12T18:04:09.697861+0000","last_active":"2024-09-12T18:04:12.706584+0000","last_peered":"2024-09-12T18:04:12.706584+0000","last_clean":"2024-09-12T18:04:12.706584+0000","last_became_active":"2024-09-12T18:04:09.688026+0000","last_became_peered":"2024-09-12T18:04:09.688026+0000","last_unstale":"2024-09-12T18:04:12.706584+0000","last_undegraded":"2024-09-12T18:04:12.706584+0000","last_fullsized":"2024-09-12T18:04:12.706584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.825721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705675+0000","last_change":"2024-09-12T18:04:09.695422+0000","last_active":"2024-09-12T18:04:12.705675+0000","last_peered":"2024-09-12T18:04:12.705675+0000","last_clean":"2024-09-12T18:04:12.705675+0000","last_became_active":"2024-09-12T18:04:09.692975+0000","last_became_peered":"2024-09-12T18:04:09.692975+0000","last_unstale":"2024-09-12T18:04:12.705675+0000","last_undegraded":"2024-09-12T18:04:12.705675+0000","last_fullsized":"2024-09-12T18:04:12.705675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.708997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1292,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705908+0000","last_change":"2024-09-12T18:04:09.693020+0000","last_active":"2024-09-12T18:04:12.705908+0000","last_peered":"2024-09-12T18:04:12.705908+0000","last_clean":"2024-09-12T18:04:12.705908+0000","last_became_active":"2024-09-12T18:04:09.684915+0000","last_became_peered":"2024-09-12T18:04:09.684915+0000","last_unstale":"2024-09-12T18:04:12.705908+0000","last_undegraded":"2024-09-12T18:04:12.705908+0000","last_fullsized":"2024-09-12T18:04:12.705908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:27.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":423,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706634+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:04:12.706634+0000","last_peered":"2024-09-12T18:04:12.706634+0000","last_clean":"2024-09-12T18:04:12.706634+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:04:12.706634+0000","last_undegraded":"2024-09-12T18:04:12.706634+0000","last_fullsized":"2024-09-12T18:04:12.706634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":563,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704948+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:04:12.704948+0000","last_peered":"2024-09-12T18:04:12.704948+0000","last_clean":"2024-09-12T18:04:12.704948+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:04:12.704948+0000","last_undegraded":"2024-09-12T18:04:12.704948+0000","last_fullsized":"2024-09-12T18:04:12.704948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691316+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:04:11.691316+0000","last_peered":"2024-09-12T18:04:11.691316+0000","last_clean":"2024-09-12T18:04:11.691316+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:04:11.691316+0000","last_undegraded":"2024-09-12T18:04:11.691316+0000","last_fullsized":"2024-09-12T18:04:11.691316+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704907+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:04:12.704907+0000","last_peered":"2024-09-12T18:04:12.704907+0000","last_clean":"2024-09-12T18:04:12.704907+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:04:12.704907+0000","last_undegraded":"2024-09-12T18:04:12.704907+0000","last_fullsized":"2024-09-12T18:04:12.704907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690565+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:04:11.690565+0000","last_peered":"2024-09-12T18:04:11.690565+0000","last_clean":"2024-09-12T18:04:11.690565+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:04:11.690565+0000","last_undegraded":"2024-09-12T18:04:11.690565+0000","last_fullsized":"2024-09-12T18:04:11.690565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6248,"ondisk_log_size":6248,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121704,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":24526848,"data_stored":81403848,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738403,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113888,"kb_used_data":28612,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94257952,"statfs":{"total":96636764160,"available":96520142848,"internally_reserved":0,"allocated":29298688,"data_stored":84724657,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738403,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118208,"kb_used_data":28776,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253632,"statfs":{"total":96636764160,"available":96515719168,"internally_reserved":0,"allocated":29466624,"data_stored":90491785,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:04:17.102 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:04:17.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:04:17.451 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:17.452 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:04:17.468 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-12T18:04:16.594787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32952,"ondisk_log_size":32952,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":353800,"kb_used_data":81340,"kb_used_omap":4,"kb_used_meta":272379,"kb_avail":282761720,"statfs":{"total":289910292480,"available":289548001280,"internally_reserved":0,"allocated":83292160,"data_stored":256620290,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":278916431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":548,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002040"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706444+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:04:12.706444+0000","last_peered":"2024-09-12T18:04:12.706444+0000","last_clean":"2024-09-12T18:04:12.706444+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:04:12.706444+0000","last_undegraded":"2024-09-12T18:04:12.706444+0000","last_fullsized":"2024-09-12T18:04:12.706444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705980+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:04:12.705980+0000","last_peered":"2024-09-12T18:04:12.705980+0000","last_clean":"2024-09-12T18:04:12.705980+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:04:12.705980+0000","last_undegraded":"2024-09-12T18:04:12.705980+0000","last_fullsized":"2024-09-12T18:04:12.705980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705200+0000","last_change":"2024-09-12T18:04:09.681163+0000","last_active":"2024-09-12T18:04:12.705200+0000","last_peered":"2024-09-12T18:04:12.705200+0000","last_clean":"2024-09-12T18:04:12.705200+0000","last_became_active":"2024-09-12T18:04:09.677098+0000","last_became_peered":"2024-09-12T18:04:09.677098+0000","last_unstale":"2024-09-12T18:04:12.705200+0000","last_undegraded":"2024-09-12T18:04:12.705200+0000","last_fullsized":"2024-09-12T18:04:12.705200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:22.899798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705006+0000","last_change":"2024-09-12T18:04:09.694526+0000","last_active":"2024-09-12T18:04:12.705006+0000","last_peered":"2024-09-12T18:04:12.705006+0000","last_clean":"2024-09-12T18:04:12.705006+0000","last_became_active":"2024-09-12T18:04:09.685115+0000","last_became_peered":"2024-09-12T18:04:09.685115+0000","last_unstale":"2024-09-12T18:04:12.705006+0000","last_undegraded":"2024-09-12T18:04:12.705006+0000","last_fullsized":"2024-09-12T18:04:12.705006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.108507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705679+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:04:12.705679+0000","last_peered":"2024-09-12T18:04:12.705679+0000","last_clean":"2024-09-12T18:04:12.705679+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:04:12.705679+0000","last_undegraded":"2024-09-12T18:04:12.705679+0000","last_fullsized":"2024-09-12T18:04:12.705679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704814+0000","last_change":"2024-09-12T18:04:09.697456+0000","last_active":"2024-09-12T18:04:12.704814+0000","last_peered":"2024-09-12T18:04:12.704814+0000","last_clean":"2024-09-12T18:04:12.704814+0000","last_became_active":"2024-09-12T18:04:09.691370+0000","last_became_peered":"2024-09-12T18:04:09.691370+0000","last_unstale":"2024-09-12T18:04:12.704814+0000","last_undegraded":"2024-09-12T18:04:12.704814+0000","last_fullsized":"2024-09-12T18:04:12.704814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705623+0000","last_change":"2024-09-12T18:04:09.694180+0000","last_active":"2024-09-12T18:04:12.705623+0000","last_peered":"2024-09-12T18:04:12.705623+0000","last_clean":"2024-09-12T18:04:12.705623+0000","last_became_active":"2024-09-12T18:04:09.686122+0000","last_became_peered":"2024-09-12T18:04:09.686122+0000","last_unstale":"2024-09-12T18:04:12.705623+0000","last_undegraded":"2024-09-12T18:04:12.705623+0000","last_fullsized":"2024-09-12T18:04:12.705623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:39.304422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":993,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704310+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:04:12.704310+0000","last_peered":"2024-09-12T18:04:12.704310+0000","last_clean":"2024-09-12T18:04:12.704310+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:04:12.704310+0000","last_undegraded":"2024-09-12T18:04:12.704310+0000","last_fullsized":"2024-09-12T18:04:12.704310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691592+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:04:11.691592+0000","last_peered":"2024-09-12T18:04:11.691592+0000","last_clean":"2024-09-12T18:04:11.691592+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:04:11.691592+0000","last_undegraded":"2024-09-12T18:04:11.691592+0000","last_fullsized":"2024-09-12T18:04:11.691592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1050,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706158+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:04:12.706158+0000","last_peered":"2024-09-12T18:04:12.706158+0000","last_clean":"2024-09-12T18:04:12.706158+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:04:12.706158+0000","last_undegraded":"2024-09-12T18:04:12.706158+0000","last_fullsized":"2024-09-12T18:04:12.706158+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705486+0000","last_change":"2024-09-12T18:04:09.685941+0000","last_active":"2024-09-12T18:04:12.705486+0000","last_peered":"2024-09-12T18:04:12.705486+0000","last_clean":"2024-09-12T18:04:12.705486+0000","last_became_active":"2024-09-12T18:04:09.681305+0000","last_became_peered":"2024-09-12T18:04:09.681305+0000","last_unstale":"2024-09-12T18:04:12.705486+0000","last_undegraded":"2024-09-12T18:04:12.705486+0000","last_fullsized":"2024-09-12T18:04:12.705486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:29.147388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":535,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705577+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:04:12.705577+0000","last_peered":"2024-09-12T18:04:12.705577+0000","last_clean":"2024-09-12T18:04:12.705577+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:04:12.705577+0000","last_undegraded":"2024-09-12T18:04:12.705577+0000","last_fullsized":"2024-09-12T18:04:12.705577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705397+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:04:12.705397+0000","last_peered":"2024-09-12T18:04:12.705397+0000","last_clean":"2024-09-12T18:04:12.705397+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:04:12.705397+0000","last_undegraded":"2024-09-12T18:04:12.705397+0000","last_fullsized":"2024-09-12T18:04:12.705397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":615,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704904+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:04:12.704904+0000","last_peered":"2024-09-12T18:04:12.704904+0000","last_clean":"2024-09-12T18:04:12.704904+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:04:12.704904+0000","last_undegraded":"2024-09-12T18:04:12.704904+0000","last_fullsized":"2024-09-12T18:04:12.704904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706583+0000","last_change":"2024-09-12T18:04:09.695076+0000","last_active":"2024-09-12T18:04:12.706583+0000","last_peered":"2024-09-12T18:04:12.706583+0000","last_clean":"2024-09-12T18:04:12.706583+0000","last_became_active":"2024-09-12T18:04:09.684858+0000","last_became_peered":"2024-09-12T18:04:09.684858+0000","last_unstale":"2024-09-12T18:04:12.706583+0000","last_undegraded":"2024-09-12T18:04:12.706583+0000","last_fullsized":"2024-09-12T18:04:12.706583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:14.097506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":685,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704492+0000","last_change":"2024-09-12T18:04:09.687477+0000","last_active":"2024-09-12T18:04:12.704492+0000","last_peered":"2024-09-12T18:04:12.704492+0000","last_clean":"2024-09-12T18:04:12.704492+0000","last_became_active":"2024-09-12T18:04:09.680510+0000","last_became_peered":"2024-09-12T18:04:09.680510+0000","last_unstale":"2024-09-12T18:04:12.704492+0000","last_undegraded":"2024-09-12T18:04:12.704492+0000","last_fullsized":"2024-09-12T18:04:12.704492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:53.703464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":605,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691939+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:04:11.691939+0000","last_peered":"2024-09-12T18:04:11.691939+0000","last_clean":"2024-09-12T18:04:11.691939+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:04:11.691939+0000","last_undegraded":"2024-09-12T18:04:11.691939+0000","last_fullsized":"2024-09-12T18:04:11.691939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":692,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706585+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:04:12.706585+0000","last_peered":"2024-09-12T18:04:12.706585+0000","last_clean":"2024-09-12T18:04:12.706585+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:04:12.706585+0000","last_undegraded":"2024-09-12T18:04:12.706585+0000","last_fullsized":"2024-09-12T18:04:12.706585+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":689,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690818+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:04:11.690818+0000","last_peered":"2024-09-12T18:04:11.690818+0000","last_clean":"2024-09-12T18:04:11.690818+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:04:11.690818+0000","last_undegraded":"2024-09-12T18:04:11.690818+0000","last_fullsized":"2024-09-12T18:04:11.690818+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705083+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:04:12.705083+0000","last_peered":"2024-09-12T18:04:12.705083+0000","last_clean":"2024-09-12T18:04:12.705083+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:04:12.705083+0000","last_undegraded":"2024-09-12T18:04:12.705083+0000","last_fullsized":"2024-09-12T18:04:12.705083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":1000,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706891+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:04:12.706891+0000","last_peered":"2024-09-12T18:04:12.706891+0000","last_clean":"2024-09-12T18:04:12.706891+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:04:12.706891+0000","last_undegraded":"2024-09-12T18:04:12.706891+0000","last_fullsized":"2024-09-12T18:04:12.706891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704901+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:04:12.704901+0000","last_peered":"2024-09-12T18:04:12.704901+0000","last_clean":"2024-09-12T18:04:12.704901+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:04:12.704901+0000","last_undegraded":"2024-09-12T18:04:12.704901+0000","last_fullsized":"2024-09-12T18:04:12.704901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":931,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689822+0000","last_change":"2024-09-12T18:03:56.341786+0000","last_active":"2024-09-12T18:04:11.689822+0000","last_peered":"2024-09-12T18:04:11.689822+0000","last_clean":"2024-09-12T18:04:11.689822+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:04:11.689822+0000","last_undegraded":"2024-09-12T18:04:11.689822+0000","last_fullsized":"2024-09-12T18:04:11.689822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704364+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:04:12.704364+0000","last_peered":"2024-09-12T18:04:12.704364+0000","last_clean":"2024-09-12T18:04:12.704364+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:04:12.704364+0000","last_undegraded":"2024-09-12T18:04:12.704364+0000","last_fullsized":"2024-09-12T18:04:12.704364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706563+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:04:12.706563+0000","last_peered":"2024-09-12T18:04:12.706563+0000","last_clean":"2024-09-12T18:04:12.706563+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:04:12.706563+0000","last_undegraded":"2024-09-12T18:04:12.706563+0000","last_fullsized":"2024-09-12T18:04:12.706563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691216+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:04:11.691216+0000","last_peered":"2024-09-12T18:04:11.691216+0000","last_clean":"2024-09-12T18:04:11.691216+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:04:11.691216+0000","last_undegraded":"2024-09-12T18:04:11.691216+0000","last_fullsized":"2024-09-12T18:04:11.691216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705566+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:04:12.705566+0000","last_peered":"2024-09-12T18:04:12.705566+0000","last_clean":"2024-09-12T18:04:12.705566+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:04:12.705566+0000","last_undegraded":"2024-09-12T18:04:12.705566+0000","last_fullsized":"2024-09-12T18:04:12.705566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706212+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:04:12.706212+0000","last_peered":"2024-09-12T18:04:12.706212+0000","last_clean":"2024-09-12T18:04:12.706212+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:04:12.706212+0000","last_undegraded":"2024-09-12T18:04:12.706212+0000","last_fullsized":"2024-09-12T18:04:12.706212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":951,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690328+0000","last_change":"2024-09-12T18:03:56.344116+0000","last_active":"2024-09-12T18:04:11.690328+0000","last_peered":"2024-09-12T18:04:11.690328+0000","last_clean":"2024-09-12T18:04:11.690328+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:04:11.690328+0000","last_undegraded":"2024-09-12T18:04:11.690328+0000","last_fullsized":"2024-09-12T18:04:11.690328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704483+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:04:12.704483+0000","last_peered":"2024-09-12T18:04:12.704483+0000","last_clean":"2024-09-12T18:04:12.704483+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:04:12.704483+0000","last_undegraded":"2024-09-12T18:04:12.704483+0000","last_fullsized":"2024-09-12T18:04:12.704483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":1004,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689361+0000","last_change":"2024-09-12T18:03:57.344789+0000","last_active":"2024-09-12T18:04:11.689361+0000","last_peered":"2024-09-12T18:04:11.689361+0000","last_clean":"2024-09-12T18:04:11.689361+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:04:11.689361+0000","last_undegraded":"2024-09-12T18:04:11.689361+0000","last_fullsized":"2024-09-12T18:04:11.689361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704604+0000","last_change":"2024-09-12T18:04:09.687125+0000","last_active":"2024-09-12T18:04:12.704604+0000","last_peered":"2024-09-12T18:04:12.704604+0000","last_clean":"2024-09-12T18:04:12.704604+0000","last_became_active":"2024-09-12T18:04:09.680177+0000","last_became_peered":"2024-09-12T18:04:09.680177+0000","last_unstale":"2024-09-12T18:04:12.704604+0000","last_undegraded":"2024-09-12T18:04:12.704604+0000","last_fullsized":"2024-09-12T18:04:12.704604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":626,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705931+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:04:12.705931+0000","last_peered":"2024-09-12T18:04:12.705931+0000","last_clean":"2024-09-12T18:04:12.705931+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:04:12.705931+0000","last_undegraded":"2024-09-12T18:04:12.705931+0000","last_fullsized":"2024-09-12T18:04:12.705931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707039+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:04:12.707039+0000","last_peered":"2024-09-12T18:04:12.707039+0000","last_clean":"2024-09-12T18:04:12.707039+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:04:12.707039+0000","last_undegraded":"2024-09-12T18:04:12.707039+0000","last_fullsized":"2024-09-12T18:04:12.707039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":562,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706416+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:04:12.706416+0000","last_peered":"2024-09-12T18:04:12.706416+0000","last_clean":"2024-09-12T18:04:12.706416+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:04:12.706416+0000","last_undegraded":"2024-09-12T18:04:12.706416+0000","last_fullsized":"2024-09-12T18:04:12.706416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":193,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690488+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:04:11.690488+0000","last_peered":"2024-09-12T18:04:11.690488+0000","last_clean":"2024-09-12T18:04:11.690488+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:04:11.690488+0000","last_undegraded":"2024-09-12T18:04:11.690488+0000","last_fullsized":"2024-09-12T18:04:11.690488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691699+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:04:11.691699+0000","last_peered":"2024-09-12T18:04:11.691699+0000","last_clean":"2024-09-12T18:04:11.691699+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:04:11.691699+0000","last_undegraded":"2024-09-12T18:04:11.691699+0000","last_fullsized":"2024-09-12T18:04:11.691699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":215,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704763+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:04:12.704763+0000","last_peered":"2024-09-12T18:04:12.704763+0000","last_clean":"2024-09-12T18:04:12.704763+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:04:12.704763+0000","last_undegraded":"2024-09-12T18:04:12.704763+0000","last_fullsized":"2024-09-12T18:04:12.704763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690883+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:04:11.690883+0000","last_peered":"2024-09-12T18:04:11.690883+0000","last_clean":"2024-09-12T18:04:11.690883+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:04:11.690883+0000","last_undegraded":"2024-09-12T18:04:11.690883+0000","last_fullsized":"2024-09-12T18:04:11.690883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":208,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704780+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:04:12.704780+0000","last_peered":"2024-09-12T18:04:12.704780+0000","last_clean":"2024-09-12T18:04:12.704780+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:04:12.704780+0000","last_undegraded":"2024-09-12T18:04:12.704780+0000","last_fullsized":"2024-09-12T18:04:12.704780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":286,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706247+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:04:12.706247+0000","last_peered":"2024-09-12T18:04:12.706247+0000","last_clean":"2024-09-12T18:04:12.706247+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:04:12.706247+0000","last_undegraded":"2024-09-12T18:04:12.706247+0000","last_fullsized":"2024-09-12T18:04:12.706247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704427+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:04:12.704427+0000","last_peered":"2024-09-12T18:04:12.704427+0000","last_clean":"2024-09-12T18:04:12.704427+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:04:12.704427+0000","last_undegraded":"2024-09-12T18:04:12.704427+0000","last_fullsized":"2024-09-12T18:04:12.704427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":397,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706623+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:04:12.706623+0000","last_peered":"2024-09-12T18:04:12.706623+0000","last_clean":"2024-09-12T18:04:12.706623+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:04:12.706623+0000","last_undegraded":"2024-09-12T18:04:12.706623+0000","last_fullsized":"2024-09-12T18:04:12.706623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1468,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704401+0000","last_change":"2024-09-12T18:03:53.336888+0000","last_active":"2024-09-12T18:04:12.704401+0000","last_peered":"2024-09-12T18:04:12.704401+0000","last_clean":"2024-09-12T18:04:12.704401+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:04:12.704401+0000","last_undegraded":"2024-09-12T18:04:12.704401+0000","last_fullsized":"2024-09-12T18:04:12.704401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706190+0000","last_change":"2024-09-12T18:04:09.686572+0000","last_active":"2024-09-12T18:04:12.706190+0000","last_peered":"2024-09-12T18:04:12.706190+0000","last_clean":"2024-09-12T18:04:12.706190+0000","last_became_active":"2024-09-12T18:04:09.682207+0000","last_became_peered":"2024-09-12T18:04:09.682207+0000","last_unstale":"2024-09-12T18:04:12.706190+0000","last_undegraded":"2024-09-12T18:04:12.706190+0000","last_fullsized":"2024-09-12T18:04:12.706190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:19.750113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705239+0000","last_change":"2024-09-12T18:04:09.694336+0000","last_active":"2024-09-12T18:04:12.705239+0000","last_peered":"2024-09-12T18:04:12.705239+0000","last_clean":"2024-09-12T18:04:12.705239+0000","last_became_active":"2024-09-12T18:04:09.681881+0000","last_became_peered":"2024-09-12T18:04:09.681881+0000","last_unstale":"2024-09-12T18:04:12.705239+0000","last_undegraded":"2024-09-12T18:04:12.705239+0000","last_fullsized":"2024-09-12T18:04:12.705239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:08.728289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":202,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706249+0000","last_change":"2024-09-12T18:04:09.695023+0000","last_active":"2024-09-12T18:04:12.706249+0000","last_peered":"2024-09-12T18:04:12.706249+0000","last_clean":"2024-09-12T18:04:12.706249+0000","last_became_active":"2024-09-12T18:04:09.692860+0000","last_became_peered":"2024-09-12T18:04:09.692860+0000","last_unstale":"2024-09-12T18:04:12.706249+0000","last_undegraded":"2024-09-12T18:04:12.706249+0000","last_fullsized":"2024-09-12T18:04:12.706249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:22.990905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":647,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690399+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:04:11.690399+0000","last_peered":"2024-09-12T18:04:11.690399+0000","last_clean":"2024-09-12T18:04:11.690399+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:04:11.690399+0000","last_undegraded":"2024-09-12T18:04:11.690399+0000","last_fullsized":"2024-09-12T18:04:11.690399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691540+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:04:11.691540+0000","last_peered":"2024-09-12T18:04:11.691540+0000","last_clean":"2024-09-12T18:04:11.691540+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:04:11.691540+0000","last_undegraded":"2024-09-12T18:04:11.691540+0000","last_fullsized":"2024-09-12T18:04:11.691540+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705390+0000","last_change":"2024-09-12T18:04:09.694162+0000","last_active":"2024-09-12T18:04:12.705390+0000","last_peered":"2024-09-12T18:04:12.705390+0000","last_clean":"2024-09-12T18:04:12.705390+0000","last_became_active":"2024-09-12T18:04:09.686387+0000","last_became_peered":"2024-09-12T18:04:09.686387+0000","last_unstale":"2024-09-12T18:04:12.705390+0000","last_undegraded":"2024-09-12T18:04:12.705390+0000","last_fullsized":"2024-09-12T18:04:12.705390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:22.543587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706189+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:04:12.706189+0000","last_peered":"2024-09-12T18:04:12.706189+0000","last_clean":"2024-09-12T18:04:12.706189+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:04:12.706189+0000","last_undegraded":"2024-09-12T18:04:12.706189+0000","last_fullsized":"2024-09-12T18:04:12.706189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705919+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:04:12.705919+0000","last_peered":"2024-09-12T18:04:12.705919+0000","last_clean":"2024-09-12T18:04:12.705919+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:04:12.705919+0000","last_undegraded":"2024-09-12T18:04:12.705919+0000","last_fullsized":"2024-09-12T18:04:12.705919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":199,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704923+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:04:12.704923+0000","last_peered":"2024-09-12T18:04:12.704923+0000","last_clean":"2024-09-12T18:04:12.704923+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:04:12.704923+0000","last_undegraded":"2024-09-12T18:04:12.704923+0000","last_fullsized":"2024-09-12T18:04:12.704923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705970+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:04:12.705970+0000","last_peered":"2024-09-12T18:04:12.705970+0000","last_clean":"2024-09-12T18:04:12.705970+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:04:12.705970+0000","last_undegraded":"2024-09-12T18:04:12.705970+0000","last_fullsized":"2024-09-12T18:04:12.705970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704648+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:04:12.704648+0000","last_peered":"2024-09-12T18:04:12.704648+0000","last_clean":"2024-09-12T18:04:12.704648+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:04:12.704648+0000","last_undegraded":"2024-09-12T18:04:12.704648+0000","last_fullsized":"2024-09-12T18:04:12.704648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691197+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:04:11.691197+0000","last_peered":"2024-09-12T18:04:11.691197+0000","last_clean":"2024-09-12T18:04:11.691197+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:04:11.691197+0000","last_undegraded":"2024-09-12T18:04:11.691197+0000","last_fullsized":"2024-09-12T18:04:11.691197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705995+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:04:12.705995+0000","last_peered":"2024-09-12T18:04:12.705995+0000","last_clean":"2024-09-12T18:04:12.705995+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:04:12.705995+0000","last_undegraded":"2024-09-12T18:04:12.705995+0000","last_fullsized":"2024-09-12T18:04:12.705995+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707193+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:04:12.707193+0000","last_peered":"2024-09-12T18:04:12.707193+0000","last_clean":"2024-09-12T18:04:12.707193+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:04:12.707193+0000","last_undegraded":"2024-09-12T18:04:12.707193+0000","last_fullsized":"2024-09-12T18:04:12.707193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":713,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690829+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:04:11.690829+0000","last_peered":"2024-09-12T18:04:11.690829+0000","last_clean":"2024-09-12T18:04:11.690829+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:04:11.690829+0000","last_undegraded":"2024-09-12T18:04:11.690829+0000","last_fullsized":"2024-09-12T18:04:11.690829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":609,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706016+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:04:12.706016+0000","last_peered":"2024-09-12T18:04:12.706016+0000","last_clean":"2024-09-12T18:04:12.706016+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:04:12.706016+0000","last_undegraded":"2024-09-12T18:04:12.706016+0000","last_fullsized":"2024-09-12T18:04:12.706016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705822+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:04:12.705822+0000","last_peered":"2024-09-12T18:04:12.705822+0000","last_clean":"2024-09-12T18:04:12.705822+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:04:12.705822+0000","last_undegraded":"2024-09-12T18:04:12.705822+0000","last_fullsized":"2024-09-12T18:04:12.705822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":342,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689704+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:04:11.689704+0000","last_peered":"2024-09-12T18:04:11.689704+0000","last_clean":"2024-09-12T18:04:11.689704+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:04:11.689704+0000","last_undegraded":"2024-09-12T18:04:11.689704+0000","last_fullsized":"2024-09-12T18:04:11.689704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706251+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:04:12.706251+0000","last_peered":"2024-09-12T18:04:12.706251+0000","last_clean":"2024-09-12T18:04:12.706251+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:04:12.706251+0000","last_undegraded":"2024-09-12T18:04:12.706251+0000","last_fullsized":"2024-09-12T18:04:12.706251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691575+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:04:11.691575+0000","last_peered":"2024-09-12T18:04:11.691575+0000","last_clean":"2024-09-12T18:04:11.691575+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:04:11.691575+0000","last_undegraded":"2024-09-12T18:04:11.691575+0000","last_fullsized":"2024-09-12T18:04:11.691575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704735+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:04:12.704735+0000","last_peered":"2024-09-12T18:04:12.704735+0000","last_clean":"2024-09-12T18:04:12.704735+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:04:12.704735+0000","last_undegraded":"2024-09-12T18:04:12.704735+0000","last_fullsized":"2024-09-12T18:04:12.704735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":811,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690607+0000","last_change":"2024-09-12T18:03:54.334607+0000","last_active":"2024-09-12T18:04:11.690607+0000","last_peered":"2024-09-12T18:04:11.690607+0000","last_clean":"2024-09-12T18:04:11.690607+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:04:11.690607+0000","last_undegraded":"2024-09-12T18:04:11.690607+0000","last_fullsized":"2024-09-12T18:04:11.690607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:27.565973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706554+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:04:12.706554+0000","last_peered":"2024-09-12T18:04:12.706554+0000","last_clean":"2024-09-12T18:04:12.706554+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:04:12.706554+0000","last_undegraded":"2024-09-12T18:04:12.706554+0000","last_fullsized":"2024-09-12T18:04:12.706554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":222,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707067+0000","last_change":"2024-09-12T18:04:09.697006+0000","last_active":"2024-09-12T18:04:12.707067+0000","last_peered":"2024-09-12T18:04:12.707067+0000","last_clean":"2024-09-12T18:04:12.707067+0000","last_became_active":"2024-09-12T18:04:09.686200+0000","last_became_peered":"2024-09-12T18:04:09.686200+0000","last_unstale":"2024-09-12T18:04:12.707067+0000","last_undegraded":"2024-09-12T18:04:12.707067+0000","last_fullsized":"2024-09-12T18:04:12.707067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:17.012774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":645,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691405+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:04:11.691405+0000","last_peered":"2024-09-12T18:04:11.691405+0000","last_clean":"2024-09-12T18:04:11.691405+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:04:11.691405+0000","last_undegraded":"2024-09-12T18:04:11.691405+0000","last_fullsized":"2024-09-12T18:04:11.691405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":448,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706291+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:04:12.706291+0000","last_peered":"2024-09-12T18:04:12.706291+0000","last_clean":"2024-09-12T18:04:12.706291+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:04:12.706291+0000","last_undegraded":"2024-09-12T18:04:12.706291+0000","last_fullsized":"2024-09-12T18:04:12.706291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691578+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:04:11.691578+0000","last_peered":"2024-09-12T18:04:11.691578+0000","last_clean":"2024-09-12T18:04:11.691578+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:04:11.691578+0000","last_undegraded":"2024-09-12T18:04:11.691578+0000","last_fullsized":"2024-09-12T18:04:11.691578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704996+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:04:12.704996+0000","last_peered":"2024-09-12T18:04:12.704996+0000","last_clean":"2024-09-12T18:04:12.704996+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:04:12.704996+0000","last_undegraded":"2024-09-12T18:04:12.704996+0000","last_fullsized":"2024-09-12T18:04:12.704996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690358+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:04:11.690358+0000","last_peered":"2024-09-12T18:04:11.690358+0000","last_clean":"2024-09-12T18:04:11.690358+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:04:11.690358+0000","last_undegraded":"2024-09-12T18:04:11.690358+0000","last_fullsized":"2024-09-12T18:04:11.690358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707020+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:04:12.707020+0000","last_peered":"2024-09-12T18:04:12.707020+0000","last_clean":"2024-09-12T18:04:12.707020+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:04:12.707020+0000","last_undegraded":"2024-09-12T18:04:12.707020+0000","last_fullsized":"2024-09-12T18:04:12.707020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":558,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705573+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:04:12.705573+0000","last_peered":"2024-09-12T18:04:12.705573+0000","last_clean":"2024-09-12T18:04:12.705573+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:04:12.705573+0000","last_undegraded":"2024-09-12T18:04:12.705573+0000","last_fullsized":"2024-09-12T18:04:12.705573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691531+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:04:11.691531+0000","last_peered":"2024-09-12T18:04:11.691531+0000","last_clean":"2024-09-12T18:04:11.691531+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:04:11.691531+0000","last_undegraded":"2024-09-12T18:04:11.691531+0000","last_fullsized":"2024-09-12T18:04:11.691531+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690336+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:04:11.690336+0000","last_peered":"2024-09-12T18:04:11.690336+0000","last_clean":"2024-09-12T18:04:11.690336+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:04:11.690336+0000","last_undegraded":"2024-09-12T18:04:11.690336+0000","last_fullsized":"2024-09-12T18:04:11.690336+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":573,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689659+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:04:11.689659+0000","last_peered":"2024-09-12T18:04:11.689659+0000","last_clean":"2024-09-12T18:04:11.689659+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:04:11.689659+0000","last_undegraded":"2024-09-12T18:04:11.689659+0000","last_fullsized":"2024-09-12T18:04:11.689659+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"72'114","reported_seq":266,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691584+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:04:11.691584+0000","last_peered":"2024-09-12T18:04:11.691584+0000","last_clean":"2024-09-12T18:04:11.691584+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:04:11.691584+0000","last_undegraded":"2024-09-12T18:04:11.691584+0000","last_fullsized":"2024-09-12T18:04:11.691584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706764+0000","last_change":"2024-09-12T18:04:09.677962+0000","last_active":"2024-09-12T18:04:12.706764+0000","last_peered":"2024-09-12T18:04:12.706764+0000","last_clean":"2024-09-12T18:04:12.706764+0000","last_became_active":"2024-09-12T18:04:09.677062+0000","last_became_peered":"2024-09-12T18:04:09.677062+0000","last_unstale":"2024-09-12T18:04:12.706764+0000","last_undegraded":"2024-09-12T18:04:12.706764+0000","last_fullsized":"2024-09-12T18:04:12.706764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:17.652687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704592+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:04:12.704592+0000","last_peered":"2024-09-12T18:04:12.704592+0000","last_clean":"2024-09-12T18:04:12.704592+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:04:12.704592+0000","last_undegraded":"2024-09-12T18:04:12.704592+0000","last_fullsized":"2024-09-12T18:04:12.704592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":588,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706604+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:04:12.706604+0000","last_peered":"2024-09-12T18:04:12.706604+0000","last_clean":"2024-09-12T18:04:12.706604+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:04:12.706604+0000","last_undegraded":"2024-09-12T18:04:12.706604+0000","last_fullsized":"2024-09-12T18:04:12.706604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":374,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705957+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:04:12.705957+0000","last_peered":"2024-09-12T18:04:12.705957+0000","last_clean":"2024-09-12T18:04:12.705957+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:04:12.705957+0000","last_undegraded":"2024-09-12T18:04:12.705957+0000","last_fullsized":"2024-09-12T18:04:12.705957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":625,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690149+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:04:11.690149+0000","last_peered":"2024-09-12T18:04:11.690149+0000","last_clean":"2024-09-12T18:04:11.690149+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:04:11.690149+0000","last_undegraded":"2024-09-12T18:04:11.690149+0000","last_fullsized":"2024-09-12T18:04:11.690149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":241,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706935+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:04:12.706935+0000","last_peered":"2024-09-12T18:04:12.706935+0000","last_clean":"2024-09-12T18:04:12.706935+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:04:12.706935+0000","last_undegraded":"2024-09-12T18:04:12.706935+0000","last_fullsized":"2024-09-12T18:04:12.706935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":358,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706436+0000","last_change":"2024-09-12T18:04:09.685980+0000","last_active":"2024-09-12T18:04:12.706436+0000","last_peered":"2024-09-12T18:04:12.706436+0000","last_clean":"2024-09-12T18:04:12.706436+0000","last_became_active":"2024-09-12T18:04:09.682878+0000","last_became_peered":"2024-09-12T18:04:09.682878+0000","last_unstale":"2024-09-12T18:04:12.706436+0000","last_undegraded":"2024-09-12T18:04:12.706436+0000","last_fullsized":"2024-09-12T18:04:12.706436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":718,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691128+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:04:11.691128+0000","last_peered":"2024-09-12T18:04:11.691128+0000","last_clean":"2024-09-12T18:04:11.691128+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:04:11.691128+0000","last_undegraded":"2024-09-12T18:04:11.691128+0000","last_fullsized":"2024-09-12T18:04:11.691128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691277+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:04:11.691277+0000","last_peered":"2024-09-12T18:04:11.691277+0000","last_clean":"2024-09-12T18:04:11.691277+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:04:11.691277+0000","last_undegraded":"2024-09-12T18:04:11.691277+0000","last_fullsized":"2024-09-12T18:04:11.691277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":694,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689505+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:04:11.689505+0000","last_peered":"2024-09-12T18:04:11.689505+0000","last_clean":"2024-09-12T18:04:11.689505+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:04:11.689505+0000","last_undegraded":"2024-09-12T18:04:11.689505+0000","last_fullsized":"2024-09-12T18:04:11.689505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706629+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:04:12.706629+0000","last_peered":"2024-09-12T18:04:12.706629+0000","last_clean":"2024-09-12T18:04:12.706629+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:04:12.706629+0000","last_undegraded":"2024-09-12T18:04:12.706629+0000","last_fullsized":"2024-09-12T18:04:12.706629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":796,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689874+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:04:11.689874+0000","last_peered":"2024-09-12T18:04:11.689874+0000","last_clean":"2024-09-12T18:04:11.689874+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:04:11.689874+0000","last_undegraded":"2024-09-12T18:04:11.689874+0000","last_fullsized":"2024-09-12T18:04:11.689874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":668,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691035+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:04:11.691035+0000","last_peered":"2024-09-12T18:04:11.691035+0000","last_clean":"2024-09-12T18:04:11.691035+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:04:11.691035+0000","last_undegraded":"2024-09-12T18:04:11.691035+0000","last_fullsized":"2024-09-12T18:04:11.691035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":369,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.689515+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:04:11.689515+0000","last_peered":"2024-09-12T18:04:11.689515+0000","last_clean":"2024-09-12T18:04:11.689515+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:04:11.689515+0000","last_undegraded":"2024-09-12T18:04:11.689515+0000","last_fullsized":"2024-09-12T18:04:11.689515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705907+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:04:12.705907+0000","last_peered":"2024-09-12T18:04:12.705907+0000","last_clean":"2024-09-12T18:04:12.705907+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:04:12.705907+0000","last_undegraded":"2024-09-12T18:04:12.705907+0000","last_fullsized":"2024-09-12T18:04:12.705907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":360,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705227+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:04:12.705227+0000","last_peered":"2024-09-12T18:04:12.705227+0000","last_clean":"2024-09-12T18:04:12.705227+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:04:12.705227+0000","last_undegraded":"2024-09-12T18:04:12.705227+0000","last_fullsized":"2024-09-12T18:04:12.705227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705628+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:04:12.705628+0000","last_peered":"2024-09-12T18:04:12.705628+0000","last_clean":"2024-09-12T18:04:12.705628+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:04:12.705628+0000","last_undegraded":"2024-09-12T18:04:12.705628+0000","last_fullsized":"2024-09-12T18:04:12.705628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":197,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705941+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:04:12.705941+0000","last_peered":"2024-09-12T18:04:12.705941+0000","last_clean":"2024-09-12T18:04:12.705941+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:04:12.705941+0000","last_undegraded":"2024-09-12T18:04:12.705941+0000","last_fullsized":"2024-09-12T18:04:12.705941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706584+0000","last_change":"2024-09-12T18:04:09.697861+0000","last_active":"2024-09-12T18:04:12.706584+0000","last_peered":"2024-09-12T18:04:12.706584+0000","last_clean":"2024-09-12T18:04:12.706584+0000","last_became_active":"2024-09-12T18:04:09.688026+0000","last_became_peered":"2024-09-12T18:04:09.688026+0000","last_unstale":"2024-09-12T18:04:12.706584+0000","last_undegraded":"2024-09-12T18:04:12.706584+0000","last_fullsized":"2024-09-12T18:04:12.706584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.825721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705675+0000","last_change":"2024-09-12T18:04:09.695422+0000","last_active":"2024-09-12T18:04:12.705675+0000","last_peered":"2024-09-12T18:04:12.705675+0000","last_clean":"2024-09-12T18:04:12.705675+0000","last_became_active":"2024-09-12T18:04:09.692975+0000","last_became_peered":"2024-09-12T18:04:09.692975+0000","last_unstale":"2024-09-12T18:04:12.705675+0000","last_undegraded":"2024-09-12T18:04:12.705675+0000","last_fullsized":"2024-09-12T18:04:12.705675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.708997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1292,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705908+0000","last_change":"2024-09-12T18:04:09.693020+0000","last_active":"2024-09-12T18:04:12.705908+0000","last_peered":"2024-09-12T18:04:12.705908+0000","last_clean":"2024-09-12T18:04:12.705908+0000","last_became_active":"2024-09-12T18:04:09.684915+0000","last_became_peered":"2024-09-12T18:04:09.684915+0000","last_unstale":"2024-09-12T18:04:12.705908+0000","last_undegraded":"2024-09-12T18:04:12.705908+0000","last_fullsized":"2024-09-12T18:04:12.705908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:27.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":423,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706634+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:04:12.706634+0000","last_peered":"2024-09-12T18:04:12.706634+0000","last_clean":"2024-09-12T18:04:12.706634+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:04:12.706634+0000","last_undegraded":"2024-09-12T18:04:12.706634+0000","last_fullsized":"2024-09-12T18:04:12.706634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":563,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704948+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:04:12.704948+0000","last_peered":"2024-09-12T18:04:12.704948+0000","last_clean":"2024-09-12T18:04:12.704948+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:04:12.704948+0000","last_undegraded":"2024-09-12T18:04:12.704948+0000","last_fullsized":"2024-09-12T18:04:12.704948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.691316+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:04:11.691316+0000","last_peered":"2024-09-12T18:04:11.691316+0000","last_clean":"2024-09-12T18:04:11.691316+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:04:11.691316+0000","last_undegraded":"2024-09-12T18:04:11.691316+0000","last_fullsized":"2024-09-12T18:04:11.691316+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704907+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:04:12.704907+0000","last_peered":"2024-09-12T18:04:12.704907+0000","last_clean":"2024-09-12T18:04:12.704907+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:04:12.704907+0000","last_undegraded":"2024-09-12T18:04:12.704907+0000","last_fullsized":"2024-09-12T18:04:12.704907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-12T18:04:11.690565+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:04:11.690565+0000","last_peered":"2024-09-12T18:04:11.690565+0000","last_clean":"2024-09-12T18:04:11.690565+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:04:11.690565+0000","last_undegraded":"2024-09-12T18:04:11.690565+0000","last_fullsized":"2024-09-12T18:04:11.690565+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6248,"ondisk_log_size":6248,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738403,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121704,"kb_used_data":23952,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":24526848,"data_stored":81403848,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738403,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113888,"kb_used_data":28612,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94257952,"statfs":{"total":96636764160,"available":96520142848,"internally_reserved":0,"allocated":29298688,"data_stored":84724657,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738403,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118208,"kb_used_data":28776,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253632,"statfs":{"total":96636764160,"available":96515719168,"internally_reserved":0,"allocated":29466624,"data_stored":90491785,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:04:17.472 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:04:17.823 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:17.824 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":85,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:04:12.691343+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.2","osds":[0,1]},{"pgid":"4.22","osds":[0,2]},{"pgid":"4.31","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:04:18.844 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T18:04:18.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:04:19.010 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:04:19.010 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:04:19.010 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:04:19.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T18:04:19.330 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T18:04:19.349 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T18:04:19.349 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:04:19.492 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:04:19.492 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:04:19.492 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:04:19.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T18:04:19.807 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T18:04:19.825 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T18:04:19.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T18:04:19.969 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-12T18:04:19.970 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T18:04:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-12T18:04:19.984 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T18:04:20.276 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T18:04:20.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:04:20.607 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:20.609 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:04:20.624 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-12T18:04:20.596219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32952,"ondisk_log_size":32952,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":353804,"kb_used_data":81348,"kb_used_omap":4,"kb_used_meta":272379,"kb_avail":282761716,"statfs":{"total":289910292480,"available":289547997184,"internally_reserved":0,"allocated":83300352,"data_stored":256624609,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":278916431},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":548,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.910091"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706444+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:04:12.706444+0000","last_peered":"2024-09-12T18:04:12.706444+0000","last_clean":"2024-09-12T18:04:12.706444+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:04:12.706444+0000","last_undegraded":"2024-09-12T18:04:12.706444+0000","last_fullsized":"2024-09-12T18:04:12.706444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705980+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:04:12.705980+0000","last_peered":"2024-09-12T18:04:12.705980+0000","last_clean":"2024-09-12T18:04:12.705980+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:04:12.705980+0000","last_undegraded":"2024-09-12T18:04:12.705980+0000","last_fullsized":"2024-09-12T18:04:12.705980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705200+0000","last_change":"2024-09-12T18:04:09.681163+0000","last_active":"2024-09-12T18:04:12.705200+0000","last_peered":"2024-09-12T18:04:12.705200+0000","last_clean":"2024-09-12T18:04:12.705200+0000","last_became_active":"2024-09-12T18:04:09.677098+0000","last_became_peered":"2024-09-12T18:04:09.677098+0000","last_unstale":"2024-09-12T18:04:12.705200+0000","last_undegraded":"2024-09-12T18:04:12.705200+0000","last_fullsized":"2024-09-12T18:04:12.705200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:22.899798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705006+0000","last_change":"2024-09-12T18:04:09.694526+0000","last_active":"2024-09-12T18:04:12.705006+0000","last_peered":"2024-09-12T18:04:12.705006+0000","last_clean":"2024-09-12T18:04:12.705006+0000","last_became_active":"2024-09-12T18:04:09.685115+0000","last_became_peered":"2024-09-12T18:04:09.685115+0000","last_unstale":"2024-09-12T18:04:12.705006+0000","last_undegraded":"2024-09-12T18:04:12.705006+0000","last_fullsized":"2024-09-12T18:04:12.705006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.108507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705679+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:04:12.705679+0000","last_peered":"2024-09-12T18:04:12.705679+0000","last_clean":"2024-09-12T18:04:12.705679+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:04:12.705679+0000","last_undegraded":"2024-09-12T18:04:12.705679+0000","last_fullsized":"2024-09-12T18:04:12.705679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:32.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704814+0000","last_change":"2024-09-12T18:04:09.697456+0000","last_active":"2024-09-12T18:04:12.704814+0000","last_peered":"2024-09-12T18:04:12.704814+0000","last_clean":"2024-09-12T18:04:12.704814+0000","last_became_active":"2024-09-12T18:04:09.691370+0000","last_became_peered":"2024-09-12T18:04:09.691370+0000","last_unstale":"2024-09-12T18:04:12.704814+0000","last_undegraded":"2024-09-12T18:04:12.704814+0000","last_fullsized":"2024-09-12T18:04:12.704814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:40.949436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":639,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705623+0000","last_change":"2024-09-12T18:04:09.694180+0000","last_active":"2024-09-12T18:04:12.705623+0000","last_peered":"2024-09-12T18:04:12.705623+0000","last_clean":"2024-09-12T18:04:12.705623+0000","last_became_active":"2024-09-12T18:04:09.686122+0000","last_became_peered":"2024-09-12T18:04:09.686122+0000","last_unstale":"2024-09-12T18:04:12.705623+0000","last_undegraded":"2024-09-12T18:04:12.705623+0000","last_fullsized":"2024-09-12T18:04:12.705623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:39.304422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":993,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704310+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:04:12.704310+0000","last_peered":"2024-09-12T18:04:12.704310+0000","last_clean":"2024-09-12T18:04:12.704310+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:04:12.704310+0000","last_undegraded":"2024-09-12T18:04:12.704310+0000","last_fullsized":"2024-09-12T18:04:12.704310+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:09.124569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":550,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873006+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:04:13.873006+0000","last_peered":"2024-09-12T18:04:13.873006+0000","last_clean":"2024-09-12T18:04:13.873006+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:04:13.873006+0000","last_undegraded":"2024-09-12T18:04:13.873006+0000","last_fullsized":"2024-09-12T18:04:13.873006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:51.198935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1050,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706158+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:04:12.706158+0000","last_peered":"2024-09-12T18:04:12.706158+0000","last_clean":"2024-09-12T18:04:12.706158+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:04:12.706158+0000","last_undegraded":"2024-09-12T18:04:12.706158+0000","last_fullsized":"2024-09-12T18:04:12.706158+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.478122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705486+0000","last_change":"2024-09-12T18:04:09.685941+0000","last_active":"2024-09-12T18:04:12.705486+0000","last_peered":"2024-09-12T18:04:12.705486+0000","last_clean":"2024-09-12T18:04:12.705486+0000","last_became_active":"2024-09-12T18:04:09.681305+0000","last_became_peered":"2024-09-12T18:04:09.681305+0000","last_unstale":"2024-09-12T18:04:12.705486+0000","last_undegraded":"2024-09-12T18:04:12.705486+0000","last_fullsized":"2024-09-12T18:04:12.705486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:29.147388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":535,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705577+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:04:12.705577+0000","last_peered":"2024-09-12T18:04:12.705577+0000","last_clean":"2024-09-12T18:04:12.705577+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:04:12.705577+0000","last_undegraded":"2024-09-12T18:04:12.705577+0000","last_fullsized":"2024-09-12T18:04:12.705577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.713843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705397+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:04:12.705397+0000","last_peered":"2024-09-12T18:04:12.705397+0000","last_clean":"2024-09-12T18:04:12.705397+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:04:12.705397+0000","last_undegraded":"2024-09-12T18:04:12.705397+0000","last_fullsized":"2024-09-12T18:04:12.705397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:58.859246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":616,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705071+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:04:12.705071+0000","last_peered":"2024-09-12T18:04:12.705071+0000","last_clean":"2024-09-12T18:04:12.705071+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:04:12.705071+0000","last_undegraded":"2024-09-12T18:04:12.705071+0000","last_fullsized":"2024-09-12T18:04:12.705071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706901+0000","last_change":"2024-09-12T18:04:09.695076+0000","last_active":"2024-09-12T18:04:12.706901+0000","last_peered":"2024-09-12T18:04:12.706901+0000","last_clean":"2024-09-12T18:04:12.706901+0000","last_became_active":"2024-09-12T18:04:09.684858+0000","last_became_peered":"2024-09-12T18:04:09.684858+0000","last_unstale":"2024-09-12T18:04:12.706901+0000","last_undegraded":"2024-09-12T18:04:12.706901+0000","last_fullsized":"2024-09-12T18:04:12.706901+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:14.097506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":686,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704636+0000","last_change":"2024-09-12T18:04:09.687477+0000","last_active":"2024-09-12T18:04:12.704636+0000","last_peered":"2024-09-12T18:04:12.704636+0000","last_clean":"2024-09-12T18:04:12.704636+0000","last_became_active":"2024-09-12T18:04:09.680510+0000","last_became_peered":"2024-09-12T18:04:09.680510+0000","last_unstale":"2024-09-12T18:04:12.704636+0000","last_undegraded":"2024-09-12T18:04:12.704636+0000","last_fullsized":"2024-09-12T18:04:12.704636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:53.703464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873930+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:04:13.873930+0000","last_peered":"2024-09-12T18:04:13.873930+0000","last_clean":"2024-09-12T18:04:13.873930+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:04:13.873930+0000","last_undegraded":"2024-09-12T18:04:13.873930+0000","last_fullsized":"2024-09-12T18:04:13.873930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":693,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706725+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:04:12.706725+0000","last_peered":"2024-09-12T18:04:12.706725+0000","last_clean":"2024-09-12T18:04:12.706725+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:04:12.706725+0000","last_undegraded":"2024-09-12T18:04:12.706725+0000","last_fullsized":"2024-09-12T18:04:12.706725+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":691,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.870813+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:04:13.870813+0000","last_peered":"2024-09-12T18:04:13.870813+0000","last_clean":"2024-09-12T18:04:13.870813+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:04:13.870813+0000","last_undegraded":"2024-09-12T18:04:13.870813+0000","last_fullsized":"2024-09-12T18:04:13.870813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705083+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:04:12.705083+0000","last_peered":"2024-09-12T18:04:12.705083+0000","last_clean":"2024-09-12T18:04:12.705083+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:04:12.705083+0000","last_undegraded":"2024-09-12T18:04:12.705083+0000","last_fullsized":"2024-09-12T18:04:12.705083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":1000,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706891+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:04:12.706891+0000","last_peered":"2024-09-12T18:04:12.706891+0000","last_clean":"2024-09-12T18:04:12.706891+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:04:12.706891+0000","last_undegraded":"2024-09-12T18:04:12.706891+0000","last_fullsized":"2024-09-12T18:04:12.706891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704901+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:04:12.704901+0000","last_peered":"2024-09-12T18:04:12.704901+0000","last_clean":"2024-09-12T18:04:12.704901+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:04:12.704901+0000","last_undegraded":"2024-09-12T18:04:12.704901+0000","last_fullsized":"2024-09-12T18:04:12.704901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":933,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871804+0000","last_change":"2024-09-12T18:03:56.341786+0000","last_active":"2024-09-12T18:04:13.871804+0000","last_peered":"2024-09-12T18:04:13.871804+0000","last_clean":"2024-09-12T18:04:13.871804+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:04:13.871804+0000","last_undegraded":"2024-09-12T18:04:13.871804+0000","last_fullsized":"2024-09-12T18:04:13.871804+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704364+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:04:12.704364+0000","last_peered":"2024-09-12T18:04:12.704364+0000","last_clean":"2024-09-12T18:04:12.704364+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:04:12.704364+0000","last_undegraded":"2024-09-12T18:04:12.704364+0000","last_fullsized":"2024-09-12T18:04:12.704364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706563+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:04:12.706563+0000","last_peered":"2024-09-12T18:04:12.706563+0000","last_clean":"2024-09-12T18:04:12.706563+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:04:12.706563+0000","last_undegraded":"2024-09-12T18:04:12.706563+0000","last_fullsized":"2024-09-12T18:04:12.706563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":647,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873222+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:04:13.873222+0000","last_peered":"2024-09-12T18:04:13.873222+0000","last_clean":"2024-09-12T18:04:13.873222+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:04:13.873222+0000","last_undegraded":"2024-09-12T18:04:13.873222+0000","last_fullsized":"2024-09-12T18:04:13.873222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705566+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:04:12.705566+0000","last_peered":"2024-09-12T18:04:12.705566+0000","last_clean":"2024-09-12T18:04:12.705566+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:04:12.705566+0000","last_undegraded":"2024-09-12T18:04:12.705566+0000","last_fullsized":"2024-09-12T18:04:12.705566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706212+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:04:12.706212+0000","last_peered":"2024-09-12T18:04:12.706212+0000","last_clean":"2024-09-12T18:04:12.706212+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:04:12.706212+0000","last_undegraded":"2024-09-12T18:04:12.706212+0000","last_fullsized":"2024-09-12T18:04:12.706212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":953,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872273+0000","last_change":"2024-09-12T18:03:56.344116+0000","last_active":"2024-09-12T18:04:13.872273+0000","last_peered":"2024-09-12T18:04:13.872273+0000","last_clean":"2024-09-12T18:04:13.872273+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:04:13.872273+0000","last_undegraded":"2024-09-12T18:04:13.872273+0000","last_fullsized":"2024-09-12T18:04:13.872273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704483+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:04:12.704483+0000","last_peered":"2024-09-12T18:04:12.704483+0000","last_clean":"2024-09-12T18:04:12.704483+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:04:12.704483+0000","last_undegraded":"2024-09-12T18:04:12.704483+0000","last_fullsized":"2024-09-12T18:04:12.704483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":1006,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.870796+0000","last_change":"2024-09-12T18:03:57.344789+0000","last_active":"2024-09-12T18:04:13.870796+0000","last_peered":"2024-09-12T18:04:13.870796+0000","last_clean":"2024-09-12T18:04:13.870796+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:04:13.870796+0000","last_undegraded":"2024-09-12T18:04:13.870796+0000","last_fullsized":"2024-09-12T18:04:13.870796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704604+0000","last_change":"2024-09-12T18:04:09.687125+0000","last_active":"2024-09-12T18:04:12.704604+0000","last_peered":"2024-09-12T18:04:12.704604+0000","last_clean":"2024-09-12T18:04:12.704604+0000","last_became_active":"2024-09-12T18:04:09.680177+0000","last_became_peered":"2024-09-12T18:04:09.680177+0000","last_unstale":"2024-09-12T18:04:12.704604+0000","last_undegraded":"2024-09-12T18:04:12.704604+0000","last_fullsized":"2024-09-12T18:04:12.704604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":627,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706075+0000","last_change":"2024-09-12T18:01:55.580486+0000","last_active":"2024-09-12T18:04:12.706075+0000","last_peered":"2024-09-12T18:04:12.706075+0000","last_clean":"2024-09-12T18:04:12.706075+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:04:12.706075+0000","last_undegraded":"2024-09-12T18:04:12.706075+0000","last_fullsized":"2024-09-12T18:04:12.706075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:15.554112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"66'446","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707107+0000","last_change":"2024-09-12T18:01:54.712625+0000","last_active":"2024-09-12T18:04:12.707107+0000","last_peered":"2024-09-12T18:04:12.707107+0000","last_clean":"2024-09-12T18:04:12.707107+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:04:12.707107+0000","last_undegraded":"2024-09-12T18:04:12.707107+0000","last_fullsized":"2024-09-12T18:04:12.707107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:13.890926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":562,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706416+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:04:12.706416+0000","last_peered":"2024-09-12T18:04:12.706416+0000","last_clean":"2024-09-12T18:04:12.706416+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:04:12.706416+0000","last_undegraded":"2024-09-12T18:04:12.706416+0000","last_fullsized":"2024-09-12T18:04:12.706416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:46.024794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":196,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872631+0000","last_change":"2024-09-12T18:01:54.710733+0000","last_active":"2024-09-12T18:04:13.872631+0000","last_peered":"2024-09-12T18:04:13.872631+0000","last_clean":"2024-09-12T18:04:13.872631+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:04:13.872631+0000","last_undegraded":"2024-09-12T18:04:13.872631+0000","last_fullsized":"2024-09-12T18:04:13.872631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:55.347984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":585,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873567+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:04:13.873567+0000","last_peered":"2024-09-12T18:04:13.873567+0000","last_clean":"2024-09-12T18:04:13.873567+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:04:13.873567+0000","last_undegraded":"2024-09-12T18:04:13.873567+0000","last_fullsized":"2024-09-12T18:04:13.873567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:19.738589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":216,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704858+0000","last_change":"2024-09-12T18:01:54.711284+0000","last_active":"2024-09-12T18:04:12.704858+0000","last_peered":"2024-09-12T18:04:12.704858+0000","last_clean":"2024-09-12T18:04:12.704858+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:04:12.704858+0000","last_undegraded":"2024-09-12T18:04:12.704858+0000","last_fullsized":"2024-09-12T18:04:12.704858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:46.347194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":585,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873208+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:04:13.873208+0000","last_peered":"2024-09-12T18:04:13.873208+0000","last_clean":"2024-09-12T18:04:13.873208+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:04:13.873208+0000","last_undegraded":"2024-09-12T18:04:13.873208+0000","last_fullsized":"2024-09-12T18:04:13.873208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"69'61","reported_seq":209,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704914+0000","last_change":"2024-09-12T18:01:54.716879+0000","last_active":"2024-09-12T18:04:12.704914+0000","last_peered":"2024-09-12T18:04:12.704914+0000","last_clean":"2024-09-12T18:04:12.704914+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:04:12.704914+0000","last_undegraded":"2024-09-12T18:04:12.704914+0000","last_fullsized":"2024-09-12T18:04:12.704914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:39.241960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"69'138","reported_seq":286,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706247+0000","last_change":"2024-09-12T18:01:54.705372+0000","last_active":"2024-09-12T18:04:12.706247+0000","last_peered":"2024-09-12T18:04:12.706247+0000","last_clean":"2024-09-12T18:04:12.706247+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:04:12.706247+0000","last_undegraded":"2024-09-12T18:04:12.706247+0000","last_fullsized":"2024-09-12T18:04:12.706247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:09.109472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704427+0000","last_change":"2024-09-12T18:01:55.587168+0000","last_active":"2024-09-12T18:04:12.704427+0000","last_peered":"2024-09-12T18:04:12.704427+0000","last_clean":"2024-09-12T18:04:12.704427+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:04:12.704427+0000","last_undegraded":"2024-09-12T18:04:12.704427+0000","last_fullsized":"2024-09-12T18:04:12.704427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:38.826644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"66'250","reported_seq":397,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706623+0000","last_change":"2024-09-12T18:01:54.709528+0000","last_active":"2024-09-12T18:04:12.706623+0000","last_peered":"2024-09-12T18:04:12.706623+0000","last_clean":"2024-09-12T18:04:12.706623+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:04:12.706623+0000","last_undegraded":"2024-09-12T18:04:12.706623+0000","last_fullsized":"2024-09-12T18:04:12.706623+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:23.083608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1468,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704401+0000","last_change":"2024-09-12T18:03:53.336888+0000","last_active":"2024-09-12T18:04:12.704401+0000","last_peered":"2024-09-12T18:04:12.704401+0000","last_clean":"2024-09-12T18:04:12.704401+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:04:12.704401+0000","last_undegraded":"2024-09-12T18:04:12.704401+0000","last_fullsized":"2024-09-12T18:04:12.704401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"66'380","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706190+0000","last_change":"2024-09-12T18:04:09.686572+0000","last_active":"2024-09-12T18:04:12.706190+0000","last_peered":"2024-09-12T18:04:12.706190+0000","last_clean":"2024-09-12T18:04:12.706190+0000","last_became_active":"2024-09-12T18:04:09.682207+0000","last_became_peered":"2024-09-12T18:04:09.682207+0000","last_unstale":"2024-09-12T18:04:12.706190+0000","last_undegraded":"2024-09-12T18:04:12.706190+0000","last_fullsized":"2024-09-12T18:04:12.706190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:19.750113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705239+0000","last_change":"2024-09-12T18:04:09.694336+0000","last_active":"2024-09-12T18:04:12.705239+0000","last_peered":"2024-09-12T18:04:12.705239+0000","last_clean":"2024-09-12T18:04:12.705239+0000","last_became_active":"2024-09-12T18:04:09.681881+0000","last_became_peered":"2024-09-12T18:04:09.681881+0000","last_unstale":"2024-09-12T18:04:12.705239+0000","last_undegraded":"2024-09-12T18:04:12.705239+0000","last_fullsized":"2024-09-12T18:04:12.705239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:08.728289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":202,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706249+0000","last_change":"2024-09-12T18:04:09.695023+0000","last_active":"2024-09-12T18:04:12.706249+0000","last_peered":"2024-09-12T18:04:12.706249+0000","last_clean":"2024-09-12T18:04:12.706249+0000","last_became_active":"2024-09-12T18:04:09.692860+0000","last_became_peered":"2024-09-12T18:04:09.692860+0000","last_unstale":"2024-09-12T18:04:12.706249+0000","last_undegraded":"2024-09-12T18:04:12.706249+0000","last_fullsized":"2024-09-12T18:04:12.706249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:22.990905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":649,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872979+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:04:13.872979+0000","last_peered":"2024-09-12T18:04:13.872979+0000","last_clean":"2024-09-12T18:04:13.872979+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:04:13.872979+0000","last_undegraded":"2024-09-12T18:04:13.872979+0000","last_fullsized":"2024-09-12T18:04:13.872979+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"66'156","reported_seq":309,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872711+0000","last_change":"2024-09-12T18:03:51.367646+0000","last_active":"2024-09-12T18:04:13.872711+0000","last_peered":"2024-09-12T18:04:13.872711+0000","last_clean":"2024-09-12T18:04:13.872711+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:04:13.872711+0000","last_undegraded":"2024-09-12T18:04:13.872711+0000","last_fullsized":"2024-09-12T18:04:13.872711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:00.475511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705390+0000","last_change":"2024-09-12T18:04:09.694162+0000","last_active":"2024-09-12T18:04:12.705390+0000","last_peered":"2024-09-12T18:04:12.705390+0000","last_clean":"2024-09-12T18:04:12.705390+0000","last_became_active":"2024-09-12T18:04:09.686387+0000","last_became_peered":"2024-09-12T18:04:09.686387+0000","last_unstale":"2024-09-12T18:04:12.705390+0000","last_undegraded":"2024-09-12T18:04:12.705390+0000","last_fullsized":"2024-09-12T18:04:12.705390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:22.543587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"66'117","reported_seq":265,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706189+0000","last_change":"2024-09-12T18:01:54.718857+0000","last_active":"2024-09-12T18:04:12.706189+0000","last_peered":"2024-09-12T18:04:12.706189+0000","last_clean":"2024-09-12T18:04:12.706189+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:04:12.706189+0000","last_undegraded":"2024-09-12T18:04:12.706189+0000","last_fullsized":"2024-09-12T18:04:12.706189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.748126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705919+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:04:12.705919+0000","last_peered":"2024-09-12T18:04:12.705919+0000","last_clean":"2024-09-12T18:04:12.705919+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:04:12.705919+0000","last_undegraded":"2024-09-12T18:04:12.705919+0000","last_fullsized":"2024-09-12T18:04:12.705919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":199,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704923+0000","last_change":"2024-09-12T18:01:54.708076+0000","last_active":"2024-09-12T18:04:12.704923+0000","last_peered":"2024-09-12T18:04:12.704923+0000","last_clean":"2024-09-12T18:04:12.704923+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:04:12.704923+0000","last_undegraded":"2024-09-12T18:04:12.704923+0000","last_fullsized":"2024-09-12T18:04:12.704923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:31.141070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705970+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:04:12.705970+0000","last_peered":"2024-09-12T18:04:12.705970+0000","last_clean":"2024-09-12T18:04:12.705970+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:04:12.705970+0000","last_undegraded":"2024-09-12T18:04:12.705970+0000","last_fullsized":"2024-09-12T18:04:12.705970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"69'482","reported_seq":653,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704648+0000","last_change":"2024-09-12T18:03:51.371570+0000","last_active":"2024-09-12T18:04:12.704648+0000","last_peered":"2024-09-12T18:04:12.704648+0000","last_clean":"2024-09-12T18:04:12.704648+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:04:12.704648+0000","last_undegraded":"2024-09-12T18:04:12.704648+0000","last_fullsized":"2024-09-12T18:04:12.704648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:26.421480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873320+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:04:13.873320+0000","last_peered":"2024-09-12T18:04:13.873320+0000","last_clean":"2024-09-12T18:04:13.873320+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:04:13.873320+0000","last_undegraded":"2024-09-12T18:04:13.873320+0000","last_fullsized":"2024-09-12T18:04:13.873320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'112","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705995+0000","last_change":"2024-09-12T18:01:44.483645+0000","last_active":"2024-09-12T18:04:12.705995+0000","last_peered":"2024-09-12T18:04:12.705995+0000","last_clean":"2024-09-12T18:04:12.705995+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:04:12.705995+0000","last_undegraded":"2024-09-12T18:04:12.705995+0000","last_fullsized":"2024-09-12T18:04:12.705995+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:43.468533+0000","last_clean_scrub_stamp":"2024-09-12T18:01:43.468533+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:48.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":162,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707193+0000","last_change":"2024-09-12T18:01:52.540434+0000","last_active":"2024-09-12T18:04:12.707193+0000","last_peered":"2024-09-12T18:04:12.707193+0000","last_clean":"2024-09-12T18:04:12.707193+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:04:12.707193+0000","last_undegraded":"2024-09-12T18:04:12.707193+0000","last_fullsized":"2024-09-12T18:04:12.707193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:16.735671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"66'569","reported_seq":715,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873085+0000","last_change":"2024-09-12T18:01:54.714645+0000","last_active":"2024-09-12T18:04:13.873085+0000","last_peered":"2024-09-12T18:04:13.873085+0000","last_clean":"2024-09-12T18:04:13.873085+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:04:13.873085+0000","last_undegraded":"2024-09-12T18:04:13.873085+0000","last_fullsized":"2024-09-12T18:04:13.873085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:35.909115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":609,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706016+0000","last_change":"2024-09-12T18:01:55.591117+0000","last_active":"2024-09-12T18:04:12.706016+0000","last_peered":"2024-09-12T18:04:12.706016+0000","last_clean":"2024-09-12T18:04:12.706016+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:04:12.706016+0000","last_undegraded":"2024-09-12T18:04:12.706016+0000","last_fullsized":"2024-09-12T18:04:12.706016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:44.917955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705822+0000","last_change":"2024-09-12T18:01:52.539743+0000","last_active":"2024-09-12T18:04:12.705822+0000","last_peered":"2024-09-12T18:04:12.705822+0000","last_clean":"2024-09-12T18:04:12.705822+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:04:12.705822+0000","last_undegraded":"2024-09-12T18:04:12.705822+0000","last_fullsized":"2024-09-12T18:04:12.705822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:46.397760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"69'129","reported_seq":344,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871712+0000","last_change":"2024-09-12T18:03:51.366963+0000","last_active":"2024-09-12T18:04:13.871712+0000","last_peered":"2024-09-12T18:04:13.871712+0000","last_clean":"2024-09-12T18:04:13.871712+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:04:13.871712+0000","last_undegraded":"2024-09-12T18:04:13.871712+0000","last_fullsized":"2024-09-12T18:04:13.871712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:18.574016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706251+0000","last_change":"2024-09-12T18:03:48.870961+0000","last_active":"2024-09-12T18:04:12.706251+0000","last_peered":"2024-09-12T18:04:12.706251+0000","last_clean":"2024-09-12T18:04:12.706251+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:04:12.706251+0000","last_undegraded":"2024-09-12T18:04:12.706251+0000","last_fullsized":"2024-09-12T18:04:12.706251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:37.117697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872596+0000","last_change":"2024-09-12T18:01:52.546540+0000","last_active":"2024-09-12T18:04:13.872596+0000","last_peered":"2024-09-12T18:04:13.872596+0000","last_clean":"2024-09-12T18:04:13.872596+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:04:13.872596+0000","last_undegraded":"2024-09-12T18:04:13.872596+0000","last_fullsized":"2024-09-12T18:04:13.872596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:48.590990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"69'374","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704735+0000","last_change":"2024-09-12T18:01:54.707608+0000","last_active":"2024-09-12T18:04:12.704735+0000","last_peered":"2024-09-12T18:04:12.704735+0000","last_clean":"2024-09-12T18:04:12.704735+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:04:12.704735+0000","last_undegraded":"2024-09-12T18:04:12.704735+0000","last_fullsized":"2024-09-12T18:04:12.704735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:36.574565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":813,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872901+0000","last_change":"2024-09-12T18:03:54.334607+0000","last_active":"2024-09-12T18:04:13.872901+0000","last_peered":"2024-09-12T18:04:13.872901+0000","last_clean":"2024-09-12T18:04:13.872901+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:04:13.872901+0000","last_undegraded":"2024-09-12T18:04:13.872901+0000","last_fullsized":"2024-09-12T18:04:13.872901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:27.565973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":173,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706554+0000","last_change":"2024-09-12T18:02:34.836179+0000","last_active":"2024-09-12T18:04:12.706554+0000","last_peered":"2024-09-12T18:04:12.706554+0000","last_clean":"2024-09-12T18:04:12.706554+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:04:12.706554+0000","last_undegraded":"2024-09-12T18:04:12.706554+0000","last_fullsized":"2024-09-12T18:04:12.706554+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:38.557178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":222,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707067+0000","last_change":"2024-09-12T18:04:09.697006+0000","last_active":"2024-09-12T18:04:12.707067+0000","last_peered":"2024-09-12T18:04:12.707067+0000","last_clean":"2024-09-12T18:04:12.707067+0000","last_became_active":"2024-09-12T18:04:09.686200+0000","last_became_peered":"2024-09-12T18:04:09.686200+0000","last_unstale":"2024-09-12T18:04:12.707067+0000","last_undegraded":"2024-09-12T18:04:12.707067+0000","last_fullsized":"2024-09-12T18:04:12.707067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:17.012774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":647,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873966+0000","last_change":"2024-09-12T18:01:55.598084+0000","last_active":"2024-09-12T18:04:13.873966+0000","last_peered":"2024-09-12T18:04:13.873966+0000","last_clean":"2024-09-12T18:04:13.873966+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:04:13.873966+0000","last_undegraded":"2024-09-12T18:04:13.873966+0000","last_fullsized":"2024-09-12T18:04:13.873966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:56.363469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"69'300","reported_seq":448,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706291+0000","last_change":"2024-09-12T18:01:54.714786+0000","last_active":"2024-09-12T18:04:12.706291+0000","last_peered":"2024-09-12T18:04:12.706291+0000","last_clean":"2024-09-12T18:04:12.706291+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:04:12.706291+0000","last_undegraded":"2024-09-12T18:04:12.706291+0000","last_fullsized":"2024-09-12T18:04:12.706291+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:54.582054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873956+0000","last_change":"2024-09-12T18:01:52.546541+0000","last_active":"2024-09-12T18:04:13.873956+0000","last_peered":"2024-09-12T18:04:13.873956+0000","last_clean":"2024-09-12T18:04:13.873956+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:04:13.873956+0000","last_undegraded":"2024-09-12T18:04:13.873956+0000","last_fullsized":"2024-09-12T18:04:13.873956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:54.441625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704996+0000","last_change":"2024-09-12T18:01:55.584241+0000","last_active":"2024-09-12T18:04:12.704996+0000","last_peered":"2024-09-12T18:04:12.704996+0000","last_clean":"2024-09-12T18:04:12.704996+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:04:12.704996+0000","last_undegraded":"2024-09-12T18:04:12.704996+0000","last_fullsized":"2024-09-12T18:04:12.704996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:46.485063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873478+0000","last_change":"2024-09-12T18:03:48.345684+0000","last_active":"2024-09-12T18:04:13.873478+0000","last_peered":"2024-09-12T18:04:13.873478+0000","last_clean":"2024-09-12T18:04:13.873478+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:04:13.873478+0000","last_undegraded":"2024-09-12T18:04:13.873478+0000","last_fullsized":"2024-09-12T18:04:13.873478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:41.317897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.707020+0000","last_change":"2024-09-12T18:03:48.349076+0000","last_active":"2024-09-12T18:04:12.707020+0000","last_peered":"2024-09-12T18:04:12.707020+0000","last_clean":"2024-09-12T18:04:12.707020+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:04:12.707020+0000","last_undegraded":"2024-09-12T18:04:12.707020+0000","last_fullsized":"2024-09-12T18:04:12.707020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:14.405726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":558,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705573+0000","last_change":"2024-09-12T18:01:55.583107+0000","last_active":"2024-09-12T18:04:12.705573+0000","last_peered":"2024-09-12T18:04:12.705573+0000","last_clean":"2024-09-12T18:04:12.705573+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:04:12.705573+0000","last_undegraded":"2024-09-12T18:04:12.705573+0000","last_fullsized":"2024-09-12T18:04:12.705573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:36.109393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"69'57","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873717+0000","last_change":"2024-09-12T18:03:48.362670+0000","last_active":"2024-09-12T18:04:13.873717+0000","last_peered":"2024-09-12T18:04:13.873717+0000","last_clean":"2024-09-12T18:04:13.873717+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:04:13.873717+0000","last_undegraded":"2024-09-12T18:04:13.873717+0000","last_fullsized":"2024-09-12T18:04:13.873717+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:55.028968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872584+0000","last_change":"2024-09-12T18:03:48.349730+0000","last_active":"2024-09-12T18:04:13.872584+0000","last_peered":"2024-09-12T18:04:13.872584+0000","last_clean":"2024-09-12T18:04:13.872584+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:04:13.872584+0000","last_undegraded":"2024-09-12T18:04:13.872584+0000","last_fullsized":"2024-09-12T18:04:13.872584+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.377741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":575,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871828+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:04:13.871828+0000","last_peered":"2024-09-12T18:04:13.871828+0000","last_clean":"2024-09-12T18:04:13.871828+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:04:13.871828+0000","last_undegraded":"2024-09-12T18:04:13.871828+0000","last_fullsized":"2024-09-12T18:04:13.871828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"72'114","reported_seq":268,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873483+0000","last_change":"2024-09-12T18:03:51.369706+0000","last_active":"2024-09-12T18:04:13.873483+0000","last_peered":"2024-09-12T18:04:13.873483+0000","last_clean":"2024-09-12T18:04:13.873483+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:04:13.873483+0000","last_undegraded":"2024-09-12T18:04:13.873483+0000","last_fullsized":"2024-09-12T18:04:13.873483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:36.115085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706764+0000","last_change":"2024-09-12T18:04:09.677962+0000","last_active":"2024-09-12T18:04:12.706764+0000","last_peered":"2024-09-12T18:04:12.706764+0000","last_clean":"2024-09-12T18:04:12.706764+0000","last_became_active":"2024-09-12T18:04:09.677062+0000","last_became_peered":"2024-09-12T18:04:09.677062+0000","last_unstale":"2024-09-12T18:04:12.706764+0000","last_undegraded":"2024-09-12T18:04:12.706764+0000","last_fullsized":"2024-09-12T18:04:12.706764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:49.503848+0000","last_clean_scrub_stamp":"2024-09-12T18:01:49.503848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:17.652687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704592+0000","last_change":"2024-09-12T18:01:55.593399+0000","last_active":"2024-09-12T18:04:12.704592+0000","last_peered":"2024-09-12T18:04:12.704592+0000","last_clean":"2024-09-12T18:04:12.704592+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:04:12.704592+0000","last_undegraded":"2024-09-12T18:04:12.704592+0000","last_fullsized":"2024-09-12T18:04:12.704592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:46.096577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":589,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706750+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:04:12.706750+0000","last_peered":"2024-09-12T18:04:12.706750+0000","last_clean":"2024-09-12T18:04:12.706750+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:04:12.706750+0000","last_undegraded":"2024-09-12T18:04:12.706750+0000","last_fullsized":"2024-09-12T18:04:12.706750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"66'227","reported_seq":375,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706091+0000","last_change":"2024-09-12T18:01:54.705253+0000","last_active":"2024-09-12T18:04:12.706091+0000","last_peered":"2024-09-12T18:04:12.706091+0000","last_clean":"2024-09-12T18:04:12.706091+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:04:12.706091+0000","last_undegraded":"2024-09-12T18:04:12.706091+0000","last_fullsized":"2024-09-12T18:04:12.706091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:56.929611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872309+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:04:13.872309+0000","last_peered":"2024-09-12T18:04:13.872309+0000","last_clean":"2024-09-12T18:04:13.872309+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:04:13.872309+0000","last_undegraded":"2024-09-12T18:04:13.872309+0000","last_fullsized":"2024-09-12T18:04:13.872309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"69'95","reported_seq":241,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706935+0000","last_change":"2024-09-12T18:01:54.707443+0000","last_active":"2024-09-12T18:04:12.706935+0000","last_peered":"2024-09-12T18:04:12.706935+0000","last_clean":"2024-09-12T18:04:12.706935+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:04:12.706935+0000","last_undegraded":"2024-09-12T18:04:12.706935+0000","last_fullsized":"2024-09-12T18:04:12.706935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:45.255000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"69'187","reported_seq":358,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706436+0000","last_change":"2024-09-12T18:04:09.685980+0000","last_active":"2024-09-12T18:04:12.706436+0000","last_peered":"2024-09-12T18:04:12.706436+0000","last_clean":"2024-09-12T18:04:12.706436+0000","last_became_active":"2024-09-12T18:04:09.682878+0000","last_became_peered":"2024-09-12T18:04:09.682878+0000","last_unstale":"2024-09-12T18:04:12.706436+0000","last_undegraded":"2024-09-12T18:04:12.706436+0000","last_fullsized":"2024-09-12T18:04:12.706436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:46.146053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":721,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872383+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:04:13.872383+0000","last_peered":"2024-09-12T18:04:13.872383+0000","last_clean":"2024-09-12T18:04:13.872383+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:04:13.872383+0000","last_undegraded":"2024-09-12T18:04:13.872383+0000","last_fullsized":"2024-09-12T18:04:13.872383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873502+0000","last_change":"2024-09-12T18:03:48.360519+0000","last_active":"2024-09-12T18:04:13.873502+0000","last_peered":"2024-09-12T18:04:13.873502+0000","last_clean":"2024-09-12T18:04:13.873502+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:04:13.873502+0000","last_undegraded":"2024-09-12T18:04:13.873502+0000","last_fullsized":"2024-09-12T18:04:13.873502+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:38.940238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":697,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871681+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:04:13.871681+0000","last_peered":"2024-09-12T18:04:13.871681+0000","last_clean":"2024-09-12T18:04:13.871681+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:04:13.871681+0000","last_undegraded":"2024-09-12T18:04:13.871681+0000","last_fullsized":"2024-09-12T18:04:13.871681+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706629+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:04:12.706629+0000","last_peered":"2024-09-12T18:04:12.706629+0000","last_clean":"2024-09-12T18:04:12.706629+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:04:12.706629+0000","last_undegraded":"2024-09-12T18:04:12.706629+0000","last_fullsized":"2024-09-12T18:04:12.706629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"69'653","reported_seq":798,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871889+0000","last_change":"2024-09-12T18:01:54.713626+0000","last_active":"2024-09-12T18:04:13.871889+0000","last_peered":"2024-09-12T18:04:13.871889+0000","last_clean":"2024-09-12T18:04:13.871889+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:04:13.871889+0000","last_undegraded":"2024-09-12T18:04:13.871889+0000","last_fullsized":"2024-09-12T18:04:13.871889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:49.069804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":670,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.870870+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:04:13.870870+0000","last_peered":"2024-09-12T18:04:13.870870+0000","last_clean":"2024-09-12T18:04:13.870870+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:04:13.870870+0000","last_undegraded":"2024-09-12T18:04:13.870870+0000","last_fullsized":"2024-09-12T18:04:13.870870+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"69'214","reported_seq":371,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871522+0000","last_change":"2024-09-12T18:03:51.367321+0000","last_active":"2024-09-12T18:04:13.871522+0000","last_peered":"2024-09-12T18:04:13.871522+0000","last_clean":"2024-09-12T18:04:13.871522+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:04:13.871522+0000","last_undegraded":"2024-09-12T18:04:13.871522+0000","last_fullsized":"2024-09-12T18:04:13.871522+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:24.423080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705907+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:04:12.705907+0000","last_peered":"2024-09-12T18:04:12.705907+0000","last_clean":"2024-09-12T18:04:12.705907+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:04:12.705907+0000","last_undegraded":"2024-09-12T18:04:12.705907+0000","last_fullsized":"2024-09-12T18:04:12.705907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:58.257382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"72'214","reported_seq":360,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705227+0000","last_change":"2024-09-12T18:01:54.704035+0000","last_active":"2024-09-12T18:04:12.705227+0000","last_peered":"2024-09-12T18:04:12.705227+0000","last_clean":"2024-09-12T18:04:12.705227+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:04:12.705227+0000","last_undegraded":"2024-09-12T18:04:12.705227+0000","last_fullsized":"2024-09-12T18:04:12.705227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:22.392875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705628+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:04:12.705628+0000","last_peered":"2024-09-12T18:04:12.705628+0000","last_clean":"2024-09-12T18:04:12.705628+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:04:12.705628+0000","last_undegraded":"2024-09-12T18:04:12.705628+0000","last_fullsized":"2024-09-12T18:04:12.705628+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"66'51","reported_seq":197,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705941+0000","last_change":"2024-09-12T18:01:54.711177+0000","last_active":"2024-09-12T18:04:12.705941+0000","last_peered":"2024-09-12T18:04:12.705941+0000","last_clean":"2024-09-12T18:04:12.705941+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:04:12.705941+0000","last_undegraded":"2024-09-12T18:04:12.705941+0000","last_fullsized":"2024-09-12T18:04:12.705941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:21.108373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706584+0000","last_change":"2024-09-12T18:04:09.697861+0000","last_active":"2024-09-12T18:04:12.706584+0000","last_peered":"2024-09-12T18:04:12.706584+0000","last_clean":"2024-09-12T18:04:12.706584+0000","last_became_active":"2024-09-12T18:04:09.688026+0000","last_became_peered":"2024-09-12T18:04:09.688026+0000","last_unstale":"2024-09-12T18:04:12.706584+0000","last_undegraded":"2024-09-12T18:04:12.706584+0000","last_fullsized":"2024-09-12T18:04:12.706584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:23.825721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"69'181","reported_seq":356,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705675+0000","last_change":"2024-09-12T18:04:09.695422+0000","last_active":"2024-09-12T18:04:12.705675+0000","last_peered":"2024-09-12T18:04:12.705675+0000","last_clean":"2024-09-12T18:04:12.705675+0000","last_became_active":"2024-09-12T18:04:09.692975+0000","last_became_peered":"2024-09-12T18:04:09.692975+0000","last_unstale":"2024-09-12T18:04:12.705675+0000","last_undegraded":"2024-09-12T18:04:12.705675+0000","last_fullsized":"2024-09-12T18:04:12.705675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.708997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1292,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705908+0000","last_change":"2024-09-12T18:04:09.693020+0000","last_active":"2024-09-12T18:04:12.705908+0000","last_peered":"2024-09-12T18:04:12.705908+0000","last_clean":"2024-09-12T18:04:12.705908+0000","last_became_active":"2024-09-12T18:04:09.684915+0000","last_became_peered":"2024-09-12T18:04:09.684915+0000","last_unstale":"2024-09-12T18:04:12.705908+0000","last_undegraded":"2024-09-12T18:04:12.705908+0000","last_fullsized":"2024-09-12T18:04:12.705908+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:27.897996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"69'277","reported_seq":423,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706634+0000","last_change":"2024-09-12T18:01:54.708497+0000","last_active":"2024-09-12T18:04:12.706634+0000","last_peered":"2024-09-12T18:04:12.706634+0000","last_clean":"2024-09-12T18:04:12.706634+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:04:12.706634+0000","last_undegraded":"2024-09-12T18:04:12.706634+0000","last_fullsized":"2024-09-12T18:04:12.706634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:44.132027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":563,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704948+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:04:12.704948+0000","last_peered":"2024-09-12T18:04:12.704948+0000","last_clean":"2024-09-12T18:04:12.704948+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:04:12.704948+0000","last_undegraded":"2024-09-12T18:04:12.704948+0000","last_fullsized":"2024-09-12T18:04:12.704948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:22.011066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"66'55","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873253+0000","last_change":"2024-09-12T18:03:48.413545+0000","last_active":"2024-09-12T18:04:13.873253+0000","last_peered":"2024-09-12T18:04:13.873253+0000","last_clean":"2024-09-12T18:04:13.873253+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:04:13.873253+0000","last_undegraded":"2024-09-12T18:04:13.873253+0000","last_fullsized":"2024-09-12T18:04:13.873253+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:45.330141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704907+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:04:12.704907+0000","last_peered":"2024-09-12T18:04:12.704907+0000","last_clean":"2024-09-12T18:04:12.704907+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:04:12.704907+0000","last_undegraded":"2024-09-12T18:04:12.704907+0000","last_fullsized":"2024-09-12T18:04:12.704907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:53.940571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"69'116","reported_seq":220,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872586+0000","last_change":"2024-09-12T18:03:51.371407+0000","last_active":"2024-09-12T18:04:13.872586+0000","last_peered":"2024-09-12T18:04:13.872586+0000","last_clean":"2024-09-12T18:04:13.872586+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:04:13.872586+0000","last_undegraded":"2024-09-12T18:04:13.872586+0000","last_fullsized":"2024-09-12T18:04:13.872586+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:53.672138+0000","last_clean_scrub_stamp":"2024-09-12T18:01:53.672138+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6248,"ondisk_log_size":6248,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738404,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121708,"kb_used_data":23960,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94250132,"statfs":{"total":96636764160,"available":96512135168,"internally_reserved":0,"allocated":24535040,"data_stored":81408167,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738404,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113888,"kb_used_data":28612,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94257952,"statfs":{"total":96636764160,"available":96520142848,"internally_reserved":0,"allocated":29298688,"data_stored":84724657,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118208,"kb_used_data":28776,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253632,"statfs":{"total":96636764160,"available":96515719168,"internally_reserved":0,"allocated":29466624,"data_stored":90491785,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:04:20.632 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.632 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.632 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.632 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.633 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.633 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.633 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.633 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.633 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.633 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.633 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.634 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.634 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.634 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.634 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.634 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.634 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.634 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.634 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.635 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.636 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.636 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.636 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.636 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.636 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.636 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.636 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.636 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.637 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.637 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.637 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.637 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.637 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.637 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.637 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.637 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.638 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.639 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.639 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.639 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.639 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T18:01:43.468533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.639 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T18:01:49.503848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.639 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.639 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.639 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T18:01:49.503848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.640 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.640 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.640 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T18:01:49.503848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.640 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.640 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.640 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T18:01:49.503848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.640 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.640 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.641 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.641 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T18:01:49.503848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.641 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.641 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.641 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T18:01:49.503848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.641 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.641 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.641 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T18:01:49.503848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.642 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.642 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.642 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T18:01:49.503848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.642 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.642 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.642 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.642 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.643 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.643 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.643 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.643 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.643 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.643 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.643 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.643 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.644 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.644 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.644 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.644 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.644 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.644 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.644 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.644 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.645 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.645 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.645 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.645 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.645 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T18:01:53.672138+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:20.645 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:04:40.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:04:40.972 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:04:40.974 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:04:40.990 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-12T18:04:40.603397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33008,"ondisk_log_size":33008,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":337140,"kb_used_data":81348,"kb_used_omap":4,"kb_used_meta":255739,"kb_avail":282778380,"statfs":{"total":289910292480,"available":289565061120,"internally_reserved":0,"allocated":83300352,"data_stored":256624609,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":261877071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004594"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706444+0000","last_change":"2024-09-12T18:01:55.579764+0000","last_active":"2024-09-12T18:04:12.706444+0000","last_peered":"2024-09-12T18:04:12.706444+0000","last_clean":"2024-09-12T18:04:12.706444+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:04:12.706444+0000","last_undegraded":"2024-09-12T18:04:12.706444+0000","last_fullsized":"2024-09-12T18:04:12.706444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:42.993621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705980+0000","last_change":"2024-09-12T18:03:49.860537+0000","last_active":"2024-09-12T18:04:12.705980+0000","last_peered":"2024-09-12T18:04:12.705980+0000","last_clean":"2024-09-12T18:04:12.705980+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:04:12.705980+0000","last_undegraded":"2024-09-12T18:04:12.705980+0000","last_fullsized":"2024-09-12T18:04:12.705980+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:02:51.391742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705200+0000","last_change":"2024-09-12T18:04:09.681163+0000","last_active":"2024-09-12T18:04:12.705200+0000","last_peered":"2024-09-12T18:04:12.705200+0000","last_clean":"2024-09-12T18:04:12.705200+0000","last_became_active":"2024-09-12T18:04:09.677098+0000","last_became_peered":"2024-09-12T18:04:09.677098+0000","last_unstale":"2024-09-12T18:04:12.705200+0000","last_undegraded":"2024-09-12T18:04:12.705200+0000","last_fullsized":"2024-09-12T18:04:12.705200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:22.899798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":549,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705006+0000","last_change":"2024-09-12T18:04:09.694526+0000","last_active":"2024-09-12T18:04:12.705006+0000","last_peered":"2024-09-12T18:04:12.705006+0000","last_clean":"2024-09-12T18:04:12.705006+0000","last_became_active":"2024-09-12T18:04:09.685115+0000","last_became_peered":"2024-09-12T18:04:09.685115+0000","last_unstale":"2024-09-12T18:04:12.705006+0000","last_undegraded":"2024-09-12T18:04:12.705006+0000","last_fullsized":"2024-09-12T18:04:12.705006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:32.108507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":667,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705816+0000","last_change":"2024-09-12T18:01:55.581719+0000","last_active":"2024-09-12T18:04:12.705816+0000","last_peered":"2024-09-12T18:04:12.705816+0000","last_clean":"2024-09-12T18:04:12.705816+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:04:12.705816+0000","last_undegraded":"2024-09-12T18:04:12.705816+0000","last_fullsized":"2024-09-12T18:04:12.705816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":530,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706405+0000","last_change":"2024-09-12T18:04:09.697456+0000","last_active":"2024-09-12T18:04:12.706405+0000","last_peered":"2024-09-12T18:04:12.706405+0000","last_clean":"2024-09-12T18:04:12.706405+0000","last_became_active":"2024-09-12T18:04:09.691370+0000","last_became_peered":"2024-09-12T18:04:09.691370+0000","last_unstale":"2024-09-12T18:04:12.706405+0000","last_undegraded":"2024-09-12T18:04:12.706405+0000","last_fullsized":"2024-09-12T18:04:12.706405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":640,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706306+0000","last_change":"2024-09-12T18:04:09.694180+0000","last_active":"2024-09-12T18:04:12.706306+0000","last_peered":"2024-09-12T18:04:12.706306+0000","last_clean":"2024-09-12T18:04:12.706306+0000","last_became_active":"2024-09-12T18:04:09.686122+0000","last_became_peered":"2024-09-12T18:04:09.686122+0000","last_unstale":"2024-09-12T18:04:12.706306+0000","last_undegraded":"2024-09-12T18:04:12.706306+0000","last_fullsized":"2024-09-12T18:04:12.706306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":994,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704455+0000","last_change":"2024-09-12T18:03:49.961215+0000","last_active":"2024-09-12T18:04:12.704455+0000","last_peered":"2024-09-12T18:04:12.704455+0000","last_clean":"2024-09-12T18:04:12.704455+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:04:12.704455+0000","last_undegraded":"2024-09-12T18:04:12.704455+0000","last_fullsized":"2024-09-12T18:04:12.704455+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873167+0000","last_change":"2024-09-12T18:01:55.602894+0000","last_active":"2024-09-12T18:04:13.873167+0000","last_peered":"2024-09-12T18:04:13.873167+0000","last_clean":"2024-09-12T18:04:13.873167+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:04:13.873167+0000","last_undegraded":"2024-09-12T18:04:13.873167+0000","last_fullsized":"2024-09-12T18:04:13.873167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1051,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706290+0000","last_change":"2024-09-12T18:03:48.759782+0000","last_active":"2024-09-12T18:04:12.706290+0000","last_peered":"2024-09-12T18:04:12.706290+0000","last_clean":"2024-09-12T18:04:12.706290+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:04:12.706290+0000","last_undegraded":"2024-09-12T18:04:12.706290+0000","last_fullsized":"2024-09-12T18:04:12.706290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":555,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705627+0000","last_change":"2024-09-12T18:04:09.685941+0000","last_active":"2024-09-12T18:04:12.705627+0000","last_peered":"2024-09-12T18:04:12.705627+0000","last_clean":"2024-09-12T18:04:12.705627+0000","last_became_active":"2024-09-12T18:04:09.681305+0000","last_became_peered":"2024-09-12T18:04:09.681305+0000","last_unstale":"2024-09-12T18:04:12.705627+0000","last_undegraded":"2024-09-12T18:04:12.705627+0000","last_fullsized":"2024-09-12T18:04:12.705627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":536,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705726+0000","last_change":"2024-09-12T18:01:55.593076+0000","last_active":"2024-09-12T18:04:12.705726+0000","last_peered":"2024-09-12T18:04:12.705726+0000","last_clean":"2024-09-12T18:04:12.705726+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:04:12.705726+0000","last_undegraded":"2024-09-12T18:04:12.705726+0000","last_fullsized":"2024-09-12T18:04:12.705726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":542,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705536+0000","last_change":"2024-09-12T18:01:55.583710+0000","last_active":"2024-09-12T18:04:12.705536+0000","last_peered":"2024-09-12T18:04:12.705536+0000","last_clean":"2024-09-12T18:04:12.705536+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:04:12.705536+0000","last_undegraded":"2024-09-12T18:04:12.705536+0000","last_fullsized":"2024-09-12T18:04:12.705536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":616,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705071+0000","last_change":"2024-09-12T18:01:55.588198+0000","last_active":"2024-09-12T18:04:12.705071+0000","last_peered":"2024-09-12T18:04:12.705071+0000","last_clean":"2024-09-12T18:04:12.705071+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:04:12.705071+0000","last_undegraded":"2024-09-12T18:04:12.705071+0000","last_fullsized":"2024-09-12T18:04:12.705071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:24.579332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706901+0000","last_change":"2024-09-12T18:04:09.695076+0000","last_active":"2024-09-12T18:04:12.706901+0000","last_peered":"2024-09-12T18:04:12.706901+0000","last_clean":"2024-09-12T18:04:12.706901+0000","last_became_active":"2024-09-12T18:04:09.684858+0000","last_became_peered":"2024-09-12T18:04:09.684858+0000","last_unstale":"2024-09-12T18:04:12.706901+0000","last_undegraded":"2024-09-12T18:04:12.706901+0000","last_fullsized":"2024-09-12T18:04:12.706901+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:14.097506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":686,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704636+0000","last_change":"2024-09-12T18:04:09.687477+0000","last_active":"2024-09-12T18:04:12.704636+0000","last_peered":"2024-09-12T18:04:12.704636+0000","last_clean":"2024-09-12T18:04:12.704636+0000","last_became_active":"2024-09-12T18:04:09.680510+0000","last_became_peered":"2024-09-12T18:04:09.680510+0000","last_unstale":"2024-09-12T18:04:12.704636+0000","last_undegraded":"2024-09-12T18:04:12.704636+0000","last_fullsized":"2024-09-12T18:04:12.704636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:53.703464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873930+0000","last_change":"2024-09-12T18:01:55.605476+0000","last_active":"2024-09-12T18:04:13.873930+0000","last_peered":"2024-09-12T18:04:13.873930+0000","last_clean":"2024-09-12T18:04:13.873930+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:04:13.873930+0000","last_undegraded":"2024-09-12T18:04:13.873930+0000","last_fullsized":"2024-09-12T18:04:13.873930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:36.387560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":693,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706725+0000","last_change":"2024-09-12T18:03:52.537368+0000","last_active":"2024-09-12T18:04:12.706725+0000","last_peered":"2024-09-12T18:04:12.706725+0000","last_clean":"2024-09-12T18:04:12.706725+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:04:12.706725+0000","last_undegraded":"2024-09-12T18:04:12.706725+0000","last_fullsized":"2024-09-12T18:04:12.706725+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":691,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.870813+0000","last_change":"2024-09-12T18:03:49.460738+0000","last_active":"2024-09-12T18:04:13.870813+0000","last_peered":"2024-09-12T18:04:13.870813+0000","last_clean":"2024-09-12T18:04:13.870813+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:04:13.870813+0000","last_undegraded":"2024-09-12T18:04:13.870813+0000","last_fullsized":"2024-09-12T18:04:13.870813+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:03.469931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705083+0000","last_change":"2024-09-12T18:01:55.592071+0000","last_active":"2024-09-12T18:04:12.705083+0000","last_peered":"2024-09-12T18:04:12.705083+0000","last_clean":"2024-09-12T18:04:12.705083+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:04:12.705083+0000","last_undegraded":"2024-09-12T18:04:12.705083+0000","last_fullsized":"2024-09-12T18:04:12.705083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:58.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":1000,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706891+0000","last_change":"2024-09-12T18:03:48.644104+0000","last_active":"2024-09-12T18:04:12.706891+0000","last_peered":"2024-09-12T18:04:12.706891+0000","last_clean":"2024-09-12T18:04:12.706891+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:04:12.706891+0000","last_undegraded":"2024-09-12T18:04:12.706891+0000","last_fullsized":"2024-09-12T18:04:12.706891+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:23.879104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704901+0000","last_change":"2024-09-12T18:01:55.592414+0000","last_active":"2024-09-12T18:04:12.704901+0000","last_peered":"2024-09-12T18:04:12.704901+0000","last_clean":"2024-09-12T18:04:12.704901+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:04:12.704901+0000","last_undegraded":"2024-09-12T18:04:12.704901+0000","last_fullsized":"2024-09-12T18:04:12.704901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:27.242664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":933,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871804+0000","last_change":"2024-09-12T18:03:56.341786+0000","last_active":"2024-09-12T18:04:13.871804+0000","last_peered":"2024-09-12T18:04:13.871804+0000","last_clean":"2024-09-12T18:04:13.871804+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:04:13.871804+0000","last_undegraded":"2024-09-12T18:04:13.871804+0000","last_fullsized":"2024-09-12T18:04:13.871804+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:05.850084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704364+0000","last_change":"2024-09-12T18:03:48.542034+0000","last_active":"2024-09-12T18:04:12.704364+0000","last_peered":"2024-09-12T18:04:12.704364+0000","last_clean":"2024-09-12T18:04:12.704364+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:04:12.704364+0000","last_undegraded":"2024-09-12T18:04:12.704364+0000","last_fullsized":"2024-09-12T18:04:12.704364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:25.425691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706563+0000","last_change":"2024-09-12T18:01:55.587773+0000","last_active":"2024-09-12T18:04:12.706563+0000","last_peered":"2024-09-12T18:04:12.706563+0000","last_clean":"2024-09-12T18:04:12.706563+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:04:12.706563+0000","last_undegraded":"2024-09-12T18:04:12.706563+0000","last_fullsized":"2024-09-12T18:04:12.706563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:26.420474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":647,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873222+0000","last_change":"2024-09-12T18:01:55.598804+0000","last_active":"2024-09-12T18:04:13.873222+0000","last_peered":"2024-09-12T18:04:13.873222+0000","last_clean":"2024-09-12T18:04:13.873222+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:04:13.873222+0000","last_undegraded":"2024-09-12T18:04:13.873222+0000","last_fullsized":"2024-09-12T18:04:13.873222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:30.365689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705566+0000","last_change":"2024-09-12T18:01:55.591312+0000","last_active":"2024-09-12T18:04:12.705566+0000","last_peered":"2024-09-12T18:04:12.705566+0000","last_clean":"2024-09-12T18:04:12.705566+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:04:12.705566+0000","last_undegraded":"2024-09-12T18:04:12.705566+0000","last_fullsized":"2024-09-12T18:04:12.705566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.066341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706212+0000","last_change":"2024-09-12T18:01:55.589180+0000","last_active":"2024-09-12T18:04:12.706212+0000","last_peered":"2024-09-12T18:04:12.706212+0000","last_clean":"2024-09-12T18:04:12.706212+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:04:12.706212+0000","last_undegraded":"2024-09-12T18:04:12.706212+0000","last_fullsized":"2024-09-12T18:04:12.706212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":953,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872273+0000","last_change":"2024-09-12T18:03:56.344116+0000","last_active":"2024-09-12T18:04:13.872273+0000","last_peered":"2024-09-12T18:04:13.872273+0000","last_clean":"2024-09-12T18:04:13.872273+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:04:13.872273+0000","last_undegraded":"2024-09-12T18:04:13.872273+0000","last_fullsized":"2024-09-12T18:04:13.872273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:25:15.813197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":634,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704483+0000","last_change":"2024-09-12T18:02:41.861262+0000","last_active":"2024-09-12T18:04:12.704483+0000","last_peered":"2024-09-12T18:04:12.704483+0000","last_clean":"2024-09-12T18:04:12.704483+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:04:12.704483+0000","last_undegraded":"2024-09-12T18:04:12.704483+0000","last_fullsized":"2024-09-12T18:04:12.704483+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:03.779471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":1006,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.870796+0000","last_change":"2024-09-12T18:03:57.344789+0000","last_active":"2024-09-12T18:04:13.870796+0000","last_peered":"2024-09-12T18:04:13.870796+0000","last_clean":"2024-09-12T18:04:13.870796+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:04:13.870796+0000","last_undegraded":"2024-09-12T18:04:13.870796+0000","last_fullsized":"2024-09-12T18:04:13.870796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:01.745522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":600,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.704604+0000","last_change":"2024-09-12T18:04:09.687125+0000","last_active":"2024-09-12T18:04:12.704604+0000","last_peered":"2024-09-12T18:04:12.704604+0000","last_clean":"2024-09-12T18:04:12.704604+0000","last_became_active":"2024-09-12T18:04:09.680177+0000","last_became_peered":"2024-09-12T18:04:09.680177+0000","last_unstale":"2024-09-12T18:04:12.704604+0000","last_undegraded":"2024-09-12T18:04:12.704604+0000","last_fullsized":"2024-09-12T18:04:12.704604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:42.148452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":635,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:35.655318+0000","last_change":"2024-09-12T18:04:35.655318+0000","last_active":"2024-09-12T18:04:35.655318+0000","last_peered":"2024-09-12T18:04:35.655318+0000","last_clean":"2024-09-12T18:04:35.655318+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:04:35.655318+0000","last_undegraded":"2024-09-12T18:04:35.655318+0000","last_fullsized":"2024-09-12T18:04:35.655318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'406","last_scrub_stamp":"2024-09-12T18:04:35.655079+0000","last_deep_scrub":"69'406","last_deep_scrub_stamp":"2024-09-12T18:04:35.655079+0000","last_clean_scrub_stamp":"2024-09-12T18:04:35.655079+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:34.683793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"85'450","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:32.375304+0000","last_change":"2024-09-12T18:04:32.375304+0000","last_active":"2024-09-12T18:04:32.375304+0000","last_peered":"2024-09-12T18:04:32.375304+0000","last_clean":"2024-09-12T18:04:32.375304+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:04:32.375304+0000","last_undegraded":"2024-09-12T18:04:32.375304+0000","last_fullsized":"2024-09-12T18:04:32.375304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'450","last_scrub_stamp":"2024-09-12T18:04:32.375097+0000","last_deep_scrub":"85'450","last_deep_scrub_stamp":"2024-09-12T18:04:32.375097+0000","last_clean_scrub_stamp":"2024-09-12T18:04:32.375097+0000","objects_scrubbed":4,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:17.504676+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":563,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706564+0000","last_change":"2024-09-12T18:01:55.584598+0000","last_active":"2024-09-12T18:04:12.706564+0000","last_peered":"2024-09-12T18:04:12.706564+0000","last_clean":"2024-09-12T18:04:12.706564+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:04:12.706564+0000","last_undegraded":"2024-09-12T18:04:12.706564+0000","last_fullsized":"2024-09-12T18:04:12.706564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":204,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:35.969727+0000","last_change":"2024-09-12T18:04:35.969727+0000","last_active":"2024-09-12T18:04:35.969727+0000","last_peered":"2024-09-12T18:04:35.969727+0000","last_clean":"2024-09-12T18:04:35.969727+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:04:35.969727+0000","last_undegraded":"2024-09-12T18:04:35.969727+0000","last_fullsized":"2024-09-12T18:04:35.969727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'50","last_scrub_stamp":"2024-09-12T18:04:35.969534+0000","last_deep_scrub":"69'50","last_deep_scrub_stamp":"2024-09-12T18:04:35.969534+0000","last_clean_scrub_stamp":"2024-09-12T18:04:35.969534+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:56.716859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873707+0000","last_change":"2024-09-12T18:01:55.598811+0000","last_active":"2024-09-12T18:04:13.873707+0000","last_peered":"2024-09-12T18:04:13.873707+0000","last_clean":"2024-09-12T18:04:13.873707+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:04:13.873707+0000","last_undegraded":"2024-09-12T18:04:13.873707+0000","last_fullsized":"2024-09-12T18:04:13.873707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":224,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:22.544003+0000","last_change":"2024-09-12T18:04:22.544003+0000","last_active":"2024-09-12T18:04:22.544003+0000","last_peered":"2024-09-12T18:04:22.544003+0000","last_clean":"2024-09-12T18:04:22.544003+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:04:22.544003+0000","last_undegraded":"2024-09-12T18:04:22.544003+0000","last_fullsized":"2024-09-12T18:04:22.544003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'69","last_scrub_stamp":"2024-09-12T18:04:22.543820+0000","last_deep_scrub":"66'69","last_deep_scrub_stamp":"2024-09-12T18:04:22.543820+0000","last_clean_scrub_stamp":"2024-09-12T18:04:22.543820+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:01.200904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873346+0000","last_change":"2024-09-12T18:01:55.599143+0000","last_active":"2024-09-12T18:04:13.873346+0000","last_peered":"2024-09-12T18:04:13.873346+0000","last_clean":"2024-09-12T18:04:13.873346+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:04:13.873346+0000","last_undegraded":"2024-09-12T18:04:13.873346+0000","last_fullsized":"2024-09-12T18:04:13.873346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"85'65","reported_seq":221,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:30.333080+0000","last_change":"2024-09-12T18:04:30.333080+0000","last_active":"2024-09-12T18:04:30.333080+0000","last_peered":"2024-09-12T18:04:30.333080+0000","last_clean":"2024-09-12T18:04:30.333080+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:04:30.333080+0000","last_undegraded":"2024-09-12T18:04:30.333080+0000","last_fullsized":"2024-09-12T18:04:30.333080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'65","last_scrub_stamp":"2024-09-12T18:04:30.332873+0000","last_deep_scrub":"85'65","last_deep_scrub_stamp":"2024-09-12T18:04:30.332873+0000","last_clean_scrub_stamp":"2024-09-12T18:04:30.332873+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:20.232824+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'140","reported_seq":296,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.363832+0000","last_change":"2024-09-12T18:04:29.363832+0000","last_active":"2024-09-12T18:04:29.363832+0000","last_peered":"2024-09-12T18:04:29.363832+0000","last_clean":"2024-09-12T18:04:29.363832+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:04:29.363832+0000","last_undegraded":"2024-09-12T18:04:29.363832+0000","last_fullsized":"2024-09-12T18:04:29.363832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'140","last_scrub_stamp":"2024-09-12T18:04:29.363634+0000","last_deep_scrub":"85'140","last_deep_scrub_stamp":"2024-09-12T18:04:29.363634+0000","last_clean_scrub_stamp":"2024-09-12T18:04:29.363634+0000","objects_scrubbed":2,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:15.077886+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:33.612031+0000","last_change":"2024-09-12T18:04:33.612031+0000","last_active":"2024-09-12T18:04:33.612031+0000","last_peered":"2024-09-12T18:04:33.612031+0000","last_clean":"2024-09-12T18:04:33.612031+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:04:33.612031+0000","last_undegraded":"2024-09-12T18:04:33.612031+0000","last_fullsized":"2024-09-12T18:04:33.612031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'429","last_scrub_stamp":"2024-09-12T18:04:33.611840+0000","last_deep_scrub":"68'429","last_deep_scrub_stamp":"2024-09-12T18:04:33.611840+0000","last_clean_scrub_stamp":"2024-09-12T18:04:33.611840+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:21.085543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"85'252","reported_seq":407,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:26.515863+0000","last_change":"2024-09-12T18:04:26.515863+0000","last_active":"2024-09-12T18:04:26.515863+0000","last_peered":"2024-09-12T18:04:26.515863+0000","last_clean":"2024-09-12T18:04:26.515863+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:04:26.515863+0000","last_undegraded":"2024-09-12T18:04:26.515863+0000","last_fullsized":"2024-09-12T18:04:26.515863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'252","last_scrub_stamp":"2024-09-12T18:04:26.515651+0000","last_deep_scrub":"85'252","last_deep_scrub_stamp":"2024-09-12T18:04:26.515651+0000","last_clean_scrub_stamp":"2024-09-12T18:04:26.515651+0000","objects_scrubbed":2,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:03.010270+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1476,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:36.698231+0000","last_change":"2024-09-12T18:04:36.698231+0000","last_active":"2024-09-12T18:04:36.698231+0000","last_peered":"2024-09-12T18:04:36.698231+0000","last_clean":"2024-09-12T18:04:36.698231+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:04:36.698231+0000","last_undegraded":"2024-09-12T18:04:36.698231+0000","last_fullsized":"2024-09-12T18:04:36.698231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'459","last_scrub_stamp":"2024-09-12T18:04:36.698045+0000","last_deep_scrub":"69'459","last_deep_scrub_stamp":"2024-09-12T18:04:36.698045+0000","last_clean_scrub_stamp":"2024-09-12T18:04:36.698045+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:29.837771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"85'382","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:28.409505+0000","last_change":"2024-09-12T18:04:28.409505+0000","last_active":"2024-09-12T18:04:28.409505+0000","last_peered":"2024-09-12T18:04:28.409505+0000","last_clean":"2024-09-12T18:04:28.409505+0000","last_became_active":"2024-09-12T18:04:09.682207+0000","last_became_peered":"2024-09-12T18:04:09.682207+0000","last_unstale":"2024-09-12T18:04:28.409505+0000","last_undegraded":"2024-09-12T18:04:28.409505+0000","last_fullsized":"2024-09-12T18:04:28.409505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'382","last_scrub_stamp":"2024-09-12T18:04:28.409289+0000","last_deep_scrub":"85'382","last_deep_scrub_stamp":"2024-09-12T18:04:28.409289+0000","last_clean_scrub_stamp":"2024-09-12T18:04:28.409289+0000","objects_scrubbed":2,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:36.366067+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":621,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:35.330483+0000","last_change":"2024-09-12T18:04:35.330483+0000","last_active":"2024-09-12T18:04:35.330483+0000","last_peered":"2024-09-12T18:04:35.330483+0000","last_clean":"2024-09-12T18:04:35.330483+0000","last_became_active":"2024-09-12T18:04:09.681881+0000","last_became_peered":"2024-09-12T18:04:09.681881+0000","last_unstale":"2024-09-12T18:04:35.330483+0000","last_undegraded":"2024-09-12T18:04:35.330483+0000","last_fullsized":"2024-09-12T18:04:35.330483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'426","last_scrub_stamp":"2024-09-12T18:04:35.330297+0000","last_deep_scrub":"69'426","last_deep_scrub_stamp":"2024-09-12T18:04:35.330297+0000","last_clean_scrub_stamp":"2024-09-12T18:04:35.330297+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:38.205633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:26.340401+0000","last_change":"2024-09-12T18:04:26.340401+0000","last_active":"2024-09-12T18:04:26.340401+0000","last_peered":"2024-09-12T18:04:26.340401+0000","last_clean":"2024-09-12T18:04:26.340401+0000","last_became_active":"2024-09-12T18:04:09.692860+0000","last_became_peered":"2024-09-12T18:04:09.692860+0000","last_unstale":"2024-09-12T18:04:26.340401+0000","last_undegraded":"2024-09-12T18:04:26.340401+0000","last_fullsized":"2024-09-12T18:04:26.340401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'54","last_scrub_stamp":"2024-09-12T18:04:26.340217+0000","last_deep_scrub":"69'54","last_deep_scrub_stamp":"2024-09-12T18:04:26.340217+0000","last_clean_scrub_stamp":"2024-09-12T18:04:26.340217+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:22.254704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":649,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872979+0000","last_change":"2024-09-12T18:03:48.662120+0000","last_active":"2024-09-12T18:04:13.872979+0000","last_peered":"2024-09-12T18:04:13.872979+0000","last_clean":"2024-09-12T18:04:13.872979+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:04:13.872979+0000","last_undegraded":"2024-09-12T18:04:13.872979+0000","last_fullsized":"2024-09-12T18:04:13.872979+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:07.719544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'159","reported_seq":320,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.028175+0000","last_change":"2024-09-12T18:04:29.028175+0000","last_active":"2024-09-12T18:04:29.028175+0000","last_peered":"2024-09-12T18:04:29.028175+0000","last_clean":"2024-09-12T18:04:29.028175+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:04:29.028175+0000","last_undegraded":"2024-09-12T18:04:29.028175+0000","last_fullsized":"2024-09-12T18:04:29.028175+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'159","last_scrub_stamp":"2024-09-12T18:04:29.028001+0000","last_deep_scrub":"85'159","last_deep_scrub_stamp":"2024-09-12T18:04:29.028001+0000","last_clean_scrub_stamp":"2024-09-12T18:04:29.028001+0000","objects_scrubbed":3,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:55.413216+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1482,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:36.307491+0000","last_change":"2024-09-12T18:04:36.307491+0000","last_active":"2024-09-12T18:04:36.307491+0000","last_peered":"2024-09-12T18:04:36.307491+0000","last_clean":"2024-09-12T18:04:36.307491+0000","last_became_active":"2024-09-12T18:04:09.686387+0000","last_became_peered":"2024-09-12T18:04:09.686387+0000","last_unstale":"2024-09-12T18:04:36.307491+0000","last_undegraded":"2024-09-12T18:04:36.307491+0000","last_fullsized":"2024-09-12T18:04:36.307491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'457","last_scrub_stamp":"2024-09-12T18:04:36.307314+0000","last_deep_scrub":"69'457","last_deep_scrub_stamp":"2024-09-12T18:04:36.307314+0000","last_clean_scrub_stamp":"2024-09-12T18:04:36.307314+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:46.983417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"85'118","reported_seq":274,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:27.393858+0000","last_change":"2024-09-12T18:04:27.393858+0000","last_active":"2024-09-12T18:04:27.393858+0000","last_peered":"2024-09-12T18:04:27.393858+0000","last_clean":"2024-09-12T18:04:27.393858+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:04:27.393858+0000","last_undegraded":"2024-09-12T18:04:27.393858+0000","last_fullsized":"2024-09-12T18:04:27.393858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'118","last_scrub_stamp":"2024-09-12T18:04:27.393673+0000","last_deep_scrub":"85'118","last_deep_scrub_stamp":"2024-09-12T18:04:27.393673+0000","last_clean_scrub_stamp":"2024-09-12T18:04:27.393673+0000","objects_scrubbed":1,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:54.873705+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":614,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705919+0000","last_change":"2024-09-12T18:01:55.588064+0000","last_active":"2024-09-12T18:04:12.705919+0000","last_peered":"2024-09-12T18:04:12.705919+0000","last_clean":"2024-09-12T18:04:12.705919+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:04:12.705919+0000","last_undegraded":"2024-09-12T18:04:12.705919+0000","last_fullsized":"2024-09-12T18:04:12.705919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:44.085315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":207,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:21.498805+0000","last_change":"2024-09-12T18:04:21.498805+0000","last_active":"2024-09-12T18:04:21.498805+0000","last_peered":"2024-09-12T18:04:21.498805+0000","last_clean":"2024-09-12T18:04:21.498805+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:04:21.498805+0000","last_undegraded":"2024-09-12T18:04:21.498805+0000","last_fullsized":"2024-09-12T18:04:21.498805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'52","last_scrub_stamp":"2024-09-12T18:04:21.498626+0000","last_deep_scrub":"66'52","last_deep_scrub_stamp":"2024-09-12T18:04:21.498626+0000","last_clean_scrub_stamp":"2024-09-12T18:04:21.498626+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:18.892666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705970+0000","last_change":"2024-09-12T18:01:55.588351+0000","last_active":"2024-09-12T18:04:12.705970+0000","last_peered":"2024-09-12T18:04:12.705970+0000","last_clean":"2024-09-12T18:04:12.705970+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:04:12.705970+0000","last_undegraded":"2024-09-12T18:04:12.705970+0000","last_fullsized":"2024-09-12T18:04:12.705970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"85'483","reported_seq":662,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:25.529772+0000","last_change":"2024-09-12T18:04:25.529772+0000","last_active":"2024-09-12T18:04:25.529772+0000","last_peered":"2024-09-12T18:04:25.529772+0000","last_clean":"2024-09-12T18:04:25.529772+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:04:25.529772+0000","last_undegraded":"2024-09-12T18:04:25.529772+0000","last_fullsized":"2024-09-12T18:04:25.529772+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'483","last_scrub_stamp":"2024-09-12T18:04:25.529540+0000","last_deep_scrub":"85'483","last_deep_scrub_stamp":"2024-09-12T18:04:25.529540+0000","last_clean_scrub_stamp":"2024-09-12T18:04:25.529540+0000","objects_scrubbed":1,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:00.369886+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.873320+0000","last_change":"2024-09-12T18:01:55.603082+0000","last_active":"2024-09-12T18:04:13.873320+0000","last_peered":"2024-09-12T18:04:13.873320+0000","last_clean":"2024-09-12T18:04:13.873320+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:04:13.873320+0000","last_undegraded":"2024-09-12T18:04:13.873320+0000","last_fullsized":"2024-09-12T18:04:13.873320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:49.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"85'114","reported_seq":308,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:21.422891+0000","last_change":"2024-09-12T18:04:21.422891+0000","last_active":"2024-09-12T18:04:21.422891+0000","last_peered":"2024-09-12T18:04:21.422891+0000","last_clean":"2024-09-12T18:04:21.422891+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:04:21.422891+0000","last_undegraded":"2024-09-12T18:04:21.422891+0000","last_fullsized":"2024-09-12T18:04:21.422891+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'114","last_scrub_stamp":"2024-09-12T18:04:21.422692+0000","last_deep_scrub":"85'114","last_deep_scrub_stamp":"2024-09-12T18:04:21.422692+0000","last_clean_scrub_stamp":"2024-09-12T18:04:21.422692+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:47.502137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"85'2","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:22.389640+0000","last_change":"2024-09-12T18:04:22.389640+0000","last_active":"2024-09-12T18:04:22.389640+0000","last_peered":"2024-09-12T18:04:22.389640+0000","last_clean":"2024-09-12T18:04:22.389640+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:04:22.389640+0000","last_undegraded":"2024-09-12T18:04:22.389640+0000","last_fullsized":"2024-09-12T18:04:22.389640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'2","last_scrub_stamp":"2024-09-12T18:04:22.389380+0000","last_deep_scrub":"85'2","last_deep_scrub_stamp":"2024-09-12T18:04:22.389380+0000","last_clean_scrub_stamp":"2024-09-12T18:04:22.389380+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:46.616076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"85'571","reported_seq":725,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:25.045744+0000","last_change":"2024-09-12T18:04:25.045744+0000","last_active":"2024-09-12T18:04:25.045744+0000","last_peered":"2024-09-12T18:04:25.045744+0000","last_clean":"2024-09-12T18:04:25.045744+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:04:25.045744+0000","last_undegraded":"2024-09-12T18:04:25.045744+0000","last_fullsized":"2024-09-12T18:04:25.045744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'571","last_scrub_stamp":"2024-09-12T18:04:25.045509+0000","last_deep_scrub":"85'571","last_deep_scrub_stamp":"2024-09-12T18:04:25.045509+0000","last_clean_scrub_stamp":"2024-09-12T18:04:25.045509+0000","objects_scrubbed":2,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:51.123485+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":617,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:37.326212+0000","last_change":"2024-09-12T18:04:37.326212+0000","last_active":"2024-09-12T18:04:37.326212+0000","last_peered":"2024-09-12T18:04:37.326212+0000","last_clean":"2024-09-12T18:04:37.326212+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:04:37.326212+0000","last_undegraded":"2024-09-12T18:04:37.326212+0000","last_fullsized":"2024-09-12T18:04:37.326212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'442","last_scrub_stamp":"2024-09-12T18:04:37.325926+0000","last_deep_scrub":"69'442","last_deep_scrub_stamp":"2024-09-12T18:04:37.325926+0000","last_clean_scrub_stamp":"2024-09-12T18:04:37.325926+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:55.816448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:23.339079+0000","last_change":"2024-09-12T18:04:23.339079+0000","last_active":"2024-09-12T18:04:23.339079+0000","last_peered":"2024-09-12T18:04:23.339079+0000","last_clean":"2024-09-12T18:04:23.339079+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:04:23.339079+0000","last_undegraded":"2024-09-12T18:04:23.339079+0000","last_fullsized":"2024-09-12T18:04:23.339079+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:23.338885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:23.338885+0000","last_clean_scrub_stamp":"2024-09-12T18:04:23.338885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:32.976595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'130","reported_seq":353,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.051344+0000","last_change":"2024-09-12T18:04:24.051344+0000","last_active":"2024-09-12T18:04:24.051344+0000","last_peered":"2024-09-12T18:04:24.051344+0000","last_clean":"2024-09-12T18:04:24.051344+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:04:24.051344+0000","last_undegraded":"2024-09-12T18:04:24.051344+0000","last_fullsized":"2024-09-12T18:04:24.051344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'130","last_scrub_stamp":"2024-09-12T18:04:24.051165+0000","last_deep_scrub":"85'130","last_deep_scrub_stamp":"2024-09-12T18:04:24.051165+0000","last_clean_scrub_stamp":"2024-09-12T18:04:24.051165+0000","objects_scrubbed":1,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:11.524867+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1175,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:32.630773+0000","last_change":"2024-09-12T18:04:32.630773+0000","last_active":"2024-09-12T18:04:32.630773+0000","last_peered":"2024-09-12T18:04:32.630773+0000","last_clean":"2024-09-12T18:04:32.630773+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:04:32.630773+0000","last_undegraded":"2024-09-12T18:04:32.630773+0000","last_fullsized":"2024-09-12T18:04:32.630773+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'461","last_scrub_stamp":"2024-09-12T18:04:32.630581+0000","last_deep_scrub":"69'461","last_deep_scrub_stamp":"2024-09-12T18:04:32.630581+0000","last_clean_scrub_stamp":"2024-09-12T18:04:32.630581+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:25.104496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:21.056050+0000","last_change":"2024-09-12T18:04:21.056050+0000","last_active":"2024-09-12T18:04:21.056050+0000","last_peered":"2024-09-12T18:04:21.056050+0000","last_clean":"2024-09-12T18:04:21.056050+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:04:21.056050+0000","last_undegraded":"2024-09-12T18:04:21.056050+0000","last_fullsized":"2024-09-12T18:04:21.056050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:21.055878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:21.055878+0000","last_clean_scrub_stamp":"2024-09-12T18:04:21.055878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:05.539797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"85'376","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:31.658499+0000","last_change":"2024-09-12T18:04:31.658499+0000","last_active":"2024-09-12T18:04:31.658499+0000","last_peered":"2024-09-12T18:04:31.658499+0000","last_clean":"2024-09-12T18:04:31.658499+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:04:31.658499+0000","last_undegraded":"2024-09-12T18:04:31.658499+0000","last_fullsized":"2024-09-12T18:04:31.658499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'376","last_scrub_stamp":"2024-09-12T18:04:31.658315+0000","last_deep_scrub":"85'376","last_deep_scrub_stamp":"2024-09-12T18:04:31.658315+0000","last_clean_scrub_stamp":"2024-09-12T18:04:31.658315+0000","objects_scrubbed":2,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.623588+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":821,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:36.931777+0000","last_change":"2024-09-12T18:04:36.931777+0000","last_active":"2024-09-12T18:04:36.931777+0000","last_peered":"2024-09-12T18:04:36.931777+0000","last_clean":"2024-09-12T18:04:36.931777+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:04:36.931777+0000","last_undegraded":"2024-09-12T18:04:36.931777+0000","last_fullsized":"2024-09-12T18:04:36.931777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'347","last_scrub_stamp":"2024-09-12T18:04:36.931592+0000","last_deep_scrub":"69'347","last_deep_scrub_stamp":"2024-09-12T18:04:36.931592+0000","last_clean_scrub_stamp":"2024-09-12T18:04:36.931592+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:52.766187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"85'3","reported_seq":182,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:20.418933+0000","last_change":"2024-09-12T18:04:20.418933+0000","last_active":"2024-09-12T18:04:20.418933+0000","last_peered":"2024-09-12T18:04:20.418933+0000","last_clean":"2024-09-12T18:04:20.418933+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:04:20.418933+0000","last_undegraded":"2024-09-12T18:04:20.418933+0000","last_fullsized":"2024-09-12T18:04:20.418933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'3","last_scrub_stamp":"2024-09-12T18:04:20.418747+0000","last_deep_scrub":"85'3","last_deep_scrub_stamp":"2024-09-12T18:04:20.418747+0000","last_clean_scrub_stamp":"2024-09-12T18:04:20.418747+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:37.888036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.336840+0000","last_change":"2024-09-12T18:04:24.336840+0000","last_active":"2024-09-12T18:04:24.336840+0000","last_peered":"2024-09-12T18:04:24.336840+0000","last_clean":"2024-09-12T18:04:24.336840+0000","last_became_active":"2024-09-12T18:04:09.686200+0000","last_became_peered":"2024-09-12T18:04:09.686200+0000","last_unstale":"2024-09-12T18:04:24.336840+0000","last_undegraded":"2024-09-12T18:04:24.336840+0000","last_fullsized":"2024-09-12T18:04:24.336840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'74","last_scrub_stamp":"2024-09-12T18:04:24.336658+0000","last_deep_scrub":"69'74","last_deep_scrub_stamp":"2024-09-12T18:04:24.336658+0000","last_clean_scrub_stamp":"2024-09-12T18:04:24.336658+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:08.269022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:33.950974+0000","last_change":"2024-09-12T18:04:33.950974+0000","last_active":"2024-09-12T18:04:33.950974+0000","last_peered":"2024-09-12T18:04:33.950974+0000","last_clean":"2024-09-12T18:04:33.950974+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:04:33.950974+0000","last_undegraded":"2024-09-12T18:04:33.950974+0000","last_fullsized":"2024-09-12T18:04:33.950974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'417","last_scrub_stamp":"2024-09-12T18:04:33.950784+0000","last_deep_scrub":"69'417","last_deep_scrub_stamp":"2024-09-12T18:04:33.950784+0000","last_clean_scrub_stamp":"2024-09-12T18:04:33.950784+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:38.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"85'301","reported_seq":457,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:25.342971+0000","last_change":"2024-09-12T18:04:25.342971+0000","last_active":"2024-09-12T18:04:25.342971+0000","last_peered":"2024-09-12T18:04:25.342971+0000","last_clean":"2024-09-12T18:04:25.342971+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:04:25.342971+0000","last_undegraded":"2024-09-12T18:04:25.342971+0000","last_fullsized":"2024-09-12T18:04:25.342971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'301","last_scrub_stamp":"2024-09-12T18:04:25.342770+0000","last_deep_scrub":"85'301","last_deep_scrub_stamp":"2024-09-12T18:04:25.342770+0000","last_clean_scrub_stamp":"2024-09-12T18:04:25.342770+0000","objects_scrubbed":1,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:23.328653+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:23.023109+0000","last_change":"2024-09-12T18:04:23.023109+0000","last_active":"2024-09-12T18:04:23.023109+0000","last_peered":"2024-09-12T18:04:23.023109+0000","last_clean":"2024-09-12T18:04:23.023109+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:04:23.023109+0000","last_undegraded":"2024-09-12T18:04:23.023109+0000","last_fullsized":"2024-09-12T18:04:23.023109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:23.022919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:23.022919+0000","last_clean_scrub_stamp":"2024-09-12T18:04:23.022919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:15.496833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":540,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.537758+0000","last_change":"2024-09-12T18:04:29.537758+0000","last_active":"2024-09-12T18:04:29.537758+0000","last_peered":"2024-09-12T18:04:29.537758+0000","last_clean":"2024-09-12T18:04:29.537758+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:04:29.537758+0000","last_undegraded":"2024-09-12T18:04:29.537758+0000","last_fullsized":"2024-09-12T18:04:29.537758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'360","last_scrub_stamp":"2024-09-12T18:04:29.537572+0000","last_deep_scrub":"69'360","last_deep_scrub_stamp":"2024-09-12T18:04:29.537572+0000","last_clean_scrub_stamp":"2024-09-12T18:04:29.537572+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:14.021491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:25.979646+0000","last_change":"2024-09-12T18:04:25.979646+0000","last_active":"2024-09-12T18:04:25.979646+0000","last_peered":"2024-09-12T18:04:25.979646+0000","last_clean":"2024-09-12T18:04:25.979646+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:04:25.979646+0000","last_undegraded":"2024-09-12T18:04:25.979646+0000","last_fullsized":"2024-09-12T18:04:25.979646+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'51","last_scrub_stamp":"2024-09-12T18:04:25.979463+0000","last_deep_scrub":"66'51","last_deep_scrub_stamp":"2024-09-12T18:04:25.979463+0000","last_clean_scrub_stamp":"2024-09-12T18:04:25.979463+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:06.507258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:20.474078+0000","last_change":"2024-09-12T18:04:20.474078+0000","last_active":"2024-09-12T18:04:20.474078+0000","last_peered":"2024-09-12T18:04:20.474078+0000","last_clean":"2024-09-12T18:04:20.474078+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:04:20.474078+0000","last_undegraded":"2024-09-12T18:04:20.474078+0000","last_fullsized":"2024-09-12T18:04:20.474078+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:20.473898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:20.473898+0000","last_clean_scrub_stamp":"2024-09-12T18:04:20.473898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:35.424990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.630120+0000","last_change":"2024-09-12T18:04:34.630120+0000","last_active":"2024-09-12T18:04:34.630120+0000","last_peered":"2024-09-12T18:04:34.630120+0000","last_clean":"2024-09-12T18:04:34.630120+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:04:34.630120+0000","last_undegraded":"2024-09-12T18:04:34.630120+0000","last_fullsized":"2024-09-12T18:04:34.630120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'380","last_scrub_stamp":"2024-09-12T18:04:34.629933+0000","last_deep_scrub":"69'380","last_deep_scrub_stamp":"2024-09-12T18:04:34.629933+0000","last_clean_scrub_stamp":"2024-09-12T18:04:34.629933+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:00.707908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"85'58","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:28.027883+0000","last_change":"2024-09-12T18:04:28.027883+0000","last_active":"2024-09-12T18:04:28.027883+0000","last_peered":"2024-09-12T18:04:28.027883+0000","last_clean":"2024-09-12T18:04:28.027883+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:04:28.027883+0000","last_undegraded":"2024-09-12T18:04:28.027883+0000","last_fullsized":"2024-09-12T18:04:28.027883+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'58","last_scrub_stamp":"2024-09-12T18:04:28.027696+0000","last_deep_scrub":"85'58","last_deep_scrub_stamp":"2024-09-12T18:04:28.027696+0000","last_clean_scrub_stamp":"2024-09-12T18:04:28.027696+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:12.657368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:22.068485+0000","last_change":"2024-09-12T18:04:22.068485+0000","last_active":"2024-09-12T18:04:22.068485+0000","last_peered":"2024-09-12T18:04:22.068485+0000","last_clean":"2024-09-12T18:04:22.068485+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:04:22.068485+0000","last_undegraded":"2024-09-12T18:04:22.068485+0000","last_fullsized":"2024-09-12T18:04:22.068485+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:22.068302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:22.068302+0000","last_clean_scrub_stamp":"2024-09-12T18:04:22.068302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:50.293351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":575,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871828+0000","last_change":"2024-09-12T18:03:48.598891+0000","last_active":"2024-09-12T18:04:13.871828+0000","last_peered":"2024-09-12T18:04:13.871828+0000","last_clean":"2024-09-12T18:04:13.871828+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:04:13.871828+0000","last_undegraded":"2024-09-12T18:04:13.871828+0000","last_fullsized":"2024-09-12T18:04:13.871828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:15.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"85'115","reported_seq":277,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:27.004442+0000","last_change":"2024-09-12T18:04:27.004442+0000","last_active":"2024-09-12T18:04:27.004442+0000","last_peered":"2024-09-12T18:04:27.004442+0000","last_clean":"2024-09-12T18:04:27.004442+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:04:27.004442+0000","last_undegraded":"2024-09-12T18:04:27.004442+0000","last_fullsized":"2024-09-12T18:04:27.004442+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'115","last_scrub_stamp":"2024-09-12T18:04:27.004264+0000","last_deep_scrub":"85'115","last_deep_scrub_stamp":"2024-09-12T18:04:27.004264+0000","last_clean_scrub_stamp":"2024-09-12T18:04:27.004264+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:20.143990+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:19.395533+0000","last_change":"2024-09-12T18:04:19.395533+0000","last_active":"2024-09-12T18:04:19.395533+0000","last_peered":"2024-09-12T18:04:19.395533+0000","last_clean":"2024-09-12T18:04:19.395533+0000","last_became_active":"2024-09-12T18:04:09.677062+0000","last_became_peered":"2024-09-12T18:04:09.677062+0000","last_unstale":"2024-09-12T18:04:19.395533+0000","last_undegraded":"2024-09-12T18:04:19.395533+0000","last_fullsized":"2024-09-12T18:04:19.395533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:19.395349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:19.395349+0000","last_clean_scrub_stamp":"2024-09-12T18:04:19.395349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:37.016295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:28.529700+0000","last_change":"2024-09-12T18:04:28.529700+0000","last_active":"2024-09-12T18:04:28.529700+0000","last_peered":"2024-09-12T18:04:28.529700+0000","last_clean":"2024-09-12T18:04:28.529700+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:04:28.529700+0000","last_undegraded":"2024-09-12T18:04:28.529700+0000","last_fullsized":"2024-09-12T18:04:28.529700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'391","last_scrub_stamp":"2024-09-12T18:04:28.529479+0000","last_deep_scrub":"69'391","last_deep_scrub_stamp":"2024-09-12T18:04:28.529479+0000","last_clean_scrub_stamp":"2024-09-12T18:04:28.529479+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:50.803453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":589,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706750+0000","last_change":"2024-09-12T18:01:55.596719+0000","last_active":"2024-09-12T18:04:12.706750+0000","last_peered":"2024-09-12T18:04:12.706750+0000","last_clean":"2024-09-12T18:04:12.706750+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:04:12.706750+0000","last_undegraded":"2024-09-12T18:04:12.706750+0000","last_fullsized":"2024-09-12T18:04:12.706750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:13.205401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"85'232","reported_seq":388,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:33.412554+0000","last_change":"2024-09-12T18:04:33.412554+0000","last_active":"2024-09-12T18:04:33.412554+0000","last_peered":"2024-09-12T18:04:33.412554+0000","last_clean":"2024-09-12T18:04:33.412554+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:04:33.412554+0000","last_undegraded":"2024-09-12T18:04:33.412554+0000","last_fullsized":"2024-09-12T18:04:33.412554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'232","last_scrub_stamp":"2024-09-12T18:04:33.412361+0000","last_deep_scrub":"85'232","last_deep_scrub_stamp":"2024-09-12T18:04:33.412361+0000","last_clean_scrub_stamp":"2024-09-12T18:04:33.412361+0000","objects_scrubbed":5,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:36.162886+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":628,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872309+0000","last_change":"2024-09-12T18:01:55.596683+0000","last_active":"2024-09-12T18:04:13.872309+0000","last_peered":"2024-09-12T18:04:13.872309+0000","last_clean":"2024-09-12T18:04:13.872309+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:04:13.872309+0000","last_undegraded":"2024-09-12T18:04:13.872309+0000","last_fullsized":"2024-09-12T18:04:13.872309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:57.045300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"85'97","reported_seq":252,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:23.543878+0000","last_change":"2024-09-12T18:04:23.543878+0000","last_active":"2024-09-12T18:04:23.543878+0000","last_peered":"2024-09-12T18:04:23.543878+0000","last_clean":"2024-09-12T18:04:23.543878+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:04:23.543878+0000","last_undegraded":"2024-09-12T18:04:23.543878+0000","last_fullsized":"2024-09-12T18:04:23.543878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'97","last_scrub_stamp":"2024-09-12T18:04:23.543701+0000","last_deep_scrub":"85'97","last_deep_scrub_stamp":"2024-09-12T18:04:23.543701+0000","last_clean_scrub_stamp":"2024-09-12T18:04:23.543701+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:10.884744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'188","reported_seq":368,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:31.387381+0000","last_change":"2024-09-12T18:04:31.387381+0000","last_active":"2024-09-12T18:04:31.387381+0000","last_peered":"2024-09-12T18:04:31.387381+0000","last_clean":"2024-09-12T18:04:31.387381+0000","last_became_active":"2024-09-12T18:04:09.682878+0000","last_became_peered":"2024-09-12T18:04:09.682878+0000","last_unstale":"2024-09-12T18:04:31.387381+0000","last_undegraded":"2024-09-12T18:04:31.387381+0000","last_fullsized":"2024-09-12T18:04:31.387381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'188","last_scrub_stamp":"2024-09-12T18:04:31.387202+0000","last_deep_scrub":"85'188","last_deep_scrub_stamp":"2024-09-12T18:04:31.387202+0000","last_clean_scrub_stamp":"2024-09-12T18:04:31.387202+0000","objects_scrubbed":1,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:52.630252+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":721,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.872383+0000","last_change":"2024-09-12T18:01:55.594795+0000","last_active":"2024-09-12T18:04:13.872383+0000","last_peered":"2024-09-12T18:04:13.872383+0000","last_clean":"2024-09-12T18:04:13.872383+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:04:13.872383+0000","last_undegraded":"2024-09-12T18:04:13.872383+0000","last_fullsized":"2024-09-12T18:04:13.872383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:27.109178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.958536+0000","last_change":"2024-09-12T18:04:29.958536+0000","last_active":"2024-09-12T18:04:29.958536+0000","last_peered":"2024-09-12T18:04:29.958536+0000","last_clean":"2024-09-12T18:04:29.958536+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:04:29.958536+0000","last_undegraded":"2024-09-12T18:04:29.958536+0000","last_fullsized":"2024-09-12T18:04:29.958536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'55","last_scrub_stamp":"2024-09-12T18:04:29.958341+0000","last_deep_scrub":"68'55","last_deep_scrub_stamp":"2024-09-12T18:04:29.958341+0000","last_clean_scrub_stamp":"2024-09-12T18:04:29.958341+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:11.640291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":697,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.871681+0000","last_change":"2024-09-12T18:03:48.517914+0000","last_active":"2024-09-12T18:04:13.871681+0000","last_peered":"2024-09-12T18:04:13.871681+0000","last_clean":"2024-09-12T18:04:13.871681+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:04:13.871681+0000","last_undegraded":"2024-09-12T18:04:13.871681+0000","last_fullsized":"2024-09-12T18:04:13.871681+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:39.983955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706629+0000","last_change":"2024-09-12T18:01:55.580982+0000","last_active":"2024-09-12T18:04:12.706629+0000","last_peered":"2024-09-12T18:04:12.706629+0000","last_clean":"2024-09-12T18:04:12.706629+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:04:12.706629+0000","last_undegraded":"2024-09-12T18:04:12.706629+0000","last_fullsized":"2024-09-12T18:04:12.706629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:57.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"85'655","reported_seq":809,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:30.970459+0000","last_change":"2024-09-12T18:04:30.970459+0000","last_active":"2024-09-12T18:04:30.970459+0000","last_peered":"2024-09-12T18:04:30.970459+0000","last_clean":"2024-09-12T18:04:30.970459+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:04:30.970459+0000","last_undegraded":"2024-09-12T18:04:30.970459+0000","last_fullsized":"2024-09-12T18:04:30.970459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'655","last_scrub_stamp":"2024-09-12T18:04:30.970274+0000","last_deep_scrub":"85'655","last_deep_scrub_stamp":"2024-09-12T18:04:30.970274+0000","last_clean_scrub_stamp":"2024-09-12T18:04:30.970274+0000","objects_scrubbed":2,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:21.518432+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":670,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:13.870870+0000","last_change":"2024-09-12T18:03:49.500106+0000","last_active":"2024-09-12T18:04:13.870870+0000","last_peered":"2024-09-12T18:04:13.870870+0000","last_clean":"2024-09-12T18:04:13.870870+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:04:13.870870+0000","last_undegraded":"2024-09-12T18:04:13.870870+0000","last_fullsized":"2024-09-12T18:04:13.870870+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:07.627685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"85'215","reported_seq":380,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:31.923094+0000","last_change":"2024-09-12T18:04:31.923094+0000","last_active":"2024-09-12T18:04:31.923094+0000","last_peered":"2024-09-12T18:04:31.923094+0000","last_clean":"2024-09-12T18:04:31.923094+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:04:31.923094+0000","last_undegraded":"2024-09-12T18:04:31.923094+0000","last_fullsized":"2024-09-12T18:04:31.923094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'215","last_scrub_stamp":"2024-09-12T18:04:31.922897+0000","last_deep_scrub":"85'215","last_deep_scrub_stamp":"2024-09-12T18:04:31.922897+0000","last_clean_scrub_stamp":"2024-09-12T18:04:31.922897+0000","objects_scrubbed":1,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:51.345653+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":578,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706058+0000","last_change":"2024-09-12T18:01:55.588743+0000","last_active":"2024-09-12T18:04:12.706058+0000","last_peered":"2024-09-12T18:04:12.706058+0000","last_clean":"2024-09-12T18:04:12.706058+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:04:12.706058+0000","last_undegraded":"2024-09-12T18:04:12.706058+0000","last_fullsized":"2024-09-12T18:04:12.706058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"85'217","reported_seq":372,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.562886+0000","last_change":"2024-09-12T18:04:24.562717+0000","last_active":"2024-09-12T18:04:24.562886+0000","last_peered":"2024-09-12T18:04:24.562886+0000","last_clean":"2024-09-12T18:04:24.562886+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:04:24.562886+0000","last_undegraded":"2024-09-12T18:04:24.562886+0000","last_fullsized":"2024-09-12T18:04:24.562886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'217","last_scrub_stamp":"2024-09-12T18:04:24.562527+0000","last_deep_scrub":"85'217","last_deep_scrub_stamp":"2024-09-12T18:04:24.562527+0000","last_clean_scrub_stamp":"2024-09-12T18:04:24.562527+0000","objects_scrubbed":3,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:38.264425+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1211,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705772+0000","last_change":"2024-09-12T18:03:52.379079+0000","last_active":"2024-09-12T18:04:12.705772+0000","last_peered":"2024-09-12T18:04:12.705772+0000","last_clean":"2024-09-12T18:04:12.705772+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:04:12.705772+0000","last_undegraded":"2024-09-12T18:04:12.705772+0000","last_fullsized":"2024-09-12T18:04:12.705772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"85'52","reported_seq":207,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:30.597355+0000","last_change":"2024-09-12T18:04:30.597355+0000","last_active":"2024-09-12T18:04:30.597355+0000","last_peered":"2024-09-12T18:04:30.597355+0000","last_clean":"2024-09-12T18:04:30.597355+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:04:30.597355+0000","last_undegraded":"2024-09-12T18:04:30.597355+0000","last_fullsized":"2024-09-12T18:04:30.597355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'52","last_scrub_stamp":"2024-09-12T18:04:30.597183+0000","last_deep_scrub":"85'52","last_deep_scrub_stamp":"2024-09-12T18:04:30.597183+0000","last_clean_scrub_stamp":"2024-09-12T18:04:30.597183+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:46.721061+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1212,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706743+0000","last_change":"2024-09-12T18:04:09.697861+0000","last_active":"2024-09-12T18:04:12.706743+0000","last_peered":"2024-09-12T18:04:12.706743+0000","last_clean":"2024-09-12T18:04:12.706743+0000","last_became_active":"2024-09-12T18:04:09.688026+0000","last_became_peered":"2024-09-12T18:04:09.688026+0000","last_unstale":"2024-09-12T18:04:12.706743+0000","last_undegraded":"2024-09-12T18:04:12.706743+0000","last_fullsized":"2024-09-12T18:04:12.706743+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"85'183","reported_seq":367,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.389694+0000","last_change":"2024-09-12T18:04:34.389694+0000","last_active":"2024-09-12T18:04:34.389694+0000","last_peered":"2024-09-12T18:04:34.389694+0000","last_clean":"2024-09-12T18:04:34.389694+0000","last_became_active":"2024-09-12T18:04:09.692975+0000","last_became_peered":"2024-09-12T18:04:09.692975+0000","last_unstale":"2024-09-12T18:04:34.389694+0000","last_undegraded":"2024-09-12T18:04:34.389694+0000","last_fullsized":"2024-09-12T18:04:34.389694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'183","last_scrub_stamp":"2024-09-12T18:04:34.389492+0000","last_deep_scrub":"85'183","last_deep_scrub_stamp":"2024-09-12T18:04:34.389492+0000","last_clean_scrub_stamp":"2024-09-12T18:04:34.389492+0000","objects_scrubbed":2,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:26.744320+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1293,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.706039+0000","last_change":"2024-09-12T18:04:09.693020+0000","last_active":"2024-09-12T18:04:12.706039+0000","last_peered":"2024-09-12T18:04:12.706039+0000","last_clean":"2024-09-12T18:04:12.706039+0000","last_became_active":"2024-09-12T18:04:09.684915+0000","last_became_peered":"2024-09-12T18:04:09.684915+0000","last_unstale":"2024-09-12T18:04:12.706039+0000","last_undegraded":"2024-09-12T18:04:12.706039+0000","last_fullsized":"2024-09-12T18:04:12.706039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"85'281","reported_seq":436,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:27.542184+0000","last_change":"2024-09-12T18:04:27.542043+0000","last_active":"2024-09-12T18:04:27.542184+0000","last_peered":"2024-09-12T18:04:27.542184+0000","last_clean":"2024-09-12T18:04:27.542184+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:04:27.542184+0000","last_undegraded":"2024-09-12T18:04:27.542184+0000","last_fullsized":"2024-09-12T18:04:27.542184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'281","last_scrub_stamp":"2024-09-12T18:04:27.541835+0000","last_deep_scrub":"85'281","last_deep_scrub_stamp":"2024-09-12T18:04:27.541835+0000","last_clean_scrub_stamp":"2024-09-12T18:04:27.541835+0000","objects_scrubbed":4,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:03.870983+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":564,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705023+0000","last_change":"2024-09-12T18:01:55.575449+0000","last_active":"2024-09-12T18:04:12.705023+0000","last_peered":"2024-09-12T18:04:12.705023+0000","last_clean":"2024-09-12T18:04:12.705023+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:04:12.705023+0000","last_undegraded":"2024-09-12T18:04:12.705023+0000","last_fullsized":"2024-09-12T18:04:12.705023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"85'56","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:32.934684+0000","last_change":"2024-09-12T18:04:32.934684+0000","last_active":"2024-09-12T18:04:32.934684+0000","last_peered":"2024-09-12T18:04:32.934684+0000","last_clean":"2024-09-12T18:04:32.934684+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:04:32.934684+0000","last_undegraded":"2024-09-12T18:04:32.934684+0000","last_fullsized":"2024-09-12T18:04:32.934684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'56","last_scrub_stamp":"2024-09-12T18:04:32.934451+0000","last_deep_scrub":"85'56","last_deep_scrub_stamp":"2024-09-12T18:04:32.934451+0000","last_clean_scrub_stamp":"2024-09-12T18:04:32.934451+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:08.971311+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":666,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:12.705075+0000","last_change":"2024-09-12T18:01:55.585257+0000","last_active":"2024-09-12T18:04:12.705075+0000","last_peered":"2024-09-12T18:04:12.705075+0000","last_clean":"2024-09-12T18:04:12.705075+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:04:12.705075+0000","last_undegraded":"2024-09-12T18:04:12.705075+0000","last_fullsized":"2024-09-12T18:04:12.705075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:01:54.674749+0000","last_clean_scrub_stamp":"2024-09-12T18:01:54.674749+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"85'119","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.965336+0000","last_change":"2024-09-12T18:04:34.965336+0000","last_active":"2024-09-12T18:04:34.965336+0000","last_peered":"2024-09-12T18:04:34.965336+0000","last_clean":"2024-09-12T18:04:34.965336+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:04:34.965336+0000","last_undegraded":"2024-09-12T18:04:34.965336+0000","last_fullsized":"2024-09-12T18:04:34.965336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'119","last_scrub_stamp":"2024-09-12T18:04:34.965164+0000","last_deep_scrub":"85'119","last_deep_scrub_stamp":"2024-09-12T18:04:34.965164+0000","last_clean_scrub_stamp":"2024-09-12T18:04:34.965164+0000","objects_scrubbed":3,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:26.530849+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6300,"ondisk_log_size":6300,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738408,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105064,"kb_used_data":23960,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94266776,"statfs":{"total":96636764160,"available":96529178624,"internally_reserved":0,"allocated":24535040,"data_stored":81408167,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738408,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113876,"kb_used_data":28612,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94257964,"statfs":{"total":96636764160,"available":96520155136,"internally_reserved":0,"allocated":29298688,"data_stored":84724657,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":28776,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":29466624,"data_stored":90491785,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:04:40.997 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.997 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.998 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.998 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.998 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.998 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.998 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.998 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.998 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.999 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.999 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.999 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.999 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:40.999 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.000 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.000 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.000 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.000 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.001 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.001 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.001 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.001 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.002 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.002 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.002 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.002 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.002 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.003 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.003 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.003 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.003 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.003 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.003 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.004 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.004 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.004 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.004 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.004 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.005 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.005 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.005 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.005 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.006 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.006 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.006 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.006 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.006 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.006 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.006 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.007 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.007 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.007 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T18:01:54.674749+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=1, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=4, tm_sec=17, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T18:04:41.007 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T18:05:01.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:05:01.339 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:05:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-12T18:05:01.355 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-12T18:05:00.610543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127785647,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2692,"num_read_kb":1272241,"num_write":29128,"num_write_kb":4163654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5287,"num_bytes_recovered":68221312,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33008,"ondisk_log_size":33008,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":337140,"kb_used_data":81348,"kb_used_omap":4,"kb_used_meta":255739,"kb_avail":282778380,"statfs":{"total":289910292480,"available":289565061120,"internally_reserved":0,"allocated":83300352,"data_stored":256624609,"data_compressed":38679431,"data_compressed_allocated":49512448,"data_compressed_original":224157696,"omap_allocated":4785,"internal_metadata":261877071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004351"},"pg_stats":[{"pgid":"4.3f","version":"69'434","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:52.703252+0000","last_change":"2024-09-12T18:04:52.703252+0000","last_active":"2024-09-12T18:04:52.703252+0000","last_peered":"2024-09-12T18:04:52.703252+0000","last_clean":"2024-09-12T18:04:52.703252+0000","last_became_active":"2024-09-12T18:01:55.578859+0000","last_became_peered":"2024-09-12T18:01:55.578859+0000","last_unstale":"2024-09-12T18:04:52.703252+0000","last_undegraded":"2024-09-12T18:04:52.703252+0000","last_fullsized":"2024-09-12T18:04:52.703252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'434","last_scrub_stamp":"2024-09-12T18:04:52.703047+0000","last_deep_scrub":"69'434","last_deep_scrub_stamp":"2024-09-12T18:04:52.703047+0000","last_clean_scrub_stamp":"2024-09-12T18:04:52.703047+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:50.864332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24249,"num_write":405,"num_write_kb":68190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"69'464","reported_seq":922,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:50.692136+0000","last_change":"2024-09-12T18:04:50.692136+0000","last_active":"2024-09-12T18:04:50.692136+0000","last_peered":"2024-09-12T18:04:50.692136+0000","last_clean":"2024-09-12T18:04:50.692136+0000","last_became_active":"2024-09-12T18:03:49.341907+0000","last_became_peered":"2024-09-12T18:03:49.341907+0000","last_unstale":"2024-09-12T18:04:50.692136+0000","last_undegraded":"2024-09-12T18:04:50.692136+0000","last_fullsized":"2024-09-12T18:04:50.692136+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'464","last_scrub_stamp":"2024-09-12T18:04:50.691934+0000","last_deep_scrub":"69'464","last_deep_scrub_stamp":"2024-09-12T18:04:50.691934+0000","last_clean_scrub_stamp":"2024-09-12T18:04:50.691934+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:42.787449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":45078,"num_write":432,"num_write_kb":129120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":30760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"69'371","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:57.635899+0000","last_change":"2024-09-12T18:04:57.635899+0000","last_active":"2024-09-12T18:04:57.635899+0000","last_peered":"2024-09-12T18:04:57.635899+0000","last_clean":"2024-09-12T18:04:57.635899+0000","last_became_active":"2024-09-12T18:04:09.677098+0000","last_became_peered":"2024-09-12T18:04:09.677098+0000","last_unstale":"2024-09-12T18:04:57.635899+0000","last_undegraded":"2024-09-12T18:04:57.635899+0000","last_fullsized":"2024-09-12T18:04:57.635899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'371","last_scrub_stamp":"2024-09-12T18:04:57.635711+0000","last_deep_scrub":"69'371","last_deep_scrub_stamp":"2024-09-12T18:04:57.635711+0000","last_clean_scrub_stamp":"2024-09-12T18:04:57.635711+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:06.013924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8296,"num_write":341,"num_write_kb":42301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"69'380","reported_seq":557,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:56.597552+0000","last_change":"2024-09-12T18:04:56.597552+0000","last_active":"2024-09-12T18:04:56.597552+0000","last_peered":"2024-09-12T18:04:56.597552+0000","last_clean":"2024-09-12T18:04:56.597552+0000","last_became_active":"2024-09-12T18:04:09.685115+0000","last_became_peered":"2024-09-12T18:04:09.685115+0000","last_unstale":"2024-09-12T18:04:56.597552+0000","last_undegraded":"2024-09-12T18:04:56.597552+0000","last_fullsized":"2024-09-12T18:04:56.597552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'380","last_scrub_stamp":"2024-09-12T18:04:56.597372+0000","last_deep_scrub":"69'380","last_deep_scrub_stamp":"2024-09-12T18:04:56.597372+0000","last_clean_scrub_stamp":"2024-09-12T18:04:56.597372+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:45.273343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12783,"num_write":341,"num_write_kb":34531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"69'452","reported_seq":675,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:51.732430+0000","last_change":"2024-09-12T18:04:51.732430+0000","last_active":"2024-09-12T18:04:51.732430+0000","last_peered":"2024-09-12T18:04:51.732430+0000","last_clean":"2024-09-12T18:04:51.732430+0000","last_became_active":"2024-09-12T18:01:55.578790+0000","last_became_peered":"2024-09-12T18:01:55.578790+0000","last_unstale":"2024-09-12T18:04:51.732430+0000","last_undegraded":"2024-09-12T18:04:51.732430+0000","last_fullsized":"2024-09-12T18:04:51.732430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'452","last_scrub_stamp":"2024-09-12T18:04:51.732248+0000","last_deep_scrub":"69'452","last_deep_scrub_stamp":"2024-09-12T18:04:51.732248+0000","last_clean_scrub_stamp":"2024-09-12T18:04:51.732248+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:08.211563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":39205,"num_write":427,"num_write_kb":101028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"69'369","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:55.554150+0000","last_change":"2024-09-12T18:04:55.554150+0000","last_active":"2024-09-12T18:04:55.554150+0000","last_peered":"2024-09-12T18:04:55.554150+0000","last_clean":"2024-09-12T18:04:55.554150+0000","last_became_active":"2024-09-12T18:04:09.691370+0000","last_became_peered":"2024-09-12T18:04:09.691370+0000","last_unstale":"2024-09-12T18:04:55.554150+0000","last_undegraded":"2024-09-12T18:04:55.554150+0000","last_fullsized":"2024-09-12T18:04:55.554150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'369","last_scrub_stamp":"2024-09-12T18:04:55.553954+0000","last_deep_scrub":"69'369","last_deep_scrub_stamp":"2024-09-12T18:04:55.553954+0000","last_clean_scrub_stamp":"2024-09-12T18:04:55.553954+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:23.978092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12295,"num_write":341,"num_write_kb":30180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"69'428","reported_seq":648,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:54.571155+0000","last_change":"2024-09-12T18:04:54.571155+0000","last_active":"2024-09-12T18:04:54.571155+0000","last_peered":"2024-09-12T18:04:54.571155+0000","last_clean":"2024-09-12T18:04:54.571155+0000","last_became_active":"2024-09-12T18:04:09.686122+0000","last_became_peered":"2024-09-12T18:04:09.686122+0000","last_unstale":"2024-09-12T18:04:54.571155+0000","last_undegraded":"2024-09-12T18:04:54.571155+0000","last_fullsized":"2024-09-12T18:04:54.571155+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'428","last_scrub_stamp":"2024-09-12T18:04:54.570918+0000","last_deep_scrub":"69'428","last_deep_scrub_stamp":"2024-09-12T18:04:54.570918+0000","last_clean_scrub_stamp":"2024-09-12T18:04:54.570918+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:42.408001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":34034,"num_write":401,"num_write_kb":59914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"69'412","reported_seq":1002,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:53.584632+0000","last_change":"2024-09-12T18:04:53.584632+0000","last_active":"2024-09-12T18:04:53.584632+0000","last_peered":"2024-09-12T18:04:53.584632+0000","last_clean":"2024-09-12T18:04:53.584632+0000","last_became_active":"2024-09-12T18:03:49.363188+0000","last_became_peered":"2024-09-12T18:03:49.363188+0000","last_unstale":"2024-09-12T18:04:53.584632+0000","last_undegraded":"2024-09-12T18:04:53.584632+0000","last_fullsized":"2024-09-12T18:04:53.584632+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'412","last_scrub_stamp":"2024-09-12T18:04:53.584449+0000","last_deep_scrub":"69'412","last_deep_scrub_stamp":"2024-09-12T18:04:53.584449+0000","last_clean_scrub_stamp":"2024-09-12T18:04:53.584449+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:17.778399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41107,"num_write":374,"num_write_kb":109157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":357831,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"69'397","reported_seq":559,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:53.016088+0000","last_change":"2024-09-12T18:04:53.016088+0000","last_active":"2024-09-12T18:04:53.016088+0000","last_peered":"2024-09-12T18:04:53.016088+0000","last_clean":"2024-09-12T18:04:53.016088+0000","last_became_active":"2024-09-12T18:01:55.602281+0000","last_became_peered":"2024-09-12T18:01:55.602281+0000","last_unstale":"2024-09-12T18:04:53.016088+0000","last_undegraded":"2024-09-12T18:04:53.016088+0000","last_fullsized":"2024-09-12T18:04:53.016088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'397","last_scrub_stamp":"2024-09-12T18:04:53.015895+0000","last_deep_scrub":"69'397","last_deep_scrub_stamp":"2024-09-12T18:04:53.015895+0000","last_clean_scrub_stamp":"2024-09-12T18:04:53.015895+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:03.691998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4935,"num_write":359,"num_write_kb":34128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"69'402","reported_seq":1059,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:48.643083+0000","last_change":"2024-09-12T18:04:48.643083+0000","last_active":"2024-09-12T18:04:48.643083+0000","last_peered":"2024-09-12T18:04:48.643083+0000","last_clean":"2024-09-12T18:04:48.643083+0000","last_became_active":"2024-09-12T18:03:48.350643+0000","last_became_peered":"2024-09-12T18:03:48.350643+0000","last_unstale":"2024-09-12T18:04:48.643083+0000","last_undegraded":"2024-09-12T18:04:48.643083+0000","last_fullsized":"2024-09-12T18:04:48.643083+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'402","last_scrub_stamp":"2024-09-12T18:04:48.642901+0000","last_deep_scrub":"69'402","last_deep_scrub_stamp":"2024-09-12T18:04:48.642901+0000","last_clean_scrub_stamp":"2024-09-12T18:04:48.642901+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:32.341823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":26382,"num_write":372,"num_write_kb":71404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":214,"num_bytes_recovered":93067,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"69'366","reported_seq":563,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:52.590366+0000","last_change":"2024-09-12T18:04:52.590366+0000","last_active":"2024-09-12T18:04:52.590366+0000","last_peered":"2024-09-12T18:04:52.590366+0000","last_clean":"2024-09-12T18:04:52.590366+0000","last_became_active":"2024-09-12T18:04:09.681305+0000","last_became_peered":"2024-09-12T18:04:09.681305+0000","last_unstale":"2024-09-12T18:04:52.590366+0000","last_undegraded":"2024-09-12T18:04:52.590366+0000","last_fullsized":"2024-09-12T18:04:52.590366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'366","last_scrub_stamp":"2024-09-12T18:04:52.590177+0000","last_deep_scrub":"69'366","last_deep_scrub_stamp":"2024-09-12T18:04:52.590177+0000","last_clean_scrub_stamp":"2024-09-12T18:04:52.590177+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:44.696650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":14093,"num_write":345,"num_write_kb":26445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"69'360","reported_seq":544,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.642725+0000","last_change":"2024-09-12T18:04:49.642725+0000","last_active":"2024-09-12T18:04:49.642725+0000","last_peered":"2024-09-12T18:04:49.642725+0000","last_clean":"2024-09-12T18:04:49.642725+0000","last_became_active":"2024-09-12T18:01:55.591185+0000","last_became_peered":"2024-09-12T18:01:55.591185+0000","last_unstale":"2024-09-12T18:04:49.642725+0000","last_undegraded":"2024-09-12T18:04:49.642725+0000","last_fullsized":"2024-09-12T18:04:49.642725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'360","last_scrub_stamp":"2024-09-12T18:04:49.642550+0000","last_deep_scrub":"69'360","last_deep_scrub_stamp":"2024-09-12T18:04:49.642550+0000","last_clean_scrub_stamp":"2024-09-12T18:04:49.642550+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:13.869247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13822,"num_write":335,"num_write_kb":42363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"69'384","reported_seq":550,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:47.665029+0000","last_change":"2024-09-12T18:04:47.665029+0000","last_active":"2024-09-12T18:04:47.665029+0000","last_peered":"2024-09-12T18:04:47.665029+0000","last_clean":"2024-09-12T18:04:47.665029+0000","last_became_active":"2024-09-12T18:01:55.582868+0000","last_became_peered":"2024-09-12T18:01:55.582868+0000","last_unstale":"2024-09-12T18:04:47.665029+0000","last_undegraded":"2024-09-12T18:04:47.665029+0000","last_fullsized":"2024-09-12T18:04:47.665029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'384","last_scrub_stamp":"2024-09-12T18:04:47.664847+0000","last_deep_scrub":"69'384","last_deep_scrub_stamp":"2024-09-12T18:04:47.664847+0000","last_clean_scrub_stamp":"2024-09-12T18:04:47.664847+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:19.178128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8220,"num_write":349,"num_write_kb":38147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"69'422","reported_seq":624,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:51.569321+0000","last_change":"2024-09-12T18:04:51.569321+0000","last_active":"2024-09-12T18:04:51.569321+0000","last_peered":"2024-09-12T18:04:51.569321+0000","last_clean":"2024-09-12T18:04:51.569321+0000","last_became_active":"2024-09-12T18:01:55.587465+0000","last_became_peered":"2024-09-12T18:01:55.587465+0000","last_unstale":"2024-09-12T18:04:51.569321+0000","last_undegraded":"2024-09-12T18:04:51.569321+0000","last_fullsized":"2024-09-12T18:04:51.569321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'422","last_scrub_stamp":"2024-09-12T18:04:51.569129+0000","last_deep_scrub":"69'422","last_deep_scrub_stamp":"2024-09-12T18:04:51.569129+0000","last_clean_scrub_stamp":"2024-09-12T18:04:51.569129+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:22.679660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":20028,"num_write":395,"num_write_kb":68309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"69'431","reported_seq":622,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:50.532802+0000","last_change":"2024-09-12T18:04:50.532802+0000","last_active":"2024-09-12T18:04:50.532802+0000","last_peered":"2024-09-12T18:04:50.532802+0000","last_clean":"2024-09-12T18:04:50.532802+0000","last_became_active":"2024-09-12T18:04:09.684858+0000","last_became_peered":"2024-09-12T18:04:09.684858+0000","last_unstale":"2024-09-12T18:04:50.532802+0000","last_undegraded":"2024-09-12T18:04:50.532802+0000","last_fullsized":"2024-09-12T18:04:50.532802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'431","last_scrub_stamp":"2024-09-12T18:04:50.532588+0000","last_deep_scrub":"69'431","last_deep_scrub_stamp":"2024-09-12T18:04:50.532588+0000","last_clean_scrub_stamp":"2024-09-12T18:04:50.532588+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:06.625599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":17946,"num_write":394,"num_write_kb":128973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"69'465","reported_seq":694,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.497804+0000","last_change":"2024-09-12T18:04:49.497804+0000","last_active":"2024-09-12T18:04:49.497804+0000","last_peered":"2024-09-12T18:04:49.497804+0000","last_clean":"2024-09-12T18:04:49.497804+0000","last_became_active":"2024-09-12T18:04:09.680510+0000","last_became_peered":"2024-09-12T18:04:09.680510+0000","last_unstale":"2024-09-12T18:04:49.497804+0000","last_undegraded":"2024-09-12T18:04:49.497804+0000","last_fullsized":"2024-09-12T18:04:49.497804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'465","last_scrub_stamp":"2024-09-12T18:04:49.497619+0000","last_deep_scrub":"69'465","last_deep_scrub_stamp":"2024-09-12T18:04:49.497619+0000","last_clean_scrub_stamp":"2024-09-12T18:04:49.497619+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:47.100108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":43506,"num_write":433,"num_write_kb":88910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"69'427","reported_seq":616,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:51.987797+0000","last_change":"2024-09-12T18:04:51.987797+0000","last_active":"2024-09-12T18:04:51.987797+0000","last_peered":"2024-09-12T18:04:51.987797+0000","last_clean":"2024-09-12T18:04:51.987797+0000","last_became_active":"2024-09-12T18:01:55.604987+0000","last_became_peered":"2024-09-12T18:01:55.604987+0000","last_unstale":"2024-09-12T18:04:51.987797+0000","last_undegraded":"2024-09-12T18:04:51.987797+0000","last_fullsized":"2024-09-12T18:04:51.987797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'427","last_scrub_stamp":"2024-09-12T18:04:51.987609+0000","last_deep_scrub":"69'427","last_deep_scrub_stamp":"2024-09-12T18:04:51.987609+0000","last_clean_scrub_stamp":"2024-09-12T18:04:51.987609+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:54.862945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19185,"num_write":396,"num_write_kb":67679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"69'404","reported_seq":701,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:46.629611+0000","last_change":"2024-09-12T18:04:46.629611+0000","last_active":"2024-09-12T18:04:46.629611+0000","last_peered":"2024-09-12T18:04:46.629611+0000","last_clean":"2024-09-12T18:04:46.629611+0000","last_became_active":"2024-09-12T18:03:49.341597+0000","last_became_peered":"2024-09-12T18:03:49.341597+0000","last_unstale":"2024-09-12T18:04:46.629611+0000","last_undegraded":"2024-09-12T18:04:46.629611+0000","last_fullsized":"2024-09-12T18:04:46.629611+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'404","last_scrub_stamp":"2024-09-12T18:04:46.629430+0000","last_deep_scrub":"69'404","last_deep_scrub_stamp":"2024-09-12T18:04:46.629430+0000","last_clean_scrub_stamp":"2024-09-12T18:04:46.629430+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:02.464024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11712,"num_write":369,"num_write_kb":87290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"69'458","reported_seq":699,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:50.995725+0000","last_change":"2024-09-12T18:04:50.995725+0000","last_active":"2024-09-12T18:04:50.995725+0000","last_peered":"2024-09-12T18:04:50.995725+0000","last_clean":"2024-09-12T18:04:50.995725+0000","last_became_active":"2024-09-12T18:03:49.331611+0000","last_became_peered":"2024-09-12T18:03:49.331611+0000","last_unstale":"2024-09-12T18:04:50.995725+0000","last_undegraded":"2024-09-12T18:04:50.995725+0000","last_fullsized":"2024-09-12T18:04:50.995725+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'458","last_scrub_stamp":"2024-09-12T18:04:50.995510+0000","last_deep_scrub":"69'458","last_deep_scrub_stamp":"2024-09-12T18:04:50.995510+0000","last_clean_scrub_stamp":"2024-09-12T18:04:50.995510+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:27.791421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":35812,"num_write":419,"num_write_kb":93226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":25044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"68'429","reported_seq":603,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:48.517723+0000","last_change":"2024-09-12T18:04:48.517723+0000","last_active":"2024-09-12T18:04:48.517723+0000","last_peered":"2024-09-12T18:04:48.517723+0000","last_clean":"2024-09-12T18:04:48.517723+0000","last_became_active":"2024-09-12T18:01:55.591362+0000","last_became_peered":"2024-09-12T18:01:55.591362+0000","last_unstale":"2024-09-12T18:04:48.517723+0000","last_undegraded":"2024-09-12T18:04:48.517723+0000","last_fullsized":"2024-09-12T18:04:48.517723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'429","last_scrub_stamp":"2024-09-12T18:04:48.517538+0000","last_deep_scrub":"68'429","last_deep_scrub_stamp":"2024-09-12T18:04:48.517538+0000","last_clean_scrub_stamp":"2024-09-12T18:04:48.517538+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:37.267216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3210,"num_write":394,"num_write_kb":30350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"69'394","reported_seq":1008,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:47.509693+0000","last_change":"2024-09-12T18:04:47.509693+0000","last_active":"2024-09-12T18:04:47.509693+0000","last_peered":"2024-09-12T18:04:47.509693+0000","last_clean":"2024-09-12T18:04:47.509693+0000","last_became_active":"2024-09-12T18:03:48.361697+0000","last_became_peered":"2024-09-12T18:03:48.361697+0000","last_unstale":"2024-09-12T18:04:47.509693+0000","last_undegraded":"2024-09-12T18:04:47.509693+0000","last_fullsized":"2024-09-12T18:04:47.509693+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'394","last_scrub_stamp":"2024-09-12T18:04:47.509517+0000","last_deep_scrub":"69'394","last_deep_scrub_stamp":"2024-09-12T18:04:47.509517+0000","last_clean_scrub_stamp":"2024-09-12T18:04:47.509517+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:43.904387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6740,"num_write":372,"num_write_kb":46849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":215,"num_bytes_recovered":208558,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"69'438","reported_seq":644,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:45.666511+0000","last_change":"2024-09-12T18:04:45.666511+0000","last_active":"2024-09-12T18:04:45.666511+0000","last_peered":"2024-09-12T18:04:45.666511+0000","last_clean":"2024-09-12T18:04:45.666511+0000","last_became_active":"2024-09-12T18:01:55.591582+0000","last_became_peered":"2024-09-12T18:01:55.591582+0000","last_unstale":"2024-09-12T18:04:45.666511+0000","last_undegraded":"2024-09-12T18:04:45.666511+0000","last_fullsized":"2024-09-12T18:04:45.666511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'438","last_scrub_stamp":"2024-09-12T18:04:45.666295+0000","last_deep_scrub":"69'438","last_deep_scrub_stamp":"2024-09-12T18:04:45.666295+0000","last_clean_scrub_stamp":"2024-09-12T18:04:45.666295+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:06.413620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":19677,"num_write":407,"num_write_kb":63475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"69'409","reported_seq":941,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.957030+0000","last_change":"2024-09-12T18:04:49.957030+0000","last_active":"2024-09-12T18:04:49.957030+0000","last_peered":"2024-09-12T18:04:49.957030+0000","last_clean":"2024-09-12T18:04:49.957030+0000","last_became_active":"2024-09-12T18:03:56.335838+0000","last_became_peered":"2024-09-12T18:03:56.335838+0000","last_unstale":"2024-09-12T18:04:49.957030+0000","last_undegraded":"2024-09-12T18:04:49.957030+0000","last_fullsized":"2024-09-12T18:04:49.957030+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'409","last_scrub_stamp":"2024-09-12T18:04:49.956761+0000","last_deep_scrub":"69'409","last_deep_scrub_stamp":"2024-09-12T18:04:49.956761+0000","last_clean_scrub_stamp":"2024-09-12T18:04:49.956761+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:24.842279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12320,"num_write":369,"num_write_kb":75407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":352,"num_bytes_recovered":222795,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"69'461","reported_seq":1176,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:43.699271+0000","last_change":"2024-09-12T18:04:43.699271+0000","last_active":"2024-09-12T18:04:43.699271+0000","last_peered":"2024-09-12T18:04:43.699271+0000","last_clean":"2024-09-12T18:04:43.699271+0000","last_became_active":"2024-09-12T18:03:48.348837+0000","last_became_peered":"2024-09-12T18:03:48.348837+0000","last_unstale":"2024-09-12T18:04:43.699271+0000","last_undegraded":"2024-09-12T18:04:43.699271+0000","last_fullsized":"2024-09-12T18:04:43.699271+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'461","last_scrub_stamp":"2024-09-12T18:04:43.699056+0000","last_deep_scrub":"69'461","last_deep_scrub_stamp":"2024-09-12T18:04:43.699056+0000","last_clean_scrub_stamp":"2024-09-12T18:04:43.699056+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:47.884755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26623,"num_write":433,"num_write_kb":88976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":186528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"69'393","reported_seq":562,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.702119+0000","last_change":"2024-09-12T18:04:44.702119+0000","last_active":"2024-09-12T18:04:44.702119+0000","last_peered":"2024-09-12T18:04:44.702119+0000","last_clean":"2024-09-12T18:04:44.702119+0000","last_became_active":"2024-09-12T18:01:55.586846+0000","last_became_peered":"2024-09-12T18:01:55.586846+0000","last_unstale":"2024-09-12T18:04:44.702119+0000","last_undegraded":"2024-09-12T18:04:44.702119+0000","last_fullsized":"2024-09-12T18:04:44.702119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'393","last_scrub_stamp":"2024-09-12T18:04:44.701903+0000","last_deep_scrub":"69'393","last_deep_scrub_stamp":"2024-09-12T18:04:44.701903+0000","last_clean_scrub_stamp":"2024-09-12T18:04:44.701903+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:36.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9970,"num_write":370,"num_write_kb":9281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"69'471","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:49.004740+0000","last_change":"2024-09-12T18:04:49.004740+0000","last_active":"2024-09-12T18:04:49.004740+0000","last_peered":"2024-09-12T18:04:49.004740+0000","last_clean":"2024-09-12T18:04:49.004740+0000","last_became_active":"2024-09-12T18:01:55.598190+0000","last_became_peered":"2024-09-12T18:01:55.598190+0000","last_unstale":"2024-09-12T18:04:49.004740+0000","last_undegraded":"2024-09-12T18:04:49.004740+0000","last_fullsized":"2024-09-12T18:04:49.004740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'471","last_scrub_stamp":"2024-09-12T18:04:49.004555+0000","last_deep_scrub":"69'471","last_deep_scrub_stamp":"2024-09-12T18:04:49.004555+0000","last_clean_scrub_stamp":"2024-09-12T18:04:49.004555+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:34.134135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":9075,"num_write":421,"num_write_kb":80194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"69'410","reported_seq":607,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:46.523407+0000","last_change":"2024-09-12T18:04:46.523407+0000","last_active":"2024-09-12T18:04:46.523407+0000","last_peered":"2024-09-12T18:04:46.523407+0000","last_clean":"2024-09-12T18:04:46.523407+0000","last_became_active":"2024-09-12T18:01:55.589928+0000","last_became_peered":"2024-09-12T18:01:55.589928+0000","last_unstale":"2024-09-12T18:04:46.523407+0000","last_undegraded":"2024-09-12T18:04:46.523407+0000","last_fullsized":"2024-09-12T18:04:46.523407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'410","last_scrub_stamp":"2024-09-12T18:04:46.523212+0000","last_deep_scrub":"69'410","last_deep_scrub_stamp":"2024-09-12T18:04:46.523212+0000","last_clean_scrub_stamp":"2024-09-12T18:04:46.523212+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:14.729686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25631,"num_write":377,"num_write_kb":72012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"69'412","reported_seq":616,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:41.762347+0000","last_change":"2024-09-12T18:04:41.762347+0000","last_active":"2024-09-12T18:04:41.762347+0000","last_peered":"2024-09-12T18:04:41.762347+0000","last_clean":"2024-09-12T18:04:41.762347+0000","last_became_active":"2024-09-12T18:01:55.586558+0000","last_became_peered":"2024-09-12T18:01:55.586558+0000","last_unstale":"2024-09-12T18:04:41.762347+0000","last_undegraded":"2024-09-12T18:04:41.762347+0000","last_fullsized":"2024-09-12T18:04:41.762347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'412","last_scrub_stamp":"2024-09-12T18:04:41.762164+0000","last_deep_scrub":"69'412","last_deep_scrub_stamp":"2024-09-12T18:04:41.762164+0000","last_clean_scrub_stamp":"2024-09-12T18:04:41.762164+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:01.184921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23578,"num_write":386,"num_write_kb":76163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"69'419","reported_seq":961,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:46.952358+0000","last_change":"2024-09-12T18:04:46.952358+0000","last_active":"2024-09-12T18:04:46.952358+0000","last_peered":"2024-09-12T18:04:46.952358+0000","last_clean":"2024-09-12T18:04:46.952358+0000","last_became_active":"2024-09-12T18:03:56.339407+0000","last_became_peered":"2024-09-12T18:03:56.339407+0000","last_unstale":"2024-09-12T18:04:46.952358+0000","last_undegraded":"2024-09-12T18:04:46.952358+0000","last_fullsized":"2024-09-12T18:04:46.952358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'419","last_scrub_stamp":"2024-09-12T18:04:46.952172+0000","last_deep_scrub":"69'419","last_deep_scrub_stamp":"2024-09-12T18:04:46.952172+0000","last_clean_scrub_stamp":"2024-09-12T18:04:46.952172+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:16.629557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30303,"num_write":381,"num_write_kb":84337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":161537,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"69'473","reported_seq":643,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:45.533774+0000","last_change":"2024-09-12T18:04:45.533585+0000","last_active":"2024-09-12T18:04:45.533774+0000","last_peered":"2024-09-12T18:04:45.533774+0000","last_clean":"2024-09-12T18:04:45.533774+0000","last_became_active":"2024-09-12T18:02:41.860728+0000","last_became_peered":"2024-09-12T18:02:41.860728+0000","last_unstale":"2024-09-12T18:04:45.533774+0000","last_undegraded":"2024-09-12T18:04:45.533774+0000","last_fullsized":"2024-09-12T18:04:45.533774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'473","last_scrub_stamp":"2024-09-12T18:04:45.533397+0000","last_deep_scrub":"69'473","last_deep_scrub_stamp":"2024-09-12T18:04:45.533397+0000","last_clean_scrub_stamp":"2024-09-12T18:04:45.533397+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:43.401694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":27128,"num_write":438,"num_write_kb":79996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"69'453","reported_seq":1014,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:47.979974+0000","last_change":"2024-09-12T18:04:47.979974+0000","last_active":"2024-09-12T18:04:47.979974+0000","last_peered":"2024-09-12T18:04:47.979974+0000","last_clean":"2024-09-12T18:04:47.979974+0000","last_became_active":"2024-09-12T18:03:57.339458+0000","last_became_peered":"2024-09-12T18:03:57.339458+0000","last_unstale":"2024-09-12T18:04:47.979974+0000","last_undegraded":"2024-09-12T18:04:47.979974+0000","last_fullsized":"2024-09-12T18:04:47.979974+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'453","last_scrub_stamp":"2024-09-12T18:04:47.979784+0000","last_deep_scrub":"69'453","last_deep_scrub_stamp":"2024-09-12T18:04:47.979784+0000","last_clean_scrub_stamp":"2024-09-12T18:04:47.979784+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:09.222833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14601,"num_write":425,"num_write_kb":96911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":329987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"69'424","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.504545+0000","last_change":"2024-09-12T18:04:44.504545+0000","last_active":"2024-09-12T18:04:44.504545+0000","last_peered":"2024-09-12T18:04:44.504545+0000","last_clean":"2024-09-12T18:04:44.504545+0000","last_became_active":"2024-09-12T18:04:09.680177+0000","last_became_peered":"2024-09-12T18:04:09.680177+0000","last_unstale":"2024-09-12T18:04:44.504545+0000","last_undegraded":"2024-09-12T18:04:44.504545+0000","last_fullsized":"2024-09-12T18:04:44.504545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'424","last_scrub_stamp":"2024-09-12T18:04:44.504291+0000","last_deep_scrub":"69'424","last_deep_scrub_stamp":"2024-09-12T18:04:44.504291+0000","last_clean_scrub_stamp":"2024-09-12T18:04:44.504291+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:46.962721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14522,"num_write":394,"num_write_kb":35864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"69'406","reported_seq":635,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:35.655318+0000","last_change":"2024-09-12T18:04:35.655318+0000","last_active":"2024-09-12T18:04:35.655318+0000","last_peered":"2024-09-12T18:04:35.655318+0000","last_clean":"2024-09-12T18:04:35.655318+0000","last_became_active":"2024-09-12T18:01:55.579494+0000","last_became_peered":"2024-09-12T18:01:55.579494+0000","last_unstale":"2024-09-12T18:04:35.655318+0000","last_undegraded":"2024-09-12T18:04:35.655318+0000","last_fullsized":"2024-09-12T18:04:35.655318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'406","last_scrub_stamp":"2024-09-12T18:04:35.655079+0000","last_deep_scrub":"69'406","last_deep_scrub_stamp":"2024-09-12T18:04:35.655079+0000","last_clean_scrub_stamp":"2024-09-12T18:04:35.655079+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:34.683793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":37880,"num_write":369,"num_write_kb":84115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"85'450","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:32.375304+0000","last_change":"2024-09-12T18:04:32.375304+0000","last_active":"2024-09-12T18:04:32.375304+0000","last_peered":"2024-09-12T18:04:32.375304+0000","last_clean":"2024-09-12T18:04:32.375304+0000","last_became_active":"2024-09-12T18:01:54.711942+0000","last_became_peered":"2024-09-12T18:01:54.711942+0000","last_unstale":"2024-09-12T18:04:32.375304+0000","last_undegraded":"2024-09-12T18:04:32.375304+0000","last_fullsized":"2024-09-12T18:04:32.375304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'450","last_scrub_stamp":"2024-09-12T18:04:32.375097+0000","last_deep_scrub":"85'450","last_deep_scrub_stamp":"2024-09-12T18:04:32.375097+0000","last_clean_scrub_stamp":"2024-09-12T18:04:32.375097+0000","objects_scrubbed":4,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:17.504676+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"69'381","reported_seq":571,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:37.715652+0000","last_change":"2024-09-12T18:04:37.715652+0000","last_active":"2024-09-12T18:04:37.715652+0000","last_peered":"2024-09-12T18:04:37.715652+0000","last_clean":"2024-09-12T18:04:37.715652+0000","last_became_active":"2024-09-12T18:01:55.583955+0000","last_became_peered":"2024-09-12T18:01:55.583955+0000","last_unstale":"2024-09-12T18:04:37.715652+0000","last_undegraded":"2024-09-12T18:04:37.715652+0000","last_fullsized":"2024-09-12T18:04:37.715652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'381","last_scrub_stamp":"2024-09-12T18:04:37.715457+0000","last_deep_scrub":"69'381","last_deep_scrub_stamp":"2024-09-12T18:04:37.715457+0000","last_clean_scrub_stamp":"2024-09-12T18:04:37.715457+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:22.345129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":14648,"num_write":348,"num_write_kb":21837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"69'50","reported_seq":204,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:35.969727+0000","last_change":"2024-09-12T18:04:35.969727+0000","last_active":"2024-09-12T18:04:35.969727+0000","last_peered":"2024-09-12T18:04:35.969727+0000","last_clean":"2024-09-12T18:04:35.969727+0000","last_became_active":"2024-09-12T18:01:54.709173+0000","last_became_peered":"2024-09-12T18:01:54.709173+0000","last_unstale":"2024-09-12T18:04:35.969727+0000","last_undegraded":"2024-09-12T18:04:35.969727+0000","last_fullsized":"2024-09-12T18:04:35.969727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'50","last_scrub_stamp":"2024-09-12T18:04:35.969534+0000","last_deep_scrub":"69'50","last_deep_scrub_stamp":"2024-09-12T18:04:35.969534+0000","last_clean_scrub_stamp":"2024-09-12T18:04:35.969534+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:56.716859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"69'416","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:43.975057+0000","last_change":"2024-09-12T18:04:43.975057+0000","last_active":"2024-09-12T18:04:43.975057+0000","last_peered":"2024-09-12T18:04:43.975057+0000","last_clean":"2024-09-12T18:04:43.975057+0000","last_became_active":"2024-09-12T18:01:55.597707+0000","last_became_peered":"2024-09-12T18:01:55.597707+0000","last_unstale":"2024-09-12T18:04:43.975057+0000","last_undegraded":"2024-09-12T18:04:43.975057+0000","last_fullsized":"2024-09-12T18:04:43.975057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'416","last_scrub_stamp":"2024-09-12T18:04:43.974856+0000","last_deep_scrub":"69'416","last_deep_scrub_stamp":"2024-09-12T18:04:43.974856+0000","last_clean_scrub_stamp":"2024-09-12T18:04:43.974856+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:32.508877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":12900,"num_write":380,"num_write_kb":38341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"66'69","reported_seq":224,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:22.544003+0000","last_change":"2024-09-12T18:04:22.544003+0000","last_active":"2024-09-12T18:04:22.544003+0000","last_peered":"2024-09-12T18:04:22.544003+0000","last_clean":"2024-09-12T18:04:22.544003+0000","last_became_active":"2024-09-12T18:01:54.710539+0000","last_became_peered":"2024-09-12T18:01:54.710539+0000","last_unstale":"2024-09-12T18:04:22.544003+0000","last_undegraded":"2024-09-12T18:04:22.544003+0000","last_fullsized":"2024-09-12T18:04:22.544003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'69","last_scrub_stamp":"2024-09-12T18:04:22.543820+0000","last_deep_scrub":"66'69","last_deep_scrub_stamp":"2024-09-12T18:04:22.543820+0000","last_clean_scrub_stamp":"2024-09-12T18:04:22.543820+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:01.200904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"69'406","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:44.960806+0000","last_change":"2024-09-12T18:04:44.960806+0000","last_active":"2024-09-12T18:04:44.960806+0000","last_peered":"2024-09-12T18:04:44.960806+0000","last_clean":"2024-09-12T18:04:44.960806+0000","last_became_active":"2024-09-12T18:01:55.598403+0000","last_became_peered":"2024-09-12T18:01:55.598403+0000","last_unstale":"2024-09-12T18:04:44.960806+0000","last_undegraded":"2024-09-12T18:04:44.960806+0000","last_fullsized":"2024-09-12T18:04:44.960806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'406","last_scrub_stamp":"2024-09-12T18:04:44.960622+0000","last_deep_scrub":"69'406","last_deep_scrub_stamp":"2024-09-12T18:04:44.960622+0000","last_clean_scrub_stamp":"2024-09-12T18:04:44.960622+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:52.917399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15079,"num_write":374,"num_write_kb":59935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"85'65","reported_seq":221,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:30.333080+0000","last_change":"2024-09-12T18:04:30.333080+0000","last_active":"2024-09-12T18:04:30.333080+0000","last_peered":"2024-09-12T18:04:30.333080+0000","last_clean":"2024-09-12T18:04:30.333080+0000","last_became_active":"2024-09-12T18:01:54.716114+0000","last_became_peered":"2024-09-12T18:01:54.716114+0000","last_unstale":"2024-09-12T18:04:30.333080+0000","last_undegraded":"2024-09-12T18:04:30.333080+0000","last_fullsized":"2024-09-12T18:04:30.333080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'65","last_scrub_stamp":"2024-09-12T18:04:30.332873+0000","last_deep_scrub":"85'65","last_deep_scrub_stamp":"2024-09-12T18:04:30.332873+0000","last_clean_scrub_stamp":"2024-09-12T18:04:30.332873+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:20.232824+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'140","reported_seq":296,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.363832+0000","last_change":"2024-09-12T18:04:29.363832+0000","last_active":"2024-09-12T18:04:29.363832+0000","last_peered":"2024-09-12T18:04:29.363832+0000","last_clean":"2024-09-12T18:04:29.363832+0000","last_became_active":"2024-09-12T18:01:54.704739+0000","last_became_peered":"2024-09-12T18:01:54.704739+0000","last_unstale":"2024-09-12T18:04:29.363832+0000","last_undegraded":"2024-09-12T18:04:29.363832+0000","last_fullsized":"2024-09-12T18:04:29.363832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'140","last_scrub_stamp":"2024-09-12T18:04:29.363634+0000","last_deep_scrub":"85'140","last_deep_scrub_stamp":"2024-09-12T18:04:29.363634+0000","last_clean_scrub_stamp":"2024-09-12T18:04:29.363634+0000","objects_scrubbed":2,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:15.077886+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":4145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"68'429","reported_seq":608,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:33.612031+0000","last_change":"2024-09-12T18:04:33.612031+0000","last_active":"2024-09-12T18:04:33.612031+0000","last_peered":"2024-09-12T18:04:33.612031+0000","last_clean":"2024-09-12T18:04:33.612031+0000","last_became_active":"2024-09-12T18:01:55.586406+0000","last_became_peered":"2024-09-12T18:01:55.586406+0000","last_unstale":"2024-09-12T18:04:33.612031+0000","last_undegraded":"2024-09-12T18:04:33.612031+0000","last_fullsized":"2024-09-12T18:04:33.612031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'429","last_scrub_stamp":"2024-09-12T18:04:33.611840+0000","last_deep_scrub":"68'429","last_deep_scrub_stamp":"2024-09-12T18:04:33.611840+0000","last_clean_scrub_stamp":"2024-09-12T18:04:33.611840+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:21.085543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":9432,"num_write":391,"num_write_kb":71258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"85'252","reported_seq":407,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:26.515863+0000","last_change":"2024-09-12T18:04:26.515863+0000","last_active":"2024-09-12T18:04:26.515863+0000","last_peered":"2024-09-12T18:04:26.515863+0000","last_clean":"2024-09-12T18:04:26.515863+0000","last_became_active":"2024-09-12T18:01:54.708847+0000","last_became_peered":"2024-09-12T18:01:54.708847+0000","last_unstale":"2024-09-12T18:04:26.515863+0000","last_undegraded":"2024-09-12T18:04:26.515863+0000","last_fullsized":"2024-09-12T18:04:26.515863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'252","last_scrub_stamp":"2024-09-12T18:04:26.515651+0000","last_deep_scrub":"85'252","last_deep_scrub_stamp":"2024-09-12T18:04:26.515651+0000","last_clean_scrub_stamp":"2024-09-12T18:04:26.515651+0000","objects_scrubbed":2,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:03.010270+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"69'459","reported_seq":1476,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:36.698231+0000","last_change":"2024-09-12T18:04:36.698231+0000","last_active":"2024-09-12T18:04:36.698231+0000","last_peered":"2024-09-12T18:04:36.698231+0000","last_clean":"2024-09-12T18:04:36.698231+0000","last_became_active":"2024-09-12T18:03:53.333570+0000","last_became_peered":"2024-09-12T18:03:53.333570+0000","last_unstale":"2024-09-12T18:04:36.698231+0000","last_undegraded":"2024-09-12T18:04:36.698231+0000","last_fullsized":"2024-09-12T18:04:36.698231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'459","last_scrub_stamp":"2024-09-12T18:04:36.698045+0000","last_deep_scrub":"69'459","last_deep_scrub_stamp":"2024-09-12T18:04:36.698045+0000","last_clean_scrub_stamp":"2024-09-12T18:04:36.698045+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:29.837771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":17660,"num_write":427,"num_write_kb":51521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":404,"num_bytes_recovered":249782,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"85'382","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:28.409505+0000","last_change":"2024-09-12T18:04:28.409505+0000","last_active":"2024-09-12T18:04:28.409505+0000","last_peered":"2024-09-12T18:04:28.409505+0000","last_clean":"2024-09-12T18:04:28.409505+0000","last_became_active":"2024-09-12T18:04:09.682207+0000","last_became_peered":"2024-09-12T18:04:09.682207+0000","last_unstale":"2024-09-12T18:04:28.409505+0000","last_undegraded":"2024-09-12T18:04:28.409505+0000","last_fullsized":"2024-09-12T18:04:28.409505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'382","last_scrub_stamp":"2024-09-12T18:04:28.409289+0000","last_deep_scrub":"85'382","last_deep_scrub_stamp":"2024-09-12T18:04:28.409289+0000","last_clean_scrub_stamp":"2024-09-12T18:04:28.409289+0000","objects_scrubbed":2,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:36.366067+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"69'426","reported_seq":621,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:35.330483+0000","last_change":"2024-09-12T18:04:35.330483+0000","last_active":"2024-09-12T18:04:35.330483+0000","last_peered":"2024-09-12T18:04:35.330483+0000","last_clean":"2024-09-12T18:04:35.330483+0000","last_became_active":"2024-09-12T18:04:09.681881+0000","last_became_peered":"2024-09-12T18:04:09.681881+0000","last_unstale":"2024-09-12T18:04:35.330483+0000","last_undegraded":"2024-09-12T18:04:35.330483+0000","last_fullsized":"2024-09-12T18:04:35.330483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'426","last_scrub_stamp":"2024-09-12T18:04:35.330297+0000","last_deep_scrub":"69'426","last_deep_scrub_stamp":"2024-09-12T18:04:35.330297+0000","last_clean_scrub_stamp":"2024-09-12T18:04:35.330297+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:38.205633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25474,"num_write":386,"num_write_kb":50903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"69'54","reported_seq":210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:26.340401+0000","last_change":"2024-09-12T18:04:26.340401+0000","last_active":"2024-09-12T18:04:26.340401+0000","last_peered":"2024-09-12T18:04:26.340401+0000","last_clean":"2024-09-12T18:04:26.340401+0000","last_became_active":"2024-09-12T18:04:09.692860+0000","last_became_peered":"2024-09-12T18:04:09.692860+0000","last_unstale":"2024-09-12T18:04:26.340401+0000","last_undegraded":"2024-09-12T18:04:26.340401+0000","last_fullsized":"2024-09-12T18:04:26.340401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'54","last_scrub_stamp":"2024-09-12T18:04:26.340217+0000","last_deep_scrub":"69'54","last_deep_scrub_stamp":"2024-09-12T18:04:26.340217+0000","last_clean_scrub_stamp":"2024-09-12T18:04:26.340217+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:22.254704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'438","reported_seq":657,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:37.887468+0000","last_change":"2024-09-12T18:04:37.887468+0000","last_active":"2024-09-12T18:04:37.887468+0000","last_peered":"2024-09-12T18:04:37.887468+0000","last_clean":"2024-09-12T18:04:37.887468+0000","last_became_active":"2024-09-12T18:03:48.368003+0000","last_became_peered":"2024-09-12T18:03:48.368003+0000","last_unstale":"2024-09-12T18:04:37.887468+0000","last_undegraded":"2024-09-12T18:04:37.887468+0000","last_fullsized":"2024-09-12T18:04:37.887468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'438","last_scrub_stamp":"2024-09-12T18:04:37.887194+0000","last_deep_scrub":"68'438","last_deep_scrub_stamp":"2024-09-12T18:04:37.887194+0000","last_clean_scrub_stamp":"2024-09-12T18:04:37.887194+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:09.400476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17705,"num_write":403,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":115966,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'159","reported_seq":320,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.028175+0000","last_change":"2024-09-12T18:04:29.028175+0000","last_active":"2024-09-12T18:04:29.028175+0000","last_peered":"2024-09-12T18:04:29.028175+0000","last_clean":"2024-09-12T18:04:29.028175+0000","last_became_active":"2024-09-12T18:03:51.366776+0000","last_became_peered":"2024-09-12T18:03:51.366776+0000","last_unstale":"2024-09-12T18:04:29.028175+0000","last_undegraded":"2024-09-12T18:04:29.028175+0000","last_fullsized":"2024-09-12T18:04:29.028175+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'159","last_scrub_stamp":"2024-09-12T18:04:29.028001+0000","last_deep_scrub":"85'159","last_deep_scrub_stamp":"2024-09-12T18:04:29.028001+0000","last_clean_scrub_stamp":"2024-09-12T18:04:29.028001+0000","objects_scrubbed":3,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:55.413216+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":8240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"69'457","reported_seq":1482,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:36.307491+0000","last_change":"2024-09-12T18:04:36.307491+0000","last_active":"2024-09-12T18:04:36.307491+0000","last_peered":"2024-09-12T18:04:36.307491+0000","last_clean":"2024-09-12T18:04:36.307491+0000","last_became_active":"2024-09-12T18:04:09.686387+0000","last_became_peered":"2024-09-12T18:04:09.686387+0000","last_unstale":"2024-09-12T18:04:36.307491+0000","last_undegraded":"2024-09-12T18:04:36.307491+0000","last_fullsized":"2024-09-12T18:04:36.307491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'457","last_scrub_stamp":"2024-09-12T18:04:36.307314+0000","last_deep_scrub":"69'457","last_deep_scrub_stamp":"2024-09-12T18:04:36.307314+0000","last_clean_scrub_stamp":"2024-09-12T18:04:36.307314+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:46.983417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":16311,"num_write":422,"num_write_kb":47132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":406,"num_bytes_recovered":386360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"85'118","reported_seq":274,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:27.393858+0000","last_change":"2024-09-12T18:04:27.393858+0000","last_active":"2024-09-12T18:04:27.393858+0000","last_peered":"2024-09-12T18:04:27.393858+0000","last_clean":"2024-09-12T18:04:27.393858+0000","last_became_active":"2024-09-12T18:01:54.717341+0000","last_became_peered":"2024-09-12T18:01:54.717341+0000","last_unstale":"2024-09-12T18:04:27.393858+0000","last_undegraded":"2024-09-12T18:04:27.393858+0000","last_fullsized":"2024-09-12T18:04:27.393858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'118","last_scrub_stamp":"2024-09-12T18:04:27.393673+0000","last_deep_scrub":"85'118","last_deep_scrub_stamp":"2024-09-12T18:04:27.393673+0000","last_clean_scrub_stamp":"2024-09-12T18:04:27.393673+0000","objects_scrubbed":1,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:54.873705+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"66'413","reported_seq":622,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:38.364160+0000","last_change":"2024-09-12T18:04:38.364160+0000","last_active":"2024-09-12T18:04:38.364160+0000","last_peered":"2024-09-12T18:04:38.364160+0000","last_clean":"2024-09-12T18:04:38.364160+0000","last_became_active":"2024-09-12T18:01:55.587400+0000","last_became_peered":"2024-09-12T18:01:55.587400+0000","last_unstale":"2024-09-12T18:04:38.364160+0000","last_undegraded":"2024-09-12T18:04:38.364160+0000","last_fullsized":"2024-09-12T18:04:38.364160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'413","last_scrub_stamp":"2024-09-12T18:04:38.363968+0000","last_deep_scrub":"66'413","last_deep_scrub_stamp":"2024-09-12T18:04:38.363968+0000","last_clean_scrub_stamp":"2024-09-12T18:04:38.363968+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:13.333805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":36964,"num_write":383,"num_write_kb":91507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"66'52","reported_seq":207,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:21.498805+0000","last_change":"2024-09-12T18:04:21.498805+0000","last_active":"2024-09-12T18:04:21.498805+0000","last_peered":"2024-09-12T18:04:21.498805+0000","last_clean":"2024-09-12T18:04:21.498805+0000","last_became_active":"2024-09-12T18:01:54.707109+0000","last_became_peered":"2024-09-12T18:01:54.707109+0000","last_unstale":"2024-09-12T18:04:21.498805+0000","last_undegraded":"2024-09-12T18:04:21.498805+0000","last_fullsized":"2024-09-12T18:04:21.498805+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'52","last_scrub_stamp":"2024-09-12T18:04:21.498626+0000","last_deep_scrub":"66'52","last_deep_scrub_stamp":"2024-09-12T18:04:21.498626+0000","last_clean_scrub_stamp":"2024-09-12T18:04:21.498626+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:18.892666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"69'379","reported_seq":569,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.406333+0000","last_change":"2024-09-12T18:04:39.406333+0000","last_active":"2024-09-12T18:04:39.406333+0000","last_peered":"2024-09-12T18:04:39.406333+0000","last_clean":"2024-09-12T18:04:39.406333+0000","last_became_active":"2024-09-12T18:01:55.587588+0000","last_became_peered":"2024-09-12T18:01:55.587588+0000","last_unstale":"2024-09-12T18:04:39.406333+0000","last_undegraded":"2024-09-12T18:04:39.406333+0000","last_fullsized":"2024-09-12T18:04:39.406333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'379","last_scrub_stamp":"2024-09-12T18:04:39.406150+0000","last_deep_scrub":"69'379","last_deep_scrub_stamp":"2024-09-12T18:04:39.406150+0000","last_clean_scrub_stamp":"2024-09-12T18:04:39.406150+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:23.502405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":16000,"num_write":348,"num_write_kb":63354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"85'483","reported_seq":662,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:25.529772+0000","last_change":"2024-09-12T18:04:25.529772+0000","last_active":"2024-09-12T18:04:25.529772+0000","last_peered":"2024-09-12T18:04:25.529772+0000","last_clean":"2024-09-12T18:04:25.529772+0000","last_became_active":"2024-09-12T18:03:51.370770+0000","last_became_peered":"2024-09-12T18:03:51.370770+0000","last_unstale":"2024-09-12T18:04:25.529772+0000","last_undegraded":"2024-09-12T18:04:25.529772+0000","last_fullsized":"2024-09-12T18:04:25.529772+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'483","last_scrub_stamp":"2024-09-12T18:04:25.529540+0000","last_deep_scrub":"85'483","last_deep_scrub_stamp":"2024-09-12T18:04:25.529540+0000","last_clean_scrub_stamp":"2024-09-12T18:04:25.529540+0000","objects_scrubbed":1,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:00.369886+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"69'388","reported_seq":559,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.973186+0000","last_change":"2024-09-12T18:04:39.973186+0000","last_active":"2024-09-12T18:04:39.973186+0000","last_peered":"2024-09-12T18:04:39.973186+0000","last_clean":"2024-09-12T18:04:39.973186+0000","last_became_active":"2024-09-12T18:01:55.602538+0000","last_became_peered":"2024-09-12T18:01:55.602538+0000","last_unstale":"2024-09-12T18:04:39.973186+0000","last_undegraded":"2024-09-12T18:04:39.973186+0000","last_fullsized":"2024-09-12T18:04:39.973186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'388","last_scrub_stamp":"2024-09-12T18:04:39.972994+0000","last_deep_scrub":"69'388","last_deep_scrub_stamp":"2024-09-12T18:04:39.972994+0000","last_clean_scrub_stamp":"2024-09-12T18:04:39.972994+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:04.199690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6356,"num_write":344,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"85'114","reported_seq":308,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:21.422891+0000","last_change":"2024-09-12T18:04:21.422891+0000","last_active":"2024-09-12T18:04:21.422891+0000","last_peered":"2024-09-12T18:04:21.422891+0000","last_clean":"2024-09-12T18:04:21.422891+0000","last_became_active":"2024-09-12T18:01:44.482979+0000","last_became_peered":"2024-09-12T18:01:44.482979+0000","last_unstale":"2024-09-12T18:04:21.422891+0000","last_undegraded":"2024-09-12T18:04:21.422891+0000","last_fullsized":"2024-09-12T18:04:21.422891+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'114","last_scrub_stamp":"2024-09-12T18:04:21.422692+0000","last_deep_scrub":"85'114","last_deep_scrub_stamp":"2024-09-12T18:04:21.422692+0000","last_clean_scrub_stamp":"2024-09-12T18:04:21.422692+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:47.502137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"85'2","reported_seq":171,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:22.389640+0000","last_change":"2024-09-12T18:04:22.389640+0000","last_active":"2024-09-12T18:04:22.389640+0000","last_peered":"2024-09-12T18:04:22.389640+0000","last_clean":"2024-09-12T18:04:22.389640+0000","last_became_active":"2024-09-12T18:01:50.536940+0000","last_became_peered":"2024-09-12T18:01:50.536940+0000","last_unstale":"2024-09-12T18:04:22.389640+0000","last_undegraded":"2024-09-12T18:04:22.389640+0000","last_fullsized":"2024-09-12T18:04:22.389640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'2","last_scrub_stamp":"2024-09-12T18:04:22.389380+0000","last_deep_scrub":"85'2","last_deep_scrub_stamp":"2024-09-12T18:04:22.389380+0000","last_clean_scrub_stamp":"2024-09-12T18:04:22.389380+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:46.616076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001793759,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"85'571","reported_seq":725,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:25.045744+0000","last_change":"2024-09-12T18:04:25.045744+0000","last_active":"2024-09-12T18:04:25.045744+0000","last_peered":"2024-09-12T18:04:25.045744+0000","last_clean":"2024-09-12T18:04:25.045744+0000","last_became_active":"2024-09-12T18:01:54.712981+0000","last_became_peered":"2024-09-12T18:01:54.712981+0000","last_unstale":"2024-09-12T18:04:25.045744+0000","last_undegraded":"2024-09-12T18:04:25.045744+0000","last_fullsized":"2024-09-12T18:04:25.045744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'571","last_scrub_stamp":"2024-09-12T18:04:25.045509+0000","last_deep_scrub":"85'571","last_deep_scrub_stamp":"2024-09-12T18:04:25.045509+0000","last_clean_scrub_stamp":"2024-09-12T18:04:25.045509+0000","objects_scrubbed":2,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:51.123485+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"69'442","reported_seq":617,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:37.326212+0000","last_change":"2024-09-12T18:04:37.326212+0000","last_active":"2024-09-12T18:04:37.326212+0000","last_peered":"2024-09-12T18:04:37.326212+0000","last_clean":"2024-09-12T18:04:37.326212+0000","last_became_active":"2024-09-12T18:01:55.590177+0000","last_became_peered":"2024-09-12T18:01:55.590177+0000","last_unstale":"2024-09-12T18:04:37.326212+0000","last_undegraded":"2024-09-12T18:04:37.326212+0000","last_fullsized":"2024-09-12T18:04:37.326212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'442","last_scrub_stamp":"2024-09-12T18:04:37.325926+0000","last_deep_scrub":"69'442","last_deep_scrub_stamp":"2024-09-12T18:04:37.325926+0000","last_clean_scrub_stamp":"2024-09-12T18:04:37.325926+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:55.816448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":6713,"num_write":400,"num_write_kb":71718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:23.339079+0000","last_change":"2024-09-12T18:04:23.339079+0000","last_active":"2024-09-12T18:04:23.339079+0000","last_peered":"2024-09-12T18:04:23.339079+0000","last_clean":"2024-09-12T18:04:23.339079+0000","last_became_active":"2024-09-12T18:01:50.534278+0000","last_became_peered":"2024-09-12T18:01:50.534278+0000","last_unstale":"2024-09-12T18:04:23.339079+0000","last_undegraded":"2024-09-12T18:04:23.339079+0000","last_fullsized":"2024-09-12T18:04:23.339079+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:23.338885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:23.338885+0000","last_clean_scrub_stamp":"2024-09-12T18:04:23.338885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:32.976595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108845,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'130","reported_seq":353,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.051344+0000","last_change":"2024-09-12T18:04:24.051344+0000","last_active":"2024-09-12T18:04:24.051344+0000","last_peered":"2024-09-12T18:04:24.051344+0000","last_clean":"2024-09-12T18:04:24.051344+0000","last_became_active":"2024-09-12T18:03:51.366304+0000","last_became_peered":"2024-09-12T18:03:51.366304+0000","last_unstale":"2024-09-12T18:04:24.051344+0000","last_undegraded":"2024-09-12T18:04:24.051344+0000","last_fullsized":"2024-09-12T18:04:24.051344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'130","last_scrub_stamp":"2024-09-12T18:04:24.051165+0000","last_deep_scrub":"85'130","last_deep_scrub_stamp":"2024-09-12T18:04:24.051165+0000","last_clean_scrub_stamp":"2024-09-12T18:04:24.051165+0000","objects_scrubbed":1,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:11.524867+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468439,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":59,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2574692,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"69'461","reported_seq":1175,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:32.630773+0000","last_change":"2024-09-12T18:04:32.630773+0000","last_active":"2024-09-12T18:04:32.630773+0000","last_peered":"2024-09-12T18:04:32.630773+0000","last_clean":"2024-09-12T18:04:32.630773+0000","last_became_active":"2024-09-12T18:03:48.353684+0000","last_became_peered":"2024-09-12T18:03:48.353684+0000","last_unstale":"2024-09-12T18:04:32.630773+0000","last_undegraded":"2024-09-12T18:04:32.630773+0000","last_fullsized":"2024-09-12T18:04:32.630773+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'461","last_scrub_stamp":"2024-09-12T18:04:32.630581+0000","last_deep_scrub":"69'461","last_deep_scrub_stamp":"2024-09-12T18:04:32.630581+0000","last_clean_scrub_stamp":"2024-09-12T18:04:32.630581+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:25.104496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":25755,"num_write":436,"num_write_kb":80489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":307205,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:21.056050+0000","last_change":"2024-09-12T18:04:21.056050+0000","last_active":"2024-09-12T18:04:21.056050+0000","last_peered":"2024-09-12T18:04:21.056050+0000","last_clean":"2024-09-12T18:04:21.056050+0000","last_became_active":"2024-09-12T18:01:50.538045+0000","last_became_peered":"2024-09-12T18:01:50.538045+0000","last_unstale":"2024-09-12T18:04:21.056050+0000","last_undegraded":"2024-09-12T18:04:21.056050+0000","last_fullsized":"2024-09-12T18:04:21.056050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:21.055878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:21.055878+0000","last_clean_scrub_stamp":"2024-09-12T18:04:21.055878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:05.539797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011330139999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"85'376","reported_seq":531,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:31.658499+0000","last_change":"2024-09-12T18:04:31.658499+0000","last_active":"2024-09-12T18:04:31.658499+0000","last_peered":"2024-09-12T18:04:31.658499+0000","last_clean":"2024-09-12T18:04:31.658499+0000","last_became_active":"2024-09-12T18:01:54.707046+0000","last_became_peered":"2024-09-12T18:01:54.707046+0000","last_unstale":"2024-09-12T18:04:31.658499+0000","last_undegraded":"2024-09-12T18:04:31.658499+0000","last_fullsized":"2024-09-12T18:04:31.658499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'376","last_scrub_stamp":"2024-09-12T18:04:31.658315+0000","last_deep_scrub":"85'376","last_deep_scrub_stamp":"2024-09-12T18:04:31.658315+0000","last_clean_scrub_stamp":"2024-09-12T18:04:31.658315+0000","objects_scrubbed":2,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:56.623588+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":8319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"69'347","reported_seq":821,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:36.931777+0000","last_change":"2024-09-12T18:04:36.931777+0000","last_active":"2024-09-12T18:04:36.931777+0000","last_peered":"2024-09-12T18:04:36.931777+0000","last_clean":"2024-09-12T18:04:36.931777+0000","last_became_active":"2024-09-12T18:03:54.332783+0000","last_became_peered":"2024-09-12T18:03:54.332783+0000","last_unstale":"2024-09-12T18:04:36.931777+0000","last_undegraded":"2024-09-12T18:04:36.931777+0000","last_fullsized":"2024-09-12T18:04:36.931777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'347","last_scrub_stamp":"2024-09-12T18:04:36.931592+0000","last_deep_scrub":"69'347","last_deep_scrub_stamp":"2024-09-12T18:04:36.931592+0000","last_clean_scrub_stamp":"2024-09-12T18:04:36.931592+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:52.766187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4718,"num_write":317,"num_write_kb":17561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":141123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"85'3","reported_seq":182,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:20.418933+0000","last_change":"2024-09-12T18:04:20.418933+0000","last_active":"2024-09-12T18:04:20.418933+0000","last_peered":"2024-09-12T18:04:20.418933+0000","last_clean":"2024-09-12T18:04:20.418933+0000","last_became_active":"2024-09-12T18:02:34.829337+0000","last_became_peered":"2024-09-12T18:02:34.829337+0000","last_unstale":"2024-09-12T18:04:20.418933+0000","last_undegraded":"2024-09-12T18:04:20.418933+0000","last_fullsized":"2024-09-12T18:04:20.418933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'3","last_scrub_stamp":"2024-09-12T18:04:20.418747+0000","last_deep_scrub":"85'3","last_deep_scrub_stamp":"2024-09-12T18:04:20.418747+0000","last_clean_scrub_stamp":"2024-09-12T18:04:20.418747+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:37.888036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0016030479999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"69'74","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.336840+0000","last_change":"2024-09-12T18:04:24.336840+0000","last_active":"2024-09-12T18:04:24.336840+0000","last_peered":"2024-09-12T18:04:24.336840+0000","last_clean":"2024-09-12T18:04:24.336840+0000","last_became_active":"2024-09-12T18:04:09.686200+0000","last_became_peered":"2024-09-12T18:04:09.686200+0000","last_unstale":"2024-09-12T18:04:24.336840+0000","last_undegraded":"2024-09-12T18:04:24.336840+0000","last_fullsized":"2024-09-12T18:04:24.336840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'74","last_scrub_stamp":"2024-09-12T18:04:24.336658+0000","last_deep_scrub":"69'74","last_deep_scrub_stamp":"2024-09-12T18:04:24.336658+0000","last_clean_scrub_stamp":"2024-09-12T18:04:24.336658+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:08.269022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"69'417","reported_seq":655,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:33.950974+0000","last_change":"2024-09-12T18:04:33.950974+0000","last_active":"2024-09-12T18:04:33.950974+0000","last_peered":"2024-09-12T18:04:33.950974+0000","last_clean":"2024-09-12T18:04:33.950974+0000","last_became_active":"2024-09-12T18:01:55.596988+0000","last_became_peered":"2024-09-12T18:01:55.596988+0000","last_unstale":"2024-09-12T18:04:33.950974+0000","last_undegraded":"2024-09-12T18:04:33.950974+0000","last_fullsized":"2024-09-12T18:04:33.950974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'417","last_scrub_stamp":"2024-09-12T18:04:33.950784+0000","last_deep_scrub":"69'417","last_deep_scrub_stamp":"2024-09-12T18:04:33.950784+0000","last_clean_scrub_stamp":"2024-09-12T18:04:33.950784+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:38.136483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":42969,"num_write":381,"num_write_kb":92884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"85'301","reported_seq":457,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:25.342971+0000","last_change":"2024-09-12T18:04:25.342971+0000","last_active":"2024-09-12T18:04:25.342971+0000","last_peered":"2024-09-12T18:04:25.342971+0000","last_clean":"2024-09-12T18:04:25.342971+0000","last_became_active":"2024-09-12T18:01:54.713952+0000","last_became_peered":"2024-09-12T18:01:54.713952+0000","last_unstale":"2024-09-12T18:04:25.342971+0000","last_undegraded":"2024-09-12T18:04:25.342971+0000","last_fullsized":"2024-09-12T18:04:25.342971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'301","last_scrub_stamp":"2024-09-12T18:04:25.342770+0000","last_deep_scrub":"85'301","last_deep_scrub_stamp":"2024-09-12T18:04:25.342770+0000","last_clean_scrub_stamp":"2024-09-12T18:04:25.342770+0000","objects_scrubbed":1,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:23.328653+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":167,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:23.023109+0000","last_change":"2024-09-12T18:04:23.023109+0000","last_active":"2024-09-12T18:04:23.023109+0000","last_peered":"2024-09-12T18:04:23.023109+0000","last_clean":"2024-09-12T18:04:23.023109+0000","last_became_active":"2024-09-12T18:01:50.538374+0000","last_became_peered":"2024-09-12T18:01:50.538374+0000","last_unstale":"2024-09-12T18:04:23.023109+0000","last_undegraded":"2024-09-12T18:04:23.023109+0000","last_fullsized":"2024-09-12T18:04:23.023109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:23.022919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:23.022919+0000","last_clean_scrub_stamp":"2024-09-12T18:04:23.022919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:15.496833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010824280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"69'360","reported_seq":540,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.537758+0000","last_change":"2024-09-12T18:04:29.537758+0000","last_active":"2024-09-12T18:04:29.537758+0000","last_peered":"2024-09-12T18:04:29.537758+0000","last_clean":"2024-09-12T18:04:29.537758+0000","last_became_active":"2024-09-12T18:01:55.582715+0000","last_became_peered":"2024-09-12T18:01:55.582715+0000","last_unstale":"2024-09-12T18:04:29.537758+0000","last_undegraded":"2024-09-12T18:04:29.537758+0000","last_fullsized":"2024-09-12T18:04:29.537758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'360","last_scrub_stamp":"2024-09-12T18:04:29.537572+0000","last_deep_scrub":"69'360","last_deep_scrub_stamp":"2024-09-12T18:04:29.537572+0000","last_clean_scrub_stamp":"2024-09-12T18:04:29.537572+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:14.021491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":12634,"num_write":326,"num_write_kb":42043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"66'51","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:25.979646+0000","last_change":"2024-09-12T18:04:25.979646+0000","last_active":"2024-09-12T18:04:25.979646+0000","last_peered":"2024-09-12T18:04:25.979646+0000","last_clean":"2024-09-12T18:04:25.979646+0000","last_became_active":"2024-09-12T18:03:48.344719+0000","last_became_peered":"2024-09-12T18:03:48.344719+0000","last_unstale":"2024-09-12T18:04:25.979646+0000","last_undegraded":"2024-09-12T18:04:25.979646+0000","last_fullsized":"2024-09-12T18:04:25.979646+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'51","last_scrub_stamp":"2024-09-12T18:04:25.979463+0000","last_deep_scrub":"66'51","last_deep_scrub_stamp":"2024-09-12T18:04:25.979463+0000","last_clean_scrub_stamp":"2024-09-12T18:04:25.979463+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:06.507258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":180,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:20.474078+0000","last_change":"2024-09-12T18:04:20.474078+0000","last_active":"2024-09-12T18:04:20.474078+0000","last_peered":"2024-09-12T18:04:20.474078+0000","last_clean":"2024-09-12T18:04:20.474078+0000","last_became_active":"2024-09-12T18:03:48.348394+0000","last_became_peered":"2024-09-12T18:03:48.348394+0000","last_unstale":"2024-09-12T18:04:20.474078+0000","last_undegraded":"2024-09-12T18:04:20.474078+0000","last_fullsized":"2024-09-12T18:04:20.474078+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:20.473898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:20.473898+0000","last_clean_scrub_stamp":"2024-09-12T18:04:20.473898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:35.424990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001259074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"69'380","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.630120+0000","last_change":"2024-09-12T18:04:34.630120+0000","last_active":"2024-09-12T18:04:34.630120+0000","last_peered":"2024-09-12T18:04:34.630120+0000","last_clean":"2024-09-12T18:04:34.630120+0000","last_became_active":"2024-09-12T18:01:55.582200+0000","last_became_peered":"2024-09-12T18:01:55.582200+0000","last_unstale":"2024-09-12T18:04:34.630120+0000","last_undegraded":"2024-09-12T18:04:34.630120+0000","last_fullsized":"2024-09-12T18:04:34.630120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'380","last_scrub_stamp":"2024-09-12T18:04:34.629933+0000","last_deep_scrub":"69'380","last_deep_scrub_stamp":"2024-09-12T18:04:34.629933+0000","last_clean_scrub_stamp":"2024-09-12T18:04:34.629933+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:00.707908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":6923,"num_write":347,"num_write_kb":34291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"85'58","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:28.027883+0000","last_change":"2024-09-12T18:04:28.027883+0000","last_active":"2024-09-12T18:04:28.027883+0000","last_peered":"2024-09-12T18:04:28.027883+0000","last_clean":"2024-09-12T18:04:28.027883+0000","last_became_active":"2024-09-12T18:03:48.351989+0000","last_became_peered":"2024-09-12T18:03:48.351989+0000","last_unstale":"2024-09-12T18:04:28.027883+0000","last_undegraded":"2024-09-12T18:04:28.027883+0000","last_fullsized":"2024-09-12T18:04:28.027883+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'58","last_scrub_stamp":"2024-09-12T18:04:28.027696+0000","last_deep_scrub":"85'58","last_deep_scrub_stamp":"2024-09-12T18:04:28.027696+0000","last_clean_scrub_stamp":"2024-09-12T18:04:28.027696+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:12.657368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:22.068485+0000","last_change":"2024-09-12T18:04:22.068485+0000","last_active":"2024-09-12T18:04:22.068485+0000","last_peered":"2024-09-12T18:04:22.068485+0000","last_clean":"2024-09-12T18:04:22.068485+0000","last_became_active":"2024-09-12T18:03:48.349092+0000","last_became_peered":"2024-09-12T18:03:48.349092+0000","last_unstale":"2024-09-12T18:04:22.068485+0000","last_undegraded":"2024-09-12T18:04:22.068485+0000","last_fullsized":"2024-09-12T18:04:22.068485+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:22.068302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:22.068302+0000","last_clean_scrub_stamp":"2024-09-12T18:04:22.068302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:50.293351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"69'394","reported_seq":583,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:38.927945+0000","last_change":"2024-09-12T18:04:38.927945+0000","last_active":"2024-09-12T18:04:38.927945+0000","last_peered":"2024-09-12T18:04:38.927945+0000","last_clean":"2024-09-12T18:04:38.927945+0000","last_became_active":"2024-09-12T18:03:48.365180+0000","last_became_peered":"2024-09-12T18:03:48.365180+0000","last_unstale":"2024-09-12T18:04:38.927945+0000","last_undegraded":"2024-09-12T18:04:38.927945+0000","last_fullsized":"2024-09-12T18:04:38.927945+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'394","last_scrub_stamp":"2024-09-12T18:04:38.927664+0000","last_deep_scrub":"69'394","last_deep_scrub_stamp":"2024-09-12T18:04:38.927664+0000","last_clean_scrub_stamp":"2024-09-12T18:04:38.927664+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:22.626585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":366,"num_write":364,"num_write_kb":33902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":99066,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"85'115","reported_seq":277,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:27.004442+0000","last_change":"2024-09-12T18:04:27.004442+0000","last_active":"2024-09-12T18:04:27.004442+0000","last_peered":"2024-09-12T18:04:27.004442+0000","last_clean":"2024-09-12T18:04:27.004442+0000","last_became_active":"2024-09-12T18:03:51.368935+0000","last_became_peered":"2024-09-12T18:03:51.368935+0000","last_unstale":"2024-09-12T18:04:27.004442+0000","last_undegraded":"2024-09-12T18:04:27.004442+0000","last_fullsized":"2024-09-12T18:04:27.004442+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'115","last_scrub_stamp":"2024-09-12T18:04:27.004264+0000","last_deep_scrub":"85'115","last_deep_scrub_stamp":"2024-09-12T18:04:27.004264+0000","last_clean_scrub_stamp":"2024-09-12T18:04:27.004264+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:20.143990+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":1177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":582,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:19.395533+0000","last_change":"2024-09-12T18:04:19.395533+0000","last_active":"2024-09-12T18:04:19.395533+0000","last_peered":"2024-09-12T18:04:19.395533+0000","last_clean":"2024-09-12T18:04:19.395533+0000","last_became_active":"2024-09-12T18:04:09.677062+0000","last_became_peered":"2024-09-12T18:04:09.677062+0000","last_unstale":"2024-09-12T18:04:19.395533+0000","last_undegraded":"2024-09-12T18:04:19.395533+0000","last_fullsized":"2024-09-12T18:04:19.395533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:04:19.395349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:04:19.395349+0000","last_clean_scrub_stamp":"2024-09-12T18:04:19.395349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:37.016295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"69'391","reported_seq":594,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:28.529700+0000","last_change":"2024-09-12T18:04:28.529700+0000","last_active":"2024-09-12T18:04:28.529700+0000","last_peered":"2024-09-12T18:04:28.529700+0000","last_clean":"2024-09-12T18:04:28.529700+0000","last_became_active":"2024-09-12T18:01:55.592583+0000","last_became_peered":"2024-09-12T18:01:55.592583+0000","last_unstale":"2024-09-12T18:04:28.529700+0000","last_undegraded":"2024-09-12T18:04:28.529700+0000","last_fullsized":"2024-09-12T18:04:28.529700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'391","last_scrub_stamp":"2024-09-12T18:04:28.529479+0000","last_deep_scrub":"69'391","last_deep_scrub_stamp":"2024-09-12T18:04:28.529479+0000","last_clean_scrub_stamp":"2024-09-12T18:04:28.529479+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:50.803453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":17879,"num_write":354,"num_write_kb":23446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"69'402","reported_seq":597,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:40.401526+0000","last_change":"2024-09-12T18:04:40.401526+0000","last_active":"2024-09-12T18:04:40.401526+0000","last_peered":"2024-09-12T18:04:40.401526+0000","last_clean":"2024-09-12T18:04:40.401526+0000","last_became_active":"2024-09-12T18:01:55.595877+0000","last_became_peered":"2024-09-12T18:01:55.595877+0000","last_unstale":"2024-09-12T18:04:40.401526+0000","last_undegraded":"2024-09-12T18:04:40.401526+0000","last_fullsized":"2024-09-12T18:04:40.401526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'402","last_scrub_stamp":"2024-09-12T18:04:40.401338+0000","last_deep_scrub":"69'402","last_deep_scrub_stamp":"2024-09-12T18:04:40.401338+0000","last_clean_scrub_stamp":"2024-09-12T18:04:40.401338+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:57.568192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30784,"num_write":365,"num_write_kb":100803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"85'232","reported_seq":388,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:33.412554+0000","last_change":"2024-09-12T18:04:33.412554+0000","last_active":"2024-09-12T18:04:33.412554+0000","last_peered":"2024-09-12T18:04:33.412554+0000","last_clean":"2024-09-12T18:04:33.412554+0000","last_became_active":"2024-09-12T18:01:54.704390+0000","last_became_peered":"2024-09-12T18:01:54.704390+0000","last_unstale":"2024-09-12T18:04:33.412554+0000","last_undegraded":"2024-09-12T18:04:33.412554+0000","last_fullsized":"2024-09-12T18:04:33.412554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'232","last_scrub_stamp":"2024-09-12T18:04:33.412361+0000","last_deep_scrub":"85'232","last_deep_scrub_stamp":"2024-09-12T18:04:33.412361+0000","last_clean_scrub_stamp":"2024-09-12T18:04:33.412361+0000","objects_scrubbed":5,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:36.162886+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":8284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"69'443","reported_seq":636,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:42.943753+0000","last_change":"2024-09-12T18:04:42.943753+0000","last_active":"2024-09-12T18:04:42.943753+0000","last_peered":"2024-09-12T18:04:42.943753+0000","last_clean":"2024-09-12T18:04:42.943753+0000","last_became_active":"2024-09-12T18:01:55.595722+0000","last_became_peered":"2024-09-12T18:01:55.595722+0000","last_unstale":"2024-09-12T18:04:42.943753+0000","last_undegraded":"2024-09-12T18:04:42.943753+0000","last_fullsized":"2024-09-12T18:04:42.943753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'443","last_scrub_stamp":"2024-09-12T18:04:42.943568+0000","last_deep_scrub":"69'443","last_deep_scrub_stamp":"2024-09-12T18:04:42.943568+0000","last_clean_scrub_stamp":"2024-09-12T18:04:42.943568+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:41.104853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22428,"num_write":407,"num_write_kb":96357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"85'97","reported_seq":252,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:23.543878+0000","last_change":"2024-09-12T18:04:23.543878+0000","last_active":"2024-09-12T18:04:23.543878+0000","last_peered":"2024-09-12T18:04:23.543878+0000","last_clean":"2024-09-12T18:04:23.543878+0000","last_became_active":"2024-09-12T18:01:54.706401+0000","last_became_peered":"2024-09-12T18:01:54.706401+0000","last_unstale":"2024-09-12T18:04:23.543878+0000","last_undegraded":"2024-09-12T18:04:23.543878+0000","last_fullsized":"2024-09-12T18:04:23.543878+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'97","last_scrub_stamp":"2024-09-12T18:04:23.543701+0000","last_deep_scrub":"85'97","last_deep_scrub_stamp":"2024-09-12T18:04:23.543701+0000","last_clean_scrub_stamp":"2024-09-12T18:04:23.543701+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:10.884744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'188","reported_seq":368,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:31.387381+0000","last_change":"2024-09-12T18:04:31.387381+0000","last_active":"2024-09-12T18:04:31.387381+0000","last_peered":"2024-09-12T18:04:31.387381+0000","last_clean":"2024-09-12T18:04:31.387381+0000","last_became_active":"2024-09-12T18:04:09.682878+0000","last_became_peered":"2024-09-12T18:04:09.682878+0000","last_unstale":"2024-09-12T18:04:31.387381+0000","last_undegraded":"2024-09-12T18:04:31.387381+0000","last_fullsized":"2024-09-12T18:04:31.387381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'188","last_scrub_stamp":"2024-09-12T18:04:31.387202+0000","last_deep_scrub":"85'188","last_deep_scrub_stamp":"2024-09-12T18:04:31.387202+0000","last_clean_scrub_stamp":"2024-09-12T18:04:31.387202+0000","objects_scrubbed":1,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:52.630252+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":7524113,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"69'487","reported_seq":729,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:41.974793+0000","last_change":"2024-09-12T18:04:41.974793+0000","last_active":"2024-09-12T18:04:41.974793+0000","last_peered":"2024-09-12T18:04:41.974793+0000","last_clean":"2024-09-12T18:04:41.974793+0000","last_became_active":"2024-09-12T18:01:55.593732+0000","last_became_peered":"2024-09-12T18:01:55.593732+0000","last_unstale":"2024-09-12T18:04:41.974793+0000","last_undegraded":"2024-09-12T18:04:41.974793+0000","last_fullsized":"2024-09-12T18:04:41.974793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'487","last_scrub_stamp":"2024-09-12T18:04:41.974608+0000","last_deep_scrub":"69'487","last_deep_scrub_stamp":"2024-09-12T18:04:41.974608+0000","last_clean_scrub_stamp":"2024-09-12T18:04:41.974608+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:58.453923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":56921,"num_write":453,"num_write_kb":109618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"68'55","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:29.958536+0000","last_change":"2024-09-12T18:04:29.958536+0000","last_active":"2024-09-12T18:04:29.958536+0000","last_peered":"2024-09-12T18:04:29.958536+0000","last_clean":"2024-09-12T18:04:29.958536+0000","last_became_active":"2024-09-12T18:03:48.359806+0000","last_became_peered":"2024-09-12T18:03:48.359806+0000","last_unstale":"2024-09-12T18:04:29.958536+0000","last_undegraded":"2024-09-12T18:04:29.958536+0000","last_fullsized":"2024-09-12T18:04:29.958536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'55","last_scrub_stamp":"2024-09-12T18:04:29.958341+0000","last_deep_scrub":"68'55","last_deep_scrub_stamp":"2024-09-12T18:04:29.958341+0000","last_clean_scrub_stamp":"2024-09-12T18:04:29.958341+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:11.640291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"69'462","reported_seq":705,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:40.930528+0000","last_change":"2024-09-12T18:04:40.930528+0000","last_active":"2024-09-12T18:04:40.930528+0000","last_peered":"2024-09-12T18:04:40.930528+0000","last_clean":"2024-09-12T18:04:40.930528+0000","last_became_active":"2024-09-12T18:03:48.351106+0000","last_became_peered":"2024-09-12T18:03:48.351106+0000","last_unstale":"2024-09-12T18:04:40.930528+0000","last_undegraded":"2024-09-12T18:04:40.930528+0000","last_fullsized":"2024-09-12T18:04:40.930528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'462","last_scrub_stamp":"2024-09-12T18:04:40.930345+0000","last_deep_scrub":"69'462","last_deep_scrub_stamp":"2024-09-12T18:04:40.930345+0000","last_clean_scrub_stamp":"2024-09-12T18:04:40.930345+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:33.025859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":31323,"num_write":433,"num_write_kb":71702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":45280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"69'371","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:42.742635+0000","last_change":"2024-09-12T18:04:42.742635+0000","last_active":"2024-09-12T18:04:42.742635+0000","last_peered":"2024-09-12T18:04:42.742635+0000","last_clean":"2024-09-12T18:04:42.742635+0000","last_became_active":"2024-09-12T18:01:55.580177+0000","last_became_peered":"2024-09-12T18:01:55.580177+0000","last_unstale":"2024-09-12T18:04:42.742635+0000","last_undegraded":"2024-09-12T18:04:42.742635+0000","last_fullsized":"2024-09-12T18:04:42.742635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'371","last_scrub_stamp":"2024-09-12T18:04:42.742398+0000","last_deep_scrub":"69'371","last_deep_scrub_stamp":"2024-09-12T18:04:42.742398+0000","last_clean_scrub_stamp":"2024-09-12T18:04:42.742398+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:18.779257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22323,"num_write":346,"num_write_kb":43164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"85'655","reported_seq":809,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:30.970459+0000","last_change":"2024-09-12T18:04:30.970459+0000","last_active":"2024-09-12T18:04:30.970459+0000","last_peered":"2024-09-12T18:04:30.970459+0000","last_clean":"2024-09-12T18:04:30.970459+0000","last_became_active":"2024-09-12T18:01:54.712737+0000","last_became_peered":"2024-09-12T18:01:54.712737+0000","last_unstale":"2024-09-12T18:04:30.970459+0000","last_undegraded":"2024-09-12T18:04:30.970459+0000","last_fullsized":"2024-09-12T18:04:30.970459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'655","last_scrub_stamp":"2024-09-12T18:04:30.970274+0000","last_deep_scrub":"85'655","last_deep_scrub_stamp":"2024-09-12T18:04:30.970274+0000","last_clean_scrub_stamp":"2024-09-12T18:04:30.970274+0000","objects_scrubbed":2,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:21.518432+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":8478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"69'438","reported_seq":678,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:45.952004+0000","last_change":"2024-09-12T18:04:45.952004+0000","last_active":"2024-09-12T18:04:45.952004+0000","last_peered":"2024-09-12T18:04:45.952004+0000","last_clean":"2024-09-12T18:04:45.952004+0000","last_became_active":"2024-09-12T18:03:49.357154+0000","last_became_peered":"2024-09-12T18:03:49.357154+0000","last_unstale":"2024-09-12T18:04:45.952004+0000","last_undegraded":"2024-09-12T18:04:45.952004+0000","last_fullsized":"2024-09-12T18:04:45.952004+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'438","last_scrub_stamp":"2024-09-12T18:04:45.951824+0000","last_deep_scrub":"69'438","last_deep_scrub_stamp":"2024-09-12T18:04:45.951824+0000","last_clean_scrub_stamp":"2024-09-12T18:04:45.951824+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:31.666076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":27423,"num_write":409,"num_write_kb":93467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"85'215","reported_seq":380,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:31.923094+0000","last_change":"2024-09-12T18:04:31.923094+0000","last_active":"2024-09-12T18:04:31.923094+0000","last_peered":"2024-09-12T18:04:31.923094+0000","last_clean":"2024-09-12T18:04:31.923094+0000","last_became_active":"2024-09-12T18:03:51.366306+0000","last_became_peered":"2024-09-12T18:03:51.366306+0000","last_unstale":"2024-09-12T18:04:31.923094+0000","last_undegraded":"2024-09-12T18:04:31.923094+0000","last_fullsized":"2024-09-12T18:04:31.923094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'215","last_scrub_stamp":"2024-09-12T18:04:31.922897+0000","last_deep_scrub":"85'215","last_deep_scrub_stamp":"2024-09-12T18:04:31.922897+0000","last_clean_scrub_stamp":"2024-09-12T18:04:31.922897+0000","objects_scrubbed":1,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:51.345653+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"69'395","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:39.672014+0000","last_change":"2024-09-12T18:04:39.672014+0000","last_active":"2024-09-12T18:04:39.672014+0000","last_peered":"2024-09-12T18:04:39.672014+0000","last_clean":"2024-09-12T18:04:39.672014+0000","last_became_active":"2024-09-12T18:01:55.586893+0000","last_became_peered":"2024-09-12T18:01:55.586893+0000","last_unstale":"2024-09-12T18:04:39.672014+0000","last_undegraded":"2024-09-12T18:04:39.672014+0000","last_fullsized":"2024-09-12T18:04:39.672014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'395","last_scrub_stamp":"2024-09-12T18:04:39.671716+0000","last_deep_scrub":"69'395","last_deep_scrub_stamp":"2024-09-12T18:04:39.671716+0000","last_clean_scrub_stamp":"2024-09-12T18:04:39.671716+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:21.353666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13211,"num_write":350,"num_write_kb":79345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"85'217","reported_seq":372,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:24.562886+0000","last_change":"2024-09-12T18:04:24.562717+0000","last_active":"2024-09-12T18:04:24.562886+0000","last_peered":"2024-09-12T18:04:24.562886+0000","last_clean":"2024-09-12T18:04:24.562886+0000","last_became_active":"2024-09-12T18:01:54.703085+0000","last_became_peered":"2024-09-12T18:01:54.703085+0000","last_unstale":"2024-09-12T18:04:24.562886+0000","last_undegraded":"2024-09-12T18:04:24.562886+0000","last_fullsized":"2024-09-12T18:04:24.562886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'217","last_scrub_stamp":"2024-09-12T18:04:24.562527+0000","last_deep_scrub":"85'217","last_deep_scrub_stamp":"2024-09-12T18:04:24.562527+0000","last_clean_scrub_stamp":"2024-09-12T18:04:24.562527+0000","objects_scrubbed":3,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:38.264425+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479143,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":12267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"69'374","reported_seq":1219,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:38.712417+0000","last_change":"2024-09-12T18:04:38.712417+0000","last_active":"2024-09-12T18:04:38.712417+0000","last_peered":"2024-09-12T18:04:38.712417+0000","last_clean":"2024-09-12T18:04:38.712417+0000","last_became_active":"2024-09-12T18:03:52.376604+0000","last_became_peered":"2024-09-12T18:03:52.376604+0000","last_unstale":"2024-09-12T18:04:38.712417+0000","last_undegraded":"2024-09-12T18:04:38.712417+0000","last_fullsized":"2024-09-12T18:04:38.712417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'374","last_scrub_stamp":"2024-09-12T18:04:38.712235+0000","last_deep_scrub":"69'374","last_deep_scrub_stamp":"2024-09-12T18:04:38.712235+0000","last_clean_scrub_stamp":"2024-09-12T18:04:38.712235+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:05.097451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8280,"num_write":344,"num_write_kb":38786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":328,"num_bytes_recovered":307168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"85'52","reported_seq":207,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:30.597355+0000","last_change":"2024-09-12T18:04:30.597355+0000","last_active":"2024-09-12T18:04:30.597355+0000","last_peered":"2024-09-12T18:04:30.597355+0000","last_clean":"2024-09-12T18:04:30.597355+0000","last_became_active":"2024-09-12T18:01:54.710420+0000","last_became_peered":"2024-09-12T18:01:54.710420+0000","last_unstale":"2024-09-12T18:04:30.597355+0000","last_undegraded":"2024-09-12T18:04:30.597355+0000","last_fullsized":"2024-09-12T18:04:30.597355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'52","last_scrub_stamp":"2024-09-12T18:04:30.597183+0000","last_deep_scrub":"85'52","last_deep_scrub_stamp":"2024-09-12T18:04:30.597183+0000","last_clean_scrub_stamp":"2024-09-12T18:04:30.597183+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:46.721061+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"69'373","reported_seq":1220,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:42.488039+0000","last_change":"2024-09-12T18:04:42.488039+0000","last_active":"2024-09-12T18:04:42.488039+0000","last_peered":"2024-09-12T18:04:42.488039+0000","last_clean":"2024-09-12T18:04:42.488039+0000","last_became_active":"2024-09-12T18:04:09.688026+0000","last_became_peered":"2024-09-12T18:04:09.688026+0000","last_unstale":"2024-09-12T18:04:42.488039+0000","last_undegraded":"2024-09-12T18:04:42.488039+0000","last_fullsized":"2024-09-12T18:04:42.488039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'373","last_scrub_stamp":"2024-09-12T18:04:42.487754+0000","last_deep_scrub":"69'373","last_deep_scrub_stamp":"2024-09-12T18:04:42.487754+0000","last_clean_scrub_stamp":"2024-09-12T18:04:42.487754+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:23.074828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2180,"num_write":346,"num_write_kb":29811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":330,"num_bytes_recovered":175720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"85'183","reported_seq":367,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.389694+0000","last_change":"2024-09-12T18:04:34.389694+0000","last_active":"2024-09-12T18:04:34.389694+0000","last_peered":"2024-09-12T18:04:34.389694+0000","last_clean":"2024-09-12T18:04:34.389694+0000","last_became_active":"2024-09-12T18:04:09.692975+0000","last_became_peered":"2024-09-12T18:04:09.692975+0000","last_unstale":"2024-09-12T18:04:34.389694+0000","last_undegraded":"2024-09-12T18:04:34.389694+0000","last_fullsized":"2024-09-12T18:04:34.389694+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'183","last_scrub_stamp":"2024-09-12T18:04:34.389492+0000","last_deep_scrub":"85'183","last_deep_scrub_stamp":"2024-09-12T18:04:34.389492+0000","last_clean_scrub_stamp":"2024-09-12T18:04:34.389492+0000","objects_scrubbed":2,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:26.744320+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":4161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"69'397","reported_seq":1301,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:43.479910+0000","last_change":"2024-09-12T18:04:43.479910+0000","last_active":"2024-09-12T18:04:43.479910+0000","last_peered":"2024-09-12T18:04:43.479910+0000","last_clean":"2024-09-12T18:04:43.479910+0000","last_became_active":"2024-09-12T18:04:09.684915+0000","last_became_peered":"2024-09-12T18:04:09.684915+0000","last_unstale":"2024-09-12T18:04:43.479910+0000","last_undegraded":"2024-09-12T18:04:43.479910+0000","last_fullsized":"2024-09-12T18:04:43.479910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'397","last_scrub_stamp":"2024-09-12T18:04:43.479726+0000","last_deep_scrub":"69'397","last_deep_scrub_stamp":"2024-09-12T18:04:43.479726+0000","last_clean_scrub_stamp":"2024-09-12T18:04:43.479726+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:02.174367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7536,"num_write":368,"num_write_kb":42417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":151595,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"85'281","reported_seq":436,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:27.542184+0000","last_change":"2024-09-12T18:04:27.542043+0000","last_active":"2024-09-12T18:04:27.542184+0000","last_peered":"2024-09-12T18:04:27.542184+0000","last_clean":"2024-09-12T18:04:27.542184+0000","last_became_active":"2024-09-12T18:01:54.707315+0000","last_became_peered":"2024-09-12T18:01:54.707315+0000","last_unstale":"2024-09-12T18:04:27.542184+0000","last_undegraded":"2024-09-12T18:04:27.542184+0000","last_fullsized":"2024-09-12T18:04:27.542184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'281","last_scrub_stamp":"2024-09-12T18:04:27.541835+0000","last_deep_scrub":"85'281","last_deep_scrub_stamp":"2024-09-12T18:04:27.541835+0000","last_clean_scrub_stamp":"2024-09-12T18:04:27.541835+0000","objects_scrubbed":4,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:03.870983+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":12397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"69'394","reported_seq":572,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:40.721888+0000","last_change":"2024-09-12T18:04:40.721888+0000","last_active":"2024-09-12T18:04:40.721888+0000","last_peered":"2024-09-12T18:04:40.721888+0000","last_clean":"2024-09-12T18:04:40.721888+0000","last_became_active":"2024-09-12T18:01:55.574902+0000","last_became_peered":"2024-09-12T18:01:55.574902+0000","last_unstale":"2024-09-12T18:04:40.721888+0000","last_undegraded":"2024-09-12T18:04:40.721888+0000","last_fullsized":"2024-09-12T18:04:40.721888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'394","last_scrub_stamp":"2024-09-12T18:04:40.721697+0000","last_deep_scrub":"69'394","last_deep_scrub_stamp":"2024-09-12T18:04:40.721697+0000","last_clean_scrub_stamp":"2024-09-12T18:04:40.721697+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:31.269856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15393,"num_write":360,"num_write_kb":21732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"85'56","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:32.934684+0000","last_change":"2024-09-12T18:04:32.934684+0000","last_active":"2024-09-12T18:04:32.934684+0000","last_peered":"2024-09-12T18:04:32.934684+0000","last_clean":"2024-09-12T18:04:32.934684+0000","last_became_active":"2024-09-12T18:03:48.355557+0000","last_became_peered":"2024-09-12T18:03:48.355557+0000","last_unstale":"2024-09-12T18:04:32.934684+0000","last_undegraded":"2024-09-12T18:04:32.934684+0000","last_fullsized":"2024-09-12T18:04:32.934684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'56","last_scrub_stamp":"2024-09-12T18:04:32.934451+0000","last_deep_scrub":"85'56","last_deep_scrub_stamp":"2024-09-12T18:04:32.934451+0000","last_clean_scrub_stamp":"2024-09-12T18:04:32.934451+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:08.971311+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"69'451","reported_seq":674,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:41.445138+0000","last_change":"2024-09-12T18:04:41.445138+0000","last_active":"2024-09-12T18:04:41.445138+0000","last_peered":"2024-09-12T18:04:41.445138+0000","last_clean":"2024-09-12T18:04:41.445138+0000","last_became_active":"2024-09-12T18:01:55.584421+0000","last_became_peered":"2024-09-12T18:01:55.584421+0000","last_unstale":"2024-09-12T18:04:41.445138+0000","last_undegraded":"2024-09-12T18:04:41.445138+0000","last_fullsized":"2024-09-12T18:04:41.445138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'451","last_scrub_stamp":"2024-09-12T18:04:41.444953+0000","last_deep_scrub":"69'451","last_deep_scrub_stamp":"2024-09-12T18:04:41.444953+0000","last_clean_scrub_stamp":"2024-09-12T18:04:41.444953+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:42.056087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32541,"num_write":418,"num_write_kb":59082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"85'119","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T18:04:34.965336+0000","last_change":"2024-09-12T18:04:34.965336+0000","last_active":"2024-09-12T18:04:34.965336+0000","last_peered":"2024-09-12T18:04:34.965336+0000","last_clean":"2024-09-12T18:04:34.965336+0000","last_became_active":"2024-09-12T18:03:51.370245+0000","last_became_peered":"2024-09-12T18:03:51.370245+0000","last_unstale":"2024-09-12T18:04:34.965336+0000","last_undegraded":"2024-09-12T18:04:34.965336+0000","last_fullsized":"2024-09-12T18:04:34.965336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'119","last_scrub_stamp":"2024-09-12T18:04:34.965164+0000","last_deep_scrub":"85'119","last_deep_scrub_stamp":"2024-09-12T18:04:34.965164+0000","last_clean_scrub_stamp":"2024-09-12T18:04:34.965164+0000","objects_scrubbed":3,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:26.530849+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":8389772,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2549,"num_read_kb":1270775,"num_write":24494,"num_write_kb":4033495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5258,"num_bytes_recovered":3595372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26589,"ondisk_log_size":26589,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127195260,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":57,"num_read_kb":1393,"num_write":4487,"num_write_kb":127485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":64625921,"num_keys_recovered":582,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":80863232,"data_stored":254390520,"data_compressed":38608927,"data_compressed_allocated":49422336,"data_compressed_original":223010816,"omap_allocated":0,"internal_metadata":0},"log_size":6300,"ondisk_log_size":6300,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":70504,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738412,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105064,"kb_used_data":23960,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94266776,"statfs":{"total":96636764160,"available":96529178624,"internally_reserved":0,"allocated":24535040,"data_stored":81408167,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738412,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113876,"kb_used_data":28612,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94257964,"statfs":{"total":96636764160,"available":96520155136,"internally_reserved":0,"allocated":29298688,"data_stored":84724657,"data_compressed":12340716,"data_compressed_allocated":16052224,"data_compressed_original":71921664,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118200,"kb_used_data":28776,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94253640,"statfs":{"total":96636764160,"available":96515727360,"internally_reserved":0,"allocated":29466624,"data_stored":90491785,"data_compressed":13696397,"data_compressed_allocated":17694720,"data_compressed_original":79171584,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":35252,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28631040,"data_stored":89550293,"data_compressed":13661145,"data_compressed_allocated":17649664,"data_compressed_original":78598144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28463104,"data_stored":83783165,"data_compressed":12305464,"data_compressed_allocated":16007168,"data_compressed_original":71348224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":81057062,"data_compressed":12642318,"data_compressed_allocated":15765504,"data_compressed_original":73064448,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:05:01.362 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T18:05:01.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T18:05:01.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:05:02.068 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:05:02.068 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:01:55.051940+0000","modified":"2024-09-12T18:01:58.061122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6803/2379477754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2379477754},{"type":"v1","addr":"172.21.15.52:6803","nonce":2379477754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-09-12T18:05:02.068 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-09-12T18:05:02.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T18:05:02.407 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:05:02.407 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"btime":"2024-09-12T18:01:58:683702+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T18:01:55.051940+0000","modified":"2024-09-12T18:01:58.061122+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.52:6803/2379477754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2379477754},{"type":"v1","addr":"172.21.15.52:6803","nonce":2379477754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4193,"qdb_cluster":[4193]},"id":1}]} 2024-09-12T18:05:02.408 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-09-12T18:05:02.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:05:02.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-12T18:05:02.736 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":85,"fsid":"da5a949a-216b-4267-953a-8d92e3d25b1d","created":"2024-09-12T18:01:33.537080+0000","modified":"2024-09-12T18:04:12.691343+0000","last_up_change":"2024-09-12T18:01:42.466111+0000","last_in_change":"2024-09-12T18:01:34.442067+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:01:42.598261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:01:48.792102+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T18:01:53.545540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T18:01:54.024396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f692452d-28b8-4aad-928e-fe1805e23b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6801","nonce":177809282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6803","nonce":177809282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6807","nonce":177809282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":177809282},{"type":"v1","addr":"172.21.15.111:6805","nonce":177809282}]},"public_addr":"172.21.15.111:6801/177809282","cluster_addr":"172.21.15.111:6803/177809282","heartbeat_back_addr":"172.21.15.111:6807/177809282","heartbeat_front_addr":"172.21.15.111:6805/177809282","state":["exists","up"]},{"osd":1,"uuid":"b5b3807e-e3b5-4530-adc6-af19dd31e340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6801","nonce":3534339867}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6803","nonce":3534339867}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6807","nonce":3534339867}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":3534339867},{"type":"v1","addr":"172.21.15.121:6805","nonce":3534339867}]},"public_addr":"172.21.15.121:6801/3534339867","cluster_addr":"172.21.15.121:6803/3534339867","heartbeat_back_addr":"172.21.15.121:6807/3534339867","heartbeat_front_addr":"172.21.15.121:6805/3534339867","state":["exists","up"]},{"osd":2,"uuid":"926e4870-279e-45c7-9d6c-5841397a5e6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6801","nonce":284634690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6803","nonce":284634690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6807","nonce":284634690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":284634690},{"type":"v1","addr":"172.21.15.153:6805","nonce":284634690}]},"public_addr":"172.21.15.153:6801/284634690","cluster_addr":"172.21.15.153:6803/284634690","heartbeat_back_addr":"172.21.15.153:6807/284634690","heartbeat_front_addr":"172.21.15.153:6805/284634690","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.382866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.379192+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:01:40.336708+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.2","osds":[0,1]},{"pgid":"4.22","osds":[0,2]},{"pgid":"4.31","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:05:02.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T18:05:03.088 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T18:05:03.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T18:05:03.138 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-09-12T18:05:04.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T18:05:05.099 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-12T18:05:05.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T18:05:06.094 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-12T18:05:06.121 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T18:05:06.121 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T18:05:06.122 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.133 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T18:05:06.134 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T18:05:06.134 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T18:05:06.134 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.215 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T18:05:06.215 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T18:05:06.216 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.290 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T18:05:06.291 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T18:05:06.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.358 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T18:05:06.358 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T18:05:06.358 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T18:05:06.359 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.389 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T18:05:06.389 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T18:05:06.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.458 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T18:05:06.458 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T18:05:06.458 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T18:05:06.459 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.519 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T18:05:06.519 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T18:05:06.520 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.577 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T18:05:06.577 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T18:05:06.578 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T18:05:06.634 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T18:05:06.635 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T18:05:06.635 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T18:05:06.697 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:05:06.697 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T18:05:07.013 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T18:05:07.013 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T18:05:07.186 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:05:07.187 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T18:05:07.346 INFO:tasks.ceph:Archiving mon data... 2024-09-12T18:05:07.347 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/data/mon.a.tgz 2024-09-12T18:05:07.347 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-12T18:05:07.353 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.k7Z292ttfA 2024-09-12T18:05:07.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.k7Z292ttfA 2024-09-12T18:05:07.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.k7Z292ttfA 2024-09-12T18:05:07.546 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.k7Z292ttfA is 337KB 2024-09-12T18:05:07.612 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.k7Z292ttfA 2024-09-12T18:05:07.618 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/data/mon.b.tgz 2024-09-12T18:05:07.618 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-12T18:05:07.667 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.jHADva0Ayr 2024-09-12T18:05:07.667 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jHADva0Ayr 2024-09-12T18:05:07.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.jHADva0Ayr 2024-09-12T18:05:07.895 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.jHADva0Ayr is 474KB 2024-09-12T18:05:07.957 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.jHADva0Ayr 2024-09-12T18:05:07.962 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/data/mon.c.tgz 2024-09-12T18:05:07.963 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-12T18:05:08.011 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.YnP3ir2Agv 2024-09-12T18:05:08.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YnP3ir2Agv 2024-09-12T18:05:08.172 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.YnP3ir2Agv 2024-09-12T18:05:08.235 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.YnP3ir2Agv is 473KB 2024-09-12T18:05:08.300 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.YnP3ir2Agv 2024-09-12T18:05:08.306 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T18:05:08.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:05:08.352 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:05:08.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:05:08.357 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T18:05:08.411 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:05:08.419 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:05:08.425 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:05:08.431 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T18:05:08.431 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T18:05:08.433 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi052/crash 2024-09-12T18:05:08.433 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:05:08.468 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi111/crash 2024-09-12T18:05:08.469 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:05:08.482 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi121/crash 2024-09-12T18:05:08.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:05:08.497 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi153/crash 2024-09-12T18:05:08.498 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T18:05:08.511 INFO:tasks.ceph:Compressing logs... 2024-09-12T18:05:08.511 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:05:08.516 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:05:08.528 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:05:08.533 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26270.log 2024-09-12T18:05:08.534 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25754.log 2024-09-12T18:05:08.534 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27717.log 2024-09-12T18:05:08.534 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26270.log.gz 2024-09-12T18:05:08.536 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28419.log 2024-09-12T18:05:08.536 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25754.log.gz 2024-09-12T18:05:08.536 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27399.log 2024-09-12T18:05:08.536 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27717.log.gz 2024-09-12T18:05:08.536 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26572.log 2024-09-12T18:05:08.536 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28419.log.gz 2024-09-12T18:05:08.536 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26831.log 2024-09-12T18:05:08.538 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27399.log.gz 2024-09-12T18:05:08.538 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26572.log.gz 2024-09-12T18:05:08.538 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28029.log 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24386.log 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26831.log.gz 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28029.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28029.log.gz 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22750.log 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24386.log.gz 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25552.log 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26074.log 2024-09-12T18:05:08.539 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22750.log.gz 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25552.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.25552.log.gz 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24639.log 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23849.log 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26074.log.gz 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27424.log 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24639.log.gz 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27246.log 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23849.log.gz 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:gzip/var/log/ceph/ceph-client.admin.27424.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28055.log 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27424.log.gz 2024-09-12T18:05:08.542 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27246.log.gz 2024-09-12T18:05:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23413.log 2024-09-12T18:05:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26235.log 2024-09-12T18:05:08.543 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28055.log.gz 2024-09-12T18:05:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27743.log 2024-09-12T18:05:08.543 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23413.log.gz 2024-09-12T18:05:08.543 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5/var/log/ceph/ceph-client.admin.26235.log: --verbose -- /var/log/ceph/ceph-client.admin.22512.log 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26235.log.gz 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27743.log.gz 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25609.log 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24437.log 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22512.log.gz 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26799.log 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25609.log.gz 2024-09-12T18:05:08.548 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24462.log 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24437.log.gz 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27374.log 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26799.log.gz 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28159.log 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24462.log.gz 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21833.log 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27374.log.gz 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26150.log 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28159.log.gz 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.21833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23295.log 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21833.log.gz 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22672.log 2024-09-12T18:05:08.549 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26150.log.gz 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23243.log 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23295.log.gz 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22249.log 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22672.log.gz 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24268.log 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23243.log.gz 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28081.log 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22249.log.gz 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22854.log 2024-09-12T18:05:08.550 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24268.log.gz 2024-09-12T18:05:08.551 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T18:05:08.556 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T18:05:08.562 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22397.log 2024-09-12T18:05:08.562 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28081.log.gz 2024-09-12T18:05:08.562 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22854.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.22854.log.gz -- 2024-09-12T18:05:08.562 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.24491.log 2024-09-12T18:05:08.562 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23957.log 2024-09-12T18:05:08.562 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22397.log.gz 2024-09-12T18:05:08.562 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26082.log 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24491.log.gz 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26900.log 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23957.log.gz 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23192.log 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26082.log.gz 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22224.log 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26900.log.gz 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23321.log 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.23192.log.gz 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22369.log 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22224.log.gz 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25962.log 2024-09-12T18:05:08.563 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23321.log.gz 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26296.log 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22369.log.gz 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28550.log 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25962.log.gz 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28341.log 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26296.log.gz 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28647.log 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28550.log.gz 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27613.log 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28341.log.gz 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22542.log 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28647.log.gz 2024-09-12T18:05:08.564 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23269.log 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27613.log.gz 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25438.log 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22542.log.gz 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23269.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23269.log.gz 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23688.log 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25438.log.gz 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28133.log 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26521.log 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23688.log.gz 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28133.log.gz 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25381.log 2024-09-12T18:05:08.565 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26521.log.gz 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26406.log 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25381.log.gz 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22297.log 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22620.log 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26406.log.gz 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25640.log 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22297.log.gz 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25526.log 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22620.log.gz 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25640.log.gz 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27769.log 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27556.log 2024-09-12T18:05:08.566 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25526.log.gz 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28367.log 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27769.log.gz 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25495.log 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27556.log.gz 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28367.log.gz 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23648.log 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25958.log 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25495.log.gz 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.23648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22698.log 2024-09-12T18:05:08.567 INFO:teuthology.orchestra.run.smithi052.stderr: 33.7% -- replaced with /var/log/ceph/ceph-client.0.23648.log.gz 2024-09-12T18:05:08.568 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25442.log 2024-09-12T18:05:08.568 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25958.log.gz 2024-09-12T18:05:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22698.log.gz 2024-09-12T18:05:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24742.log 2024-09-12T18:05:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.25442.log: -- /var/log/ceph/ceph-client.admin.25101.log 2024-09-12T18:05:08.585 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25442.log.gz 2024-09-12T18:05:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24013.log 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24742.log.gz 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26717.log 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25101.log.gz 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24013.log.gz 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26660.log 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24521.log 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26717.log.gz 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27054.log 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26660.log.gz 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27111.log 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24521.log.gz 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27054.log.gz 2024-09-12T18:05:08.586 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22861.log 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25838.log 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27111.log.gz 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27880.log 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22861.log.gz 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24608.log 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25838.log.gz 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24998.log 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27880.log.gz 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24351.log 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24608.log.gz 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27250.log 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24998.log.gz 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27504.log 2024-09-12T18:05:08.587 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24351.log.gz 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27250.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.27250.log.gz --verbose 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr: -- /var/log/ceph/ceph-client.admin.25053.log 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25127.log 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27504.log.gz 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25053.log.gz 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26322.log 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26603.log 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25127.log.gz 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26322.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.24578.log -- replaced with /var/log/ceph/ceph-client.admin.26322.log.gz 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25644.log 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26603.log.gz 2024-09-12T18:05:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26210.log 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24578.log.gz 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23389.log 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25644.log.gz 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25723.log 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26210.log.gz 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24154.log 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23389.log.gz 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25723.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.25723.log.gz 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23777.log 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24154.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.24154.log.gz -- 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.28289.log 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28621.log 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23777.log.gz 2024-09-12T18:05:08.589 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27639.log 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28289.log.gz 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26546.log 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28621.log.gz 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25346.log 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27639.log.gz 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26546.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.26546.log.gz 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22940.log 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28107.log 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25346.log.gz 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27587.log 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22940.log.gz 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28107.log.gz 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24716.log 2024-09-12T18:05:08.590 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23166.log 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27587.log.gz 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26153.log 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24716.log.gz 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23166.log.gz 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27080.log 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26685.log 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26153.log.gz 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27080.log.gz 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24825.log 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27800.log 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26685.log: /var/log/ceph/ceph-client.admin.24825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22343.log 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24825.log.gz 2024-09-12T18:05:08.591 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26685.log.gz 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24236.log 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27800.log.gz 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24635.log 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22343.log.gz 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23875.log 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24236.log.gz 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28393.log 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24635.log.gz 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26438.log 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23875.log.gz 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24770.log 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28393.log.gz 2024-09-12T18:05:08.592 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24801.log 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26438.log.gz 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27665.log 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24770.log.gz 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24801.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24801.log.gz 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28315.log 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27665.log.gz 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25077.log 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23010.log 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28315.log.gz 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25077.log.gz 2024-09-12T18:05:08.593 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26628.log 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27691.log 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23010.log.gz 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26628.log.gz 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27691.log.gz 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28443.log 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22646.log 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.28443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28443.log.gz 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28211.log 2024-09-12T18:05:08.613 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27189.log 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22646.log: /var/log/ceph/ceph-client.admin.28211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22646.log.gz 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28211.log.gz 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23899.log 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24972.log 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27189.log.gz 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23899.log.gz 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28498.log 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24941.log 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24972.log.gz 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28498.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.23351.log -- replaced with /var/log/ceph/ceph-client.admin.28498.log.gz 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr: 94.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23931.log 2024-09-12T18:05:08.614 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24941.log.gz 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22169.log 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23351.log.gz 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24858.log 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23931.log.gz 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24097.log 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22169.log.gz 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23619.log 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24858.log.gz 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26857.log 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24097.log.gz 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22936.log 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23619.log.gz 2024-09-12T18:05:08.615 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22783.log 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26857.log.gz 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24893.log 0.0% 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.22936.log.gz 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22783.log.gz 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27220.log 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27323.log 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24893.log.gz 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27220.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.27220.log.gz /var/log/ceph/ceph-client.admin.27530.log 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27323.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27323.log.gz 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27530.log.gz 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27297.log 2024-09-12T18:05:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22932.log 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27297.log.gz 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26743.log 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25406.log 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22932.log.gz 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26743.log.gz 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24319.log 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25406.log.gz 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24411.log 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26462.log 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24319.log.gz 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27881.log 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24411.log.gz 2024-09-12T18:05:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26462.log.gz 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22274.log 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22862.log 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27881.log.gz 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28576.log 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22274.log.gz 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22862.log.gz 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24294.log 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25182.log 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28576.log.gz 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24294.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.28185.log -- replaced with /var/log/ceph/ceph-client.admin.24294.log.gz 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25182.log.gz 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23812.log 2024-09-12T18:05:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28185.log.gz 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28472.log 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23812.log.gz 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24070.log 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23088.log 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28472.log.gz 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24070.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.24070.log.gz /var/log/ceph/ceph-mds.a.log 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23140.log 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23088.log.gz 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26495.log 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23140.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26381.log 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.23140.log.gz 2024-09-12T18:05:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21631.log 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26495.log: 0.0% 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26495.log.gz 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22026.log 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26381.log.gz 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.21631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25583.log 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21631.log.gz 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22026.log.gz 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27106.log 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27958.log 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25583.log: /var/log/ceph/ceph-client.admin.27106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25583.log.gz 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27106.log.gz 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23494.log 2024-09-12T18:05:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26997.log 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27958.log: /var/log/ceph/ceph-client.admin.23494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27958.log.gz 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25688.log 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.23494.log.gz 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23114.log 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26997.log.gz 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24692.log 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25688.log.gz 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23114.log.gz 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27450.log 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26347.log 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24692.log.gz 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27450.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.27450.log.gz 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27163.log 2024-09-12T18:05:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28524.log 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26347.log.gz 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26892.log 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27163.log.gz 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22781.log 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28524.log.gz 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26892.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.26892.log.gz -5 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr: --verbose -- /var/log/ceph/ceph-client.admin.22425.log 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22781.log.gz 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26901.log 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28237.log 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22425.log: /var/log/ceph/ceph-client.admin.26901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22425.log.gz 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26901.log.gz 2024-09-12T18:05:08.622 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24044.log 2024-09-12T18:05:08.623 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28263.log 2024-09-12T18:05:08.623 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28237.log.gz 2024-09-12T18:05:08.623 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24044.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.25029.log 2024-09-12T18:05:08.623 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24044.log.gz 2024-09-12T18:05:08.633 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.28263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22568.log 2024-09-12T18:05:08.633 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28263.log.gz 2024-09-12T18:05:08.633 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25029.log.gz 2024-09-12T18:05:08.633 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22460.log 2024-09-12T18:05:08.633 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23988.log 2024-09-12T18:05:08.633 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22568.log.gz 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22460.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.22460.log.gz 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23720.log 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25863.log 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23988.log.gz 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23720.log.gz 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22784.log 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25863.log.gz 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27802.log 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25292.log 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22784.log.gz 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24180.log 2024-09-12T18:05:08.634 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27802.log.gz 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25292.log.gz 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27959.log 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25158.log 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24180.log.gz 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23391.log 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27959.log.gz 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25158.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25158.log.gz 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24123.log 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23391.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.23391.log.gz -- 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.23390.log 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23036.log 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24123.log.gz 2024-09-12T18:05:08.635 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23390.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.22594.log -- replaced with /var/log/ceph/ceph-client.admin.23390.log.gz 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23036.log.gz 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22724.log 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25783.log 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22594.log.gz 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26893.log 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22724.log.gz 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27477.log 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25783.log: 0.0%/var/log/ceph/ceph-client.admin.26893.log: -- replaced with /var/log/ceph/ceph-client.admin.25783.log.gz 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27873.log 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26893.log.gz 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27477.log.gz 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22049.log 2024-09-12T18:05:08.636 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23062.log 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27873.log.gz 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24546.log 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22049.log.gz 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24887.log 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23062.log: 92.2% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23062.log.gz 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27028.log 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24546.log.gz 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22486.log 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24887.log.gz 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23724.log 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27028.log.gz 2024-09-12T18:05:08.637 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.22486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27951.log 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22486.log.gz 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.23724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25216.log 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23724.log.gz 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26774.log 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27951.log.gz 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.25216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27803.log 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25216.log.gz 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24211.log 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26774.log.gz 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.27803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27803.log.gz 2024-09-12T18:05:08.638 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.24211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24211.log.gz 2024-09-12T18:05:08.639 INFO:teuthology.orchestra.run.smithi052.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T18:05:08.651 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T18:05:08.701 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T18:05:08.701 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22932.log 2024-09-12T18:05:08.701 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22908.log 2024-09-12T18:05:08.702 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.22932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22932.log.gz 2024-09-12T18:05:08.702 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22956.log 2024-09-12T18:05:08.702 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.22908.log: /var/log/ceph/ceph-client.admin.22956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22908.log.gz 2024-09-12T18:05:08.703 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22956.log.gz 2024-09-12T18:05:08.714 INFO:teuthology.orchestra.run.smithi052.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T18:05:08.722 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T18:05:08.770 INFO:teuthology.orchestra.run.smithi052.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T18:05:08.772 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-12T18:05:08.772 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m0.254s 2024-09-12T18:05:08.772 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m0.686s 2024-09-12T18:05:08.772 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.092s 2024-09-12T18:05:12.005 INFO:teuthology.orchestra.run.smithi153.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T18:05:12.006 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-12T18:05:12.006 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m3.447s 2024-09-12T18:05:12.006 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m3.198s 2024-09-12T18:05:12.006 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.132s 2024-09-12T18:05:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.1.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T18:05:12.827 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-12T18:05:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m4.280s 2024-09-12T18:05:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m4.085s 2024-09-12T18:05:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.111s 2024-09-12T18:05:12.999 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.0.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T18:05:13.001 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T18:05:13.001 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m4.471s 2024-09-12T18:05:13.001 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m4.289s 2024-09-12T18:05:13.001 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m0.177s 2024-09-12T18:05:13.001 INFO:tasks.ceph:Archiving logs... 2024-09-12T18:05:13.001 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi052/log 2024-09-12T18:05:13.003 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:05:13.270 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi111/log 2024-09-12T18:05:13.271 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:05:13.892 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi121/log 2024-09-12T18:05:13.893 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:05:14.505 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi153/log 2024-09-12T18:05:14.506 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T18:05:14.946 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T18:05:14.955 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T18:05:14.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:05:14.958 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:05:14.961 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:05:14.963 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T18:05:15.087 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T18:05:15.096 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T18:05:15.096 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:05:15.099 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:05:15.101 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:05:15.103 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:05:15.110 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:05:15.110 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-09-12T18:05:15.110 INFO:teuthology.orchestra.run.smithi111.stdout:+hv01.front.sepi 67.205.162.81 3 u 38 64 77 0.142 -1.115 1.998 2024-09-12T18:05:15.111 INFO:teuthology.orchestra.run.smithi111.stdout:*hv02.front.sepi 63.231.80.2 3 u 39 64 77 0.102 -0.180 1.960 2024-09-12T18:05:15.111 INFO:teuthology.orchestra.run.smithi111.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 77 0.121 +1.141 1.962 2024-09-12T18:05:15.111 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:05:15.112 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:05:15.112 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2024-09-12T18:05:15.112 INFO:teuthology.orchestra.run.smithi052.stdout:*hv01.front.sepi 67.205.162.81 3 u 39 64 77 0.109 -1.071 0.512 2024-09-12T18:05:15.112 INFO:teuthology.orchestra.run.smithi052.stdout:+hv02.front.sepi 63.231.80.2 3 u 38 64 77 0.075 -0.808 0.850 2024-09-12T18:05:15.112 INFO:teuthology.orchestra.run.smithi052.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 77 0.060 +1.773 0.869 2024-09-12T18:05:15.113 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:05:15.114 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:05:15.114 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2024-09-12T18:05:15.114 INFO:teuthology.orchestra.run.smithi121.stdout:*hv01.front.sepi 67.205.162.81 3 u 42 64 77 0.121 -1.075 1.400 2024-09-12T18:05:15.114 INFO:teuthology.orchestra.run.smithi121.stdout:+hv02.front.sepi 63.231.80.2 3 u 33 64 77 0.102 -1.780 1.001 2024-09-12T18:05:15.114 INFO:teuthology.orchestra.run.smithi121.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 77 0.109 -0.611 1.088 2024-09-12T18:05:15.114 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:05:15.117 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:05:15.117 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-12T18:05:15.117 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 67.205.162.81 3 u 37 64 77 0.076 -1.568 0.644 2024-09-12T18:05:15.117 INFO:teuthology.orchestra.run.smithi153.stdout:+hv02.front.sepi 63.231.80.2 3 u 38 64 77 0.064 -1.144 0.460 2024-09-12T18:05:15.118 INFO:teuthology.orchestra.run.smithi153.stdout:*hv03.front.sepi 74.6.168.72 3 u 38 64 77 0.126 +0.680 0.682 2024-09-12T18:05:15.118 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:05:15.119 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T18:05:15.128 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T18:05:15.128 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T18:05:15.138 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T18:05:15.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T18:05:15.156 INFO:teuthology.task.internal:Duration was 832.258885 seconds 2024-09-12T18:05:15.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T18:05:15.164 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T18:05:15.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:05:15.167 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:05:15.170 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:05:15.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T18:05:15.210 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T18:05:15.210 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-12T18:05:15.210 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:05:15.255 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:05:15.256 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:05:15.265 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T18:05:15.265 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:05:15.276 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:05:15.276 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T18:05:15.286 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T18:05:15.286 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:05:15.303 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:05:15.308 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:05:15.320 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T18:05:15.356 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T18:05:15.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:05:15.376 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:05:15.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:05:15.392 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T18:05:15.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T18:05:15.470 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T18:05:15.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:05:15.483 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:05:15.496 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:05:15.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T18:05:15.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T18:05:15.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:05:15.532 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:05:15.540 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:05:15.541 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-12T18:05:15.549 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-09-12T18:05:15.552 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:05:15.560 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-09-12T18:05:15.572 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-12T18:05:15.671 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:05:15.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:05:15.676 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:05:15.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:05:15.681 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:05:15.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:05:15.686 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T18:05:15.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:05:15.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T18:05:15.729 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T18:05:15.729 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi052 2024-09-12T18:05:15.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:05:15.752 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi111 2024-09-12T18:05:15.753 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:05:15.774 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi121 2024-09-12T18:05:15.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:05:15.795 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/bhubbard-2024-09-11_02:37:30-powercycle-main-distro-default-smithi/7901157/remote/smithi153 2024-09-12T18:05:15.795 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T18:05:15.817 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T18:05:15.817 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:05:15.820 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:05:15.822 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:05:15.836 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T18:05:15.859 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T18:05:15.870 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T18:05:15.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T18:05:15.893 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T18:05:15.893 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:05:15.896 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:05:15.898 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:05:15.899 INFO:teuthology.orchestra.run.smithi052.stdout: 658467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:05 /home/ubuntu/cephtest 2024-09-12T18:05:15.900 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T18:05:15.902 INFO:teuthology.orchestra.run.smithi111.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:05 /home/ubuntu/cephtest 2024-09-12T18:05:15.904 INFO:teuthology.orchestra.run.smithi121.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:05 /home/ubuntu/cephtest 2024-09-12T18:05:15.907 INFO:teuthology.orchestra.run.smithi153.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 18:05 /home/ubuntu/cephtest 2024-09-12T18:05:15.908 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T18:05:15.918 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T18:05:15.940 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 832.2588846683502 flavor: default owner: scheduled_bhubbard@teuthology success: true 2024-09-12T18:05:15.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:05:16.020 INFO:teuthology.run:pass